2024-09-19T06:27:03.014 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T06:27:03.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T06:27:03.132 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911752 branch: squid description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911752' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 filestore flush min: 0 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - Replacing daemon mds - SLOW_OPS - slow request sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi086.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJOLYdo7NY0j36lLoI5mUSLaCW14mKu3rtF7vMJLuwDXn5yxA3UUOZWAe8W0Co66RzSVB3mfX37QKNiH4Cd7oNM= smithi169.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDvSN2nzKMsQVCPCxTDab3+ajujzwpUnZ3QE+nAucEfDfodhLym0wbLO+WMvJxdQKSkq00yIFJZ6yRiVlA2wI0E= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - mds_thrash: null - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T06:27:03.133 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T06:27:03.133 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T06:27:03.134 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T06:27:03.135 INFO:teuthology.task.internal:Checking packages... 2024-09-19T06:27:03.157 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T06:27:03.157 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T06:27:03.157 INFO:teuthology.packaging:ref: None 2024-09-19T06:27:03.157 INFO:teuthology.packaging:tag: None 2024-09-19T06:27:03.157 INFO:teuthology.packaging:branch: squid 2024-09-19T06:27:03.157 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:27:03.158 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T06:27:03.405 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T06:27:03.406 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T06:27:03.413 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T06:27:03.413 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T06:27:03.479 INFO:teuthology.task.internal:Saving configuration 2024-09-19T06:27:03.498 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T06:27:03.504 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T06:27:03.529 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911752', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 06:22:03.635413', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJOLYdo7NY0j36lLoI5mUSLaCW14mKu3rtF7vMJLuwDXn5yxA3UUOZWAe8W0Co66RzSVB3mfX37QKNiH4Cd7oNM='} 2024-09-19T06:27:03.549 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911752', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 06:22:03.636902', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDvSN2nzKMsQVCPCxTDab3+ajujzwpUnZ3QE+nAucEfDfodhLym0wbLO+WMvJxdQKSkq00yIFJZ6yRiVlA2wI0E='} 2024-09-19T06:27:03.549 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T06:27:03.556 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-09-19T06:27:03.556 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-09-19T06:27:03.556 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T06:27:03.632 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd81bca3be0>, signals=[15]) 2024-09-19T06:27:03.632 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T06:27:03.637 INFO:teuthology.task.internal:Opening connections... 2024-09-19T06:27:03.637 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi086.front.sepia.ceph.com 2024-09-19T06:27:03.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:27:03.716 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi169.front.sepia.ceph.com 2024-09-19T06:27:03.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:27:03.792 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T06:27:03.799 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2024-09-19T06:27:03.817 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2024-09-19T06:27:03.818 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-09-19T06:27:03.876 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream" 2024-09-19T06:27:03.876 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="9" 2024-09-19T06:27:03.876 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos" 2024-09-19T06:27:03.876 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora" 2024-09-19T06:27:03.876 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="9" 2024-09-19T06:27:03.876 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el9" 2024-09-19T06:27:03.877 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T06:27:03.877 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2024-09-19T06:27:03.877 INFO:teuthology.orchestra.run.smithi086.stdout:LOGO="fedora-logo-icon" 2024-09-19T06:27:03.877 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T06:27:03.877 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/" 2024-09-19T06:27:03.877 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T06:27:03.877 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T06:27:03.877 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T06:27:03.878 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-09-19T06:27:03.902 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2024-09-19T06:27:03.920 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2024-09-19T06:27:03.921 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-09-19T06:27:03.979 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2024-09-19T06:27:03.979 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9" 2024-09-19T06:27:03.980 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2024-09-19T06:27:03.980 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2024-09-19T06:27:03.980 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9" 2024-09-19T06:27:03.980 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9" 2024-09-19T06:27:03.980 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T06:27:03.980 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2024-09-19T06:27:03.980 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon" 2024-09-19T06:27:03.980 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T06:27:03.980 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2024-09-19T06:27:03.980 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T06:27:03.980 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T06:27:03.981 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T06:27:03.981 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-09-19T06:27:04.002 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T06:27:04.011 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T06:27:04.030 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T06:27:04.030 DEBUG:teuthology.orchestra.run.smithi086:> test '!' -e /home/ubuntu/cephtest 2024-09-19T06:27:04.033 DEBUG:teuthology.orchestra.run.smithi169:> test '!' -e /home/ubuntu/cephtest 2024-09-19T06:27:04.050 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T06:27:04.057 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T06:27:04.057 DEBUG:teuthology.orchestra.run.smithi086:> test -z $(ls -A /var/lib/ceph) 2024-09-19T06:27:04.091 DEBUG:teuthology.orchestra.run.smithi169:> test -z $(ls -A /var/lib/ceph) 2024-09-19T06:27:04.209 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T06:27:04.263 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T06:27:04.276 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-19T06:27:04.277 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-19T06:27:04.277 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-19T06:27:04.277 DEBUG:teuthology.orchestra.run.smithi086:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T06:27:04.294 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:27:04.295 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2024-09-19T06:27:04.353 INFO:teuthology.orchestra.run.smithi086.stdout:5.14.0-503.el9.x86_64 2024-09-19T06:27:04.353 INFO:teuthology.task.kernel:Running kernel on smithi086: 5.14.0-503.el9.x86_64 2024-09-19T06:27:04.353 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum install -y kernel 2024-09-19T06:27:06.664 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.3 MB 00:00 2024-09-19T06:27:08.299 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - AppStream 36 MB/s | 20 MB 00:00 2024-09-19T06:27:12.808 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - CRB 8.6 MB/s | 6.5 MB 00:00 2024-09-19T06:27:14.275 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 19 kB 00:00 2024-09-19T06:27:15.146 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-19T06:27:20.710 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-19T06:27:22.633 INFO:teuthology.orchestra.run.smithi086.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T06:27:22.633 INFO:teuthology.orchestra.run.smithi086.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T06:27:22.732 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-19T06:27:22.743 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-19T06:27:22.744 INFO:teuthology.orchestra.run.smithi086.stdout: Package Architecture Version Repository Size 2024-09-19T06:27:22.744 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-19T06:27:22.744 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-09-19T06:27:22.744 INFO:teuthology.orchestra.run.smithi086.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T06:27:22.744 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2024-09-19T06:27:22.744 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T06:27:22.744 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T06:27:22.744 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T06:27:22.744 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:27:22.744 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-09-19T06:27:22.744 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-19T06:27:22.744 INFO:teuthology.orchestra.run.smithi086.stdout:Install 4 Packages 2024-09-19T06:27:22.745 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:27:22.745 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 79 M 2024-09-19T06:27:22.745 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 126 M 2024-09-19T06:27:22.745 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-09-19T06:27:22.870 INFO:teuthology.orchestra.run.smithi086.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 348 kB/s | 36 kB 00:00 2024-09-19T06:27:24.720 INFO:teuthology.orchestra.run.smithi086.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 8.0 MB/s | 16 MB 00:01 2024-09-19T06:27:25.953 INFO:teuthology.orchestra.run.smithi086.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 9.3 MB/s | 29 MB 00:03 2024-09-19T06:27:26.537 INFO:teuthology.orchestra.run.smithi086.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 9.2 MB/s | 35 MB 00:03 2024-09-19T06:27:26.537 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:27:26.537 INFO:teuthology.orchestra.run.smithi086.stdout:Total 21 MB/s | 79 MB 00:03 2024-09-19T06:27:27.222 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-09-19T06:27:27.562 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-09-19T06:27:27.562 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-09-19T06:27:28.534 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-09-19T06:27:28.534 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-09-19T06:27:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-09-19T06:27:31.629 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T06:27:31.720 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:27:34.473 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:27:34.605 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:27:39.403 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:27:39.449 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:27:44.272 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:28:22.349 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:28:22.391 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:28:22.739 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:28:22.739 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T06:28:22.739 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:28:22.739 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:28:23.612 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:28:23.612 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:28:23.612 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-09-19T06:28:23.612 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T06:28:23.612 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T06:28:23.613 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T06:28:23.613 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T06:28:23.613 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:28:23.613 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-19T06:28:23.976 DEBUG:teuthology.orchestra.run.smithi086:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T06:28:24.068 INFO:teuthology.orchestra.run.smithi086.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T06:28:24.069 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T06:28:24.069 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T06:28:24.069 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T06:28:24.069 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T06:28:24.069 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-19T06:28:24.069 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi086.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T06:28:24.069 DEBUG:teuthology.orchestra.run.smithi086:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T06:28:24.128 INFO:teuthology.orchestra.run.smithi086.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T06:28:24.129 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T06:28:24.129 DEBUG:teuthology.orchestra.run.smithi086:> sudo rpm -qi grub2-tools 2024-09-19T06:28:24.170 INFO:teuthology.orchestra.run.smithi086.stdout:Name : grub2-tools 2024-09-19T06:28:24.170 INFO:teuthology.orchestra.run.smithi086.stdout:Epoch : 1 2024-09-19T06:28:24.170 INFO:teuthology.orchestra.run.smithi086.stdout:Version : 2.06 2024-09-19T06:28:24.170 INFO:teuthology.orchestra.run.smithi086.stdout:Release : 82.el9 2024-09-19T06:28:24.170 INFO:teuthology.orchestra.run.smithi086.stdout:Architecture: x86_64 2024-09-19T06:28:24.170 INFO:teuthology.orchestra.run.smithi086.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T06:28:24.171 INFO:teuthology.orchestra.run.smithi086.stdout:Group : Unspecified 2024-09-19T06:28:24.171 INFO:teuthology.orchestra.run.smithi086.stdout:Size : 8274670 2024-09-19T06:28:24.171 INFO:teuthology.orchestra.run.smithi086.stdout:License : GPLv3+ 2024-09-19T06:28:24.171 INFO:teuthology.orchestra.run.smithi086.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T06:28:24.171 INFO:teuthology.orchestra.run.smithi086.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T06:28:24.171 INFO:teuthology.orchestra.run.smithi086.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T06:28:24.171 INFO:teuthology.orchestra.run.smithi086.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T06:28:24.171 INFO:teuthology.orchestra.run.smithi086.stdout:Packager : builder@centos.org 2024-09-19T06:28:24.171 INFO:teuthology.orchestra.run.smithi086.stdout:Vendor : CentOS 2024-09-19T06:28:24.171 INFO:teuthology.orchestra.run.smithi086.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T06:28:24.171 INFO:teuthology.orchestra.run.smithi086.stdout:Summary : Support tools for GRUB. 2024-09-19T06:28:24.171 INFO:teuthology.orchestra.run.smithi086.stdout:Description : 2024-09-19T06:28:24.171 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:28:24.171 INFO:teuthology.orchestra.run.smithi086.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T06:28:24.172 INFO:teuthology.orchestra.run.smithi086.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T06:28:24.172 INFO:teuthology.orchestra.run.smithi086.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T06:28:24.172 INFO:teuthology.orchestra.run.smithi086.stdout:hardware devices. 2024-09-19T06:28:24.172 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:28:24.172 INFO:teuthology.orchestra.run.smithi086.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T06:28:24.173 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T06:28:24.173 INFO:teuthology.task.kernel:Updating grub on smithi086 to boot 5.14.0-508.el9.x86_64 2024-09-19T06:28:24.173 DEBUG:teuthology.orchestra.run.smithi086:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T06:28:24.815 INFO:teuthology.orchestra.run.smithi086.stderr:Generating grub configuration file ... 2024-09-19T06:28:26.133 INFO:teuthology.orchestra.run.smithi086.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T06:28:26.165 INFO:teuthology.orchestra.run.smithi086.stderr:done 2024-09-19T06:28:26.177 DEBUG:teuthology.orchestra.run.smithi086:> mktemp 2024-09-19T06:28:26.193 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.i3NqJfzGzS 2024-09-19T06:28:26.193 DEBUG:teuthology.orchestra.run.smithi086:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.i3NqJfzGzS 2024-09-19T06:28:26.261 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.i3NqJfzGzS 2024-09-19T06:28:26.401 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.i3NqJfzGzS is 6KB 2024-09-19T06:28:26.449 DEBUG:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.i3NqJfzGzS 2024-09-19T06:28:26.464 DEBUG:teuthology.orchestra.run.smithi086:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T06:28:26.526 INFO:teuthology.orchestra.run.smithi086.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T06:28:26.526 INFO:teuthology.orchestra.run.smithi086.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T06:28:26.526 INFO:teuthology.orchestra.run.smithi086.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T06:28:26.527 INFO:teuthology.orchestra.run.smithi086.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T06:28:26.528 DEBUG:teuthology.orchestra.run.smithi086:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T06:28:26.675 DEBUG:teuthology.orchestra.run.smithi086:> sudo shutdown -r now 2024-09-19T06:28:56.678 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-19T06:28:56.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-19T06:28:56.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:29:15.197 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-09-19T06:29:24.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-19T06:29:24.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:29:27.261 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-09-19T06:29:39.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-19T06:29:39.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:29:57.693 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-09-19T06:30:12.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-19T06:30:12.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:30:13.066 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-09-19T06:30:13.470 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-19T06:30:13.470 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-19T06:30:13.470 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2024-09-19T06:30:13.485 INFO:teuthology.orchestra.run.smithi086.stdout:5.14.0-508.el9.x86_64 2024-09-19T06:30:13.485 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T06:30:13.485 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T06:30:13.485 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T06:30:14.486 DEBUG:teuthology.parallel:result is None 2024-09-19T06:30:14.487 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T06:30:14.497 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T06:30:14.497 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T06:30:14.500 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T06:30:14.519 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T06:30:14.536 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T06:30:14.568 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T06:30:14.568 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T06:30:14.571 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T06:30:14.608 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T06:30:14.615 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T06:30:14.615 DEBUG:teuthology.orchestra.run.smithi169:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T06:30:14.658 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:30:14.659 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T06:30:14.661 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T06:30:14.750 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:30:14.760 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:30:14.767 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:30:14.787 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:30:14.788 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T06:30:14.795 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T06:30:14.795 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T06:30:14.798 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T06:30:14.825 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T06:30:14.835 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T06:30:14.835 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T06:30:14.862 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T06:30:14.881 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:30:14.964 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:30:15.006 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:30:15.088 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:30:15.127 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:30:15.127 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T06:30:15.191 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:30:15.236 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:30:15.284 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:30:15.373 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:30:15.410 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T06:30:15.410 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T06:30:15.476 DEBUG:teuthology.orchestra.run.smithi086:> sudo service rsyslog restart 2024-09-19T06:30:15.479 DEBUG:teuthology.orchestra.run.smithi169:> sudo service rsyslog restart 2024-09-19T06:30:15.530 INFO:teuthology.orchestra.run.smithi086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:30:15.555 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:30:16.010 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T06:30:16.017 INFO:teuthology.task.internal:Starting timer... 2024-09-19T06:30:16.017 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T06:30:16.064 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T06:30:16.095 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-19T06:30:16.095 DEBUG:teuthology.orchestra.run.smithi086:> sudo service auditd rotate 2024-09-19T06:30:16.169 INFO:teuthology.orchestra.run.smithi086.stdout:Rotating logs: 2024-09-19T06:30:16.170 DEBUG:teuthology.orchestra.run.smithi169:> sudo service auditd rotate 2024-09-19T06:30:16.235 INFO:teuthology.orchestra.run.smithi169.stdout:Rotating logs: 2024-09-19T06:30:16.237 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T06:30:16.237 DEBUG:teuthology.orchestra.run.smithi086:> /usr/sbin/getenforce 2024-09-19T06:30:16.269 INFO:teuthology.orchestra.run.smithi086.stdout:Permissive 2024-09-19T06:30:16.269 DEBUG:teuthology.orchestra.run.smithi169:> /usr/sbin/getenforce 2024-09-19T06:30:16.294 INFO:teuthology.orchestra.run.smithi169.stdout:Permissive 2024-09-19T06:30:16.294 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi086.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi169.front.sepia.ceph.com': 'permissive'} 2024-09-19T06:30:16.294 DEBUG:teuthology.orchestra.run.smithi086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:30:16.334 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:30:16.335 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:30:16.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:30:16.362 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T06:30:16.362 DEBUG:teuthology.orchestra.run.smithi086:> sudo /usr/sbin/setenforce permissive 2024-09-19T06:30:16.507 DEBUG:teuthology.orchestra.run.smithi169:> sudo /usr/sbin/setenforce permissive 2024-09-19T06:30:16.542 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T06:30:16.552 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T06:30:16.567 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T06:30:16.568 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi086.front.sepia.ceph.com,smithi169.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T06:34:15.440 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi086.front.sepia.ceph.com'), Remote(name='ubuntu@smithi169.front.sepia.ceph.com')] 2024-09-19T06:34:15.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-19T06:34:15.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:34:15.520 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-09-19T06:34:15.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-19T06:34:15.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-19T06:34:15.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:34:15.684 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-09-19T06:34:15.769 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-19T06:34:15.769 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T06:34:15.780 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T06:34:15.780 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T06:34:15.781 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:34:15.784 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T06:34:15.784 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:34:15.812 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T06:34:15.827 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T06:34:15.839 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T06:34:15.852 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: ntpd: command not found 2024-09-19T06:34:15.854 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T06:34:15.863 INFO:teuthology.orchestra.run.smithi086.stdout:506 Cannot talk to daemon 2024-09-19T06:34:15.877 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T06:34:15.878 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: ntpd: command not found 2024-09-19T06:34:15.890 INFO:teuthology.orchestra.run.smithi169.stdout:506 Cannot talk to daemon 2024-09-19T06:34:15.891 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T06:34:15.904 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T06:34:15.918 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T06:34:15.949 INFO:teuthology.orchestra.run.smithi086.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:34:15.952 INFO:teuthology.orchestra.run.smithi086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:34:15.952 INFO:teuthology.orchestra.run.smithi086.stdout:=============================================================================== 2024-09-19T06:34:15.952 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:34:15.953 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:34:15.953 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:34:15.953 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:34:15.981 INFO:teuthology.orchestra.run.smithi169.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:34:15.985 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:34:15.985 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2024-09-19T06:34:15.985 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:34:15.985 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:34:15.985 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:34:15.985 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:34:15.986 INFO:teuthology.run_tasks:Running task install... 2024-09-19T06:34:15.993 DEBUG:teuthology.task.install:project ceph 2024-09-19T06:34:15.994 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T06:34:15.994 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T06:34:15.994 INFO:teuthology.task.install:Using flavor: default 2024-09-19T06:34:16.000 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T06:34:16.001 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T06:34:16.001 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T06:34:16.002 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:34:16.004 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T06:34:16.004 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:34:16.150 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T06:34:16.150 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T06:34:16.154 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T06:34:16.154 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T06:34:16.262 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T06:34:16.262 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T06:34:16.262 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T06:34:16.270 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T06:34:16.270 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:34:16.271 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T06:34:16.288 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T06:34:16.289 DEBUG:teuthology.orchestra.run.smithi169:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T06:34:16.297 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T06:34:16.297 DEBUG:teuthology.orchestra.run.smithi086:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T06:34:16.355 DEBUG:teuthology.orchestra.run.smithi169:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T06:34:16.362 DEBUG:teuthology.orchestra.run.smithi086:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T06:34:16.430 DEBUG:teuthology.orchestra.run.smithi169:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T06:34:16.437 DEBUG:teuthology.orchestra.run.smithi086:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T06:34:16.494 INFO:teuthology.orchestra.run.smithi169.stdout:check_obsoletes = 1 2024-09-19T06:34:16.496 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum clean all 2024-09-19T06:34:16.501 INFO:teuthology.orchestra.run.smithi086.stdout:check_obsoletes = 1 2024-09-19T06:34:16.503 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum clean all 2024-09-19T06:34:16.724 INFO:teuthology.orchestra.run.smithi169.stdout:45 files removed 2024-09-19T06:34:16.729 INFO:teuthology.orchestra.run.smithi086.stdout:45 files removed 2024-09-19T06:34:16.752 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T06:34:16.755 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T06:34:17.292 INFO:teuthology.orchestra.run.smithi169.stdout:ceph packages for x86_64 323 kB/s | 84 kB 00:00 2024-09-19T06:34:17.313 INFO:teuthology.orchestra.run.smithi086.stdout:ceph packages for x86_64 305 kB/s | 84 kB 00:00 2024-09-19T06:34:17.576 INFO:teuthology.orchestra.run.smithi169.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-19T06:34:17.597 INFO:teuthology.orchestra.run.smithi086.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-19T06:34:17.835 INFO:teuthology.orchestra.run.smithi169.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-09-19T06:34:17.873 INFO:teuthology.orchestra.run.smithi086.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T06:34:18.531 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.3 MB 00:00 2024-09-19T06:34:21.827 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - AppStream 9.2 MB/s | 20 MB 00:02 2024-09-19T06:34:27.509 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-19T06:34:28.634 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - BaseOS 785 kB/s | 8.3 MB 00:10 2024-09-19T06:34:29.201 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-19T06:34:30.107 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-19T06:34:30.310 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-09-19T06:34:35.689 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-19T06:34:37.873 INFO:teuthology.orchestra.run.smithi086.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:34:37.874 INFO:teuthology.orchestra.run.smithi086.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:34:37.885 INFO:teuthology.orchestra.run.smithi086.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T06:34:37.886 INFO:teuthology.orchestra.run.smithi086.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T06:34:37.887 INFO:teuthology.orchestra.run.smithi086.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T06:34:37.888 INFO:teuthology.orchestra.run.smithi086.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T06:34:37.889 INFO:teuthology.orchestra.run.smithi086.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T06:34:37.892 INFO:teuthology.orchestra.run.smithi086.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T06:34:37.892 INFO:teuthology.orchestra.run.smithi086.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T06:34:37.954 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-19T06:34:37.982 INFO:teuthology.orchestra.run.smithi086.stdout:====================================================================================== 2024-09-19T06:34:37.982 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2024-09-19T06:34:37.982 INFO:teuthology.orchestra.run.smithi086.stdout:====================================================================================== 2024-09-19T06:34:37.982 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-09-19T06:34:37.982 INFO:teuthology.orchestra.run.smithi086.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T06:34:37.982 INFO:teuthology.orchestra.run.smithi086.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T06:34:37.982 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T06:34:37.982 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T06:34:37.982 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T06:34:37.983 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T06:34:37.983 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T06:34:37.983 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T06:34:37.983 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T06:34:37.983 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T06:34:37.983 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T06:34:37.983 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T06:34:37.983 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T06:34:37.983 INFO:teuthology.orchestra.run.smithi086.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T06:34:37.983 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T06:34:37.983 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T06:34:37.983 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T06:34:37.984 INFO:teuthology.orchestra.run.smithi086.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T06:34:37.984 INFO:teuthology.orchestra.run.smithi086.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T06:34:37.984 INFO:teuthology.orchestra.run.smithi086.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T06:34:37.984 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T06:34:37.984 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T06:34:37.984 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T06:34:37.984 INFO:teuthology.orchestra.run.smithi086.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T06:34:37.984 INFO:teuthology.orchestra.run.smithi086.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T06:34:37.984 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T06:34:37.984 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T06:34:37.984 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T06:34:37.984 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T06:34:37.985 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T06:34:37.985 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T06:34:37.985 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T06:34:37.985 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T06:34:37.985 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T06:34:37.985 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T06:34:37.985 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T06:34:37.985 INFO:teuthology.orchestra.run.smithi086.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T06:34:37.985 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrading: 2024-09-19T06:34:37.985 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T06:34:37.985 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T06:34:37.985 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T06:34:37.985 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T06:34:37.986 INFO:teuthology.orchestra.run.smithi086.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T06:34:37.986 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T06:34:37.986 INFO:teuthology.orchestra.run.smithi086.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T06:34:37.986 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T06:34:37.986 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2024-09-19T06:34:37.986 INFO:teuthology.orchestra.run.smithi086.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T06:34:37.986 INFO:teuthology.orchestra.run.smithi086.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T06:34:37.986 INFO:teuthology.orchestra.run.smithi086.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T06:34:37.986 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T06:34:37.986 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T06:34:37.986 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T06:34:37.986 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T06:34:37.986 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T06:34:37.987 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T06:34:37.987 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T06:34:37.987 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T06:34:37.987 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T06:34:37.987 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T06:34:37.987 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T06:34:37.987 INFO:teuthology.orchestra.run.smithi086.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T06:34:37.987 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T06:34:37.987 INFO:teuthology.orchestra.run.smithi086.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T06:34:37.987 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T06:34:37.987 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T06:34:37.987 INFO:teuthology.orchestra.run.smithi086.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T06:34:37.987 INFO:teuthology.orchestra.run.smithi086.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T06:34:37.988 INFO:teuthology.orchestra.run.smithi086.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T06:34:37.988 INFO:teuthology.orchestra.run.smithi086.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T06:34:37.988 INFO:teuthology.orchestra.run.smithi086.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T06:34:37.988 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T06:34:37.988 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T06:34:37.988 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T06:34:37.988 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T06:34:37.988 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T06:34:37.988 INFO:teuthology.orchestra.run.smithi086.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T06:34:37.988 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T06:34:37.988 INFO:teuthology.orchestra.run.smithi086.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T06:34:37.988 INFO:teuthology.orchestra.run.smithi086.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T06:34:37.989 INFO:teuthology.orchestra.run.smithi086.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T06:34:37.989 INFO:teuthology.orchestra.run.smithi086.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T06:34:37.989 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T06:34:37.989 INFO:teuthology.orchestra.run.smithi086.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T06:34:37.989 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T06:34:37.989 INFO:teuthology.orchestra.run.smithi086.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T06:34:37.989 INFO:teuthology.orchestra.run.smithi086.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T06:34:37.989 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T06:34:37.989 INFO:teuthology.orchestra.run.smithi086.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T06:34:37.989 INFO:teuthology.orchestra.run.smithi086.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T06:34:37.989 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T06:34:37.989 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T06:34:37.989 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T06:34:37.990 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T06:34:37.990 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T06:34:37.990 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T06:34:37.990 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T06:34:37.990 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T06:34:37.990 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T06:34:37.990 INFO:teuthology.orchestra.run.smithi086.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T06:34:37.990 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T06:34:37.990 INFO:teuthology.orchestra.run.smithi086.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T06:34:37.990 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T06:34:37.990 INFO:teuthology.orchestra.run.smithi086.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T06:34:37.990 INFO:teuthology.orchestra.run.smithi086.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T06:34:37.990 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T06:34:37.991 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T06:34:37.991 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T06:34:37.991 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T06:34:37.991 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T06:34:37.991 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T06:34:37.991 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T06:34:37.991 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T06:34:37.991 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T06:34:37.991 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T06:34:37.991 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T06:34:37.991 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T06:34:37.991 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T06:34:37.991 INFO:teuthology.orchestra.run.smithi086.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T06:34:37.992 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T06:34:37.992 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T06:34:37.992 INFO:teuthology.orchestra.run.smithi086.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T06:34:37.992 INFO:teuthology.orchestra.run.smithi086.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T06:34:37.992 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T06:34:37.992 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T06:34:37.992 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T06:34:37.992 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T06:34:37.992 INFO:teuthology.orchestra.run.smithi086.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T06:34:37.992 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T06:34:37.992 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T06:34:37.992 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T06:34:37.993 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T06:34:37.993 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T06:34:37.993 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T06:34:37.993 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T06:34:37.993 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T06:34:37.993 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T06:34:37.993 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T06:34:37.993 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T06:34:37.993 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T06:34:37.993 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T06:34:37.993 INFO:teuthology.orchestra.run.smithi086.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T06:34:37.993 INFO:teuthology.orchestra.run.smithi086.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T06:34:37.993 INFO:teuthology.orchestra.run.smithi086.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T06:34:37.994 INFO:teuthology.orchestra.run.smithi086.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T06:34:37.994 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T06:34:37.994 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T06:34:37.994 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T06:34:37.994 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T06:34:37.994 INFO:teuthology.orchestra.run.smithi086.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T06:34:37.994 INFO:teuthology.orchestra.run.smithi086.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T06:34:37.994 INFO:teuthology.orchestra.run.smithi086.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T06:34:37.994 INFO:teuthology.orchestra.run.smithi086.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T06:34:37.994 INFO:teuthology.orchestra.run.smithi086.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T06:34:37.994 INFO:teuthology.orchestra.run.smithi086.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T06:34:37.994 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T06:34:37.994 INFO:teuthology.orchestra.run.smithi086.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T06:34:37.995 INFO:teuthology.orchestra.run.smithi086.stdout:Installing weak dependencies: 2024-09-19T06:34:37.995 INFO:teuthology.orchestra.run.smithi086.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T06:34:37.995 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:34:37.995 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-09-19T06:34:37.995 INFO:teuthology.orchestra.run.smithi086.stdout:====================================================================================== 2024-09-19T06:34:37.995 INFO:teuthology.orchestra.run.smithi086.stdout:Install 148 Packages 2024-09-19T06:34:37.995 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrade 8 Packages 2024-09-19T06:34:37.995 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:34:37.996 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 226 M 2024-09-19T06:34:37.996 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-09-19T06:34:38.060 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - CRB 1.6 MB/s | 6.5 MB 00:03 2024-09-19T06:34:38.948 INFO:teuthology.orchestra.run.smithi086.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 55 kB/s | 6.6 kB 00:00 2024-09-19T06:34:39.115 INFO:teuthology.orchestra.run.smithi086.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 5.2 MB/s | 896 kB 00:00 2024-09-19T06:34:39.199 INFO:teuthology.orchestra.run.smithi086.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.7 MB/s | 145 kB 00:00 2024-09-19T06:34:39.274 INFO:teuthology.orchestra.run.smithi086.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-19T06:34:39.374 INFO:teuthology.orchestra.run.smithi086.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 15 MB/s | 1.5 MB 00:00 2024-09-19T06:34:39.433 INFO:teuthology.orchestra.run.smithi086.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 10 MB/s | 2.4 MB 00:00 2024-09-19T06:34:39.608 INFO:teuthology.orchestra.run.smithi086.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 20 MB/s | 4.7 MB 00:00 2024-09-19T06:34:39.769 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 19 kB 00:00 2024-09-19T06:34:40.067 INFO:teuthology.orchestra.run.smithi086.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 17 MB/s | 21 MB 00:01 2024-09-19T06:34:40.117 INFO:teuthology.orchestra.run.smithi086.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 506 kB/s | 25 kB 00:00 2024-09-19T06:34:40.301 INFO:teuthology.orchestra.run.smithi086.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 15 MB/s | 11 MB 00:00 2024-09-19T06:34:40.359 INFO:teuthology.orchestra.run.smithi086.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.8 MB/s | 228 kB 00:00 2024-09-19T06:34:40.426 INFO:teuthology.orchestra.run.smithi086.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 407 kB/s | 27 kB 00:00 2024-09-19T06:34:40.601 INFO:teuthology.orchestra.run.smithi086.stdout:(13/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 14 MB/s | 17 MB 00:01 2024-09-19T06:34:40.627 INFO:teuthology.orchestra.run.smithi086.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 158 kB/s | 32 kB 00:00 2024-09-19T06:34:40.660 INFO:teuthology.orchestra.run.smithi086.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 13 MB/s | 751 kB 00:00 2024-09-19T06:34:40.685 INFO:teuthology.orchestra.run.smithi086.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.7 MB/s | 163 kB 00:00 2024-09-19T06:34:40.711 INFO:teuthology.orchestra.run.smithi086.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T06:34:40.795 INFO:teuthology.orchestra.run.smithi086.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 4.5 MB/s | 506 kB 00:00 2024-09-19T06:34:40.798 INFO:teuthology.orchestra.run.smithi169.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-19T06:34:40.861 INFO:teuthology.orchestra.run.smithi086.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 718 kB/s | 45 kB 00:00 2024-09-19T06:34:40.929 INFO:teuthology.orchestra.run.smithi086.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.0 MB/s | 136 kB 00:00 2024-09-19T06:34:41.045 INFO:teuthology.orchestra.run.smithi086.stdout:(21/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 16 MB/s | 5.3 MB 00:00 2024-09-19T06:34:41.071 INFO:teuthology.orchestra.run.smithi086.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.1 MB/s | 161 kB 00:00 2024-09-19T06:34:41.096 INFO:teuthology.orchestra.run.smithi086.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 6.2 MB/s | 320 kB 00:00 2024-09-19T06:34:41.121 INFO:teuthology.orchestra.run.smithi086.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.9 MB/s | 300 kB 00:00 2024-09-19T06:34:41.147 INFO:teuthology.orchestra.run.smithi086.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T06:34:41.172 INFO:teuthology.orchestra.run.smithi086.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T06:34:41.231 INFO:teuthology.orchestra.run.smithi086.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-19T06:34:41.331 INFO:teuthology.orchestra.run.smithi086.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 17 MB/s | 3.1 MB 00:00 2024-09-19T06:34:41.356 INFO:teuthology.orchestra.run.smithi086.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 255 kB/s | 32 kB 00:00 2024-09-19T06:34:41.381 INFO:teuthology.orchestra.run.smithi086.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.9 MB/s | 146 kB 00:00 2024-09-19T06:34:41.615 INFO:teuthology.orchestra.run.smithi086.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 14 MB/s | 3.6 MB 00:00 2024-09-19T06:34:41.698 INFO:teuthology.orchestra.run.smithi086.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.9 MB/s | 249 kB 00:00 2024-09-19T06:34:41.765 INFO:teuthology.orchestra.run.smithi086.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 743 kB/s | 49 kB 00:00 2024-09-19T06:34:41.841 INFO:teuthology.orchestra.run.smithi086.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 219 kB/s | 16 kB 00:00 2024-09-19T06:34:41.933 INFO:teuthology.orchestra.run.smithi086.stdout:(35/156): ceph-mgr-diskprediction-local-19.1.1- 13 MB/s | 7.4 MB 00:00 2024-09-19T06:34:41.958 INFO:teuthology.orchestra.run.smithi086.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 2.4 MB/s | 285 kB 00:00 2024-09-19T06:34:41.992 INFO:teuthology.orchestra.run.smithi086.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 13 MB/s | 765 kB 00:00 2024-09-19T06:34:42.017 INFO:teuthology.orchestra.run.smithi086.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 311 kB/s | 18 kB 00:00 2024-09-19T06:34:42.442 INFO:teuthology.orchestra.run.smithi086.stdout:(39/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 21 MB/s | 49 MB 00:02 2024-09-19T06:34:43.009 INFO:teuthology.orchestra.run.smithi086.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 78 kB/s | 80 kB 00:01 2024-09-19T06:34:43.168 INFO:teuthology.orchestra.run.smithi086.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 264 kB/s | 191 kB 00:00 2024-09-19T06:34:43.268 INFO:teuthology.orchestra.run.smithi086.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 641 kB/s | 801 kB 00:01 2024-09-19T06:34:43.818 INFO:teuthology.orchestra.run.smithi086.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 313 kB/s | 253 kB 00:00 2024-09-19T06:34:43.943 INFO:teuthology.orchestra.run.smithi086.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 160 kB/s | 106 kB 00:00 2024-09-19T06:34:44.235 INFO:teuthology.orchestra.run.smithi086.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 1.1 MB/s | 1.2 MB 00:01 2024-09-19T06:34:44.519 INFO:teuthology.orchestra.run.smithi086.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 193 kB/s | 135 kB 00:00 2024-09-19T06:34:44.627 INFO:teuthology.orchestra.run.smithi086.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 183 kB/s | 125 kB 00:00 2024-09-19T06:34:44.786 INFO:teuthology.orchestra.run.smithi086.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2024-09-19T06:34:44.836 INFO:teuthology.orchestra.run.smithi086.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-19T06:34:44.870 INFO:teuthology.orchestra.run.smithi086.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 3.8 MB/s | 943 kB 00:00 2024-09-19T06:34:44.903 INFO:teuthology.orchestra.run.smithi086.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 323 kB/s | 22 kB 00:00 2024-09-19T06:34:44.954 INFO:teuthology.orchestra.run.smithi086.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 653 kB/s | 33 kB 00:00 2024-09-19T06:34:45.012 INFO:teuthology.orchestra.run.smithi086.stdout:(53/156): python3-urllib3-1.26.5-6.el9.noarch.r 277 kB/s | 215 kB 00:00 2024-09-19T06:34:45.088 INFO:teuthology.orchestra.run.smithi086.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 1.4 MB/s | 313 kB 00:00 2024-09-19T06:34:45.113 INFO:teuthology.orchestra.run.smithi086.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 182 kB/s | 18 kB 00:00 2024-09-19T06:34:45.172 INFO:teuthology.orchestra.run.smithi086.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 133 kB/s | 11 kB 00:00 2024-09-19T06:34:45.247 INFO:teuthology.orchestra.run.smithi086.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-19T06:34:45.272 INFO:teuthology.orchestra.run.smithi086.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2024-09-19T06:34:45.389 INFO:teuthology.orchestra.run.smithi086.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.6 MB/s | 662 kB 00:00 2024-09-19T06:34:45.448 INFO:teuthology.orchestra.run.smithi086.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 3.2 MB/s | 581 kB 00:00 2024-09-19T06:34:45.473 INFO:teuthology.orchestra.run.smithi086.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 293 kB/s | 24 kB 00:00 2024-09-19T06:34:45.498 INFO:teuthology.orchestra.run.smithi086.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 949 kB/s | 47 kB 00:00 2024-09-19T06:34:45.557 INFO:teuthology.orchestra.run.smithi086.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-19T06:34:45.582 INFO:teuthology.orchestra.run.smithi086.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-19T06:34:45.632 INFO:teuthology.orchestra.run.smithi086.stdout:(65/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.4 MB/s | 3.0 MB 00:00 2024-09-19T06:34:45.658 INFO:teuthology.orchestra.run.smithi086.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 383 kB/s | 38 kB 00:00 2024-09-19T06:34:45.941 INFO:teuthology.orchestra.run.smithi086.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 5.6 MB/s | 1.6 MB 00:00 2024-09-19T06:34:46.117 INFO:teuthology.orchestra.run.smithi086.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 5.1 MB/s | 910 kB 00:00 2024-09-19T06:34:46.137 INFO:teuthology.orchestra.run.smithi169.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-09-19T06:34:46.183 INFO:teuthology.orchestra.run.smithi086.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-19T06:34:46.417 INFO:teuthology.orchestra.run.smithi086.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 5.9 MB/s | 4.9 MB 00:00 2024-09-19T06:34:46.609 INFO:teuthology.orchestra.run.smithi086.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.5 MB/s | 4.4 MB 00:00 2024-09-19T06:34:46.659 INFO:teuthology.orchestra.run.smithi086.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 4.2 MB/s | 1.0 MB 00:00 2024-09-19T06:34:46.684 INFO:teuthology.orchestra.run.smithi086.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-09-19T06:34:46.735 INFO:teuthology.orchestra.run.smithi086.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-19T06:34:46.818 INFO:teuthology.orchestra.run.smithi086.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-19T06:34:46.910 INFO:teuthology.orchestra.run.smithi086.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-09-19T06:34:46.969 INFO:teuthology.orchestra.run.smithi086.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 440 kB/s | 26 kB 00:00 2024-09-19T06:34:47.027 INFO:teuthology.orchestra.run.smithi086.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 330 kB/s | 19 kB 00:00 2024-09-19T06:34:47.086 INFO:teuthology.orchestra.run.smithi086.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-19T06:34:47.145 INFO:teuthology.orchestra.run.smithi086.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 597 kB/s | 35 kB 00:00 2024-09-19T06:34:47.220 INFO:teuthology.orchestra.run.smithi086.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 5.6 MB/s | 5.8 MB 00:01 2024-09-19T06:34:47.304 INFO:teuthology.orchestra.run.smithi086.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-19T06:34:47.371 INFO:teuthology.orchestra.run.smithi086.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-09-19T06:34:47.421 INFO:teuthology.orchestra.run.smithi086.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T06:34:47.471 INFO:teuthology.orchestra.run.smithi086.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 846 kB/s | 42 kB 00:00 2024-09-19T06:34:47.563 INFO:teuthology.orchestra.run.smithi086.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 2.9 MB/s | 269 kB 00:00 2024-09-19T06:34:47.622 INFO:teuthology.orchestra.run.smithi086.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-19T06:34:47.739 INFO:teuthology.orchestra.run.smithi086.stdout:(88/156): python3-babel-2.9.1-2.el9.noarch.rpm 5.5 MB/s | 6.0 MB 00:01 2024-09-19T06:34:47.764 INFO:teuthology.orchestra.run.smithi086.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.9 MB/s | 279 kB 00:00 2024-09-19T06:34:47.808 INFO:teuthology.orchestra.run.smithi086.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 741 kB/s | 51 kB 00:00 2024-09-19T06:34:47.839 INFO:teuthology.orchestra.run.smithi086.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 714 kB/s | 54 kB 00:00 2024-09-19T06:34:47.890 INFO:teuthology.orchestra.run.smithi086.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 42 kB 00:00 2024-09-19T06:34:47.940 INFO:teuthology.orchestra.run.smithi086.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 886 kB/s | 44 kB 00:00 2024-09-19T06:34:47.998 INFO:teuthology.orchestra.run.smithi086.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-19T06:34:48.049 INFO:teuthology.orchestra.run.smithi086.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-09-19T06:34:48.116 INFO:teuthology.orchestra.run.smithi086.stdout:(96/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.2 MB/s | 5.1 MB 00:00 2024-09-19T06:34:48.141 INFO:teuthology.orchestra.run.smithi086.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 516 kB/s | 47 kB 00:00 2024-09-19T06:34:48.191 INFO:teuthology.orchestra.run.smithi086.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-19T06:34:48.216 INFO:teuthology.orchestra.run.smithi086.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.0 MB/s | 304 kB 00:00 2024-09-19T06:34:48.242 INFO:teuthology.orchestra.run.smithi086.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-19T06:34:48.267 INFO:teuthology.orchestra.run.smithi086.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T06:34:48.283 INFO:teuthology.orchestra.run.smithi169.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:34:48.284 INFO:teuthology.orchestra.run.smithi169.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:34:48.292 INFO:teuthology.orchestra.run.smithi086.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-19T06:34:48.297 INFO:teuthology.orchestra.run.smithi169.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T06:34:48.298 INFO:teuthology.orchestra.run.smithi169.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T06:34:48.299 INFO:teuthology.orchestra.run.smithi169.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T06:34:48.300 INFO:teuthology.orchestra.run.smithi169.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T06:34:48.302 INFO:teuthology.orchestra.run.smithi169.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T06:34:48.305 INFO:teuthology.orchestra.run.smithi169.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T06:34:48.306 INFO:teuthology.orchestra.run.smithi169.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T06:34:48.368 INFO:teuthology.orchestra.run.smithi086.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 223 kB/s | 22 kB 00:00 2024-09-19T06:34:48.369 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-09-19T06:34:48.383 INFO:teuthology.orchestra.run.smithi169.stdout:====================================================================================== 2024-09-19T06:34:48.384 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repository Size 2024-09-19T06:34:48.384 INFO:teuthology.orchestra.run.smithi169.stdout:====================================================================================== 2024-09-19T06:34:48.384 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-09-19T06:34:48.384 INFO:teuthology.orchestra.run.smithi169.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T06:34:48.384 INFO:teuthology.orchestra.run.smithi169.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T06:34:48.384 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T06:34:48.384 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T06:34:48.384 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T06:34:48.384 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T06:34:48.384 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T06:34:48.385 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T06:34:48.385 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T06:34:48.385 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T06:34:48.385 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T06:34:48.386 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T06:34:48.386 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T06:34:48.386 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T06:34:48.386 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T06:34:48.386 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T06:34:48.386 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T06:34:48.386 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T06:34:48.386 INFO:teuthology.orchestra.run.smithi169.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T06:34:48.386 INFO:teuthology.orchestra.run.smithi169.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T06:34:48.386 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T06:34:48.386 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T06:34:48.386 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T06:34:48.387 INFO:teuthology.orchestra.run.smithi169.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T06:34:48.387 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T06:34:48.387 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T06:34:48.387 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T06:34:48.387 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T06:34:48.387 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T06:34:48.387 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T06:34:48.387 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T06:34:48.387 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T06:34:48.387 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T06:34:48.387 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T06:34:48.387 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T06:34:48.388 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T06:34:48.388 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T06:34:48.388 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrading: 2024-09-19T06:34:48.388 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T06:34:48.388 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T06:34:48.388 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T06:34:48.388 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T06:34:48.388 INFO:teuthology.orchestra.run.smithi169.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T06:34:48.388 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T06:34:48.388 INFO:teuthology.orchestra.run.smithi169.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T06:34:48.388 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T06:34:48.388 INFO:teuthology.orchestra.run.smithi169.stdout:Installing dependencies: 2024-09-19T06:34:48.389 INFO:teuthology.orchestra.run.smithi169.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T06:34:48.389 INFO:teuthology.orchestra.run.smithi169.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T06:34:48.389 INFO:teuthology.orchestra.run.smithi169.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T06:34:48.389 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T06:34:48.389 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T06:34:48.389 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T06:34:48.389 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T06:34:48.389 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T06:34:48.389 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T06:34:48.389 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T06:34:48.389 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T06:34:48.389 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T06:34:48.390 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T06:34:48.390 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T06:34:48.390 INFO:teuthology.orchestra.run.smithi169.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T06:34:48.390 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T06:34:48.390 INFO:teuthology.orchestra.run.smithi169.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T06:34:48.390 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T06:34:48.390 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T06:34:48.390 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T06:34:48.390 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T06:34:48.390 INFO:teuthology.orchestra.run.smithi169.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T06:34:48.390 INFO:teuthology.orchestra.run.smithi169.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T06:34:48.390 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T06:34:48.391 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T06:34:48.391 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T06:34:48.391 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T06:34:48.391 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T06:34:48.391 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T06:34:48.391 INFO:teuthology.orchestra.run.smithi169.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T06:34:48.391 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T06:34:48.391 INFO:teuthology.orchestra.run.smithi169.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T06:34:48.391 INFO:teuthology.orchestra.run.smithi169.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T06:34:48.391 INFO:teuthology.orchestra.run.smithi169.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T06:34:48.391 INFO:teuthology.orchestra.run.smithi169.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T06:34:48.391 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T06:34:48.391 INFO:teuthology.orchestra.run.smithi169.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T06:34:48.392 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T06:34:48.392 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T06:34:48.392 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T06:34:48.392 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T06:34:48.392 INFO:teuthology.orchestra.run.smithi169.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T06:34:48.392 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T06:34:48.392 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T06:34:48.392 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T06:34:48.392 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T06:34:48.392 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T06:34:48.392 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T06:34:48.392 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T06:34:48.393 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T06:34:48.393 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T06:34:48.393 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T06:34:48.393 INFO:teuthology.orchestra.run.smithi169.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T06:34:48.393 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T06:34:48.393 INFO:teuthology.orchestra.run.smithi169.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T06:34:48.393 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T06:34:48.393 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T06:34:48.393 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T06:34:48.393 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T06:34:48.393 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T06:34:48.393 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T06:34:48.393 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T06:34:48.394 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T06:34:48.394 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T06:34:48.394 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T06:34:48.394 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T06:34:48.394 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T06:34:48.394 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T06:34:48.394 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T06:34:48.394 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T06:34:48.394 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T06:34:48.394 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T06:34:48.394 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T06:34:48.394 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T06:34:48.394 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T06:34:48.395 INFO:teuthology.orchestra.run.smithi169.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T06:34:48.395 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T06:34:48.395 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T06:34:48.395 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T06:34:48.395 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T06:34:48.395 INFO:teuthology.orchestra.run.smithi169.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T06:34:48.395 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T06:34:48.395 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T06:34:48.395 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T06:34:48.395 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T06:34:48.396 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T06:34:48.396 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T06:34:48.396 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T06:34:48.396 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T06:34:48.396 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T06:34:48.396 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T06:34:48.396 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T06:34:48.396 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T06:34:48.396 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T06:34:48.396 INFO:teuthology.orchestra.run.smithi169.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T06:34:48.397 INFO:teuthology.orchestra.run.smithi169.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T06:34:48.397 INFO:teuthology.orchestra.run.smithi169.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T06:34:48.397 INFO:teuthology.orchestra.run.smithi169.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T06:34:48.397 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T06:34:48.397 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T06:34:48.397 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T06:34:48.397 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T06:34:48.397 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T06:34:48.397 INFO:teuthology.orchestra.run.smithi169.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T06:34:48.397 INFO:teuthology.orchestra.run.smithi169.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T06:34:48.397 INFO:teuthology.orchestra.run.smithi169.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T06:34:48.397 INFO:teuthology.orchestra.run.smithi169.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T06:34:48.397 INFO:teuthology.orchestra.run.smithi169.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T06:34:48.398 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T06:34:48.398 INFO:teuthology.orchestra.run.smithi169.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T06:34:48.398 INFO:teuthology.orchestra.run.smithi169.stdout:Installing weak dependencies: 2024-09-19T06:34:48.398 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T06:34:48.398 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:34:48.398 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-09-19T06:34:48.398 INFO:teuthology.orchestra.run.smithi169.stdout:====================================================================================== 2024-09-19T06:34:48.398 INFO:teuthology.orchestra.run.smithi169.stdout:Install 148 Packages 2024-09-19T06:34:48.398 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrade 8 Packages 2024-09-19T06:34:48.398 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:34:48.399 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 226 M 2024-09-19T06:34:48.399 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-09-19T06:34:48.426 INFO:teuthology.orchestra.run.smithi086.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-19T06:34:48.468 INFO:teuthology.orchestra.run.smithi086.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 7.2 MB/s | 308 kB 00:00 2024-09-19T06:34:48.493 INFO:teuthology.orchestra.run.smithi086.stdout:(106/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.2 MB/s | 863 kB 00:00 2024-09-19T06:34:48.519 INFO:teuthology.orchestra.run.smithi086.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 387 kB/s | 19 kB 00:00 2024-09-19T06:34:48.553 INFO:teuthology.orchestra.run.smithi086.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T06:34:48.586 INFO:teuthology.orchestra.run.smithi086.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2024-09-19T06:34:48.620 INFO:teuthology.orchestra.run.smithi086.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-19T06:34:48.653 INFO:teuthology.orchestra.run.smithi086.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-19T06:34:48.729 INFO:teuthology.orchestra.run.smithi086.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-19T06:34:48.770 INFO:teuthology.orchestra.run.smithi086.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-19T06:34:48.796 INFO:teuthology.orchestra.run.smithi086.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T06:34:48.813 INFO:teuthology.orchestra.run.smithi086.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-19T06:34:48.830 INFO:teuthology.orchestra.run.smithi086.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 847 kB/s | 14 kB 00:00 2024-09-19T06:34:48.855 INFO:teuthology.orchestra.run.smithi086.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.8 MB/s | 172 kB 00:00 2024-09-19T06:34:48.914 INFO:teuthology.orchestra.run.smithi086.stdout:(118/156): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-19T06:34:48.947 INFO:teuthology.orchestra.run.smithi086.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-09-19T06:34:48.972 INFO:teuthology.orchestra.run.smithi086.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-19T06:34:48.998 INFO:teuthology.orchestra.run.smithi086.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T06:34:49.032 INFO:teuthology.orchestra.run.smithi086.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-19T06:34:49.057 INFO:teuthology.orchestra.run.smithi086.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 432 kB/s | 11 kB 00:00 2024-09-19T06:34:49.082 INFO:teuthology.orchestra.run.smithi086.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-09-19T06:34:49.105 INFO:teuthology.orchestra.run.smithi169.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 45 kB/s | 6.6 kB 00:00 2024-09-19T06:34:49.107 INFO:teuthology.orchestra.run.smithi086.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 928 kB/s | 23 kB 00:00 2024-09-19T06:34:49.132 INFO:teuthology.orchestra.run.smithi086.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 779 kB/s | 19 kB 00:00 2024-09-19T06:34:49.158 INFO:teuthology.orchestra.run.smithi086.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 792 kB/s | 20 kB 00:00 2024-09-19T06:34:49.208 INFO:teuthology.orchestra.run.smithi086.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-09-19T06:34:49.233 INFO:teuthology.orchestra.run.smithi086.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T06:34:49.267 INFO:teuthology.orchestra.run.smithi086.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-19T06:34:49.292 INFO:teuthology.orchestra.run.smithi086.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T06:34:49.334 INFO:teuthology.orchestra.run.smithi086.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-09-19T06:34:49.347 INFO:teuthology.orchestra.run.smithi169.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 3.6 MB/s | 896 kB 00:00 2024-09-19T06:34:49.359 INFO:teuthology.orchestra.run.smithi086.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-19T06:34:49.385 INFO:teuthology.orchestra.run.smithi086.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-19T06:34:49.408 INFO:teuthology.orchestra.run.smithi086.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.2 MB/s | 28 kB 00:00 2024-09-19T06:34:49.434 INFO:teuthology.orchestra.run.smithi086.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-19T06:34:49.439 INFO:teuthology.orchestra.run.smithi169.stdout:(3/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-19T06:34:49.459 INFO:teuthology.orchestra.run.smithi086.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-19T06:34:49.464 INFO:teuthology.orchestra.run.smithi169.stdout:(4/156): ceph-immutable-object-cache-19.1.1-361 1.2 MB/s | 145 kB 00:00 2024-09-19T06:34:49.484 INFO:teuthology.orchestra.run.smithi086.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-09-19T06:34:49.510 INFO:teuthology.orchestra.run.smithi086.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-19T06:34:49.535 INFO:teuthology.orchestra.run.smithi086.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-19T06:34:49.556 INFO:teuthology.orchestra.run.smithi169.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 20 MB/s | 2.4 MB 00:00 2024-09-19T06:34:49.560 INFO:teuthology.orchestra.run.smithi086.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-19T06:34:49.585 INFO:teuthology.orchestra.run.smithi086.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T06:34:49.611 INFO:teuthology.orchestra.run.smithi086.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-19T06:34:49.636 INFO:teuthology.orchestra.run.smithi086.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 806 kB/s | 20 kB 00:00 2024-09-19T06:34:49.669 INFO:teuthology.orchestra.run.smithi086.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-09-19T06:34:49.695 INFO:teuthology.orchestra.run.smithi086.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-19T06:34:49.698 INFO:teuthology.orchestra.run.smithi169.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 6.5 MB/s | 1.5 MB 00:00 2024-09-19T06:34:49.753 INFO:teuthology.orchestra.run.smithi086.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-19T06:34:49.815 INFO:teuthology.orchestra.run.smithi169.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 18 MB/s | 4.7 MB 00:00 2024-09-19T06:34:50.082 INFO:teuthology.orchestra.run.smithi169.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 19 MB/s | 21 MB 00:01 2024-09-19T06:34:50.112 INFO:teuthology.orchestra.run.smithi086.stdout:(148/156): librados2-19.1.1-361.g2f599a46.el9.x 8.2 MB/s | 3.4 MB 00:00 2024-09-19T06:34:50.124 INFO:teuthology.orchestra.run.smithi169.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 606 kB/s | 25 kB 00:00 2024-09-19T06:34:50.179 INFO:teuthology.orchestra.run.smithi086.stdout:(149/156): librbd1-19.1.1-361.g2f599a46.el9.x86 7.4 MB/s | 3.2 MB 00:00 2024-09-19T06:34:50.349 INFO:teuthology.orchestra.run.smithi169.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 20 MB/s | 11 MB 00:00 2024-09-19T06:34:50.399 INFO:teuthology.orchestra.run.smithi169.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 4.5 MB/s | 228 kB 00:00 2024-09-19T06:34:50.491 INFO:teuthology.orchestra.run.smithi169.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 295 kB/s | 27 kB 00:00 2024-09-19T06:34:50.567 INFO:teuthology.orchestra.run.smithi169.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 423 kB/s | 32 kB 00:00 2024-09-19T06:34:50.675 INFO:teuthology.orchestra.run.smithi169.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 6.8 MB/s | 751 kB 00:00 2024-09-19T06:34:50.767 INFO:teuthology.orchestra.run.smithi169.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 1.7 MB/s | 163 kB 00:00 2024-09-19T06:34:50.859 INFO:teuthology.orchestra.run.smithi169.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.4 MB/s | 127 kB 00:00 2024-09-19T06:34:51.101 INFO:teuthology.orchestra.run.smithi169.stdout:(17/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 17 MB 00:01 2024-09-19T06:34:51.126 INFO:teuthology.orchestra.run.smithi169.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 1.9 MB/s | 506 kB 00:00 2024-09-19T06:34:51.177 INFO:teuthology.orchestra.run.smithi169.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 899 kB/s | 45 kB 00:00 2024-09-19T06:34:51.294 INFO:teuthology.orchestra.run.smithi169.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.1 MB/s | 136 kB 00:00 2024-09-19T06:34:51.411 INFO:teuthology.orchestra.run.smithi169.stdout:(21/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 17 MB/s | 5.3 MB 00:00 2024-09-19T06:34:51.436 INFO:teuthology.orchestra.run.smithi169.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.1 MB/s | 161 kB 00:00 2024-09-19T06:34:51.461 INFO:teuthology.orchestra.run.smithi169.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 6.3 MB/s | 320 kB 00:00 2024-09-19T06:34:51.495 INFO:teuthology.orchestra.run.smithi169.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.0 MB/s | 300 kB 00:00 2024-09-19T06:34:51.520 INFO:teuthology.orchestra.run.smithi169.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.7 MB/s | 99 kB 00:00 2024-09-19T06:34:51.545 INFO:teuthology.orchestra.run.smithi169.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T06:34:51.571 INFO:teuthology.orchestra.run.smithi086.stdout:(150/156): NetworkManager-1.51.0-1.el9.x86_64.r 1.6 MB/s | 2.3 MB 00:01 2024-09-19T06:34:51.604 INFO:teuthology.orchestra.run.smithi169.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-19T06:34:51.671 INFO:teuthology.orchestra.run.smithi169.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 21 MB/s | 3.1 MB 00:00 2024-09-19T06:34:51.688 INFO:teuthology.orchestra.run.smithi086.stdout:(151/156): NetworkManager-libnm-1.51.0-1.el9.x8 1.2 MB/s | 1.8 MB 00:01 2024-09-19T06:34:51.696 INFO:teuthology.orchestra.run.smithi169.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 347 kB/s | 32 kB 00:00 2024-09-19T06:34:51.721 INFO:teuthology.orchestra.run.smithi169.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.8 MB/s | 146 kB 00:00 2024-09-19T06:34:52.180 INFO:teuthology.orchestra.run.smithi086.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 67 kB/s | 41 kB 00:00 2024-09-19T06:34:52.314 INFO:teuthology.orchestra.run.smithi169.stdout:(31/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 22 MB/s | 49 MB 00:02 2024-09-19T06:34:52.347 INFO:teuthology.orchestra.run.smithi086.stdout:(153/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.6 MB/s | 16 MB 00:04 2024-09-19T06:34:52.364 INFO:teuthology.orchestra.run.smithi169.stdout:(32/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 5.3 MB/s | 3.6 MB 00:00 2024-09-19T06:34:52.389 INFO:teuthology.orchestra.run.smithi169.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 3.3 MB/s | 249 kB 00:00 2024-09-19T06:34:52.414 INFO:teuthology.orchestra.run.smithi169.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 983 kB/s | 49 kB 00:00 2024-09-19T06:34:52.440 INFO:teuthology.orchestra.run.smithi169.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 328 kB/s | 16 kB 00:00 2024-09-19T06:34:52.468 INFO:teuthology.orchestra.run.smithi169.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.5 MB/s | 285 kB 00:00 2024-09-19T06:34:52.567 INFO:teuthology.orchestra.run.smithi169.stdout:(37/156): ceph-mgr-diskprediction-local-19.1.1- 8.8 MB/s | 7.4 MB 00:00 2024-09-19T06:34:52.573 INFO:teuthology.orchestra.run.smithi086.stdout:(154/156): NetworkManager-tui-1.51.0-1.el9.x86_ 282 kB/s | 249 kB 00:00 2024-09-19T06:34:52.592 INFO:teuthology.orchestra.run.smithi169.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 144 kB/s | 18 kB 00:00 2024-09-19T06:34:52.626 INFO:teuthology.orchestra.run.smithi169.stdout:(39/156): cephadm-19.1.1-361.g2f599a46.el9.noar 4.0 MB/s | 765 kB 00:00 2024-09-19T06:34:52.693 INFO:teuthology.orchestra.run.smithi169.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 638 kB/s | 80 kB 00:00 2024-09-19T06:34:52.718 INFO:teuthology.orchestra.run.smithi169.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-19T06:34:52.776 INFO:teuthology.orchestra.run.smithi169.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-19T06:34:52.835 INFO:teuthology.orchestra.run.smithi169.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-19T06:34:52.877 INFO:teuthology.orchestra.run.smithi169.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 7.7 MB/s | 1.2 MB 00:00 2024-09-19T06:34:52.902 INFO:teuthology.orchestra.run.smithi169.stdout:(45/156): python3-ply-3.11-14.el9.noarch.rpm 850 kB/s | 106 kB 00:00 2024-09-19T06:34:52.961 INFO:teuthology.orchestra.run.smithi169.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-19T06:34:52.986 INFO:teuthology.orchestra.run.smithi169.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-19T06:34:53.011 INFO:teuthology.orchestra.run.smithi169.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-09-19T06:34:53.247 INFO:teuthology.orchestra.run.smithi086.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 1.3 MB/s | 1.4 MB 00:01 2024-09-19T06:34:53.381 INFO:teuthology.orchestra.run.smithi086.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.3 MB/s | 2.4 MB 00:01 2024-09-19T06:34:53.386 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:34:53.387 INFO:teuthology.orchestra.run.smithi086.stdout:Total 15 MB/s | 226 MB 00:15 2024-09-19T06:34:53.478 INFO:teuthology.orchestra.run.smithi169.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 229 kB/s | 107 kB 00:00 2024-09-19T06:34:53.595 INFO:teuthology.orchestra.run.smithi169.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 186 kB/s | 22 kB 00:00 2024-09-19T06:34:53.804 INFO:teuthology.orchestra.run.smithi169.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-09-19T06:34:53.829 INFO:teuthology.orchestra.run.smithi169.stdout:(52/156): automake-1.16.2-8.el9.noarch.rpm 794 kB/s | 689 kB 00:00 2024-09-19T06:34:53.904 INFO:teuthology.orchestra.run.smithi169.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 1.0 MB/s | 313 kB 00:00 2024-09-19T06:34:53.929 INFO:teuthology.orchestra.run.smithi169.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 260 kB/s | 33 kB 00:00 2024-09-19T06:34:54.013 INFO:teuthology.orchestra.run.smithi169.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 167 kB/s | 18 kB 00:00 2024-09-19T06:34:54.038 INFO:teuthology.orchestra.run.smithi169.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 102 kB/s | 11 kB 00:00 2024-09-19T06:34:54.122 INFO:teuthology.orchestra.run.smithi169.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-19T06:34:54.155 INFO:teuthology.orchestra.run.smithi169.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 387 kB/s | 45 kB 00:00 2024-09-19T06:34:54.339 INFO:teuthology.orchestra.run.smithi169.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.9 MB/s | 3.0 MB 00:00 2024-09-19T06:34:54.456 INFO:teuthology.orchestra.run.smithi169.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 1.9 MB/s | 662 kB 00:00 2024-09-19T06:34:54.482 INFO:teuthology.orchestra.run.smithi169.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 172 kB/s | 24 kB 00:00 2024-09-19T06:34:54.573 INFO:teuthology.orchestra.run.smithi169.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 1.4 MB/s | 581 kB 00:00 2024-09-19T06:34:54.598 INFO:teuthology.orchestra.run.smithi169.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 334 kB/s | 47 kB 00:00 2024-09-19T06:34:54.618 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-09-19T06:34:54.682 INFO:teuthology.orchestra.run.smithi169.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-19T06:34:54.708 INFO:teuthology.orchestra.run.smithi169.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 354 kB/s | 38 kB 00:00 2024-09-19T06:34:54.771 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-09-19T06:34:54.771 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-09-19T06:34:54.974 INFO:teuthology.orchestra.run.smithi169.stdout:(66/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 594 kB/s | 292 kB 00:00 2024-09-19T06:34:55.975 INFO:teuthology.orchestra.run.smithi169.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.5 MB/s | 4.4 MB 00:01 2024-09-19T06:34:56.108 INFO:teuthology.orchestra.run.smithi169.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 1.4 MB/s | 1.6 MB 00:01 2024-09-19T06:34:56.233 INFO:teuthology.orchestra.run.smithi169.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-19T06:34:56.948 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-09-19T06:34:56.948 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-09-19T06:34:57.309 INFO:teuthology.orchestra.run.smithi169.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 1.9 MB/s | 4.9 MB 00:02 2024-09-19T06:34:57.334 INFO:teuthology.orchestra.run.smithi169.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 669 kB/s | 910 kB 00:01 2024-09-19T06:34:57.542 INFO:teuthology.orchestra.run.smithi169.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 420 kB/s | 87 kB 00:00 2024-09-19T06:34:57.768 INFO:teuthology.orchestra.run.smithi169.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 2.2 MB/s | 1.0 MB 00:00 2024-09-19T06:34:57.885 INFO:teuthology.orchestra.run.smithi169.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 525 kB/s | 61 kB 00:00 2024-09-19T06:34:57.993 INFO:teuthology.orchestra.run.smithi169.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-19T06:34:58.110 INFO:teuthology.orchestra.run.smithi169.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-09-19T06:34:58.227 INFO:teuthology.orchestra.run.smithi169.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 220 kB/s | 26 kB 00:00 2024-09-19T06:34:58.344 INFO:teuthology.orchestra.run.smithi169.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 164 kB/s | 19 kB 00:00 2024-09-19T06:34:58.461 INFO:teuthology.orchestra.run.smithi169.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-19T06:34:58.569 INFO:teuthology.orchestra.run.smithi169.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 321 kB/s | 35 kB 00:00 2024-09-19T06:35:00.103 INFO:teuthology.orchestra.run.smithi169.stdout:(81/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.3 MB/s | 5.1 MB 00:01 2024-09-19T06:35:00.220 INFO:teuthology.orchestra.run.smithi169.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-19T06:35:00.337 INFO:teuthology.orchestra.run.smithi169.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-09-19T06:35:00.470 INFO:teuthology.orchestra.run.smithi169.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 579 kB/s | 77 kB 00:00 2024-09-19T06:35:00.579 INFO:teuthology.orchestra.run.smithi169.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 391 kB/s | 42 kB 00:00 2024-09-19T06:35:00.696 INFO:teuthology.orchestra.run.smithi169.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 2.3 MB/s | 269 kB 00:00 2024-09-19T06:35:00.813 INFO:teuthology.orchestra.run.smithi169.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-19T06:35:00.930 INFO:teuthology.orchestra.run.smithi169.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-19T06:35:01.039 INFO:teuthology.orchestra.run.smithi169.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 469 kB/s | 51 kB 00:00 2024-09-19T06:35:01.147 INFO:teuthology.orchestra.run.smithi169.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 495 kB/s | 54 kB 00:00 2024-09-19T06:35:01.489 INFO:teuthology.orchestra.run.smithi169.stdout:(91/156): postgresql-server-13.16-1.el9.x86_64. 1.1 MB/s | 5.8 MB 00:05 2024-09-19T06:35:01.606 INFO:teuthology.orchestra.run.smithi169.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 357 kB/s | 42 kB 00:00 2024-09-19T06:35:01.723 INFO:teuthology.orchestra.run.smithi169.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 378 kB/s | 44 kB 00:00 2024-09-19T06:35:02.098 INFO:teuthology.orchestra.run.smithi169.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 589 kB/s | 221 kB 00:00 2024-09-19T06:35:02.207 INFO:teuthology.orchestra.run.smithi169.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 331 kB/s | 36 kB 00:00 2024-09-19T06:35:02.324 INFO:teuthology.orchestra.run.smithi169.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 406 kB/s | 47 kB 00:00 2024-09-19T06:35:02.799 INFO:teuthology.orchestra.run.smithi169.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 640 kB/s | 304 kB 00:00 2024-09-19T06:35:02.933 INFO:teuthology.orchestra.run.smithi169.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 433 kB/s | 58 kB 00:00 2024-09-19T06:35:03.133 INFO:teuthology.orchestra.run.smithi169.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 479 kB/s | 96 kB 00:00 2024-09-19T06:35:03.229 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-09-19T06:35:03.333 INFO:teuthology.orchestra.run.smithi169.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 318 kB/s | 64 kB 00:00 2024-09-19T06:35:03.360 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T06:35:03.450 INFO:teuthology.orchestra.run.smithi169.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 384 kB/s | 45 kB 00:00 2024-09-19T06:35:03.521 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T06:35:03.534 INFO:teuthology.orchestra.run.smithi169.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-09-19T06:35:03.585 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T06:35:03.619 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T06:35:03.644 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T06:35:03.696 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T06:35:03.859 INFO:teuthology.orchestra.run.smithi169.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.0 MB/s | 16 MB 00:02 2024-09-19T06:35:03.901 INFO:teuthology.orchestra.run.smithi169.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.3 MB/s | 863 kB 00:00 2024-09-19T06:35:03.951 INFO:teuthology.orchestra.run.smithi169.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 5.9 MB/s | 548 kB 00:00 2024-09-19T06:35:03.977 INFO:teuthology.orchestra.run.smithi169.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-19T06:35:04.002 INFO:teuthology.orchestra.run.smithi169.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 3.2 MB/s | 308 kB 00:00 2024-09-19T06:35:04.027 INFO:teuthology.orchestra.run.smithi169.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T06:35:04.052 INFO:teuthology.orchestra.run.smithi169.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T06:35:04.078 INFO:teuthology.orchestra.run.smithi169.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-19T06:35:04.088 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T06:35:04.111 INFO:teuthology.orchestra.run.smithi169.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-19T06:35:04.153 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:35:04.170 INFO:teuthology.orchestra.run.smithi169.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-19T06:35:04.212 INFO:teuthology.orchestra.run.smithi169.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-19T06:35:04.229 INFO:teuthology.orchestra.run.smithi169.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-19T06:35:04.246 INFO:teuthology.orchestra.run.smithi169.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-19T06:35:04.271 INFO:teuthology.orchestra.run.smithi169.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 564 kB/s | 14 kB 00:00 2024-09-19T06:35:04.275 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:35:04.313 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:35:04.338 INFO:teuthology.orchestra.run.smithi169.stdout:(117/156): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-19T06:35:04.372 INFO:teuthology.orchestra.run.smithi169.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-09-19T06:35:04.396 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:35:04.405 INFO:teuthology.orchestra.run.smithi169.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-19T06:35:04.425 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:35:04.430 INFO:teuthology.orchestra.run.smithi169.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-19T06:35:04.464 INFO:teuthology.orchestra.run.smithi169.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-19T06:35:04.489 INFO:teuthology.orchestra.run.smithi169.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-19T06:35:04.515 INFO:teuthology.orchestra.run.smithi169.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-19T06:35:04.540 INFO:teuthology.orchestra.run.smithi169.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-19T06:35:04.565 INFO:teuthology.orchestra.run.smithi169.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 934 kB/s | 23 kB 00:00 2024-09-19T06:35:04.591 INFO:teuthology.orchestra.run.smithi169.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-19T06:35:04.593 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T06:35:04.617 INFO:teuthology.orchestra.run.smithi169.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 791 kB/s | 20 kB 00:00 2024-09-19T06:35:04.647 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T06:35:04.674 INFO:teuthology.orchestra.run.smithi169.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-19T06:35:04.675 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:35:04.700 INFO:teuthology.orchestra.run.smithi169.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T06:35:04.777 INFO:teuthology.orchestra.run.smithi169.stdout:(130/156): python3-babel-2.9.1-2.el9.noarch.rpm 844 kB/s | 6.0 MB 00:07 2024-09-19T06:35:04.779 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:35:04.800 INFO:teuthology.orchestra.run.smithi169.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 786 kB/s | 79 kB 00:00 2024-09-19T06:35:04.809 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:35:04.842 INFO:teuthology.orchestra.run.smithi169.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 7.9 MB/s | 272 kB 00:00 2024-09-19T06:35:04.867 INFO:teuthology.orchestra.run.smithi169.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 715 kB/s | 16 kB 00:00 2024-09-19T06:35:04.872 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:35:04.893 INFO:teuthology.orchestra.run.smithi169.stdout:(134/156): python3-natsort-7.1.1-5.el9.noarch.r 492 kB/s | 58 kB 00:00 2024-09-19T06:35:04.902 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:35:04.923 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:35:04.926 INFO:teuthology.orchestra.run.smithi169.stdout:(135/156): python3-kubernetes-26.1.0-2.el9.noar 3.3 MB/s | 1.0 MB 00:00 2024-09-19T06:35:04.952 INFO:teuthology.orchestra.run.smithi169.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 483 kB/s | 28 kB 00:00 2024-09-19T06:35:04.977 INFO:teuthology.orchestra.run.smithi169.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-19T06:35:05.002 INFO:teuthology.orchestra.run.smithi169.stdout:(138/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 669 kB/s | 90 kB 00:00 2024-09-19T06:35:05.027 INFO:teuthology.orchestra.run.smithi169.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-19T06:35:05.053 INFO:teuthology.orchestra.run.smithi169.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-19T06:35:05.078 INFO:teuthology.orchestra.run.smithi169.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-19T06:35:05.103 INFO:teuthology.orchestra.run.smithi169.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-19T06:35:05.113 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:35:05.128 INFO:teuthology.orchestra.run.smithi169.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T06:35:05.154 INFO:teuthology.orchestra.run.smithi169.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-19T06:35:05.179 INFO:teuthology.orchestra.run.smithi169.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-19T06:35:05.204 INFO:teuthology.orchestra.run.smithi169.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T06:35:05.230 INFO:teuthology.orchestra.run.smithi169.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-19T06:35:05.285 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:35:05.288 INFO:teuthology.orchestra.run.smithi169.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T06:35:05.428 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T06:35:05.464 INFO:teuthology.orchestra.run.smithi169.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 13 MB/s | 3.4 MB 00:00 2024-09-19T06:35:05.549 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:35:05.592 INFO:teuthology.orchestra.run.smithi169.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 8.7 MB/s | 3.2 MB 00:00 2024-09-19T06:35:05.618 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:35:05.648 INFO:teuthology.orchestra.run.smithi169.stdout:(151/156): NetworkManager-1.51.0-1.el9.x86_64.r 6.5 MB/s | 2.3 MB 00:00 2024-09-19T06:35:05.689 INFO:teuthology.orchestra.run.smithi169.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 420 kB/s | 41 kB 00:00 2024-09-19T06:35:05.748 INFO:teuthology.orchestra.run.smithi169.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 6.4 MB/s | 1.8 MB 00:00 2024-09-19T06:35:05.774 INFO:teuthology.orchestra.run.smithi169.stdout:(154/156): NetworkManager-tui-1.51.0-1.el9.x86_ 1.9 MB/s | 249 kB 00:00 2024-09-19T06:35:05.845 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:35:05.899 INFO:teuthology.orchestra.run.smithi169.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 16 MB/s | 2.4 MB 00:00 2024-09-19T06:35:05.949 INFO:teuthology.orchestra.run.smithi169.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 5.2 MB/s | 1.4 MB 00:00 2024-09-19T06:35:05.956 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:35:05.956 INFO:teuthology.orchestra.run.smithi169.stdout:Total 13 MB/s | 226 MB 00:17 2024-09-19T06:35:05.958 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T06:35:06.052 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T06:35:06.090 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T06:35:06.132 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T06:35:06.198 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T06:35:06.242 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T06:35:06.282 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T06:35:06.327 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T06:35:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T06:35:06.403 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T06:35:06.472 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T06:35:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T06:35:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T06:35:06.599 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T06:35:06.675 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T06:35:06.718 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T06:35:06.770 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T06:35:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T06:35:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T06:35:06.922 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T06:35:06.996 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T06:35:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T06:35:07.132 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-09-19T06:35:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T06:35:07.284 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-09-19T06:35:07.284 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-09-19T06:35:07.715 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T06:35:07.802 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T06:35:07.831 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T06:35:07.875 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T06:35:07.912 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T06:35:07.955 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T06:35:08.120 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T06:35:08.182 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T06:35:08.237 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T06:35:08.309 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T06:35:08.341 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T06:35:08.377 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T06:35:08.424 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T06:35:08.461 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T06:35:08.502 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T06:35:08.553 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T06:35:08.698 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T06:35:08.747 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T06:35:08.791 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T06:35:08.902 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T06:35:09.097 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-09-19T06:35:09.097 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-09-19T06:35:09.160 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T06:35:09.201 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T06:35:09.232 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T06:35:09.257 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T06:35:09.359 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T06:35:09.486 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T06:35:09.522 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T06:35:09.574 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T06:35:09.619 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T06:35:09.656 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T06:35:09.688 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T06:35:09.717 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T06:35:09.761 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T06:35:09.794 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T06:35:09.836 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T06:35:09.870 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T06:35:09.966 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T06:35:10.017 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T06:35:10.048 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T06:35:10.171 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T06:35:10.224 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T06:35:10.937 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T06:35:10.986 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T06:35:11.019 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T06:35:11.117 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T06:35:11.166 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T06:35:11.219 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T06:35:11.315 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T06:35:11.366 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T06:35:11.550 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T06:35:11.586 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T06:35:11.664 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T06:35:12.316 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T06:35:12.425 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T06:35:13.670 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T06:35:13.747 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T06:35:13.775 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T06:35:13.833 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T06:35:14.143 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T06:35:14.179 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:35:14.270 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:35:14.301 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T06:35:14.346 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T06:35:14.825 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T06:35:14.857 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:35:14.929 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:35:14.959 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T06:35:15.347 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-09-19T06:35:15.461 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T06:35:15.500 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T06:35:15.554 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T06:35:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T06:35:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T06:35:15.655 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T06:35:16.139 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T06:35:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:35:16.310 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:35:16.348 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:35:16.439 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:35:16.469 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:35:16.621 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T06:35:16.676 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T06:35:16.710 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:35:16.797 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:35:16.819 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:35:16.866 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:35:16.887 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:35:16.907 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:35:17.054 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:35:17.190 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:35:17.309 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:35:17.335 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T06:35:17.347 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:35:17.436 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:35:17.503 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:35:17.728 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:35:17.834 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T06:35:17.892 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:35:17.933 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:35:17.936 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T06:35:17.983 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T06:35:18.017 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T06:35:18.027 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:35:18.027 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T06:35:18.027 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T06:35:18.027 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:35:18.068 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:35:18.081 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T06:35:18.127 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T06:35:18.159 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T06:35:18.205 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T06:35:18.238 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T06:35:18.275 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T06:35:18.342 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T06:35:18.396 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T06:35:18.427 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T06:35:18.462 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T06:35:18.539 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T06:35:18.573 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T06:35:18.616 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T06:35:18.645 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T06:35:18.705 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T06:35:18.760 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T06:35:18.834 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T06:35:18.967 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T06:35:19.020 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T06:35:19.543 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T06:35:19.624 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T06:35:19.654 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T06:35:19.696 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T06:35:19.736 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T06:35:19.776 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T06:35:19.947 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T06:35:20.012 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T06:35:20.067 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T06:35:20.140 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T06:35:20.181 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T06:35:20.217 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T06:35:20.264 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T06:35:20.300 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T06:35:20.343 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T06:35:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T06:35:20.537 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T06:35:20.579 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T06:35:20.620 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T06:35:20.723 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T06:35:20.754 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T06:35:20.785 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T06:35:20.810 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T06:35:20.835 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T06:35:20.909 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T06:35:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T06:35:21.134 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T06:35:21.164 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T06:35:21.198 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T06:35:21.238 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T06:35:21.286 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T06:35:21.316 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T06:35:21.350 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T06:35:21.383 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T06:35:21.425 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T06:35:21.459 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T06:35:21.546 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T06:35:21.590 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T06:35:21.621 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T06:35:21.724 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T06:35:21.780 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T06:35:22.511 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T06:35:22.569 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T06:35:22.603 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T06:35:22.702 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T06:35:22.758 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T06:35:22.803 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T06:35:22.898 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T06:35:22.931 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T06:35:23.116 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T06:35:23.145 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T06:35:23.223 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T06:35:23.873 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T06:35:23.977 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T06:35:25.207 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T06:35:25.299 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T06:35:25.326 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T06:35:25.360 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T06:35:25.672 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T06:35:25.714 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:35:25.804 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:35:25.836 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T06:35:25.872 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T06:35:26.362 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T06:35:26.384 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:35:26.447 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:35:26.478 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T06:35:28.777 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:35:28.816 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:35:29.365 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:35:29.428 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:35:29.520 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:35:29.520 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T06:35:29.520 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T06:35:29.520 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:35:29.553 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:35:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:35:29.704 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /sys 2024-09-19T06:35:29.704 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /proc 2024-09-19T06:35:29.704 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /mnt 2024-09-19T06:35:29.704 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /var/tmp 2024-09-19T06:35:29.704 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /home 2024-09-19T06:35:29.704 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /root 2024-09-19T06:35:29.704 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /tmp 2024-09-19T06:35:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:35:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:35:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:35:29.896 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:35:29.896 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T06:35:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:35:31.366 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:35:31.392 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:35:31.393 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:35:31.393 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T06:35:31.393 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:35:31.393 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:35:31.393 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:35:31.616 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:35:31.640 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:35:31.640 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:35:31.641 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T06:35:31.641 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:35:31.641 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:35:31.641 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:35:32.075 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:35:32.099 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:35:32.099 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:35:32.099 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T06:35:32.099 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:35:32.099 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:35:32.099 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:35:32.205 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T06:35:32.254 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T06:35:32.309 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T06:35:32.494 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T06:35:32.542 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T06:35:32.620 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T06:35:32.708 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T06:35:32.848 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T06:35:32.913 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T06:35:32.949 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T06:35:32.977 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T06:35:33.439 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:35:33.467 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:35:33.498 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T06:35:33.561 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T06:35:33.590 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:35:34.632 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:35:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:35:35.640 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:35:35.675 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:35:35.777 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:35:35.937 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T06:35:35.969 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:35:35.993 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:35:35.993 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:35:35.993 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T06:35:35.993 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:35:35.993 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:35:35.993 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:35:36.045 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:35:36.056 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:35:36.153 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T06:35:36.210 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T06:35:37.128 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T06:35:37.155 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:35:37.179 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:35:37.179 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:35:37.179 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T06:35:37.180 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:35:37.180 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:35:37.180 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:35:37.223 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:35:37.246 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:35:37.246 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:35:37.246 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T06:35:37.247 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:35:37.298 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:35:37.322 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:35:37.322 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:35:37.322 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T06:35:37.322 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:35:37.323 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:35:37.323 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:35:37.632 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:35:37.656 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:35:37.656 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:35:37.656 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T06:35:37.656 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:35:37.656 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:35:37.656 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:35:41.296 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:35:41.296 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /sys 2024-09-19T06:35:41.297 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /proc 2024-09-19T06:35:41.297 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /mnt 2024-09-19T06:35:41.297 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /var/tmp 2024-09-19T06:35:41.297 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /home 2024-09-19T06:35:41.297 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /root 2024-09-19T06:35:41.297 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /tmp 2024-09-19T06:35:41.297 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:35:41.473 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:35:41.489 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:35:41.490 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:35:41.490 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T06:35:41.490 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:35:42.186 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T06:35:42.227 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T06:35:42.268 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T06:35:42.300 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T06:35:42.327 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T06:35:42.520 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T06:35:42.565 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T06:35:42.596 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T06:35:42.636 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T06:35:42.671 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T06:35:42.977 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:35:43.003 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:35:43.003 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:35:43.003 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T06:35:43.003 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:35:43.003 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:35:43.003 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:35:43.228 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:35:43.250 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:35:43.250 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:35:43.250 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T06:35:43.250 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:35:43.250 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:35:43.251 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:35:43.302 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:35:43.352 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:35:43.373 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:35:43.686 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:35:43.710 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:35:43.710 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:35:43.710 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T06:35:43.710 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:35:43.710 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:35:43.711 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:35:43.816 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T06:35:43.873 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T06:35:43.929 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T06:35:44.115 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T06:35:44.162 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T06:35:44.193 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T06:35:44.240 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T06:35:44.265 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T06:35:44.311 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T06:35:44.328 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T06:35:44.414 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T06:35:44.451 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T06:35:44.458 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T06:35:44.477 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T06:35:44.511 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T06:35:44.511 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:35:44.512 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T06:35:44.544 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T06:35:44.572 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T06:35:44.595 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:35:44.595 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:35:44.679 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:35:44.704 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T06:35:44.709 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:35:44.709 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:35:44.880 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:35:44.880 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:35:44.973 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:35:45.026 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:35:45.037 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:35:45.045 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:35:45.077 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T06:35:45.140 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T06:35:45.169 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:35:46.223 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:35:46.262 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:35:47.227 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:35:47.254 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:35:47.356 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:35:47.518 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T06:35:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:35:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:35:47.571 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:35:47.571 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T06:35:47.572 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:35:47.572 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:35:47.572 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:35:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:35:47.627 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:35:47.717 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T06:35:47.763 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T06:35:48.692 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T06:35:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:35:48.758 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:35:48.758 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:35:48.758 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T06:35:48.759 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:35:48.759 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:35:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:35:48.802 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:35:48.824 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:35:48.824 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:35:48.825 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T06:35:48.825 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:35:48.869 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:35:48.893 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:35:48.893 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:35:48.893 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T06:35:48.893 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:35:48.893 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:35:48.893 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:35:49.195 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:35:49.218 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:35:49.218 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:35:49.218 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T06:35:49.218 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:35:49.219 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:35:49.219 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:35:50.672 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:35:50.672 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T06:35:50.672 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T06:35:50.673 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T06:35:50.673 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T06:35:50.673 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T06:35:50.673 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T06:35:50.673 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T06:35:50.673 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:35:50.673 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:35:50.673 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:35:50.673 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T06:35:50.673 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T06:35:50.673 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:35:50.673 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T06:35:50.674 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T06:35:50.674 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T06:35:50.674 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T06:35:50.674 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T06:35:50.674 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T06:35:50.674 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T06:35:50.674 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T06:35:50.674 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T06:35:50.674 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T06:35:50.674 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T06:35:50.674 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T06:35:50.675 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T06:35:50.675 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T06:35:50.686 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T06:35:50.686 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T06:35:50.687 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T06:35:50.687 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T06:35:50.687 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T06:35:50.687 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T06:35:50.687 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T06:35:50.687 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T06:35:50.687 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T06:35:50.687 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T06:35:50.687 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T06:35:50.687 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T06:35:50.687 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T06:35:50.687 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T06:35:50.687 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T06:35:50.688 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T06:35:50.688 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T06:35:50.688 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T06:35:50.688 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T06:35:50.688 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T06:35:50.688 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T06:35:50.688 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T06:35:50.688 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T06:35:50.688 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T06:35:50.688 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T06:35:50.688 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T06:35:50.688 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T06:35:50.688 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T06:35:50.689 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T06:35:50.689 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T06:35:50.689 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T06:35:50.689 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T06:35:50.689 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T06:35:50.689 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T06:35:50.689 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T06:35:50.689 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T06:35:50.689 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T06:35:50.689 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T06:35:50.689 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T06:35:50.690 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T06:35:50.690 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T06:35:50.690 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T06:35:50.690 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T06:35:50.690 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T06:35:50.690 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T06:35:50.690 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T06:35:50.690 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T06:35:50.690 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T06:35:50.690 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T06:35:50.690 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T06:35:50.690 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T06:35:50.690 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T06:35:50.691 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T06:35:50.691 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T06:35:50.691 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T06:35:50.691 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T06:35:50.691 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T06:35:50.691 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T06:35:50.691 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T06:35:50.691 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T06:35:50.691 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T06:35:50.691 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T06:35:50.691 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T06:35:50.691 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T06:35:50.691 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T06:35:50.691 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T06:35:50.692 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T06:35:50.692 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T06:35:50.692 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T06:35:50.692 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T06:35:50.692 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T06:35:50.692 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T06:35:50.692 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T06:35:50.692 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T06:35:50.692 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T06:35:50.692 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T06:35:50.692 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T06:35:50.692 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T06:35:50.692 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T06:35:50.693 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T06:35:50.693 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T06:35:50.693 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T06:35:50.693 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T06:35:50.693 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T06:35:50.693 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T06:35:50.693 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T06:35:50.693 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T06:35:50.693 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T06:35:50.693 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T06:35:50.693 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T06:35:50.693 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T06:35:50.693 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T06:35:50.694 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T06:35:50.694 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T06:35:50.694 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T06:35:50.694 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T06:35:50.694 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T06:35:50.694 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T06:35:50.694 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T06:35:50.694 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T06:35:50.694 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T06:35:50.694 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T06:35:50.694 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T06:35:50.694 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T06:35:50.694 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T06:35:50.695 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T06:35:50.695 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T06:35:50.695 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T06:35:50.695 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T06:35:50.695 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T06:35:50.695 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T06:35:50.695 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T06:35:50.695 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T06:35:50.695 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T06:35:50.695 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T06:35:50.695 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T06:35:50.696 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T06:35:50.696 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T06:35:50.696 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T06:35:50.696 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T06:35:50.696 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T06:35:50.696 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T06:35:50.696 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T06:35:50.696 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T06:35:50.696 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T06:35:50.696 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T06:35:50.696 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T06:35:50.696 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T06:35:50.697 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T06:35:50.697 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T06:35:50.697 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T06:35:50.697 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T06:35:50.697 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T06:35:50.697 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T06:35:50.697 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T06:35:50.697 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T06:35:53.494 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:35:53.494 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:35:53.494 INFO:teuthology.orchestra.run.smithi086.stdout:Upgraded: 2024-09-19T06:35:53.494 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T06:35:53.494 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T06:35:53.494 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T06:35:53.494 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T06:35:53.494 INFO:teuthology.orchestra.run.smithi086.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.494 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.494 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T06:35:53.495 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T06:35:53.495 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-09-19T06:35:53.495 INFO:teuthology.orchestra.run.smithi086.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T06:35:53.495 INFO:teuthology.orchestra.run.smithi086.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T06:35:53.495 INFO:teuthology.orchestra.run.smithi086.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T06:35:53.495 INFO:teuthology.orchestra.run.smithi086.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T06:35:53.495 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.495 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.495 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.495 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.495 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:35:53.496 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.496 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.496 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.496 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:35:53.496 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:35:53.496 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:35:53.496 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:35:53.496 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:35:53.496 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.496 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.496 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:35:53.497 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.497 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.497 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.497 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:35:53.497 INFO:teuthology.orchestra.run.smithi086.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:35:53.497 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.497 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.497 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:35:53.497 INFO:teuthology.orchestra.run.smithi086.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T06:35:53.497 INFO:teuthology.orchestra.run.smithi086.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T06:35:53.497 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T06:35:53.497 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T06:35:53.497 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T06:35:53.498 INFO:teuthology.orchestra.run.smithi086.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T06:35:53.498 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T06:35:53.498 INFO:teuthology.orchestra.run.smithi086.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T06:35:53.498 INFO:teuthology.orchestra.run.smithi086.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T06:35:53.498 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T06:35:53.498 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T06:35:53.498 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.498 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.498 INFO:teuthology.orchestra.run.smithi086.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.498 INFO:teuthology.orchestra.run.smithi086.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T06:35:53.498 INFO:teuthology.orchestra.run.smithi086.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T06:35:53.498 INFO:teuthology.orchestra.run.smithi086.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T06:35:53.498 INFO:teuthology.orchestra.run.smithi086.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T06:35:53.499 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T06:35:53.499 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.499 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.499 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T06:35:53.499 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.499 INFO:teuthology.orchestra.run.smithi086.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T06:35:53.499 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T06:35:53.499 INFO:teuthology.orchestra.run.smithi086.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T06:35:53.499 INFO:teuthology.orchestra.run.smithi086.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T06:35:53.499 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T06:35:53.499 INFO:teuthology.orchestra.run.smithi086.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T06:35:53.499 INFO:teuthology.orchestra.run.smithi086.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T06:35:53.499 INFO:teuthology.orchestra.run.smithi086.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T06:35:53.500 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T06:35:53.500 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T06:35:53.500 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T06:35:53.500 INFO:teuthology.orchestra.run.smithi086.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T06:35:53.500 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T06:35:53.500 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T06:35:53.500 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T06:35:53.500 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T06:35:53.500 INFO:teuthology.orchestra.run.smithi086.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T06:35:53.500 INFO:teuthology.orchestra.run.smithi086.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T06:35:53.500 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T06:35:53.500 INFO:teuthology.orchestra.run.smithi086.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T06:35:53.500 INFO:teuthology.orchestra.run.smithi086.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T06:35:53.501 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T06:35:53.501 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T06:35:53.501 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.501 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.501 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.501 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T06:35:53.501 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T06:35:53.501 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T06:35:53.501 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T06:35:53.502 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T06:35:53.502 INFO:teuthology.orchestra.run.smithi086.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T06:35:53.502 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T06:35:53.502 INFO:teuthology.orchestra.run.smithi086.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T06:35:53.502 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T06:35:53.502 INFO:teuthology.orchestra.run.smithi086.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T06:35:53.502 INFO:teuthology.orchestra.run.smithi086.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T06:35:53.502 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T06:35:53.502 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T06:35:53.503 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T06:35:53.503 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T06:35:53.503 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T06:35:53.503 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T06:35:53.503 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T06:35:53.503 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T06:35:53.503 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T06:35:53.503 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T06:35:53.503 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T06:35:53.503 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T06:35:53.503 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T06:35:53.503 INFO:teuthology.orchestra.run.smithi086.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T06:35:53.504 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T06:35:53.504 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T06:35:53.504 INFO:teuthology.orchestra.run.smithi086.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T06:35:53.504 INFO:teuthology.orchestra.run.smithi086.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T06:35:53.504 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T06:35:53.504 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T06:35:53.504 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T06:35:53.504 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T06:35:53.504 INFO:teuthology.orchestra.run.smithi086.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T06:35:53.504 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T06:35:53.505 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T06:35:53.505 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T06:35:53.505 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T06:35:53.505 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T06:35:53.505 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T06:35:53.505 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.505 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.505 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T06:35:53.505 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T06:35:53.505 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T06:35:53.506 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.506 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T06:35:53.506 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T06:35:53.506 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T06:35:53.506 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T06:35:53.506 INFO:teuthology.orchestra.run.smithi086.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T06:35:53.506 INFO:teuthology.orchestra.run.smithi086.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T06:35:53.506 INFO:teuthology.orchestra.run.smithi086.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T06:35:53.506 INFO:teuthology.orchestra.run.smithi086.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T06:35:53.506 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T06:35:53.506 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T06:35:53.507 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T06:35:53.507 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T06:35:53.507 INFO:teuthology.orchestra.run.smithi086.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T06:35:53.507 INFO:teuthology.orchestra.run.smithi086.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T06:35:53.507 INFO:teuthology.orchestra.run.smithi086.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T06:35:53.507 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.507 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.507 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:35:53.507 INFO:teuthology.orchestra.run.smithi086.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T06:35:53.508 INFO:teuthology.orchestra.run.smithi086.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T06:35:53.508 INFO:teuthology.orchestra.run.smithi086.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T06:35:53.508 INFO:teuthology.orchestra.run.smithi086.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T06:35:53.508 INFO:teuthology.orchestra.run.smithi086.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T06:35:53.508 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T06:35:53.508 INFO:teuthology.orchestra.run.smithi086.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T06:35:53.508 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:35:53.509 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-19T06:35:53.774 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T06:35:53.815 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T06:35:53.856 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T06:35:53.880 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T06:35:53.907 DEBUG:teuthology.parallel:result is None 2024-09-19T06:35:53.907 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T06:35:54.092 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T06:35:54.145 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T06:35:54.175 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T06:35:54.205 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T06:35:54.243 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T06:35:54.818 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:35:54.857 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:35:54.877 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:35:55.722 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T06:35:55.820 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T06:35:55.861 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T06:35:55.942 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T06:35:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T06:35:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T06:35:56.033 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T06:35:56.033 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:35:56.117 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:35:56.117 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:35:56.201 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:35:56.226 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T06:35:56.231 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:35:56.231 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:35:56.411 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:35:56.411 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:35:56.495 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:35:56.558 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:36:02.264 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:36:02.264 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T06:36:02.264 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T06:36:02.264 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T06:36:02.264 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T06:36:02.265 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T06:36:02.265 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T06:36:02.265 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T06:36:02.265 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:36:02.265 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:36:02.265 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:36:02.265 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T06:36:02.265 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T06:36:02.265 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:36:02.265 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T06:36:02.265 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T06:36:02.265 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T06:36:02.266 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T06:36:02.266 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T06:36:02.266 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T06:36:02.266 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T06:36:02.266 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T06:36:02.266 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T06:36:02.266 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T06:36:02.266 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T06:36:02.266 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T06:36:02.266 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T06:36:02.266 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T06:36:02.266 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T06:36:02.266 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T06:36:02.266 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T06:36:02.283 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T06:36:02.283 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T06:36:02.283 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T06:36:02.283 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T06:36:02.283 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T06:36:02.283 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T06:36:02.283 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T06:36:02.283 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T06:36:02.284 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T06:36:02.284 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T06:36:02.284 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T06:36:02.284 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T06:36:02.284 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T06:36:02.284 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T06:36:02.284 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T06:36:02.284 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T06:36:02.284 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T06:36:02.284 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T06:36:02.285 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T06:36:02.285 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T06:36:02.285 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T06:36:02.285 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T06:36:02.285 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T06:36:02.285 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T06:36:02.285 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T06:36:02.285 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T06:36:02.285 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T06:36:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T06:36:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T06:36:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T06:36:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T06:36:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T06:36:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T06:36:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T06:36:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T06:36:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T06:36:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T06:36:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T06:36:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T06:36:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T06:36:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T06:36:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T06:36:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T06:36:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T06:36:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T06:36:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T06:36:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T06:36:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T06:36:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T06:36:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T06:36:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T06:36:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T06:36:02.288 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T06:36:02.288 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T06:36:02.288 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T06:36:02.288 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T06:36:02.288 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T06:36:02.288 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T06:36:02.288 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T06:36:02.288 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T06:36:02.288 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T06:36:02.288 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T06:36:02.288 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T06:36:02.288 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T06:36:02.289 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T06:36:02.289 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T06:36:02.289 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T06:36:02.289 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T06:36:02.289 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T06:36:02.289 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T06:36:02.289 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T06:36:02.289 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T06:36:02.289 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T06:36:02.289 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T06:36:02.289 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T06:36:02.289 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T06:36:02.289 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T06:36:02.290 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T06:36:02.290 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T06:36:02.290 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T06:36:02.290 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T06:36:02.290 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T06:36:02.290 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T06:36:02.290 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T06:36:02.290 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T06:36:02.290 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T06:36:02.290 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T06:36:02.290 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T06:36:02.290 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T06:36:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T06:36:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T06:36:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T06:36:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T06:36:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T06:36:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T06:36:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T06:36:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T06:36:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T06:36:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T06:36:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T06:36:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T06:36:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T06:36:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T06:36:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T06:36:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T06:36:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T06:36:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T06:36:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T06:36:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T06:36:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T06:36:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T06:36:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T06:36:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T06:36:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T06:36:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T06:36:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T06:36:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T06:36:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T06:36:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T06:36:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T06:36:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T06:36:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T06:36:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T06:36:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T06:36:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T06:36:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T06:36:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T06:36:02.294 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T06:36:02.294 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T06:36:02.294 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T06:36:02.294 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T06:36:02.294 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T06:36:02.294 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T06:36:04.811 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:36:04.811 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:04.811 INFO:teuthology.orchestra.run.smithi169.stdout:Upgraded: 2024-09-19T06:36:04.811 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T06:36:04.812 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T06:36:04.812 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T06:36:04.812 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T06:36:04.812 INFO:teuthology.orchestra.run.smithi169.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.812 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.812 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T06:36:04.812 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T06:36:04.812 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-09-19T06:36:04.812 INFO:teuthology.orchestra.run.smithi169.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T06:36:04.812 INFO:teuthology.orchestra.run.smithi169.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T06:36:04.812 INFO:teuthology.orchestra.run.smithi169.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T06:36:04.812 INFO:teuthology.orchestra.run.smithi169.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T06:36:04.813 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.813 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.813 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.813 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.813 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:04.813 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.813 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.813 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.813 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:04.813 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:04.813 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:04.814 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:04.814 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:04.814 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.814 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.814 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:04.814 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.814 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.814 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.814 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:04.814 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:04.814 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.814 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.815 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:04.815 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T06:36:04.815 INFO:teuthology.orchestra.run.smithi169.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T06:36:04.815 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T06:36:04.815 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T06:36:04.815 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T06:36:04.815 INFO:teuthology.orchestra.run.smithi169.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T06:36:04.815 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T06:36:04.815 INFO:teuthology.orchestra.run.smithi169.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T06:36:04.815 INFO:teuthology.orchestra.run.smithi169.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T06:36:04.815 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T06:36:04.815 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T06:36:04.815 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.816 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.816 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.816 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T06:36:04.816 INFO:teuthology.orchestra.run.smithi169.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T06:36:04.816 INFO:teuthology.orchestra.run.smithi169.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T06:36:04.816 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T06:36:04.816 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T06:36:04.816 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.816 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.816 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T06:36:04.816 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.816 INFO:teuthology.orchestra.run.smithi169.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T06:36:04.817 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T06:36:04.817 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T06:36:04.817 INFO:teuthology.orchestra.run.smithi169.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T06:36:04.817 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T06:36:04.817 INFO:teuthology.orchestra.run.smithi169.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T06:36:04.817 INFO:teuthology.orchestra.run.smithi169.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T06:36:04.817 INFO:teuthology.orchestra.run.smithi169.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T06:36:04.817 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T06:36:04.817 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T06:36:04.817 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T06:36:04.817 INFO:teuthology.orchestra.run.smithi169.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T06:36:04.817 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T06:36:04.817 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T06:36:04.818 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T06:36:04.818 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T06:36:04.818 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T06:36:04.818 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T06:36:04.818 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T06:36:04.818 INFO:teuthology.orchestra.run.smithi169.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T06:36:04.818 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T06:36:04.818 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T06:36:04.818 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T06:36:04.818 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.818 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.818 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.818 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T06:36:04.819 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T06:36:04.819 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T06:36:04.819 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T06:36:04.819 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T06:36:04.819 INFO:teuthology.orchestra.run.smithi169.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T06:36:04.819 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T06:36:04.819 INFO:teuthology.orchestra.run.smithi169.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T06:36:04.819 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T06:36:04.819 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T06:36:04.819 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T06:36:04.819 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T06:36:04.819 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T06:36:04.819 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T06:36:04.820 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T06:36:04.820 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T06:36:04.820 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T06:36:04.820 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T06:36:04.820 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T06:36:04.820 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T06:36:04.820 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T06:36:04.820 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T06:36:04.820 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T06:36:04.820 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T06:36:04.820 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T06:36:04.820 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T06:36:04.820 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T06:36:04.821 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T06:36:04.821 INFO:teuthology.orchestra.run.smithi169.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T06:36:04.821 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T06:36:04.821 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T06:36:04.821 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T06:36:04.821 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T06:36:04.821 INFO:teuthology.orchestra.run.smithi169.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T06:36:04.821 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T06:36:04.821 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T06:36:04.821 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T06:36:04.821 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T06:36:04.821 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T06:36:04.821 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T06:36:04.821 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.822 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.822 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T06:36:04.822 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T06:36:04.822 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T06:36:04.822 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.822 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T06:36:04.822 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T06:36:04.822 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T06:36:04.822 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T06:36:04.822 INFO:teuthology.orchestra.run.smithi169.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T06:36:04.822 INFO:teuthology.orchestra.run.smithi169.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T06:36:04.822 INFO:teuthology.orchestra.run.smithi169.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T06:36:04.822 INFO:teuthology.orchestra.run.smithi169.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T06:36:04.822 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T06:36:04.823 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T06:36:04.823 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T06:36:04.823 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T06:36:04.823 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T06:36:04.823 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T06:36:04.823 INFO:teuthology.orchestra.run.smithi169.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T06:36:04.823 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.823 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.823 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:04.823 INFO:teuthology.orchestra.run.smithi169.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T06:36:04.823 INFO:teuthology.orchestra.run.smithi169.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T06:36:04.823 INFO:teuthology.orchestra.run.smithi169.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T06:36:04.823 INFO:teuthology.orchestra.run.smithi169.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T06:36:04.824 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T06:36:04.824 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T06:36:04.824 INFO:teuthology.orchestra.run.smithi169.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T06:36:04.824 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:04.824 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-09-19T06:36:05.249 DEBUG:teuthology.parallel:result is None 2024-09-19T06:36:05.250 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:36:05.397 DEBUG:teuthology.orchestra.run.smithi086:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T06:36:05.424 INFO:teuthology.orchestra.run.smithi086.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T06:36:05.424 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T06:36:05.425 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T06:36:05.426 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:36:05.565 DEBUG:teuthology.orchestra.run.smithi169:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T06:36:05.588 INFO:teuthology.orchestra.run.smithi169.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T06:36:05.588 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T06:36:05.588 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T06:36:05.590 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T06:36:05.590 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:36:05.590 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T06:36:05.623 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T06:36:05.623 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T06:36:05.655 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T06:36:05.656 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:36:05.656 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T06:36:05.691 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T06:36:05.760 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T06:36:05.760 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T06:36:05.786 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T06:36:05.851 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T06:36:05.851 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:36:05.851 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T06:36:05.879 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T06:36:05.945 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T06:36:05.945 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T06:36:05.970 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T06:36:06.035 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T06:36:06.035 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:36:06.035 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T06:36:06.061 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T06:36:06.128 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T06:36:06.128 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T06:36:06.153 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T06:36:06.218 INFO:teuthology.run_tasks:Running task ceph... 2024-09-19T06:36:06.299 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-19T06:36:06.299 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 777 /var/log/ceph 2024-09-19T06:36:06.301 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 777 /var/log/ceph 2024-09-19T06:36:06.326 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-19T06:36:06.326 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-19T06:36:06.367 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-19T06:36:06.391 INFO:tasks.ceph:Creating extra log directories... 2024-09-19T06:36:06.391 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-19T06:36:06.432 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-19T06:36:06.463 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-19T06:36:06.463 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-19T06:36:06.463 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-19T06:36:06.464 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:36:06.464 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-19T06:36:06.510 DEBUG:teuthology.orchestra.run.smithi086:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-19T06:36:06.633 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-19T06:36:06.658 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T06:36:06.658 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-19T06:36:06.674 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-19T06:36:06.783 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-19T06:36:06.813 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-19T06:36:06.813 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Replacing daemon mds', 'SLOW_OPS', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-19T06:36:06.814 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911752', 'branch': 'squid', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/ffsb}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7911752', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Replacing daemon mds', 'SLOW_OPS', 'slow request'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '6fad5dd73c93545e52f57f681e140a9c3529c11e'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 1747, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'sleep_before_teardown': 0, 'subset': '176/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '6fad5dd73c93545e52f57f681e140a9c3529c11e', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi086.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJOLYdo7NY0j36lLoI5mUSLaCW14mKu3rtF7vMJLuwDXn5yxA3UUOZWAe8W0Co66RzSVB3mfX37QKNiH4Cd7oNM=', 'smithi169.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDvSN2nzKMsQVCPCxTDab3+ajujzwpUnZ3QE+nAucEfDfodhLym0wbLO+WMvJxdQKSkq00yIFJZ6yRiVlA2wI0E='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Replacing daemon mds', 'SLOW_OPS', 'slow request'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'mds_thrash': None}, {'workunit': {'clients': {'all': ['suites/ffsb.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-18_21:24:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-19T06:36:06.814 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-19T06:36:06.817 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-19T06:36:06.863 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/run/ceph 2024-09-19T06:36:06.872 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/run/ceph 2024-09-19T06:36:06.928 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:36:06.928 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T06:36:06.950 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T06:36:06.951 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_1 2024-09-19T06:36:07.006 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T06:36:07.006 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:36:07.006 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-19T06:36:07.006 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:36:07.007 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:36:07.007 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-19 06:35:45.394743406 +0000 2024-09-19T06:36:07.007 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-19 06:33:38.763798781 +0000 2024-09-19T06:36:07.007 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-19 06:33:38.763798781 +0000 2024-09-19T06:36:07.007 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-09-19 06:33:38.763798781 +0000 2024-09-19T06:36:07.007 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T06:36:07.069 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-19T06:36:07.069 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-19T06:36:07.069 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000191401 s, 2.7 MB/s 2024-09-19T06:36:07.070 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T06:36:07.126 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_2 2024-09-19T06:36:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T06:36:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:36:07.181 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-19T06:36:07.182 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:36:07.182 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:36:07.182 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-19 06:35:45.395743385 +0000 2024-09-19T06:36:07.182 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-19 06:33:39.079791855 +0000 2024-09-19T06:36:07.182 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-19 06:33:39.079791855 +0000 2024-09-19T06:36:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-09-19 06:33:39.079791855 +0000 2024-09-19T06:36:07.182 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T06:36:07.244 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-19T06:36:07.244 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-19T06:36:07.244 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000165523 s, 3.1 MB/s 2024-09-19T06:36:07.245 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T06:36:07.301 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_3 2024-09-19T06:36:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T06:36:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:36:07.357 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-19T06:36:07.357 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:36:07.357 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:36:07.357 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-19 06:35:45.395743385 +0000 2024-09-19T06:36:07.357 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-19 06:33:39.402784775 +0000 2024-09-19T06:36:07.357 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-19 06:33:39.402784775 +0000 2024-09-19T06:36:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-09-19 06:33:39.402784775 +0000 2024-09-19T06:36:07.358 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T06:36:07.421 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-19T06:36:07.421 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-19T06:36:07.421 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000167048 s, 3.1 MB/s 2024-09-19T06:36:07.422 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T06:36:07.479 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_4 2024-09-19T06:36:07.535 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T06:36:07.535 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:36:07.535 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-19T06:36:07.535 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:36:07.536 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:36:07.536 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-19 06:35:45.396743363 +0000 2024-09-19T06:36:07.536 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-19 06:33:39.736777455 +0000 2024-09-19T06:36:07.536 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-19 06:33:39.736777455 +0000 2024-09-19T06:36:07.536 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-09-19 06:33:39.736777455 +0000 2024-09-19T06:36:07.537 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T06:36:07.598 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-19T06:36:07.598 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-19T06:36:07.599 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000185884 s, 2.8 MB/s 2024-09-19T06:36:07.601 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T06:36:07.656 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T06:36:07.657 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T06:36:07.657 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T06:36:07.674 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T06:36:07.675 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_1 2024-09-19T06:36:07.730 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T06:36:07.731 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:36:07.731 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-19T06:36:07.731 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:36:07.731 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:36:07.731 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-19 06:35:56.903210840 +0000 2024-09-19T06:36:07.731 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-19 06:33:57.414688343 +0000 2024-09-19T06:36:07.731 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-19 06:33:57.414688343 +0000 2024-09-19T06:36:07.731 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-19 06:33:57.414688343 +0000 2024-09-19T06:36:07.731 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T06:36:07.794 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-19T06:36:07.795 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-19T06:36:07.795 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000262707 s, 1.9 MB/s 2024-09-19T06:36:07.796 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T06:36:07.853 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_2 2024-09-19T06:36:07.908 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T06:36:07.909 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:36:07.909 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-19T06:36:07.909 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:36:07.909 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:36:07.909 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-19 06:35:56.903210840 +0000 2024-09-19T06:36:07.909 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-19 06:33:57.745680932 +0000 2024-09-19T06:36:07.909 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-19 06:33:57.745680932 +0000 2024-09-19T06:36:07.909 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-19 06:33:57.745680932 +0000 2024-09-19T06:36:07.909 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T06:36:07.972 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-19T06:36:07.972 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-19T06:36:07.972 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000295056 s, 1.7 MB/s 2024-09-19T06:36:07.974 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T06:36:08.030 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_3 2024-09-19T06:36:08.086 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T06:36:08.086 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:36:08.086 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T06:36:08.087 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:36:08.087 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:36:08.087 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-19 06:35:56.903210840 +0000 2024-09-19T06:36:08.087 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-19 06:33:58.071673634 +0000 2024-09-19T06:36:08.087 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-19 06:33:58.071673634 +0000 2024-09-19T06:36:08.087 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-19 06:33:58.071673634 +0000 2024-09-19T06:36:08.087 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T06:36:08.149 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-19T06:36:08.149 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-19T06:36:08.149 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000168081 s, 3.0 MB/s 2024-09-19T06:36:08.150 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T06:36:08.207 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_4 2024-09-19T06:36:08.264 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T06:36:08.264 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:36:08.265 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-09-19T06:36:08.265 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:36:08.265 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:36:08.265 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-19 06:35:56.904210818 +0000 2024-09-19T06:36:08.265 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-19 06:33:58.393666425 +0000 2024-09-19T06:36:08.265 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-19 06:33:58.393666425 +0000 2024-09-19T06:36:08.265 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-19 06:33:58.393666425 +0000 2024-09-19T06:36:08.265 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T06:36:08.328 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-19T06:36:08.328 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-19T06:36:08.328 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000205253 s, 2.5 MB/s 2024-09-19T06:36:08.329 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T06:36:08.386 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T06:36:08.386 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi086.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-19T06:36:08.387 INFO:tasks.ceph:Generating config... 2024-09-19T06:36:08.388 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-19T06:36:08.388 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-09-19T06:36:08.388 INFO:tasks.ceph:[client] debug client = 20 2024-09-19T06:36:08.388 INFO:tasks.ceph:[client] debug ms = 1 2024-09-19T06:36:08.388 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-19T06:36:08.388 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-19T06:36:08.388 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-19T06:36:08.388 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-19T06:36:08.389 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-19T06:36:08.389 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-19T06:36:08.389 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-09-19T06:36:08.389 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-09-19T06:36:08.389 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-09-19T06:36:08.389 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-09-19T06:36:08.389 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-19T06:36:08.389 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-19T06:36:08.389 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-09-19T06:36:08.389 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-19T06:36:08.389 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-19T06:36:08.389 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-09-19T06:36:08.389 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-09-19T06:36:08.390 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-09-19T06:36:08.390 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-09-19T06:36:08.390 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-09-19T06:36:08.390 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-09-19T06:36:08.390 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-09-19T06:36:08.390 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-19T06:36:08.390 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-19T06:36:08.390 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-19T06:36:08.390 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-19T06:36:08.390 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-19T06:36:08.390 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-19T06:36:08.390 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-19T06:36:08.390 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-19T06:36:08.390 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-19T06:36:08.391 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-19T06:36:08.391 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-19T06:36:08.391 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-19T06:36:08.391 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-19T06:36:08.391 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-19T06:36:08.391 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-19T06:36:08.391 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-19T06:36:08.391 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-19T06:36:08.391 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-19T06:36:08.391 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-19T06:36:08.391 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-19T06:36:08.391 INFO:tasks.ceph:[osd] filestore flush min = 0 2024-09-19T06:36:08.391 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-09-19T06:36:08.392 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-19T06:36:08.392 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-19T06:36:08.392 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-19T06:36:08.392 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-09-19T06:36:08.392 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-09-19T06:36:08.392 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-09-19T06:36:08.392 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-09-19T06:36:08.392 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-19T06:36:08.392 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-19T06:36:08.392 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-19T06:36:08.392 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-19T06:36:08.392 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-19T06:36:08.393 INFO:tasks.ceph:Setting up mon.a... 2024-09-19T06:36:08.393 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-19T06:36:08.449 INFO:teuthology.orchestra.run.smithi086.stdout:creating /etc/ceph/ceph.keyring 2024-09-19T06:36:08.452 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-19T06:36:08.508 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T06:36:08.576 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.86'), ('mon.b', '172.21.15.169'), ('mon.c', '[v2:172.21.15.169:3301,v1:172.21.15.169:6790]')] 2024-09-19T06:36:08.576 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.86,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-19T06:36:08.577 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:36:08.577 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-19T06:36:08.633 DEBUG:teuthology.orchestra.run.smithi086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.86 --add b 172.21.15.169 --addv c '[v2:172.21.15.169:3301,v1:172.21.15.169:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-19T06:36:08.720 INFO:teuthology.orchestra.run.smithi086.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-19T06:36:08.720 INFO:teuthology.orchestra.run.smithi086.stdout:monmaptool: generated fsid 1785f09f-0959-457d-8c4a-6cce2e655a37 2024-09-19T06:36:08.720 INFO:teuthology.orchestra.run.smithi086.stdout:setting min_mon_release = quincy 2024-09-19T06:36:08.720 INFO:teuthology.orchestra.run.smithi086.stdout:epoch 0 2024-09-19T06:36:08.720 INFO:teuthology.orchestra.run.smithi086.stdout:fsid 1785f09f-0959-457d-8c4a-6cce2e655a37 2024-09-19T06:36:08.720 INFO:teuthology.orchestra.run.smithi086.stdout:last_changed 2024-09-19T06:36:08.719592+0000 2024-09-19T06:36:08.720 INFO:teuthology.orchestra.run.smithi086.stdout:created 2024-09-19T06:36:08.719592+0000 2024-09-19T06:36:08.720 INFO:teuthology.orchestra.run.smithi086.stdout:min_mon_release 17 (quincy) 2024-09-19T06:36:08.721 INFO:teuthology.orchestra.run.smithi086.stdout:election_strategy: 1 2024-09-19T06:36:08.721 INFO:teuthology.orchestra.run.smithi086.stdout:0: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.a 2024-09-19T06:36:08.721 INFO:teuthology.orchestra.run.smithi086.stdout:1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.b 2024-09-19T06:36:08.721 INFO:teuthology.orchestra.run.smithi086.stdout:2: [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] mon.c 2024-09-19T06:36:08.721 INFO:teuthology.orchestra.run.smithi086.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-19T06:36:08.722 DEBUG:teuthology.orchestra.run.smithi086:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-19T06:36:08.737 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1785f09f-0959-457d-8c4a-6cce2e655a37... 2024-09-19T06:36:08.738 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-19T06:36:08.780 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-19T06:36:08.820 INFO:teuthology.orchestra.run.smithi086.stdout:[global] 2024-09-19T06:36:08.820 INFO:teuthology.orchestra.run.smithi086.stdout: chdir = "" 2024-09-19T06:36:08.820 INFO:teuthology.orchestra.run.smithi086.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-19T06:36:08.820 INFO:teuthology.orchestra.run.smithi086.stdout: auth supported = cephx 2024-09-19T06:36:08.820 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.821 INFO:teuthology.orchestra.run.smithi086.stdout: filestore xattr use omap = true 2024-09-19T06:36:08.821 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.821 INFO:teuthology.orchestra.run.smithi086.stdout: mon clock drift allowed = 1.000 2024-09-19T06:36:08.821 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.821 INFO:teuthology.orchestra.run.smithi086.stdout: osd crush chooseleaf type = 0 2024-09-19T06:36:08.821 INFO:teuthology.orchestra.run.smithi086.stdout: auth debug = true 2024-09-19T06:36:08.821 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.821 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on old message = true 2024-09-19T06:36:08.821 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on bug = true 2024-09-19T06:36:08.821 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.821 INFO:teuthology.orchestra.run.smithi086.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-19T06:36:08.821 INFO:teuthology.orchestra.run.smithi086.stdout: mon pg warn max object skew = 0 2024-09-19T06:36:08.821 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.821 INFO:teuthology.orchestra.run.smithi086.stdout: # disable pg_autoscaler by default for new pools 2024-09-19T06:36:08.822 INFO:teuthology.orchestra.run.smithi086.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-19T06:36:08.822 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.822 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default size = 2 2024-09-19T06:36:08.822 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.824 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow primary affinity = true 2024-09-19T06:36:08.824 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow pg remap = true 2024-09-19T06:36:08.824 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on legacy crush tunables = false 2024-09-19T06:36:08.824 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on crush straw calc version zero = false 2024-09-19T06:36:08.825 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on no sortbitwise = false 2024-09-19T06:36:08.825 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on osd down out interval zero = false 2024-09-19T06:36:08.825 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on too few osds = false 2024-09-19T06:36:08.825 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-19T06:36:08.825 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-19T06:36:08.825 INFO:teuthology.orchestra.run.smithi086.stdout: mon_allow_pool_size_one = true 2024-09-19T06:36:08.825 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.825 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-19T06:36:08.825 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.825 INFO:teuthology.orchestra.run.smithi086.stdout: osd default data pool replay window = 5 2024-09-19T06:36:08.825 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.826 INFO:teuthology.orchestra.run.smithi086.stdout: mon allow pool delete = true 2024-09-19T06:36:08.826 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.826 INFO:teuthology.orchestra.run.smithi086.stdout: mon cluster log file level = debug 2024-09-19T06:36:08.826 INFO:teuthology.orchestra.run.smithi086.stdout: debug asserts on shutdown = true 2024-09-19T06:36:08.826 INFO:teuthology.orchestra.run.smithi086.stdout: mon health detail to clog = false 2024-09-19T06:36:08.826 INFO:teuthology.orchestra.run.smithi086.stdout: mon host = "172.21.15.86,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2024-09-19T06:36:08.826 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on skipped message = False 2024-09-19T06:36:08.826 INFO:teuthology.orchestra.run.smithi086.stdout: fsid = 1785f09f-0959-457d-8c4a-6cce2e655a37 2024-09-19T06:36:08.826 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.826 INFO:teuthology.orchestra.run.smithi086.stdout:[osd] 2024-09-19T06:36:08.826 INFO:teuthology.orchestra.run.smithi086.stdout: osd journal size = 100 2024-09-19T06:36:08.826 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.826 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub load threshold = 5.0 2024-09-19T06:36:08.827 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub max interval = 600 2024-09-19T06:36:08.827 INFO:teuthology.orchestra.run.smithi086.stdout: osd mclock profile = high_recovery_ops 2024-09-19T06:36:08.827 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.827 INFO:teuthology.orchestra.run.smithi086.stdout: osd recover clone overlap = true 2024-09-19T06:36:08.827 INFO:teuthology.orchestra.run.smithi086.stdout: osd recovery max chunk = 1048576 2024-09-19T06:36:08.827 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.827 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug shutdown = true 2024-09-19T06:36:08.827 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug op order = true 2024-09-19T06:36:08.827 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug verify stray on activate = true 2024-09-19T06:36:08.827 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug trim objects = true 2024-09-19T06:36:08.827 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.827 INFO:teuthology.orchestra.run.smithi086.stdout: osd open classes on start = true 2024-09-19T06:36:08.827 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug pg log writeout = true 2024-09-19T06:36:08.827 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.828 INFO:teuthology.orchestra.run.smithi086.stdout: osd deep scrub update digest min age = 30 2024-09-19T06:36:08.828 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.828 INFO:teuthology.orchestra.run.smithi086.stdout: osd map max advance = 10 2024-09-19T06:36:08.828 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.828 INFO:teuthology.orchestra.run.smithi086.stdout: journal zero on create = true 2024-09-19T06:36:08.828 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.828 INFO:teuthology.orchestra.run.smithi086.stdout: filestore ondisk finisher threads = 3 2024-09-19T06:36:08.828 INFO:teuthology.orchestra.run.smithi086.stdout: filestore apply finisher threads = 3 2024-09-19T06:36:08.828 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.828 INFO:teuthology.orchestra.run.smithi086.stdout: bdev debug aio = true 2024-09-19T06:36:08.828 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug misdirected ops = true 2024-09-19T06:36:08.828 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore block size = 96636764160 2024-09-19T06:36:08.829 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore compression mode = aggressive 2024-09-19T06:36:08.829 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore fsck on mount = True 2024-09-19T06:36:08.829 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluefs = 20 2024-09-19T06:36:08.829 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluestore = 20 2024-09-19T06:36:08.829 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-19T06:36:08.829 INFO:teuthology.orchestra.run.smithi086.stdout: debug osd = 20 2024-09-19T06:36:08.829 INFO:teuthology.orchestra.run.smithi086.stdout: debug rocksdb = 10 2024-09-19T06:36:08.829 INFO:teuthology.orchestra.run.smithi086.stdout: filestore flush min = 0 2024-09-19T06:36:08.829 INFO:teuthology.orchestra.run.smithi086.stdout: mon client directed command retry = 5 2024-09-19T06:36:08.830 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd backfillfull_ratio = 0.85 2024-09-19T06:36:08.830 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd full ratio = 0.9 2024-09-19T06:36:08.830 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd nearfull ratio = 0.8 2024-09-19T06:36:08.830 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject delay max = 1 2024-09-19T06:36:08.830 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject delay probability = 0.005 2024-09-19T06:36:08.830 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject delay type = client mds 2024-09-19T06:36:08.830 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject socket failures = 2500 2024-09-19T06:36:08.830 INFO:teuthology.orchestra.run.smithi086.stdout: osd blocked scrub grace period = 3600 2024-09-19T06:36:08.830 INFO:teuthology.orchestra.run.smithi086.stdout: osd failsafe full ratio = 0.95 2024-09-19T06:36:08.830 INFO:teuthology.orchestra.run.smithi086.stdout: osd max markdown count = 1000 2024-09-19T06:36:08.830 INFO:teuthology.orchestra.run.smithi086.stdout: osd objectstore = bluestore 2024-09-19T06:36:08.830 INFO:teuthology.orchestra.run.smithi086.stdout: osd op complaint time = 180 2024-09-19T06:36:08.830 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.830 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr] 2024-09-19T06:36:08.831 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-19T06:36:08.831 INFO:teuthology.orchestra.run.smithi086.stdout: debug mgr = 20 2024-09-19T06:36:08.831 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2024-09-19T06:36:08.831 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2024-09-19T06:36:08.831 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2024-09-19T06:36:08.831 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2024-09-19T06:36:08.831 INFO:teuthology.orchestra.run.smithi086.stdout: mgr/telemetry/nag = false 2024-09-19T06:36:08.831 INFO:teuthology.orchestra.run.smithi086.stdout: debug client = 20 2024-09-19T06:36:08.831 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.831 INFO:teuthology.orchestra.run.smithi086.stdout:[mon] 2024-09-19T06:36:08.831 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-19T06:36:08.831 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2024-09-19T06:36:08.831 INFO:teuthology.orchestra.run.smithi086.stdout: debug paxos = 20 2024-09-19T06:36:08.831 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2024-09-19T06:36:08.832 INFO:teuthology.orchestra.run.smithi086.stdout: mon data avail warn = 5 2024-09-19T06:36:08.832 INFO:teuthology.orchestra.run.smithi086.stdout: mon mgr mkfs grace = 240 2024-09-19T06:36:08.832 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2024-09-19T06:36:08.832 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd reporter subtree level = osd 2024-09-19T06:36:08.832 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd prime pg temp = true 2024-09-19T06:36:08.832 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2024-09-19T06:36:08.832 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.832 INFO:teuthology.orchestra.run.smithi086.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-19T06:36:08.832 INFO:teuthology.orchestra.run.smithi086.stdout: auth mon ticket ttl = 660 # 11m 2024-09-19T06:36:08.832 INFO:teuthology.orchestra.run.smithi086.stdout: auth service ticket ttl = 240 # 4m 2024-09-19T06:36:08.832 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.832 INFO:teuthology.orchestra.run.smithi086.stdout: # don't complain about insecure global_id in the test suite 2024-09-19T06:36:08.832 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-19T06:36:08.833 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-19T06:36:08.833 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.833 INFO:teuthology.orchestra.run.smithi086.stdout: # 1m isn't quite enough 2024-09-19T06:36:08.833 INFO:teuthology.orchestra.run.smithi086.stdout: mon_down_mkfs_grace = 2m 2024-09-19T06:36:08.833 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.833 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_filestore_osds = false 2024-09-19T06:36:08.833 INFO:teuthology.orchestra.run.smithi086.stdout: mon down mkfs grace = 300 2024-09-19T06:36:08.833 INFO:teuthology.orchestra.run.smithi086.stdout: mon op complaint time = 120 2024-09-19T06:36:08.833 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on pool no app = False 2024-09-19T06:36:08.833 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:08.833 INFO:teuthology.orchestra.run.smithi086.stdout:[client] 2024-09-19T06:36:08.833 INFO:teuthology.orchestra.run.smithi086.stdout: rgw cache enabled = true 2024-09-19T06:36:08.833 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable ops log = true 2024-09-19T06:36:08.833 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable usage log = true 2024-09-19T06:36:08.834 INFO:teuthology.orchestra.run.smithi086.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-19T06:36:08.834 INFO:teuthology.orchestra.run.smithi086.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-19T06:36:08.834 INFO:teuthology.orchestra.run.smithi086.stdout: client mount timeout = 600 2024-09-19T06:36:08.834 INFO:teuthology.orchestra.run.smithi086.stdout: client_shutdown_timeout = 120 2024-09-19T06:36:08.834 INFO:teuthology.orchestra.run.smithi086.stdout: debug client = 20 2024-09-19T06:36:08.834 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-19T06:36:08.834 INFO:teuthology.orchestra.run.smithi086.stdout: rados mon op timeout = 900 2024-09-19T06:36:08.834 INFO:teuthology.orchestra.run.smithi086.stdout: rados osd op timeout = 900 2024-09-19T06:36:08.834 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.a] 2024-09-19T06:36:08.834 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.b] 2024-09-19T06:36:08.834 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.c] 2024-09-19T06:36:08.834 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.a] 2024-09-19T06:36:08.834 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.c] 2024-09-19T06:36:08.834 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.e] 2024-09-19T06:36:08.835 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.b] 2024-09-19T06:36:08.835 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.d] 2024-09-19T06:36:08.835 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.f] 2024-09-19T06:36:08.835 INFO:teuthology.orchestra.run.smithi086.stdout:[mds] 2024-09-19T06:36:08.835 INFO:teuthology.orchestra.run.smithi086.stdout: debug mds = 20 2024-09-19T06:36:08.835 INFO:teuthology.orchestra.run.smithi086.stdout: debug mds balancer = 20 2024-09-19T06:36:08.835 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-19T06:36:08.835 INFO:teuthology.orchestra.run.smithi086.stdout: mds bal fragment size max = 10000 2024-09-19T06:36:08.835 INFO:teuthology.orchestra.run.smithi086.stdout: mds bal merge size = 5 2024-09-19T06:36:08.835 INFO:teuthology.orchestra.run.smithi086.stdout: mds bal split bits = 3 2024-09-19T06:36:08.835 INFO:teuthology.orchestra.run.smithi086.stdout: mds bal split size = 100 2024-09-19T06:36:08.835 INFO:teuthology.orchestra.run.smithi086.stdout: mds debug frag = True 2024-09-19T06:36:08.835 INFO:teuthology.orchestra.run.smithi086.stdout: mds debug scatterstat = True 2024-09-19T06:36:08.835 INFO:teuthology.orchestra.run.smithi086.stdout: mds oft prefetch dirfrags = True 2024-09-19T06:36:08.836 INFO:teuthology.orchestra.run.smithi086.stdout: mds op complaint time = 180 2024-09-19T06:36:08.836 INFO:teuthology.orchestra.run.smithi086.stdout: mds verify scatter = True 2024-09-19T06:36:08.836 INFO:teuthology.orchestra.run.smithi086.stdout: mds_dir_prefetch = True 2024-09-19T06:36:08.836 INFO:teuthology.orchestra.run.smithi086.stdout: mds_sleep_rank_change = 5000000.0 2024-09-19T06:36:08.836 INFO:teuthology.orchestra.run.smithi086.stdout: mon client directed command retry = 5 2024-09-19T06:36:08.836 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject delay max = 1 2024-09-19T06:36:08.836 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject delay probability = 0.005 2024-09-19T06:36:08.836 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject delay type = client mds osd 2024-09-19T06:36:08.836 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject socket failures = 2500 2024-09-19T06:36:08.836 INFO:teuthology.orchestra.run.smithi086.stdout: osd op complaint time = 180 2024-09-19T06:36:08.837 INFO:teuthology.orchestra.run.smithi086.stdout: rados mon op timeout = 900 2024-09-19T06:36:08.837 INFO:teuthology.orchestra.run.smithi086.stdout: rados osd op timeout = 900 2024-09-19T06:36:08.838 INFO:teuthology.orchestra.run.smithi169.stdout:[global] 2024-09-19T06:36:08.838 INFO:teuthology.orchestra.run.smithi169.stdout: chdir = "" 2024-09-19T06:36:08.838 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-19T06:36:08.839 INFO:teuthology.orchestra.run.smithi169.stdout: auth supported = cephx 2024-09-19T06:36:08.839 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.839 INFO:teuthology.orchestra.run.smithi169.stdout: filestore xattr use omap = true 2024-09-19T06:36:08.839 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.839 INFO:teuthology.orchestra.run.smithi169.stdout: mon clock drift allowed = 1.000 2024-09-19T06:36:08.839 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.839 INFO:teuthology.orchestra.run.smithi169.stdout: osd crush chooseleaf type = 0 2024-09-19T06:36:08.839 INFO:teuthology.orchestra.run.smithi169.stdout: auth debug = true 2024-09-19T06:36:08.839 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.839 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on old message = true 2024-09-19T06:36:08.840 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on bug = true 2024-09-19T06:36:08.840 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.840 INFO:teuthology.orchestra.run.smithi169.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-19T06:36:08.840 INFO:teuthology.orchestra.run.smithi169.stdout: mon pg warn max object skew = 0 2024-09-19T06:36:08.840 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.840 INFO:teuthology.orchestra.run.smithi169.stdout: # disable pg_autoscaler by default for new pools 2024-09-19T06:36:08.840 INFO:teuthology.orchestra.run.smithi169.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-19T06:36:08.841 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.841 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default size = 2 2024-09-19T06:36:08.841 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.841 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow primary affinity = true 2024-09-19T06:36:08.841 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow pg remap = true 2024-09-19T06:36:08.841 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on legacy crush tunables = false 2024-09-19T06:36:08.841 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on crush straw calc version zero = false 2024-09-19T06:36:08.841 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on no sortbitwise = false 2024-09-19T06:36:08.841 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on osd down out interval zero = false 2024-09-19T06:36:08.841 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on too few osds = false 2024-09-19T06:36:08.841 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-19T06:36:08.841 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-19T06:36:08.842 INFO:teuthology.orchestra.run.smithi169.stdout: mon_allow_pool_size_one = true 2024-09-19T06:36:08.842 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.842 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-19T06:36:08.842 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.842 INFO:teuthology.orchestra.run.smithi169.stdout: osd default data pool replay window = 5 2024-09-19T06:36:08.842 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.843 INFO:teuthology.orchestra.run.smithi169.stdout: mon allow pool delete = true 2024-09-19T06:36:08.843 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.843 INFO:teuthology.orchestra.run.smithi169.stdout: mon cluster log file level = debug 2024-09-19T06:36:08.843 INFO:teuthology.orchestra.run.smithi169.stdout: debug asserts on shutdown = true 2024-09-19T06:36:08.843 INFO:teuthology.orchestra.run.smithi169.stdout: mon health detail to clog = false 2024-09-19T06:36:08.843 INFO:teuthology.orchestra.run.smithi169.stdout: mon host = "172.21.15.86,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2024-09-19T06:36:08.843 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on skipped message = False 2024-09-19T06:36:08.843 INFO:teuthology.orchestra.run.smithi169.stdout: fsid = 1785f09f-0959-457d-8c4a-6cce2e655a37 2024-09-19T06:36:08.843 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.843 INFO:teuthology.orchestra.run.smithi169.stdout:[osd] 2024-09-19T06:36:08.843 INFO:teuthology.orchestra.run.smithi169.stdout: osd journal size = 100 2024-09-19T06:36:08.843 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.843 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub load threshold = 5.0 2024-09-19T06:36:08.844 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub max interval = 600 2024-09-19T06:36:08.844 INFO:teuthology.orchestra.run.smithi169.stdout: osd mclock profile = high_recovery_ops 2024-09-19T06:36:08.844 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.844 INFO:teuthology.orchestra.run.smithi169.stdout: osd recover clone overlap = true 2024-09-19T06:36:08.844 INFO:teuthology.orchestra.run.smithi169.stdout: osd recovery max chunk = 1048576 2024-09-19T06:36:08.844 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.844 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug shutdown = true 2024-09-19T06:36:08.844 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug op order = true 2024-09-19T06:36:08.844 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug verify stray on activate = true 2024-09-19T06:36:08.844 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug trim objects = true 2024-09-19T06:36:08.844 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.844 INFO:teuthology.orchestra.run.smithi169.stdout: osd open classes on start = true 2024-09-19T06:36:08.844 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug pg log writeout = true 2024-09-19T06:36:08.845 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.845 INFO:teuthology.orchestra.run.smithi169.stdout: osd deep scrub update digest min age = 30 2024-09-19T06:36:08.845 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.845 INFO:teuthology.orchestra.run.smithi169.stdout: osd map max advance = 10 2024-09-19T06:36:08.845 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.845 INFO:teuthology.orchestra.run.smithi169.stdout: journal zero on create = true 2024-09-19T06:36:08.845 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.845 INFO:teuthology.orchestra.run.smithi169.stdout: filestore ondisk finisher threads = 3 2024-09-19T06:36:08.845 INFO:teuthology.orchestra.run.smithi169.stdout: filestore apply finisher threads = 3 2024-09-19T06:36:08.845 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.845 INFO:teuthology.orchestra.run.smithi169.stdout: bdev debug aio = true 2024-09-19T06:36:08.845 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug misdirected ops = true 2024-09-19T06:36:08.845 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore block size = 96636764160 2024-09-19T06:36:08.846 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore compression mode = aggressive 2024-09-19T06:36:08.846 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore fsck on mount = True 2024-09-19T06:36:08.846 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluefs = 20 2024-09-19T06:36:08.846 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluestore = 20 2024-09-19T06:36:08.846 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-19T06:36:08.846 INFO:teuthology.orchestra.run.smithi169.stdout: debug osd = 20 2024-09-19T06:36:08.846 INFO:teuthology.orchestra.run.smithi169.stdout: debug rocksdb = 10 2024-09-19T06:36:08.846 INFO:teuthology.orchestra.run.smithi169.stdout: filestore flush min = 0 2024-09-19T06:36:08.846 INFO:teuthology.orchestra.run.smithi169.stdout: mon client directed command retry = 5 2024-09-19T06:36:08.846 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd backfillfull_ratio = 0.85 2024-09-19T06:36:08.846 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd full ratio = 0.9 2024-09-19T06:36:08.846 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd nearfull ratio = 0.8 2024-09-19T06:36:08.846 INFO:teuthology.orchestra.run.smithi169.stdout: ms inject delay max = 1 2024-09-19T06:36:08.847 INFO:teuthology.orchestra.run.smithi169.stdout: ms inject delay probability = 0.005 2024-09-19T06:36:08.847 INFO:teuthology.orchestra.run.smithi169.stdout: ms inject delay type = client mds 2024-09-19T06:36:08.847 INFO:teuthology.orchestra.run.smithi169.stdout: ms inject socket failures = 2500 2024-09-19T06:36:08.847 INFO:teuthology.orchestra.run.smithi169.stdout: osd blocked scrub grace period = 3600 2024-09-19T06:36:08.847 INFO:teuthology.orchestra.run.smithi169.stdout: osd failsafe full ratio = 0.95 2024-09-19T06:36:08.847 INFO:teuthology.orchestra.run.smithi169.stdout: osd max markdown count = 1000 2024-09-19T06:36:08.847 INFO:teuthology.orchestra.run.smithi169.stdout: osd objectstore = bluestore 2024-09-19T06:36:08.847 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2024-09-19T06:36:08.847 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.847 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr] 2024-09-19T06:36:08.847 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-19T06:36:08.847 INFO:teuthology.orchestra.run.smithi169.stdout: debug mgr = 20 2024-09-19T06:36:08.847 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-09-19T06:36:08.847 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-09-19T06:36:08.848 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-09-19T06:36:08.848 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-09-19T06:36:08.848 INFO:teuthology.orchestra.run.smithi169.stdout: mgr/telemetry/nag = false 2024-09-19T06:36:08.848 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2024-09-19T06:36:08.848 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.848 INFO:teuthology.orchestra.run.smithi169.stdout:[mon] 2024-09-19T06:36:08.848 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-19T06:36:08.848 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-09-19T06:36:08.848 INFO:teuthology.orchestra.run.smithi169.stdout: debug paxos = 20 2024-09-19T06:36:08.848 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-09-19T06:36:08.848 INFO:teuthology.orchestra.run.smithi169.stdout: mon data avail warn = 5 2024-09-19T06:36:08.848 INFO:teuthology.orchestra.run.smithi169.stdout: mon mgr mkfs grace = 240 2024-09-19T06:36:08.849 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-09-19T06:36:08.849 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd reporter subtree level = osd 2024-09-19T06:36:08.849 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd prime pg temp = true 2024-09-19T06:36:08.849 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-09-19T06:36:08.849 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.849 INFO:teuthology.orchestra.run.smithi169.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-19T06:36:08.849 INFO:teuthology.orchestra.run.smithi169.stdout: auth mon ticket ttl = 660 # 11m 2024-09-19T06:36:08.849 INFO:teuthology.orchestra.run.smithi169.stdout: auth service ticket ttl = 240 # 4m 2024-09-19T06:36:08.849 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.849 INFO:teuthology.orchestra.run.smithi169.stdout: # don't complain about insecure global_id in the test suite 2024-09-19T06:36:08.849 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-19T06:36:08.849 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-19T06:36:08.849 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.849 INFO:teuthology.orchestra.run.smithi169.stdout: # 1m isn't quite enough 2024-09-19T06:36:08.850 INFO:teuthology.orchestra.run.smithi169.stdout: mon_down_mkfs_grace = 2m 2024-09-19T06:36:08.850 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.850 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_filestore_osds = false 2024-09-19T06:36:08.850 INFO:teuthology.orchestra.run.smithi169.stdout: mon down mkfs grace = 300 2024-09-19T06:36:08.850 INFO:teuthology.orchestra.run.smithi169.stdout: mon op complaint time = 120 2024-09-19T06:36:08.850 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on pool no app = False 2024-09-19T06:36:08.850 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:36:08.850 INFO:teuthology.orchestra.run.smithi169.stdout:[client] 2024-09-19T06:36:08.850 INFO:teuthology.orchestra.run.smithi169.stdout: rgw cache enabled = true 2024-09-19T06:36:08.850 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable ops log = true 2024-09-19T06:36:08.850 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable usage log = true 2024-09-19T06:36:08.850 INFO:teuthology.orchestra.run.smithi169.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-19T06:36:08.850 INFO:teuthology.orchestra.run.smithi169.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-19T06:36:08.851 INFO:teuthology.orchestra.run.smithi169.stdout: client mount timeout = 600 2024-09-19T06:36:08.851 INFO:teuthology.orchestra.run.smithi169.stdout: client_shutdown_timeout = 120 2024-09-19T06:36:08.851 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2024-09-19T06:36:08.851 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-19T06:36:08.851 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2024-09-19T06:36:08.851 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2024-09-19T06:36:08.851 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.a] 2024-09-19T06:36:08.851 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.b] 2024-09-19T06:36:08.851 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.c] 2024-09-19T06:36:08.851 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2024-09-19T06:36:08.851 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.c] 2024-09-19T06:36:08.851 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.e] 2024-09-19T06:36:08.851 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.b] 2024-09-19T06:36:08.852 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.d] 2024-09-19T06:36:08.852 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.f] 2024-09-19T06:36:08.852 INFO:teuthology.orchestra.run.smithi169.stdout:[mds] 2024-09-19T06:36:08.852 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds = 20 2024-09-19T06:36:08.852 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds balancer = 20 2024-09-19T06:36:08.852 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-19T06:36:08.852 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal fragment size max = 10000 2024-09-19T06:36:08.852 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal merge size = 5 2024-09-19T06:36:08.852 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal split bits = 3 2024-09-19T06:36:08.852 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal split size = 100 2024-09-19T06:36:08.852 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug frag = True 2024-09-19T06:36:08.852 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug scatterstat = True 2024-09-19T06:36:08.852 INFO:teuthology.orchestra.run.smithi169.stdout: mds oft prefetch dirfrags = True 2024-09-19T06:36:08.853 INFO:teuthology.orchestra.run.smithi169.stdout: mds op complaint time = 180 2024-09-19T06:36:08.853 INFO:teuthology.orchestra.run.smithi169.stdout: mds verify scatter = True 2024-09-19T06:36:08.853 INFO:teuthology.orchestra.run.smithi169.stdout: mds_dir_prefetch = True 2024-09-19T06:36:08.853 INFO:teuthology.orchestra.run.smithi169.stdout: mds_sleep_rank_change = 5000000.0 2024-09-19T06:36:08.853 INFO:teuthology.orchestra.run.smithi169.stdout: mon client directed command retry = 5 2024-09-19T06:36:08.853 INFO:teuthology.orchestra.run.smithi169.stdout: ms inject delay max = 1 2024-09-19T06:36:08.853 INFO:teuthology.orchestra.run.smithi169.stdout: ms inject delay probability = 0.005 2024-09-19T06:36:08.853 INFO:teuthology.orchestra.run.smithi169.stdout: ms inject delay type = client mds osd 2024-09-19T06:36:08.853 INFO:teuthology.orchestra.run.smithi169.stdout: ms inject socket failures = 2500 2024-09-19T06:36:08.853 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2024-09-19T06:36:08.853 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2024-09-19T06:36:08.853 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2024-09-19T06:36:08.854 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-19T06:36:08.854 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-19T06:36:08.932 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-19T06:36:08.933 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:36:08.933 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-19T06:36:08.948 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:36:08.948 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-19T06:36:09.003 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi086.front.sepia.ceph.com 2024-09-19T06:36:09.004 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:36:09.004 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-19T06:36:09.004 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T06:36:09.077 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:36:09.077 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-19T06:36:09.133 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi169.front.sepia.ceph.com 2024-09-19T06:36:09.133 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T06:36:09.133 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-19T06:36:09.133 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T06:36:09.169 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T06:36:09.169 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-19T06:36:09.225 INFO:tasks.ceph:Setting up mon nodes... 2024-09-19T06:36:09.225 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-19T06:36:09.225 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-19T06:36:09.276 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-19T06:36:09.278 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-19T06:36:09.335 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-19T06:36:09.337 INFO:tasks.ceph:Setting up mds nodes... 2024-09-19T06:36:09.338 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-19T06:36:09.388 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-19T06:36:09.391 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-19T06:36:09.416 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-19T06:36:09.507 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-19T06:36:09.509 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-19T06:36:09.534 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-09-19T06:36:09.624 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-09-19T06:36:09.627 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-09-19T06:36:09.652 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-19T06:36:09.704 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-19T06:36:09.707 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-19T06:36:09.731 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-19T06:36:09.822 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-19T06:36:09.824 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-19T06:36:09.849 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-09-19T06:36:09.940 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-09-19T06:36:09.943 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-09-19T06:36:09.967 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-19T06:36:09.968 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T06:36:10.009 INFO:teuthology.orchestra.run.smithi086.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-19T06:36:10.021 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-19T06:36:10.021 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi086.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-19T06:36:10.021 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-19T06:36:10.086 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T06:36:10.086 INFO:tasks.ceph:role: osd.0 2024-09-19T06:36:10.086 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-19T06:36:10.086 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-19T06:36:10.158 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T06:36:10.158 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T06:36:10.158 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T06:36:10.158 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T06:36:10.158 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T06:36:10.159 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-09-19T06:36:10.159 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T06:36:10.159 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T06:36:10.159 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T06:36:10.159 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T06:36:10.648 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-09-19T06:36:10.651 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-09-19T06:36:10.651 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-19T06:36:10.761 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-19T06:36:10.793 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-19T06:36:10.858 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T06:36:10.858 INFO:tasks.ceph:role: osd.1 2024-09-19T06:36:10.859 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-19T06:36:10.859 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-19T06:36:10.931 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T06:36:10.931 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T06:36:10.931 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T06:36:10.931 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T06:36:10.931 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T06:36:10.931 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-09-19T06:36:10.931 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T06:36:10.932 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T06:36:10.932 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T06:36:10.932 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T06:36:11.389 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-09-19T06:36:11.391 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-09-19T06:36:11.392 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-19T06:36:11.465 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-19T06:36:11.535 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-19T06:36:11.601 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T06:36:11.601 INFO:tasks.ceph:role: osd.2 2024-09-19T06:36:11.601 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-19T06:36:11.601 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-19T06:36:11.675 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T06:36:11.675 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T06:36:11.675 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T06:36:11.675 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T06:36:11.675 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T06:36:11.675 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-09-19T06:36:11.675 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T06:36:11.675 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T06:36:11.675 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T06:36:11.675 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T06:36:12.160 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-09-19T06:36:12.162 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-09-19T06:36:12.162 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-19T06:36:12.257 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-19T06:36:12.287 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-19T06:36:12.352 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T06:36:12.353 INFO:tasks.ceph:role: osd.3 2024-09-19T06:36:12.353 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-19T06:36:12.353 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-19T06:36:12.425 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T06:36:12.425 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T06:36:12.425 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T06:36:12.426 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T06:36:12.426 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T06:36:12.426 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-09-19T06:36:12.426 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T06:36:12.426 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T06:36:12.426 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T06:36:12.426 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T06:36:12.942 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-09-19T06:36:12.944 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-09-19T06:36:12.944 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-19T06:36:13.066 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-19T06:36:13.097 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T06:36:13.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:13.195+0000 7f37ae21a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-19T06:36:13.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:13.200+0000 7f37ae21a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-19T06:36:13.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:13.200+0000 7f37ae21a640 -1 bdev(0x55784cb77800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-19T06:36:13.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:13.200+0000 7f37ae21a640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-19T06:36:16.118 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-19T06:36:16.148 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T06:36:16.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:16.237+0000 7f7404fdb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-19T06:36:16.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:16.237+0000 7f7404fdb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-19T06:36:16.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:16.237+0000 7f7404fdb640 -1 bdev(0x55cd6fee3800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-19T06:36:16.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:16.237+0000 7f7404fdb640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-19T06:36:19.397 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-19T06:36:19.427 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T06:36:19.518 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:19.517+0000 7f8d07831640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-19T06:36:19.518 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:19.517+0000 7f8d07831640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-19T06:36:19.518 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:19.517+0000 7f8d07831640 -1 bdev(0x558643d6d800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-19T06:36:19.518 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:19.517+0000 7f8d07831640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-19T06:36:22.678 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-19T06:36:22.708 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T06:36:22.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:22.796+0000 7f2baee16640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-19T06:36:22.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:22.797+0000 7f2baee16640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-19T06:36:22.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:22.797+0000 7f2baee16640 -1 bdev(0x556314837800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-19T06:36:22.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:22.797+0000 7f2baee16640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-19T06:36:26.224 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-19T06:36:26.253 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-19T06:36:26.284 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T06:36:26.284 INFO:tasks.ceph:role: osd.4 2024-09-19T06:36:26.284 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-19T06:36:26.284 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-19T06:36:26.361 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T06:36:26.361 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T06:36:26.361 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T06:36:26.362 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T06:36:26.362 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T06:36:26.362 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-09-19T06:36:26.363 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T06:36:26.363 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T06:36:26.363 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T06:36:26.363 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T06:36:26.885 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-09-19T06:36:26.887 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-09-19T06:36:26.887 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-19T06:36:27.005 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-19T06:36:27.036 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-19T06:36:27.101 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T06:36:27.102 INFO:tasks.ceph:role: osd.5 2024-09-19T06:36:27.102 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-19T06:36:27.102 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-19T06:36:27.175 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T06:36:27.175 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T06:36:27.175 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T06:36:27.175 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T06:36:27.175 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T06:36:27.175 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-09-19T06:36:27.175 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T06:36:27.175 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T06:36:27.175 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T06:36:27.175 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T06:36:27.630 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-09-19T06:36:27.632 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-09-19T06:36:27.632 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-19T06:36:27.718 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-19T06:36:27.748 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-19T06:36:27.813 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T06:36:27.813 INFO:tasks.ceph:role: osd.6 2024-09-19T06:36:27.813 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-19T06:36:27.813 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-19T06:36:27.885 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T06:36:27.885 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T06:36:27.885 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T06:36:27.885 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T06:36:27.885 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T06:36:27.885 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-09-19T06:36:27.885 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T06:36:27.885 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T06:36:27.886 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T06:36:27.886 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T06:36:28.374 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-09-19T06:36:28.376 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-09-19T06:36:28.376 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-19T06:36:28.523 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-19T06:36:28.556 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-19T06:36:28.622 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T06:36:28.622 INFO:tasks.ceph:role: osd.7 2024-09-19T06:36:28.622 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-19T06:36:28.623 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-19T06:36:28.696 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T06:36:28.696 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T06:36:28.696 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T06:36:28.696 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T06:36:28.696 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T06:36:28.696 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-09-19T06:36:28.696 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T06:36:28.697 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T06:36:28.697 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T06:36:28.697 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T06:36:29.210 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-09-19T06:36:29.213 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-09-19T06:36:29.213 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-19T06:36:29.355 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-19T06:36:29.394 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T06:36:29.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:29.493+0000 7fe1291cc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-19T06:36:29.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:29.493+0000 7fe1291cc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-19T06:36:29.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:29.493+0000 7fe1291cc640 -1 bdev(0x556da0f69800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-19T06:36:29.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:29.493+0000 7fe1291cc640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-19T06:36:32.901 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-19T06:36:32.932 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T06:36:33.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:33.020+0000 7fbf05b1b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-19T06:36:33.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:33.021+0000 7fbf05b1b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-19T06:36:33.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:33.021+0000 7fbf05b1b640 -1 bdev(0x5638dccfb800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-19T06:36:33.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:33.021+0000 7fbf05b1b640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-19T06:36:36.184 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-19T06:36:36.212 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T06:36:36.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:36.300+0000 7f8cd060d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-19T06:36:36.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:36.300+0000 7f8cd060d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-19T06:36:36.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:36.300+0000 7f8cd060d640 -1 bdev(0x562a46b17800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-19T06:36:36.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:36.300+0000 7f8cd060d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-19T06:36:36.815 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:36:36.818 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:36:39.463 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-19T06:36:39.489 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T06:36:39.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:39.573+0000 7f107252e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-19T06:36:39.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:39.573+0000 7f107252e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-19T06:36:39.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:39.573+0000 7f107252e640 -1 bdev(0x561686321800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-19T06:36:39.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:39.573+0000 7f107252e640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-19T06:36:42.747 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-19T06:36:42.776 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-19T06:36:42.777 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:36:42.777 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-19T06:36:42.807 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:36:42.807 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-19T06:36:42.876 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:36:42.876 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-19T06:36:42.944 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:36:42.944 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-09-19T06:36:43.011 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:36:43.012 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-19T06:36:43.078 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:36:43.078 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-19T06:36:43.144 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:36:43.144 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-19T06:36:43.210 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:36:43.210 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-19T06:36:43.277 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T06:36:43.277 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-19T06:36:43.307 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T06:36:43.307 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-19T06:36:43.376 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T06:36:43.376 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-19T06:36:43.445 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T06:36:43.445 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-09-19T06:36:43.513 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T06:36:43.514 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-19T06:36:43.582 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T06:36:43.582 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-19T06:36:43.649 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T06:36:43.649 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-19T06:36:43.716 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T06:36:43.716 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-19T06:36:43.782 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:36:43.782 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-19T06:36:43.800 INFO:tasks.ceph:Adding keys to all mons... 2024-09-19T06:36:43.800 DEBUG:teuthology.orchestra.run.smithi086:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-19T06:36:43.843 DEBUG:teuthology.orchestra.run.smithi169:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-19T06:36:43.866 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr.y] 2024-09-19T06:36:43.866 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBZxutmZe9uEBAAV2QsT6+pYSsqlBMYRnJ2TQ== 2024-09-19T06:36:43.867 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.a] 2024-09-19T06:36:43.867 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBZxutmmVIkFxAAhftWu/ON3/40il3ym5IbKA== 2024-09-19T06:36:43.867 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.c] 2024-09-19T06:36:43.867 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBZxutm8qUyHhAAceN6UPVr31LxNgSYbNHcQQ== 2024-09-19T06:36:43.867 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.e] 2024-09-19T06:36:43.867 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBZxutmm2g3JRAApMuJFFxq8WZLde1CG4+DZA== 2024-09-19T06:36:43.867 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.0] 2024-09-19T06:36:43.867 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBdxutmSv65CxAAhLy7VcjX1C4d8n25qjtIBg== 2024-09-19T06:36:43.867 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.1] 2024-09-19T06:36:43.867 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBgxutmiPQ2DhAAlmO1ldoDQwP1tDdp3G+Adw== 2024-09-19T06:36:43.867 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.2] 2024-09-19T06:36:43.867 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBjxutmEkbYHhAAPBcXkKpz6XpeASVNs76G1Q== 2024-09-19T06:36:43.868 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.3] 2024-09-19T06:36:43.868 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBmxutmngWQLxAAzdfDNbocpU1WWe0AQm2miA== 2024-09-19T06:36:43.868 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr.x] 2024-09-19T06:36:43.868 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBZxutm9l/0ExAAtNvfHpb9HspAuYvYslA0PA== 2024-09-19T06:36:43.868 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.b] 2024-09-19T06:36:43.868 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBZxutmQt72KRAAQSPqv0vzybt+I8+E/idTbg== 2024-09-19T06:36:43.868 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.d] 2024-09-19T06:36:43.868 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBZxutmjmf6MBAAmCv8Lc0OUUNv65mh7iYgnA== 2024-09-19T06:36:43.868 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.f] 2024-09-19T06:36:43.868 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBZxutmJbELOBAArE4iKacN+ALbE4Kvx6S9JA== 2024-09-19T06:36:43.869 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.4] 2024-09-19T06:36:43.869 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBtxutmq8ZxHRAAc/Bzpss/2xUWK8BCIr5Sqg== 2024-09-19T06:36:43.869 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.5] 2024-09-19T06:36:43.869 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBxxutm/qVNARAAZG12UK1Zu2ixlMoD3IWkZw== 2024-09-19T06:36:43.869 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.6] 2024-09-19T06:36:43.869 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQB0xutmhpnzERAAIadkNh5pQxNF+HrMIkrX6Q== 2024-09-19T06:36:43.869 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.7] 2024-09-19T06:36:43.869 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQB3xutmnZ87IhAAam+vuEZJZtiC8QeSM6MSwQ== 2024-09-19T06:36:43.869 INFO:teuthology.orchestra.run.smithi086.stdout:[client.0] 2024-09-19T06:36:43.869 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBaxutmXgOIABAAr7OF63Fnn7jiMj8hqXQdDA== 2024-09-19T06:36:43.871 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr.y] 2024-09-19T06:36:43.871 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBZxutmZe9uEBAAV2QsT6+pYSsqlBMYRnJ2TQ== 2024-09-19T06:36:43.871 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2024-09-19T06:36:43.871 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBZxutmmVIkFxAAhftWu/ON3/40il3ym5IbKA== 2024-09-19T06:36:43.871 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.c] 2024-09-19T06:36:43.871 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBZxutm8qUyHhAAceN6UPVr31LxNgSYbNHcQQ== 2024-09-19T06:36:43.872 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.e] 2024-09-19T06:36:43.872 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBZxutmm2g3JRAApMuJFFxq8WZLde1CG4+DZA== 2024-09-19T06:36:43.872 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.0] 2024-09-19T06:36:43.872 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBdxutmSv65CxAAhLy7VcjX1C4d8n25qjtIBg== 2024-09-19T06:36:43.872 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.1] 2024-09-19T06:36:43.872 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBgxutmiPQ2DhAAlmO1ldoDQwP1tDdp3G+Adw== 2024-09-19T06:36:43.872 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.2] 2024-09-19T06:36:43.872 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBjxutmEkbYHhAAPBcXkKpz6XpeASVNs76G1Q== 2024-09-19T06:36:43.872 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.3] 2024-09-19T06:36:43.872 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBmxutmngWQLxAAzdfDNbocpU1WWe0AQm2miA== 2024-09-19T06:36:43.872 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr.x] 2024-09-19T06:36:43.872 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBZxutm9l/0ExAAtNvfHpb9HspAuYvYslA0PA== 2024-09-19T06:36:43.873 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.b] 2024-09-19T06:36:43.873 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBZxutmQt72KRAAQSPqv0vzybt+I8+E/idTbg== 2024-09-19T06:36:43.873 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.d] 2024-09-19T06:36:43.873 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBZxutmjmf6MBAAmCv8Lc0OUUNv65mh7iYgnA== 2024-09-19T06:36:43.873 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.f] 2024-09-19T06:36:43.873 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBZxutmJbELOBAArE4iKacN+ALbE4Kvx6S9JA== 2024-09-19T06:36:43.873 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.4] 2024-09-19T06:36:43.873 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBtxutmq8ZxHRAAc/Bzpss/2xUWK8BCIr5Sqg== 2024-09-19T06:36:43.873 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.5] 2024-09-19T06:36:43.873 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBxxutm/qVNARAAZG12UK1Zu2ixlMoD3IWkZw== 2024-09-19T06:36:43.873 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.6] 2024-09-19T06:36:43.873 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQB0xutmhpnzERAAIadkNh5pQxNF+HrMIkrX6Q== 2024-09-19T06:36:43.873 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.7] 2024-09-19T06:36:43.874 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQB3xutmnZ87IhAAam+vuEZJZtiC8QeSM6MSwQ== 2024-09-19T06:36:43.874 INFO:teuthology.orchestra.run.smithi169.stdout:[client.0] 2024-09-19T06:36:43.874 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBaxutmXgOIABAAr7OF63Fnn7jiMj8hqXQdDA== 2024-09-19T06:36:43.874 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T06:36:43.914 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T06:36:43.966 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T06:36:43.968 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T06:36:44.022 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T06:36:44.024 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T06:36:44.078 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T06:36:44.080 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T06:36:44.134 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T06:36:44.137 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T06:36:44.187 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T06:36:44.190 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T06:36:44.241 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T06:36:44.243 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T06:36:44.294 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T06:36:44.297 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T06:36:44.348 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T06:36:44.350 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T06:36:44.401 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T06:36:44.404 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T06:36:44.457 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T06:36:44.460 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T06:36:44.514 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T06:36:44.517 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T06:36:44.570 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T06:36:44.573 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T06:36:44.624 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T06:36:44.627 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T06:36:44.678 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T06:36:44.681 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T06:36:44.731 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T06:36:44.733 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T06:36:44.785 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T06:36:44.787 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T06:36:44.841 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-19T06:36:44.841 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-19T06:36:44.866 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T06:36:44.961 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-19T06:36:44.986 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-19T06:36:45.011 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T06:36:45.106 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-19T06:36:45.131 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-19T06:36:45.196 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T06:36:45.292 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-19T06:36:45.317 DEBUG:teuthology.orchestra.run.smithi086:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-19T06:36:45.319 DEBUG:teuthology.orchestra.run.smithi169:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-19T06:36:45.372 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-19T06:36:45.373 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-19T06:36:45.373 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-19T06:36:45.375 INFO:tasks.ceph.mon.a:Started 2024-09-19T06:36:45.376 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-19T06:36:45.376 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-19T06:36:45.414 INFO:tasks.ceph.mon.b:Started 2024-09-19T06:36:45.414 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-19T06:36:45.415 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-19T06:36:45.417 INFO:tasks.ceph.mon.c:Started 2024-09-19T06:36:45.417 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-19T06:36:45.417 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-19T06:36:45.417 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-19T06:36:45.419 INFO:tasks.ceph.mgr.y:Started 2024-09-19T06:36:45.419 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-19T06:36:45.419 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-19T06:36:45.421 INFO:tasks.ceph.mgr.x:Started 2024-09-19T06:36:45.421 INFO:tasks.ceph:Setting crush tunables to default 2024-09-19T06:36:45.422 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd crush tunables default 2024-09-19T06:36:45.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.520+0000 7ff4915b9640 1 Processor -- start 2024-09-19T06:36:45.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.520+0000 7ff4915b9640 1 -- start start 2024-09-19T06:36:45.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.521+0000 7ff4915b9640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff48c0ca8b0 0x7ff48c15b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:45.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.521+0000 7ff4915b9640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff48c15b220 con 0x7ff48c071f90 2024-09-19T06:36:45.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.521+0000 7ff4915b9640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff48c06bee0 con 0x7ff48c0ca4d0 2024-09-19T06:36:45.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.521+0000 7ff4915b9640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7ff48c06c1c0 con 0x7ff48c0ca8b0 2024-09-19T06:36:45.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.521+0000 7ff483fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff48c0ca8b0 0x7ff48c15b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:45.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.521+0000 7ff483fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff48c0ca8b0 0x7ff48c15b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47152/0 (socket says 172.21.15.86:47152) 2024-09-19T06:36:45.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.521+0000 7ff483fff640 1 -- 172.21.15.86:0/2482262571 learned_addr learned my addr 172.21.15.86:0/2482262571 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:36:45.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.521+0000 7ff483fff640 1 -- 172.21.15.86:0/2482262571 >> v2:172.21.15.86:3300/0 conn(0x7ff48c0ca8b0 msgr2=0x7ff48c15b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T06:36:45.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.521+0000 7ff483fff640 1 -- 172.21.15.86:0/2482262571 >> v2:172.21.15.86:3300/0 conn(0x7ff48c0ca8b0 msgr2=0x7ff48c15b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T06:36:45.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.521+0000 7ff483fff640 1 --2- 172.21.15.86:0/2482262571 >> v2:172.21.15.86:3300/0 conn(0x7ff48c0ca8b0 0x7ff48c15b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T06:36:45.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.522+0000 7ff483fff640 1 --2- 172.21.15.86:0/2482262571 >> v2:172.21.15.86:3300/0 conn(0x7ff48c0ca8b0 0x7ff48c15b700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:36:45.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.682+0000 7ff48a7fc640 1 -- 172.21.15.86:0/2482262571 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1647275278 0 0) 0x7ff48c15b220 con 0x7ff48c071f90 2024-09-19T06:36:45.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.682+0000 7ff48a7fc640 1 -- 172.21.15.86:0/2482262571 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff478003520 con 0x7ff48c071f90 2024-09-19T06:36:45.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.683+0000 7ff48a7fc640 1 -- 172.21.15.86:0/2482262571 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2012093722 0 0) 0x7ff48c06bee0 con 0x7ff48c0ca4d0 2024-09-19T06:36:45.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.683+0000 7ff48a7fc640 1 -- 172.21.15.86:0/2482262571 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff48c15b220 con 0x7ff48c0ca4d0 2024-09-19T06:36:45.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.683+0000 7ff48a7fc640 1 -- 172.21.15.86:0/2482262571 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 276572938 0 0) 0x7ff478003520 con 0x7ff48c071f90 2024-09-19T06:36:45.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.683+0000 7ff48a7fc640 1 -- 172.21.15.86:0/2482262571 >> v2:172.21.15.86:3300/0 conn(0x7ff48c0ca8b0 msgr2=0x7ff48c15b700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:36:45.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.683+0000 7ff48a7fc640 1 --2- 172.21.15.86:0/2482262571 >> v2:172.21.15.86:3300/0 conn(0x7ff48c0ca8b0 0x7ff48c15b700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:45.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.683+0000 7ff48a7fc640 1 -- 172.21.15.86:0/2482262571 >> v1:172.21.15.169:6789/0 conn(0x7ff48c0ca4d0 legacy=0x7ff48c0c99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:45.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.683+0000 7ff48a7fc640 1 -- 172.21.15.86:0/2482262571 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48c06c4a0 con 0x7ff48c071f90 2024-09-19T06:36:45.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.683+0000 7ff48a7fc640 1 -- 172.21.15.86:0/2482262571 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7ff4840019f0 con 0x7ff48c071f90 2024-09-19T06:36:45.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.683+0000 7ff48a7fc640 1 -- 172.21.15.86:0/2482262571 >> v1:172.21.15.86:6789/0 conn(0x7ff48c071f90 legacy=0x7ff48c0c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:45.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.683+0000 7ff48a7fc640 1 --2- 172.21.15.86:0/2482262571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff478003b40 0x7ff478003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:45.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.683+0000 7ff48a7fc640 1 --2- 172.21.15.86:0/2482262571 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff478004800 0x7ff478004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:45.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.683+0000 7ff48a7fc640 1 --2- 172.21.15.86:0/2482262571 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff4780051c0 0x7ff47800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:45.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.683+0000 7ff48a7fc640 1 -- 172.21.15.86:0/2482262571 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c06c1c0 con 0x7ff478003b40 2024-09-19T06:36:45.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.683+0000 7ff48a7fc640 1 -- 172.21.15.86:0/2482262571 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff47800c0f0 con 0x7ff4780051c0 2024-09-19T06:36:45.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.683+0000 7ff48a7fc640 1 -- 172.21.15.86:0/2482262571 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff47800c2f0 con 0x7ff478004800 2024-09-19T06:36:45.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.683+0000 7ff48affd640 1 --2- 172.21.15.86:0/2482262571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff478003b40 0x7ff478003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:45.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.684+0000 7ff483fff640 1 --2- 172.21.15.86:0/2482262571 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff478004800 0x7ff478004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:45.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.684+0000 7ff48b7fe640 1 --2- 172.21.15.86:0/2482262571 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff4780051c0 0x7ff47800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:45.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.684+0000 7ff48affd640 1 -- 172.21.15.86:0/2482262571 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff478004800 msgr2=0x7ff478004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:36:45.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.684+0000 7ff48affd640 1 --2- 172.21.15.86:0/2482262571 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff478004800 0x7ff478004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:45.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.684+0000 7ff48affd640 1 -- 172.21.15.86:0/2482262571 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff4780051c0 msgr2=0x7ff47800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:36:45.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.684+0000 7ff48affd640 1 --2- 172.21.15.86:0/2482262571 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff4780051c0 0x7ff47800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:45.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.684+0000 7ff48affd640 1 -- 172.21.15.86:0/2482262571 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff478003520 con 0x7ff478003b40 2024-09-19T06:36:45.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.684+0000 7ff48b7fe640 1 -- 172.21.15.86:0/2482262571 reap_dead start 2024-09-19T06:36:45.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.685+0000 7ff48affd640 1 --2- 172.21.15.86:0/2482262571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff478003b40 0x7ff478003f40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff47c0018a0 tx=0x7ff478005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6516be05dc1a43 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:45.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.685+0000 7ff48a7fc640 1 -- 172.21.15.86:0/2482262571 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff47c0014f0 con 0x7ff478003b40 2024-09-19T06:36:45.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.685+0000 7ff48a7fc640 1 -- 172.21.15.86:0/2482262571 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff47c0052d0 con 0x7ff478003b40 2024-09-19T06:36:45.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.685+0000 7ff48a7fc640 1 -- 172.21.15.86:0/2482262571 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff47c02ac40 con 0x7ff478003b40 2024-09-19T06:36:45.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.685+0000 7ff4915b9640 1 -- 172.21.15.86:0/2482262571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff478003b40 msgr2=0x7ff478003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:45.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.685+0000 7ff4915b9640 1 --2- 172.21.15.86:0/2482262571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff478003b40 0x7ff478003f40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff47c0018a0 tx=0x7ff478005830 comp rx=0 tx=0).stop 2024-09-19T06:36:45.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.686+0000 7ff4915b9640 1 -- 172.21.15.86:0/2482262571 shutdown_connections 2024-09-19T06:36:45.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.686+0000 7ff4915b9640 1 --2- 172.21.15.86:0/2482262571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff478003b40 0x7ff478003f40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:45.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.686+0000 7ff4915b9640 1 -- 172.21.15.86:0/2482262571 >> 172.21.15.86:0/2482262571 conn(0x7ff48c06fb80 msgr2=0x7ff48c06ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:45.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.686+0000 7ff4915b9640 1 -- 172.21.15.86:0/2482262571 shutdown_connections 2024-09-19T06:36:45.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.686+0000 7ff4915b9640 1 -- 172.21.15.86:0/2482262571 wait complete. 2024-09-19T06:36:45.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.687+0000 7ff4915b9640 1 Processor -- start 2024-09-19T06:36:45.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.687+0000 7ff4915b9640 1 -- start start 2024-09-19T06:36:45.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.688+0000 7ff4915b9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff478003b40 0x7ff48c13f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:45.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.688+0000 7ff4915b9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff48c15a820 0x7ff48c1f2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:45.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.688+0000 7ff4915b9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff48c1f29d0 0x7ff48c1f3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:45.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.688+0000 7ff4915b9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c06ca60 con 0x7ff48c15a820 2024-09-19T06:36:45.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.688+0000 7ff4915b9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c06bbc0 con 0x7ff48c1f29d0 2024-09-19T06:36:45.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.688+0000 7ff4915b9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff48c06cbe0 con 0x7ff478003b40 2024-09-19T06:36:45.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.688+0000 7ff483fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff48c15a820 0x7ff48c1f2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:45.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.688+0000 7ff483fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff48c15a820 0x7ff48c1f2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47194/0 (socket says 172.21.15.86:47194) 2024-09-19T06:36:45.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.688+0000 7ff483fff640 1 -- 172.21.15.86:0/380262072 learned_addr learned my addr 172.21.15.86:0/380262072 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:36:45.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.688+0000 7ff48affd640 1 --2- 172.21.15.86:0/380262072 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff478003b40 0x7ff48c13f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:45.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.688+0000 7ff48b7fe640 1 --2- 172.21.15.86:0/380262072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff48c1f29d0 0x7ff48c1f3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:45.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.688+0000 7ff483fff640 1 -- 172.21.15.86:0/380262072 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff478003b40 msgr2=0x7ff48c13f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:45.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.688+0000 7ff483fff640 1 --2- 172.21.15.86:0/380262072 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff478003b40 0x7ff48c13f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:45.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.688+0000 7ff483fff640 1 -- 172.21.15.86:0/380262072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff48c1f29d0 msgr2=0x7ff48c1f3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:45.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.688+0000 7ff483fff640 1 --2- 172.21.15.86:0/380262072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff48c1f29d0 0x7ff48c1f3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:45.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.688+0000 7ff483fff640 1 -- 172.21.15.86:0/380262072 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48c1f2e50 con 0x7ff48c15a820 2024-09-19T06:36:45.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.688+0000 7ff483fff640 1 --2- 172.21.15.86:0/380262072 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff48c15a820 0x7ff48c1f2490 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff4740116b0 tx=0x7ff474011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:45.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.688+0000 7ff4837fe640 1 -- 172.21.15.86:0/380262072 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff474019070 con 0x7ff48c15a820 2024-09-19T06:36:45.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.688+0000 7ff4837fe640 1 -- 172.21.15.86:0/380262072 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff47400f9c0 con 0x7ff48c15a820 2024-09-19T06:36:45.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.689+0000 7ff4837fe640 1 -- 172.21.15.86:0/380262072 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff47400f040 con 0x7ff48c15a820 2024-09-19T06:36:45.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.689+0000 7ff4915b9640 1 -- 172.21.15.86:0/380262072 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff48c15bb60 con 0x7ff48c15a820 2024-09-19T06:36:45.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.689+0000 7ff4915b9640 1 -- 172.21.15.86:0/380262072 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff48c159ac0 con 0x7ff48c15a820 2024-09-19T06:36:45.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.689+0000 7ff4837fe640 1 -- 172.21.15.86:0/380262072 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff47401c070 con 0x7ff48c15a820 2024-09-19T06:36:45.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.689+0000 7ff4837fe640 1 -- 172.21.15.86:0/380262072 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff47401e790 con 0x7ff48c15a820 2024-09-19T06:36:45.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.690+0000 7ff4915b9640 1 -- 172.21.15.86:0/380262072 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff48c0c99c0 con 0x7ff48c15a820 2024-09-19T06:36:45.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.692+0000 7ff4837fe640 1 -- 172.21.15.86:0/380262072 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff48c1f2e50 con 0x7ff48c15a820 2024-09-19T06:36:45.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.755+0000 7ff4915b9640 1 -- 172.21.15.86:0/380262072 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7ff48c070100 con 0x7ff48c15a820 2024-09-19T06:36:45.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.757+0000 7ff4837fe640 1 -- 172.21.15.86:0/380262072 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7ff47400fd90 con 0x7ff48c15a820 2024-09-19T06:36:45.758 INFO:teuthology.orchestra.run.smithi086.stderr:adjusted tunables profile to default 2024-09-19T06:36:45.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.758+0000 7ff4915b9640 1 -- 172.21.15.86:0/380262072 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff48c15a820 msgr2=0x7ff48c1f2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:45.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.758+0000 7ff4915b9640 1 --2- 172.21.15.86:0/380262072 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff48c15a820 0x7ff48c1f2490 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff4740116b0 tx=0x7ff474011b70 comp rx=0 tx=0).stop 2024-09-19T06:36:45.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.758+0000 7ff4915b9640 1 -- 172.21.15.86:0/380262072 shutdown_connections 2024-09-19T06:36:45.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.758+0000 7ff4915b9640 1 --2- 172.21.15.86:0/380262072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff48c1f29d0 0x7ff48c1f3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:45.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.758+0000 7ff4915b9640 1 --2- 172.21.15.86:0/380262072 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff48c15a820 0x7ff48c1f2490 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:45.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.758+0000 7ff4915b9640 1 --2- 172.21.15.86:0/380262072 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff478003b40 0x7ff48c13f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:45.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.758+0000 7ff4915b9640 1 -- 172.21.15.86:0/380262072 >> 172.21.15.86:0/380262072 conn(0x7ff48c06fb80 msgr2=0x7ff48c0c6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:45.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.758+0000 7ff4915b9640 1 -- 172.21.15.86:0/380262072 shutdown_connections 2024-09-19T06:36:45.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:45.758+0000 7ff4915b9640 1 -- 172.21.15.86:0/380262072 wait complete. 2024-09-19T06:36:45.770 INFO:tasks.ceph:check_enable_crimson: False 2024-09-19T06:36:45.770 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-19T06:36:45.770 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:36:45.770 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-19T06:36:45.787 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:45.785+0000 7f82a0e21040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:36:45.790 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-19T06:36:45.789+0000 7fc026f42040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:36:45.795 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:36:45.795 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-19T06:36:45.829 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:45.828+0000 7f82a0e21040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:36:45.830 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-19T06:36:45.829+0000 7fc026f42040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:36:45.853 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:36:45.853 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-19T06:36:45.918 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:36:45.918 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-19T06:36:45.974 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-19T06:36:45.973+0000 7fc026f42040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:36:45.978 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:45.977+0000 7f82a0e21040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:36:45.983 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T06:36:45.983 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-19T06:36:46.009 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T06:36:46.009 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-19T06:36:46.026 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-19T06:36:46.025+0000 7fc026f42040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:36:46.030 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:46.029+0000 7f82a0e21040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:36:46.051 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T06:36:46.051 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-19T06:36:46.116 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T06:36:46.116 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-19T06:36:46.181 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new bd3ce3f2-2a37-40ec-8dc3-69246437277c 0 2024-09-19T06:36:46.190 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-19T06:36:46.189+0000 7fc026f42040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:36:46.197 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:46.196+0000 7f82a0e21040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:36:46.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.288+0000 7f10c33b9640 1 Processor -- start 2024-09-19T06:36:46.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.288+0000 7f10c33b9640 1 -- start start 2024-09-19T06:36:46.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.289+0000 7f10c33b9640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f10bc072900 0x7f10bc158980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:46.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.289+0000 7f10c33b9640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10bc073550 con 0x7f10bc0ca160 2024-09-19T06:36:46.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.289+0000 7f10c33b9640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10bc0726b0 con 0x7f10bc152160 2024-09-19T06:36:46.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.289+0000 7f10c33b9640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f10bc158ec0 con 0x7f10bc072900 2024-09-19T06:36:46.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.289+0000 7f10c1155640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f10bc152160 0x7f10bc072e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:53874/0 (socket says 172.21.15.169:53874) 2024-09-19T06:36:46.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.289+0000 7f10c1155640 1 -- 172.21.15.169:0/2730141330 learned_addr learned my addr 172.21.15.169:0/2730141330 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-19T06:36:46.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.289+0000 7f10c0954640 1 --2- 172.21.15.169:0/2730141330 >> v2:172.21.15.86:3300/0 conn(0x7f10bc072900 0x7f10bc158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:46.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.289+0000 7f10b3fff640 1 -- 172.21.15.169:0/2730141330 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3760870895 0 0) 0x7f10bc0726b0 con 0x7f10bc152160 2024-09-19T06:36:46.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.289+0000 7f10b3fff640 1 -- 172.21.15.169:0/2730141330 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10a8003520 con 0x7f10bc152160 2024-09-19T06:36:46.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.289+0000 7f10b3fff640 1 -- 172.21.15.169:0/2730141330 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3211682160 0 0) 0x7f10bc073550 con 0x7f10bc0ca160 2024-09-19T06:36:46.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.289+0000 7f10b3fff640 1 -- 172.21.15.169:0/2730141330 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10bc0726b0 con 0x7f10bc0ca160 2024-09-19T06:36:46.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.289+0000 7f10b3fff640 1 -- 172.21.15.169:0/2730141330 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4209178565 0 0) 0x7f10a8003520 con 0x7f10bc152160 2024-09-19T06:36:46.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.289+0000 7f10b3fff640 1 -- 172.21.15.169:0/2730141330 >> v2:172.21.15.86:3300/0 conn(0x7f10bc072900 msgr2=0x7f10bc158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:36:46.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.289+0000 7f10b3fff640 1 --2- 172.21.15.169:0/2730141330 >> v2:172.21.15.86:3300/0 conn(0x7f10bc072900 0x7f10bc158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.289+0000 7f10b3fff640 1 -- 172.21.15.169:0/2730141330 >> v1:172.21.15.86:6789/0 conn(0x7f10bc0ca160 legacy=0x7f10bc162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:46.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.289+0000 7f10b3fff640 1 -- 172.21.15.169:0/2730141330 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10bc0723d0 con 0x7f10bc152160 2024-09-19T06:36:46.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.289+0000 7f10b3fff640 1 -- 172.21.15.169:0/2730141330 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f10b8001670 con 0x7f10bc152160 2024-09-19T06:36:46.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.289+0000 7f10c0954640 1 --2- 172.21.15.169:0/2730141330 >> v2:172.21.15.86:3300/0 conn(0x7f10bc072900 0x7f10bc158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:36:46.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.290+0000 7f10b3fff640 1 -- 172.21.15.169:0/2730141330 >> v1:172.21.15.169:6789/0 conn(0x7f10bc152160 legacy=0x7f10bc072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:46.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.290+0000 7f10b3fff640 1 --2- 172.21.15.169:0/2730141330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a8003b40 0x7f10a8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:46.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.290+0000 7f10b3fff640 1 --2- 172.21.15.169:0/2730141330 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10a8004800 0x7f10a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:46.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.290+0000 7f10b3fff640 1 --2- 172.21.15.169:0/2730141330 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10a80051c0 0x7f10a800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:46.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.290+0000 7f10b3fff640 1 -- 172.21.15.169:0/2730141330 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f10bc158ec0 con 0x7f10a8003b40 2024-09-19T06:36:46.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.290+0000 7f10b3fff640 1 -- 172.21.15.169:0/2730141330 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f10a800e250 con 0x7f10a8004800 2024-09-19T06:36:46.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.290+0000 7f10b3fff640 1 -- 172.21.15.169:0/2730141330 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f10a800e450 con 0x7f10a80051c0 2024-09-19T06:36:46.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.290+0000 7f10c1155640 1 --2- 172.21.15.169:0/2730141330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a8003b40 0x7f10a8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:46.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.290+0000 7f10c0954640 1 --2- 172.21.15.169:0/2730141330 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10a8004800 0x7f10a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:46.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.290+0000 7f10c1956640 1 --2- 172.21.15.169:0/2730141330 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10a80051c0 0x7f10a800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:46.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.290+0000 7f10c1155640 1 -- 172.21.15.169:0/2730141330 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10a80051c0 msgr2=0x7f10a800dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:36:46.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.290+0000 7f10c1155640 1 --2- 172.21.15.169:0/2730141330 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10a80051c0 0x7f10a800dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.290+0000 7f10c1155640 1 -- 172.21.15.169:0/2730141330 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10a8004800 msgr2=0x7f10a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:36:46.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.290+0000 7f10c1155640 1 --2- 172.21.15.169:0/2730141330 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10a8004800 0x7f10a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.290+0000 7f10c1155640 1 -- 172.21.15.169:0/2730141330 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a8003520 con 0x7f10a8003b40 2024-09-19T06:36:46.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.290+0000 7f10c1956640 1 --2- 172.21.15.169:0/2730141330 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10a80051c0 0x7f10a800dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:36:46.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.290+0000 7f10c0954640 1 --2- 172.21.15.169:0/2730141330 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10a8004800 0x7f10a8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:36:46.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.290+0000 7f10c1956640 1 -- 172.21.15.169:0/2730141330 reap_dead start 2024-09-19T06:36:46.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.291+0000 7f10c1155640 1 --2- 172.21.15.169:0/2730141330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a8003b40 0x7f10a8003f40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f10b800c160 tx=0x7f10a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246b315de13fc62e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:46.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.291+0000 7f10b3fff640 1 -- 172.21.15.169:0/2730141330 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b8007ca0 con 0x7f10a8003b40 2024-09-19T06:36:46.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.291+0000 7f10b3fff640 1 -- 172.21.15.169:0/2730141330 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10b8005ad0 con 0x7f10a8003b40 2024-09-19T06:36:46.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.291+0000 7f10b3fff640 1 -- 172.21.15.169:0/2730141330 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b8007070 con 0x7f10a8003b40 2024-09-19T06:36:46.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.292+0000 7f10c33b9640 1 -- 172.21.15.169:0/2730141330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a8003b40 msgr2=0x7f10a8003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:46.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.292+0000 7f10c33b9640 1 --2- 172.21.15.169:0/2730141330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a8003b40 0x7f10a8003f40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f10b800c160 tx=0x7f10a8005830 comp rx=0 tx=0).stop 2024-09-19T06:36:46.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.292+0000 7f10c33b9640 1 -- 172.21.15.169:0/2730141330 shutdown_connections 2024-09-19T06:36:46.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.292+0000 7f10c33b9640 1 --2- 172.21.15.169:0/2730141330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a8003b40 0x7f10a8003f40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.292+0000 7f10c33b9640 1 -- 172.21.15.169:0/2730141330 >> 172.21.15.169:0/2730141330 conn(0x7f10bc06fb80 msgr2=0x7f10bc06ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:46.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.292+0000 7f10c33b9640 1 -- 172.21.15.169:0/2730141330 shutdown_connections 2024-09-19T06:36:46.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.292+0000 7f10c33b9640 1 -- 172.21.15.169:0/2730141330 wait complete. 2024-09-19T06:36:46.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.293+0000 7f10c33b9640 1 Processor -- start 2024-09-19T06:36:46.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.293+0000 7f10c33b9640 1 -- start start 2024-09-19T06:36:46.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.294+0000 7f10c33b9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a8003b40 0x7f10bc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:46.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.294+0000 7f10c33b9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10bc14ab60 0x7f10bc0cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:46.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.294+0000 7f10c33b9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10bc0cca50 0x7f10bc148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:46.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.294+0000 7f10c33b9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f10bc15b7f0 con 0x7f10a8003b40 2024-09-19T06:36:46.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.294+0000 7f10c33b9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f10bc15be40 con 0x7f10bc14ab60 2024-09-19T06:36:46.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.294+0000 7f10c33b9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f10bc15bad0 con 0x7f10bc0cca50 2024-09-19T06:36:46.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.294+0000 7f10c0954640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10bc14ab60 0x7f10bc0cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:46.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.294+0000 7f10c1956640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10bc0cca50 0x7f10bc148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.294+0000 7f10c0954640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10bc14ab60 0x7f10bc0cc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:38342/0 (socket says 172.21.15.169:38342) 2024-09-19T06:36:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.294+0000 7f10c0954640 1 -- 172.21.15.169:0/4205947016 learned_addr learned my addr 172.21.15.169:0/4205947016 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T06:36:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.294+0000 7f10c1155640 1 --2- 172.21.15.169:0/4205947016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a8003b40 0x7f10bc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.294+0000 7f10c1956640 1 -- 172.21.15.169:0/4205947016 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10bc14ab60 msgr2=0x7f10bc0cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.294+0000 7f10c1956640 1 --2- 172.21.15.169:0/4205947016 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10bc14ab60 0x7f10bc0cc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.294+0000 7f10c1956640 1 -- 172.21.15.169:0/4205947016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a8003b40 msgr2=0x7f10bc06d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.294+0000 7f10c1956640 1 --2- 172.21.15.169:0/4205947016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a8003b40 0x7f10bc06d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.294+0000 7f10c1956640 1 -- 172.21.15.169:0/4205947016 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10bc1ecd80 con 0x7f10bc0cca50 2024-09-19T06:36:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.294+0000 7f10c1956640 1 --2- 172.21.15.169:0/4205947016 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10bc0cca50 0x7f10bc148cb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f10bc0ce890 tx=0x7f10b40021d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.294+0000 7f10b1ffb640 1 -- 172.21.15.169:0/4205947016 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac009860 con 0x7f10bc0cca50 2024-09-19T06:36:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.294+0000 7f10b1ffb640 1 -- 172.21.15.169:0/4205947016 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10b4018070 con 0x7f10bc0cca50 2024-09-19T06:36:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.294+0000 7f10c33b9640 1 -- 172.21.15.169:0/4205947016 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10bc0cb790 con 0x7f10bc0cca50 2024-09-19T06:36:46.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.294+0000 7f10b1ffb640 1 -- 172.21.15.169:0/4205947016 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b4001bf0 con 0x7f10bc0cca50 2024-09-19T06:36:46.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.295+0000 7f10c33b9640 1 -- 172.21.15.169:0/4205947016 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f10bc0cba30 con 0x7f10bc0cca50 2024-09-19T06:36:46.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.295+0000 7f10b1ffb640 1 -- 172.21.15.169:0/4205947016 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f10b400d7a0 con 0x7f10bc0cca50 2024-09-19T06:36:46.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.295+0000 7f10b1ffb640 1 -- 172.21.15.169:0/4205947016 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f10b40055f0 con 0x7f10bc0cca50 2024-09-19T06:36:46.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.296+0000 7f10c33b9640 1 -- 172.21.15.169:0/4205947016 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10bc15c2d0 con 0x7f10bc0cca50 2024-09-19T06:36:46.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.298+0000 7f10b1ffb640 1 -- 172.21.15.169:0/4205947016 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f10b4021020 con 0x7f10bc0cca50 2024-09-19T06:36:46.307 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-19T06:36:46.306+0000 7fc026f42040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:36:46.308 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:46.307+0000 7f82a0e21040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:36:46.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.366+0000 7f10c33b9640 1 -- 172.21.15.169:0/4205947016 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "bd3ce3f2-2a37-40ec-8dc3-69246437277c", "id": 0} v 0) -- 0x7f10bc0c7c60 con 0x7f10bc0cca50 2024-09-19T06:36:46.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.372+0000 7f10b1ffb640 1 -- 172.21.15.169:0/4205947016 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bd3ce3f2-2a37-40ec-8dc3-69246437277c", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f10b40050d0 con 0x7f10bc0cca50 2024-09-19T06:36:46.373 INFO:teuthology.orchestra.run.smithi169.stdout:0 2024-09-19T06:36:46.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.373+0000 7f10c33b9640 1 -- 172.21.15.169:0/4205947016 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10bc0cca50 msgr2=0x7f10bc148cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:46.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.373+0000 7f10c33b9640 1 --2- 172.21.15.169:0/4205947016 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10bc0cca50 0x7f10bc148cb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f10bc0ce890 tx=0x7f10b40021d0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.373+0000 7f10c33b9640 1 -- 172.21.15.169:0/4205947016 shutdown_connections 2024-09-19T06:36:46.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.373+0000 7f10c33b9640 1 --2- 172.21.15.169:0/4205947016 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10bc0cca50 0x7f10bc148cb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.373+0000 7f10c33b9640 1 --2- 172.21.15.169:0/4205947016 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10bc14ab60 0x7f10bc0cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.373+0000 7f10c33b9640 1 --2- 172.21.15.169:0/4205947016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a8003b40 0x7f10bc06d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.373+0000 7f10c33b9640 1 -- 172.21.15.169:0/4205947016 >> 172.21.15.169:0/4205947016 conn(0x7f10bc06fb80 msgr2=0x7f10bc0c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:46.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.373+0000 7f10c33b9640 1 -- 172.21.15.169:0/4205947016 shutdown_connections 2024-09-19T06:36:46.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.373+0000 7f10c33b9640 1 -- 172.21.15.169:0/4205947016 wait complete. 2024-09-19T06:36:46.385 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 871d7d23-ed03-4629-bca9-5b71ad0d926a 1 2024-09-19T06:36:46.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.482+0000 7f7c362ae640 1 Processor -- start 2024-09-19T06:36:46.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.482+0000 7f7c362ae640 1 -- start start 2024-09-19T06:36:46.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.483+0000 7f7c362ae640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c30152160 0x7f7c30158980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:46.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.483+0000 7f7c362ae640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7c30072900 0x7f7c30072e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:46.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.483+0000 7f7c362ae640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c300726b0 con 0x7f7c300ca160 2024-09-19T06:36:46.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.483+0000 7f7c362ae640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f7c30158ec0 con 0x7f7c30072900 2024-09-19T06:36:46.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.483+0000 7f7c362ae640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7c3015be40 con 0x7f7c30152160 2024-09-19T06:36:46.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.483+0000 7f7c2ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c30152160 0x7f7c30158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:46.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.483+0000 7f7c2ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c30152160 0x7f7c30158980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:49202/0 (socket says 172.21.15.169:49202) 2024-09-19T06:36:46.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.483+0000 7f7c2ffff640 1 -- 172.21.15.169:0/1325037211 learned_addr learned my addr 172.21.15.169:0/1325037211 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T06:36:46.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.483+0000 7f7c2ffff640 1 -- 172.21.15.169:0/1325037211 >> v2:172.21.15.86:3300/0 conn(0x7f7c30072900 msgr2=0x7f7c30072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:36:46.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.483+0000 7f7c2ffff640 1 --2- 172.21.15.169:0/1325037211 >> v2:172.21.15.86:3300/0 conn(0x7f7c30072900 0x7f7c30072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.483+0000 7f7c2ffff640 1 -- 172.21.15.169:0/1325037211 >> v1:172.21.15.86:6789/0 conn(0x7f7c300ca160 legacy=0x7f7c3006ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:36:46.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.483+0000 7f7c2ffff640 1 -- 172.21.15.169:0/1325037211 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c300723d0 con 0x7f7c30152160 2024-09-19T06:36:46.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.484+0000 7f7c2ffff640 1 --2- 172.21.15.169:0/1325037211 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c30152160 0x7f7c30158980 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7c18009870 tx=0x7f7c1802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5d1a0ef53f5db6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:46.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.484+0000 7f7c2effd640 1 -- 172.21.15.169:0/1325037211 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c18037070 con 0x7f7c30152160 2024-09-19T06:36:46.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.484+0000 7f7c2effd640 1 -- 172.21.15.169:0/1325037211 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c18032440 con 0x7f7c30152160 2024-09-19T06:36:46.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.484+0000 7f7c2effd640 1 -- 172.21.15.169:0/1325037211 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c18032810 con 0x7f7c30152160 2024-09-19T06:36:46.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.485+0000 7f7c362ae640 1 -- 172.21.15.169:0/1325037211 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c30152160 msgr2=0x7f7c30158980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:46.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.485+0000 7f7c362ae640 1 --2- 172.21.15.169:0/1325037211 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c30152160 0x7f7c30158980 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7c18009870 tx=0x7f7c1802a210 comp rx=0 tx=0).stop 2024-09-19T06:36:46.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.485+0000 7f7c362ae640 1 -- 172.21.15.169:0/1325037211 shutdown_connections 2024-09-19T06:36:46.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.485+0000 7f7c362ae640 1 --2- 172.21.15.169:0/1325037211 >> v2:172.21.15.86:3300/0 conn(0x7f7c30072900 0x7f7c30072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.485+0000 7f7c362ae640 1 --2- 172.21.15.169:0/1325037211 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c30152160 0x7f7c30158980 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.485+0000 7f7c362ae640 1 -- 172.21.15.169:0/1325037211 >> 172.21.15.169:0/1325037211 conn(0x7f7c3006fb80 msgr2=0x7f7c3006ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:46.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.485+0000 7f7c362ae640 1 -- 172.21.15.169:0/1325037211 shutdown_connections 2024-09-19T06:36:46.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.485+0000 7f7c362ae640 1 -- 172.21.15.169:0/1325037211 wait complete. 2024-09-19T06:36:46.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.486+0000 7f7c362ae640 1 Processor -- start 2024-09-19T06:36:46.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.486+0000 7f7c362ae640 1 -- start start 2024-09-19T06:36:46.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.487+0000 7f7c362ae640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c30072900 0x7f7c301f1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:46.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.487+0000 7f7c362ae640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c300ca160 0x7f7c301f1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:46.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.487+0000 7f7c362ae640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c30152160 0x7f7c300cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:46.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.487+0000 7f7c362ae640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7c3015bad0 con 0x7f7c30152160 2024-09-19T06:36:46.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.487+0000 7f7c362ae640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7c3015b7f0 con 0x7f7c30072900 2024-09-19T06:36:46.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.487+0000 7f7c362ae640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7c3015c2d0 con 0x7f7c300ca160 2024-09-19T06:36:46.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.487+0000 7f7c2f7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c300ca160 0x7f7c301f1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:46.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.487+0000 7f7c2ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c30072900 0x7f7c301f1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:46.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.487+0000 7f7c2f7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c300ca160 0x7f7c301f1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:49206/0 (socket says 172.21.15.169:49206) 2024-09-19T06:36:46.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.487+0000 7f7c2f7fe640 1 -- 172.21.15.169:0/864970881 learned_addr learned my addr 172.21.15.169:0/864970881 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T06:36:46.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.487+0000 7f7c3484b640 1 --2- 172.21.15.169:0/864970881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c30152160 0x7f7c300cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:46.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.487+0000 7f7c2f7fe640 1 -- 172.21.15.169:0/864970881 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c30072900 msgr2=0x7f7c301f1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:46.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.487+0000 7f7c2f7fe640 1 --2- 172.21.15.169:0/864970881 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c30072900 0x7f7c301f1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.487+0000 7f7c2f7fe640 1 -- 172.21.15.169:0/864970881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c30152160 msgr2=0x7f7c300cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:46.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.487+0000 7f7c2f7fe640 1 --2- 172.21.15.169:0/864970881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c30152160 0x7f7c300cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.488+0000 7f7c2f7fe640 1 -- 172.21.15.169:0/864970881 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c301f2360 con 0x7f7c300ca160 2024-09-19T06:36:46.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.488+0000 7f7c2f7fe640 1 --2- 172.21.15.169:0/864970881 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c300ca160 0x7f7c301f1cb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000b480 tx=0x7f7c2000b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:46.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.488+0000 7f7c2cff9640 1 -- 172.21.15.169:0/864970881 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c20014070 con 0x7f7c300ca160 2024-09-19T06:36:46.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.488+0000 7f7c2cff9640 1 -- 172.21.15.169:0/864970881 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c20010870 con 0x7f7c300ca160 2024-09-19T06:36:46.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.488+0000 7f7c362ae640 1 -- 172.21.15.169:0/864970881 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c30142e80 con 0x7f7c300ca160 2024-09-19T06:36:46.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.488+0000 7f7c2cff9640 1 -- 172.21.15.169:0/864970881 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c20010c60 con 0x7f7c300ca160 2024-09-19T06:36:46.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.488+0000 7f7c362ae640 1 -- 172.21.15.169:0/864970881 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c300cb7b0 con 0x7f7c300ca160 2024-09-19T06:36:46.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.488+0000 7f7c2cff9640 1 -- 172.21.15.169:0/864970881 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7c20017070 con 0x7f7c300ca160 2024-09-19T06:36:46.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.488+0000 7f7c2cff9640 1 -- 172.21.15.169:0/864970881 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f7c2000f8e0 con 0x7f7c300ca160 2024-09-19T06:36:46.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.489+0000 7f7c362ae640 1 -- 172.21.15.169:0/864970881 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c30152540 con 0x7f7c300ca160 2024-09-19T06:36:46.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.491+0000 7f7c2cff9640 1 -- 172.21.15.169:0/864970881 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f7c2000fb30 con 0x7f7c300ca160 2024-09-19T06:36:46.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.560+0000 7f7c362ae640 1 -- 172.21.15.169:0/864970881 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "871d7d23-ed03-4629-bca9-5b71ad0d926a", "id": 1} v 0) -- 0x7f7c301433a0 con 0x7f7c300ca160 2024-09-19T06:36:46.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.568+0000 7f7c2cff9640 1 -- 172.21.15.169:0/864970881 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "871d7d23-ed03-4629-bca9-5b71ad0d926a", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f7c2000fde0 con 0x7f7c300ca160 2024-09-19T06:36:46.569 INFO:teuthology.orchestra.run.smithi169.stdout:1 2024-09-19T06:36:46.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.569+0000 7f7c362ae640 1 -- 172.21.15.169:0/864970881 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c300ca160 msgr2=0x7f7c301f1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:46.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.569+0000 7f7c362ae640 1 --2- 172.21.15.169:0/864970881 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c300ca160 0x7f7c301f1cb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000b480 tx=0x7f7c2000b940 comp rx=0 tx=0).stop 2024-09-19T06:36:46.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.569+0000 7f7c362ae640 1 -- 172.21.15.169:0/864970881 shutdown_connections 2024-09-19T06:36:46.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.569+0000 7f7c362ae640 1 --2- 172.21.15.169:0/864970881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c30152160 0x7f7c300cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.569+0000 7f7c362ae640 1 --2- 172.21.15.169:0/864970881 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c300ca160 0x7f7c301f1cb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.569+0000 7f7c362ae640 1 --2- 172.21.15.169:0/864970881 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c30072900 0x7f7c301f1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.569+0000 7f7c362ae640 1 -- 172.21.15.169:0/864970881 >> 172.21.15.169:0/864970881 conn(0x7f7c3006fb80 msgr2=0x7f7c301512e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:46.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.569+0000 7f7c362ae640 1 -- 172.21.15.169:0/864970881 shutdown_connections 2024-09-19T06:36:46.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.569+0000 7f7c362ae640 1 -- 172.21.15.169:0/864970881 wait complete. 2024-09-19T06:36:46.581 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 39d3562d-8c52-4af9-935a-2d90abb8b68d 2 2024-09-19T06:36:46.620 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-19T06:36:46.618+0000 7fc026f42040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:36:46.634 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:46.633+0000 7f82a0e21040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:36:46.672 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-19T06:36:46.671+0000 7fc026f42040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:36:46.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.678+0000 7f4e682ac640 1 Processor -- start 2024-09-19T06:36:46.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.678+0000 7f4e682ac640 1 -- start start 2024-09-19T06:36:46.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.680+0000 7f4e682ac640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e60072900 0x7f4e60158980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:46.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.680+0000 7f4e682ac640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4e600ca160 0x7f4e600ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:46.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.680+0000 7f4e65847640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e60072900 0x7f4e60158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:46.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.680+0000 7f4e66048640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f4e60152160 0x7f4e60072e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.169:60880/0 (socket says 172.21.15.169:60880) 2024-09-19T06:36:46.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.680+0000 7f4e66048640 1 -- 172.21.15.169:0/3637954646 learned_addr learned my addr 172.21.15.169:0/3637954646 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-19T06:36:46.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.680+0000 7f4e682ac640 1 -- 172.21.15.169:0/3637954646 --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e60073550 con 0x7f4e60152160 2024-09-19T06:36:46.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.680+0000 7f4e682ac640 1 -- 172.21.15.169:0/3637954646 --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f4e60158ec0 con 0x7f4e600ca160 2024-09-19T06:36:46.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.680+0000 7f4e682ac640 1 -- 172.21.15.169:0/3637954646 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4e6015be40 con 0x7f4e60072900 2024-09-19T06:36:46.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.680+0000 7f4e66849640 1 --2- 172.21.15.169:0/3637954646 >> v2:172.21.15.86:3300/0 conn(0x7f4e600ca160 0x7f4e600ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:46.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.680+0000 7f4e65847640 1 -- 172.21.15.169:0/3637954646 >> v2:172.21.15.86:3300/0 conn(0x7f4e600ca160 msgr2=0x7f4e600ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:36:46.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.680+0000 7f4e65847640 1 --2- 172.21.15.169:0/3637954646 >> v2:172.21.15.86:3300/0 conn(0x7f4e600ca160 0x7f4e600ca5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.680+0000 7f4e65847640 1 -- 172.21.15.169:0/3637954646 >> v1:172.21.15.86:6789/0 conn(0x7f4e60152160 legacy=0x7f4e60072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:46.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.680+0000 7f4e65847640 1 -- 172.21.15.169:0/3637954646 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e600726b0 con 0x7f4e60072900 2024-09-19T06:36:46.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.681+0000 7f4e65847640 1 --2- 172.21.15.169:0/3637954646 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e60072900 0x7f4e60158980 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4e500097a0 tx=0x7f4e5002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12e278f7595df311 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:46.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.681+0000 7f4e65046640 1 -- 172.21.15.169:0/3637954646 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e50037070 con 0x7f4e60072900 2024-09-19T06:36:46.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.681+0000 7f4e65046640 1 -- 172.21.15.169:0/3637954646 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e50032440 con 0x7f4e60072900 2024-09-19T06:36:46.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.681+0000 7f4e65046640 1 -- 172.21.15.169:0/3637954646 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e50032810 con 0x7f4e60072900 2024-09-19T06:36:46.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.682+0000 7f4e682ac640 1 -- 172.21.15.169:0/3637954646 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e60072900 msgr2=0x7f4e60158980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:46.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.682+0000 7f4e682ac640 1 --2- 172.21.15.169:0/3637954646 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e60072900 0x7f4e60158980 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4e500097a0 tx=0x7f4e5002a180 comp rx=0 tx=0).stop 2024-09-19T06:36:46.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.682+0000 7f4e682ac640 1 -- 172.21.15.169:0/3637954646 shutdown_connections 2024-09-19T06:36:46.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.682+0000 7f4e682ac640 1 --2- 172.21.15.169:0/3637954646 >> v2:172.21.15.86:3300/0 conn(0x7f4e600ca160 0x7f4e600ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.682+0000 7f4e682ac640 1 --2- 172.21.15.169:0/3637954646 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e60072900 0x7f4e60158980 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.682+0000 7f4e682ac640 1 -- 172.21.15.169:0/3637954646 >> 172.21.15.169:0/3637954646 conn(0x7f4e6006fb80 msgr2=0x7f4e6006ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:46.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.682+0000 7f4e682ac640 1 -- 172.21.15.169:0/3637954646 shutdown_connections 2024-09-19T06:36:46.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.682+0000 7f4e682ac640 1 -- 172.21.15.169:0/3637954646 wait complete. 2024-09-19T06:36:46.685 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:46.682+0000 7f82a0e21040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:36:46.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.684+0000 7f4e682ac640 1 Processor -- start 2024-09-19T06:36:46.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.684+0000 7f4e682ac640 1 -- start start 2024-09-19T06:36:46.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.685+0000 7f4e682ac640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e60072900 0x7f4e6014c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:46.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.685+0000 7f4e682ac640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e600ca160 0x7f4e6014c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:46.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.685+0000 7f4e682ac640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e60152160 0x7f4e60145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:46.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.685+0000 7f4e682ac640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6015b7f0 con 0x7f4e600ca160 2024-09-19T06:36:46.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.685+0000 7f4e682ac640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6015b510 con 0x7f4e60152160 2024-09-19T06:36:46.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.685+0000 7f4e682ac640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4e6015bad0 con 0x7f4e60072900 2024-09-19T06:36:46.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.685+0000 7f4e66048640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e60072900 0x7f4e6014c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:46.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.686+0000 7f4e66048640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e60072900 0x7f4e6014c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:49228/0 (socket says 172.21.15.169:49228) 2024-09-19T06:36:46.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.686+0000 7f4e66048640 1 -- 172.21.15.169:0/761248987 learned_addr learned my addr 172.21.15.169:0/761248987 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T06:36:46.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.686+0000 7f4e66849640 1 --2- 172.21.15.169:0/761248987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e60152160 0x7f4e60145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:46.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.686+0000 7f4e65847640 1 --2- 172.21.15.169:0/761248987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e600ca160 0x7f4e6014c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:46.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.686+0000 7f4e66048640 1 -- 172.21.15.169:0/761248987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e60152160 msgr2=0x7f4e60145e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:46.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.686+0000 7f4e66048640 1 --2- 172.21.15.169:0/761248987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e60152160 0x7f4e60145e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.686+0000 7f4e66048640 1 -- 172.21.15.169:0/761248987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e600ca160 msgr2=0x7f4e6014c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:46.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.686+0000 7f4e66048640 1 --2- 172.21.15.169:0/761248987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e600ca160 0x7f4e6014c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.686+0000 7f4e66048640 1 -- 172.21.15.169:0/761248987 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e601eec60 con 0x7f4e60072900 2024-09-19T06:36:46.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.686+0000 7f4e66048640 1 --2- 172.21.15.169:0/761248987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e60072900 0x7f4e6014c0a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00c3c0 tx=0x7f4e5c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:46.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.686+0000 7f4e56ffd640 1 -- 172.21.15.169:0/761248987 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c017070 con 0x7f4e60072900 2024-09-19T06:36:46.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.686+0000 7f4e56ffd640 1 -- 172.21.15.169:0/761248987 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e5c005ce0 con 0x7f4e60072900 2024-09-19T06:36:46.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.686+0000 7f4e56ffd640 1 -- 172.21.15.169:0/761248987 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c0072f0 con 0x7f4e60072900 2024-09-19T06:36:46.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.686+0000 7f4e682ac640 1 -- 172.21.15.169:0/761248987 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e6014b7f0 con 0x7f4e60072900 2024-09-19T06:36:46.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.686+0000 7f4e682ac640 1 -- 172.21.15.169:0/761248987 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e60145950 con 0x7f4e60072900 2024-09-19T06:36:46.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.686+0000 7f4e56ffd640 1 -- 172.21.15.169:0/761248987 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4e5c01a070 con 0x7f4e60072900 2024-09-19T06:36:46.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.686+0000 7f4e56ffd640 1 -- 172.21.15.169:0/761248987 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f4e5c012820 con 0x7f4e60072900 2024-09-19T06:36:46.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.687+0000 7f4e682ac640 1 -- 172.21.15.169:0/761248987 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e6015c2d0 con 0x7f4e60072900 2024-09-19T06:36:46.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.689+0000 7f4e56ffd640 1 -- 172.21.15.169:0/761248987 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4e5c021070 con 0x7f4e60072900 2024-09-19T06:36:46.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.759+0000 7f4e682ac640 1 -- 172.21.15.169:0/761248987 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "39d3562d-8c52-4af9-935a-2d90abb8b68d", "id": 2} v 0) -- 0x7f4e600c4460 con 0x7f4e60072900 2024-09-19T06:36:46.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.764+0000 7f4e56ffd640 1 -- 172.21.15.169:0/761248987 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "39d3562d-8c52-4af9-935a-2d90abb8b68d", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f4e5c012570 con 0x7f4e60072900 2024-09-19T06:36:46.765 INFO:teuthology.orchestra.run.smithi169.stdout:2 2024-09-19T06:36:46.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.765+0000 7f4e682ac640 1 -- 172.21.15.169:0/761248987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e60072900 msgr2=0x7f4e6014c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:46.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.765+0000 7f4e682ac640 1 --2- 172.21.15.169:0/761248987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e60072900 0x7f4e6014c0a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00c3c0 tx=0x7f4e5c00c880 comp rx=0 tx=0).stop 2024-09-19T06:36:46.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.765+0000 7f4e682ac640 1 -- 172.21.15.169:0/761248987 shutdown_connections 2024-09-19T06:36:46.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.765+0000 7f4e682ac640 1 --2- 172.21.15.169:0/761248987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e60152160 0x7f4e60145e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.765+0000 7f4e682ac640 1 --2- 172.21.15.169:0/761248987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e600ca160 0x7f4e6014c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.765+0000 7f4e682ac640 1 --2- 172.21.15.169:0/761248987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e60072900 0x7f4e6014c0a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.765+0000 7f4e682ac640 1 -- 172.21.15.169:0/761248987 >> 172.21.15.169:0/761248987 conn(0x7f4e6006fb80 msgr2=0x7f4e60075200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:46.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.765+0000 7f4e682ac640 1 -- 172.21.15.169:0/761248987 shutdown_connections 2024-09-19T06:36:46.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.765+0000 7f4e682ac640 1 -- 172.21.15.169:0/761248987 wait complete. 2024-09-19T06:36:46.777 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 7f88c5b1-042c-4a9f-a674-32456e0644a2 3 2024-09-19T06:36:46.832 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:46.830+0000 7f82a0e21040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:36:46.833 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-19T06:36:46.831+0000 7fc026f42040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:36:46.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.916+0000 7f319ac5c640 1 Processor -- start 2024-09-19T06:36:46.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.916+0000 7f319ac5c640 1 -- start start 2024-09-19T06:36:46.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.917+0000 7f319ac5c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31941554b0 0x7f319415e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:46.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.917+0000 7f319ac5c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f31940cb5c0 0x7f31940cba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:46.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.917+0000 7f319ac5c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31940cc9a0 con 0x7f31940c71c0 2024-09-19T06:36:46.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.917+0000 7f319ac5c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f31940c6d30 con 0x7f31940cb5c0 2024-09-19T06:36:46.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.917+0000 7f319ac5c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3194155890 con 0x7f31941554b0 2024-09-19T06:36:46.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.917+0000 7f31989f8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31941554b0 0x7f319415e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:46.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.917+0000 7f31991f9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f31940cb5c0 0x7f31940cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:46.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.917+0000 7f31991f9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f31940cb5c0 0x7f31940cba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:38366/0 (socket says 172.21.15.169:38366) 2024-09-19T06:36:46.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.917+0000 7f31989f8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31941554b0 0x7f319415e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:49244/0 (socket says 172.21.15.169:49244) 2024-09-19T06:36:46.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.917+0000 7f31991f9640 1 -- 172.21.15.169:0/2306001773 learned_addr learned my addr 172.21.15.169:0/2306001773 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T06:36:46.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.917+0000 7f3193fff640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f31940c71c0 0x7f31940cc290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:53882/0 (socket says 172.21.15.169:53882) 2024-09-19T06:36:46.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.917+0000 7f31989f8640 1 -- 172.21.15.169:0/2306001773 >> v2:172.21.15.169:3300/0 conn(0x7f31940cb5c0 msgr2=0x7f31940cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:36:46.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.917+0000 7f31989f8640 1 --2- 172.21.15.169:0/2306001773 >> v2:172.21.15.169:3300/0 conn(0x7f31940cb5c0 0x7f31940cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.917+0000 7f31989f8640 1 -- 172.21.15.169:0/2306001773 >> v1:172.21.15.169:6789/0 conn(0x7f31940c71c0 legacy=0x7f31940cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:46.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.917+0000 7f31989f8640 1 -- 172.21.15.169:0/2306001773 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31940d1970 con 0x7f31941554b0 2024-09-19T06:36:46.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.917+0000 7f31937fe640 1 -- 172.21.15.169:0/2306001773 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1416072977 0 0) 0x7f31940cc9a0 con 0x7f31940c71c0 2024-09-19T06:36:46.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.917+0000 7f31991f9640 1 --2- 172.21.15.169:0/2306001773 >> v2:172.21.15.169:3300/0 conn(0x7f31940cb5c0 0x7f31940cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:36:46.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.918+0000 7f31989f8640 1 --2- 172.21.15.169:0/2306001773 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31941554b0 0x7f319415e6b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f31880097a0 tx=0x7f318802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=636f28fba01c3970 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:46.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.918+0000 7f31937fe640 1 -- 172.21.15.169:0/2306001773 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3188037070 con 0x7f31941554b0 2024-09-19T06:36:46.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.918+0000 7f31937fe640 1 -- 172.21.15.169:0/2306001773 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3188032440 con 0x7f31941554b0 2024-09-19T06:36:46.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.918+0000 7f31937fe640 1 -- 172.21.15.169:0/2306001773 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3188032810 con 0x7f31941554b0 2024-09-19T06:36:46.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.919+0000 7f319ac5c640 1 -- 172.21.15.169:0/2306001773 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31941554b0 msgr2=0x7f319415e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:46.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.919+0000 7f319ac5c640 1 --2- 172.21.15.169:0/2306001773 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31941554b0 0x7f319415e6b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f31880097a0 tx=0x7f318802a180 comp rx=0 tx=0).stop 2024-09-19T06:36:46.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.919+0000 7f319ac5c640 1 -- 172.21.15.169:0/2306001773 shutdown_connections 2024-09-19T06:36:46.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.919+0000 7f319ac5c640 1 --2- 172.21.15.169:0/2306001773 >> v2:172.21.15.169:3300/0 conn(0x7f31940cb5c0 0x7f31940cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.919+0000 7f319ac5c640 1 --2- 172.21.15.169:0/2306001773 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31941554b0 0x7f319415e6b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.919+0000 7f319ac5c640 1 -- 172.21.15.169:0/2306001773 >> 172.21.15.169:0/2306001773 conn(0x7f3194067a70 msgr2=0x7f3194067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:46.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.919+0000 7f319ac5c640 1 -- 172.21.15.169:0/2306001773 shutdown_connections 2024-09-19T06:36:46.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.919+0000 7f319ac5c640 1 -- 172.21.15.169:0/2306001773 wait complete. 2024-09-19T06:36:46.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.920+0000 7f319ac5c640 1 Processor -- start 2024-09-19T06:36:46.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.920+0000 7f319ac5c640 1 -- start start 2024-09-19T06:36:46.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.921+0000 7f319ac5c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31940c71c0 0x7f319414cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:46.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.921+0000 7f319ac5c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31940cb5c0 0x7f31941f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:46.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.921+0000 7f319ac5c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31941554b0 0x7f31940c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:46.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.921+0000 7f319ac5c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f31940d1690 con 0x7f31940cb5c0 2024-09-19T06:36:46.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.921+0000 7f319ac5c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f31940c6720 con 0x7f31941554b0 2024-09-19T06:36:46.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.921+0000 7f319ac5c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f31940c69c0 con 0x7f31940c71c0 2024-09-19T06:36:46.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.921+0000 7f31989f8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31940c71c0 0x7f319414cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:46.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.921+0000 7f31989f8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31940c71c0 0x7f319414cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:49248/0 (socket says 172.21.15.169:49248) 2024-09-19T06:36:46.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.921+0000 7f31991f9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31941554b0 0x7f31940c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:46.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.921+0000 7f31989f8640 1 -- 172.21.15.169:0/817644999 learned_addr learned my addr 172.21.15.169:0/817644999 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T06:36:46.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.921+0000 7f3193fff640 1 --2- 172.21.15.169:0/817644999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31940cb5c0 0x7f31941f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:46.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.921+0000 7f31989f8640 1 -- 172.21.15.169:0/817644999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31941554b0 msgr2=0x7f31940c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:46.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.921+0000 7f31989f8640 1 --2- 172.21.15.169:0/817644999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31941554b0 0x7f31940c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.921+0000 7f31989f8640 1 -- 172.21.15.169:0/817644999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31940cb5c0 msgr2=0x7f31941f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:46.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.921+0000 7f31989f8640 1 --2- 172.21.15.169:0/817644999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31940cb5c0 0x7f31941f4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:46.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.921+0000 7f31989f8640 1 -- 172.21.15.169:0/817644999 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f319414f490 con 0x7f31940c71c0 2024-09-19T06:36:46.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.921+0000 7f31991f9640 1 --2- 172.21.15.169:0/817644999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31941554b0 0x7f31940c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:36:46.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.921+0000 7f3193fff640 1 --2- 172.21.15.169:0/817644999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31940cb5c0 0x7f31941f4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:36:46.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.921+0000 7f31989f8640 1 --2- 172.21.15.169:0/817644999 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31940c71c0 0x7f319414cd40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3188035040 tx=0x7f31880046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:46.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.922+0000 7f31917fa640 1 -- 172.21.15.169:0/817644999 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3188037050 con 0x7f31940c71c0 2024-09-19T06:36:46.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.922+0000 7f31917fa640 1 -- 172.21.15.169:0/817644999 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3188038040 con 0x7f31940c71c0 2024-09-19T06:36:46.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.922+0000 7f31917fa640 1 -- 172.21.15.169:0/817644999 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3188030b50 con 0x7f31940c71c0 2024-09-19T06:36:46.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.922+0000 7f319ac5c640 1 -- 172.21.15.169:0/817644999 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31941e6360 con 0x7f31940c71c0 2024-09-19T06:36:46.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.922+0000 7f319ac5c640 1 -- 172.21.15.169:0/817644999 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f31940c8500 con 0x7f31940c71c0 2024-09-19T06:36:46.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.922+0000 7f31917fa640 1 -- 172.21.15.169:0/817644999 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3188030cf0 con 0x7f31940c71c0 2024-09-19T06:36:46.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.922+0000 7f31917fa640 1 -- 172.21.15.169:0/817644999 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f318803cdf0 con 0x7f31940c71c0 2024-09-19T06:36:46.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.923+0000 7f319ac5c640 1 -- 172.21.15.169:0/817644999 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31940d0f70 con 0x7f31940c71c0 2024-09-19T06:36:46.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.925+0000 7f31917fa640 1 -- 172.21.15.169:0/817644999 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f318803e410 con 0x7f31940c71c0 2024-09-19T06:36:46.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.994+0000 7f319ac5c640 1 -- 172.21.15.169:0/817644999 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7f88c5b1-042c-4a9f-a674-32456e0644a2", "id": 3} v 0) -- 0x7f31940cc070 con 0x7f31940c71c0 2024-09-19T06:36:47.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:46.999+0000 7f31917fa640 1 -- 172.21.15.169:0/817644999 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7f88c5b1-042c-4a9f-a674-32456e0644a2", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f318803e630 con 0x7f31940c71c0 2024-09-19T06:36:47.001 INFO:teuthology.orchestra.run.smithi169.stdout:3 2024-09-19T06:36:47.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.000+0000 7f319ac5c640 1 -- 172.21.15.169:0/817644999 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31940c71c0 msgr2=0x7f319414cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:47.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.000+0000 7f319ac5c640 1 --2- 172.21.15.169:0/817644999 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31940c71c0 0x7f319414cd40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3188035040 tx=0x7f31880046c0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.000+0000 7f319ac5c640 1 -- 172.21.15.169:0/817644999 shutdown_connections 2024-09-19T06:36:47.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.000+0000 7f319ac5c640 1 --2- 172.21.15.169:0/817644999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31941554b0 0x7f31940c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.000+0000 7f319ac5c640 1 --2- 172.21.15.169:0/817644999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31940cb5c0 0x7f31941f4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.000+0000 7f319ac5c640 1 --2- 172.21.15.169:0/817644999 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31940c71c0 0x7f319414cd40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.000+0000 7f319ac5c640 1 -- 172.21.15.169:0/817644999 >> 172.21.15.169:0/817644999 conn(0x7f3194067a70 msgr2=0x7f319406c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:47.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.001+0000 7f319ac5c640 1 -- 172.21.15.169:0/817644999 shutdown_connections 2024-09-19T06:36:47.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.001+0000 7f319ac5c640 1 -- 172.21.15.169:0/817644999 wait complete. 2024-09-19T06:36:47.012 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 18aa391b-0863-48bf-bff6-107e22ee9752 4 2024-09-19T06:36:47.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.151+0000 7f3d9ef5f640 1 Processor -- start 2024-09-19T06:36:47.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.151+0000 7f3d9ef5f640 1 -- start start 2024-09-19T06:36:47.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.151+0000 7f3d9ef5f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d980c2460 0x7f3d9806d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:47.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.151+0000 7f3d9ef5f640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3d9815bad0 0x7f3d9815dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:47.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.151+0000 7f3d9ef5f640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d98067ef0 con 0x7f3d980c2840 2024-09-19T06:36:47.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.151+0000 7f3d9ef5f640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f3d9815bf60 con 0x7f3d9815bad0 2024-09-19T06:36:47.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.151+0000 7f3d9ef5f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3d98067930 con 0x7f3d980c2460 2024-09-19T06:36:47.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.152+0000 7f3d9ccfb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d980c2460 0x7f3d9806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:47.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.152+0000 7f3d9ccfb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d980c2460 0x7f3d9806d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:49254/0 (socket says 172.21.15.169:49254) 2024-09-19T06:36:47.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.152+0000 7f3d9ccfb640 1 -- 172.21.15.169:0/2351458854 learned_addr learned my addr 172.21.15.169:0/2351458854 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T06:36:47.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.152+0000 7f3d97fff640 1 --2- 172.21.15.169:0/2351458854 >> v2:172.21.15.86:3300/0 conn(0x7f3d9815bad0 0x7f3d9815dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:47.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.152+0000 7f3d9ccfb640 1 -- 172.21.15.169:0/2351458854 >> v2:172.21.15.86:3300/0 conn(0x7f3d9815bad0 msgr2=0x7f3d9815dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:36:47.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.152+0000 7f3d9ccfb640 1 --2- 172.21.15.169:0/2351458854 >> v2:172.21.15.86:3300/0 conn(0x7f3d9815bad0 0x7f3d9815dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.152+0000 7f3d9ccfb640 1 -- 172.21.15.169:0/2351458854 >> v1:172.21.15.86:6789/0 conn(0x7f3d980c2840 legacy=0x7f3d9815e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:47.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.152+0000 7f3d9ccfb640 1 -- 172.21.15.169:0/2351458854 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d98067c10 con 0x7f3d980c2460 2024-09-19T06:36:47.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.153+0000 7f3d9ccfb640 1 --2- 172.21.15.169:0/2351458854 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d980c2460 0x7f3d9806d710 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c009870 tx=0x7f3d8c02a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dd5f0a5f9fedf04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:47.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.153+0000 7f3d977fe640 1 -- 172.21.15.169:0/2351458854 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c037070 con 0x7f3d980c2460 2024-09-19T06:36:47.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.153+0000 7f3d977fe640 1 -- 172.21.15.169:0/2351458854 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d8c02ae50 con 0x7f3d980c2460 2024-09-19T06:36:47.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.153+0000 7f3d977fe640 1 -- 172.21.15.169:0/2351458854 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c032860 con 0x7f3d980c2460 2024-09-19T06:36:47.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.153+0000 7f3d9ef5f640 1 -- 172.21.15.169:0/2351458854 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d980c2460 msgr2=0x7f3d9806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:47.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.153+0000 7f3d9ef5f640 1 --2- 172.21.15.169:0/2351458854 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d980c2460 0x7f3d9806d710 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c009870 tx=0x7f3d8c02a300 comp rx=0 tx=0).stop 2024-09-19T06:36:47.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.154+0000 7f3d9ef5f640 1 -- 172.21.15.169:0/2351458854 shutdown_connections 2024-09-19T06:36:47.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.154+0000 7f3d9ef5f640 1 --2- 172.21.15.169:0/2351458854 >> v2:172.21.15.86:3300/0 conn(0x7f3d9815bad0 0x7f3d9815dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.154+0000 7f3d9ef5f640 1 --2- 172.21.15.169:0/2351458854 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d980c2460 0x7f3d9806d710 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.154+0000 7f3d9ef5f640 1 -- 172.21.15.169:0/2351458854 >> 172.21.15.169:0/2351458854 conn(0x7f3d9806bbc0 msgr2=0x7f3d9806bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:47.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.154+0000 7f3d9ef5f640 1 -- 172.21.15.169:0/2351458854 shutdown_connections 2024-09-19T06:36:47.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.154+0000 7f3d9ef5f640 1 -- 172.21.15.169:0/2351458854 wait complete. 2024-09-19T06:36:47.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.155+0000 7f3d9ef5f640 1 Processor -- start 2024-09-19T06:36:47.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.155+0000 7f3d9ef5f640 1 -- start start 2024-09-19T06:36:47.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.156+0000 7f3d9ef5f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3d980c2460 0x7f3d9815a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:47.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.156+0000 7f3d9ef5f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d980c2840 0x7f3d981f0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:47.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.156+0000 7f3d9ef5f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d98155a10 0x7f3d981f3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:47.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.156+0000 7f3d9ef5f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9815c510 con 0x7f3d980c2840 2024-09-19T06:36:47.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.156+0000 7f3d9ef5f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9806d1f0 con 0x7f3d980c2460 2024-09-19T06:36:47.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.156+0000 7f3d9ef5f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3d981f0970 con 0x7f3d98155a10 2024-09-19T06:36:47.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.156+0000 7f3d9ccfb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3d980c2460 0x7f3d9815a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:47.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.156+0000 7f3d9d4fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d98155a10 0x7f3d981f3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:47.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.156+0000 7f3d9ccfb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3d980c2460 0x7f3d9815a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:38388/0 (socket says 172.21.15.169:38388) 2024-09-19T06:36:47.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.156+0000 7f3d9ccfb640 1 -- 172.21.15.169:0/1746107337 learned_addr learned my addr 172.21.15.169:0/1746107337 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T06:36:47.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.156+0000 7f3d97fff640 1 --2- 172.21.15.169:0/1746107337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d980c2840 0x7f3d981f0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:47.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.156+0000 7f3d9ccfb640 1 -- 172.21.15.169:0/1746107337 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d98155a10 msgr2=0x7f3d981f3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:47.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.156+0000 7f3d9ccfb640 1 --2- 172.21.15.169:0/1746107337 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d98155a10 0x7f3d981f3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.156+0000 7f3d9ccfb640 1 -- 172.21.15.169:0/1746107337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d980c2840 msgr2=0x7f3d981f0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:47.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.156+0000 7f3d9ccfb640 1 --2- 172.21.15.169:0/1746107337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d980c2840 0x7f3d981f0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.156+0000 7f3d9ccfb640 1 -- 172.21.15.169:0/1746107337 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d980c7610 con 0x7f3d980c2460 2024-09-19T06:36:47.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.156+0000 7f3d9d4fc640 1 --2- 172.21.15.169:0/1746107337 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d98155a10 0x7f3d981f3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:36:47.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.156+0000 7f3d9ccfb640 1 --2- 172.21.15.169:0/1746107337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3d980c2460 0x7f3d9815a8c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c009870 tx=0x7f3d8c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:47.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.156+0000 7f3d957fa640 1 -- 172.21.15.169:0/1746107337 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c041070 con 0x7f3d980c2460 2024-09-19T06:36:47.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.156+0000 7f3d957fa640 1 -- 172.21.15.169:0/1746107337 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d8c03c670 con 0x7f3d980c2460 2024-09-19T06:36:47.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.156+0000 7f3d9ef5f640 1 -- 172.21.15.169:0/1746107337 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d980b0f90 con 0x7f3d980c2460 2024-09-19T06:36:47.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.156+0000 7f3d957fa640 1 -- 172.21.15.169:0/1746107337 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c037040 con 0x7f3d980c2460 2024-09-19T06:36:47.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.157+0000 7f3d9ef5f640 1 -- 172.21.15.169:0/1746107337 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d980b1550 con 0x7f3d980c2460 2024-09-19T06:36:47.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.157+0000 7f3d957fa640 1 -- 172.21.15.169:0/1746107337 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3d8c044070 con 0x7f3d980c2460 2024-09-19T06:36:47.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.157+0000 7f3d957fa640 1 -- 172.21.15.169:0/1746107337 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f3d8c03d3f0 con 0x7f3d980c2460 2024-09-19T06:36:47.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.158+0000 7f3d9ef5f640 1 -- 172.21.15.169:0/1746107337 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d981f06d0 con 0x7f3d980c2460 2024-09-19T06:36:47.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.160+0000 7f3d957fa640 1 -- 172.21.15.169:0/1746107337 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3d8c046450 con 0x7f3d980c2460 2024-09-19T06:36:47.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.229+0000 7f3d9ef5f640 1 -- 172.21.15.169:0/1746107337 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "18aa391b-0863-48bf-bff6-107e22ee9752", "id": 4} v 0) -- 0x7f3d98153f60 con 0x7f3d980c2460 2024-09-19T06:36:47.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.235+0000 7f3d957fa640 1 -- 172.21.15.169:0/1746107337 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "18aa391b-0863-48bf-bff6-107e22ee9752", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f3d8c03ca60 con 0x7f3d980c2460 2024-09-19T06:36:47.236 INFO:teuthology.orchestra.run.smithi169.stdout:4 2024-09-19T06:36:47.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.236+0000 7f3d9ef5f640 1 -- 172.21.15.169:0/1746107337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3d980c2460 msgr2=0x7f3d9815a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:47.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.236+0000 7f3d9ef5f640 1 --2- 172.21.15.169:0/1746107337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3d980c2460 0x7f3d9815a8c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c009870 tx=0x7f3d8c0046c0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.236+0000 7f3d9ef5f640 1 -- 172.21.15.169:0/1746107337 shutdown_connections 2024-09-19T06:36:47.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.236+0000 7f3d9ef5f640 1 --2- 172.21.15.169:0/1746107337 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d98155a10 0x7f3d981f3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.236+0000 7f3d9ef5f640 1 --2- 172.21.15.169:0/1746107337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d980c2840 0x7f3d981f0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.236+0000 7f3d9ef5f640 1 --2- 172.21.15.169:0/1746107337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3d980c2460 0x7f3d9815a8c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.236+0000 7f3d9ef5f640 1 -- 172.21.15.169:0/1746107337 >> 172.21.15.169:0/1746107337 conn(0x7f3d9806bbc0 msgr2=0x7f3d9806d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:47.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.236+0000 7f3d9ef5f640 1 -- 172.21.15.169:0/1746107337 shutdown_connections 2024-09-19T06:36:47.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.236+0000 7f3d9ef5f640 1 -- 172.21.15.169:0/1746107337 wait complete. 2024-09-19T06:36:47.248 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 90fa5ca6-1815-4af1-a664-b45a9e19dd56 5 2024-09-19T06:36:47.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.346+0000 7fe103cae640 1 Processor -- start 2024-09-19T06:36:47.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.346+0000 7fe103cae640 1 -- start start 2024-09-19T06:36:47.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.347+0000 7fe103cae640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe0fc0c83a0 0x7fe0fc071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:47.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.347+0000 7fe103cae640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0fc070980 con 0x7fe0fc0c8780 2024-09-19T06:36:47.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.347+0000 7fe103cae640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0fc159940 con 0x7fe0fc0c5da0 2024-09-19T06:36:47.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.347+0000 7fe103cae640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe0fc159c20 con 0x7fe0fc0c83a0 2024-09-19T06:36:47.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.347+0000 7fe101a4a640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe0fc0c83a0 0x7fe0fc071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:47.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.347+0000 7fe10224b640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fe0fc0c5da0 0x7fe0fc152f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:53888/0 (socket says 172.21.15.169:53888) 2024-09-19T06:36:47.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.347+0000 7fe10224b640 1 -- 172.21.15.169:0/1559064627 learned_addr learned my addr 172.21.15.169:0/1559064627 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-19T06:36:47.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.347+0000 7fe101a4a640 1 -- 172.21.15.169:0/1559064627 >> v1:172.21.15.169:6789/0 conn(0x7fe0fc0c5da0 legacy=0x7fe0fc152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:47.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.347+0000 7fe101a4a640 1 -- 172.21.15.169:0/1559064627 >> v1:172.21.15.86:6789/0 conn(0x7fe0fc0c8780 legacy=0x7fe0fc159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:47.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.347+0000 7fe101a4a640 1 -- 172.21.15.169:0/1559064627 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0fc070c20 con 0x7fe0fc0c83a0 2024-09-19T06:36:47.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.348+0000 7fe101a4a640 1 --2- 172.21.15.169:0/1559064627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0fc0c83a0 0x7fe0fc071420 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec0097a0 tx=0x7fe0ec02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2a6f3d1130931db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:47.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.348+0000 7fe100a48640 1 -- 172.21.15.169:0/1559064627 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec037070 con 0x7fe0fc0c83a0 2024-09-19T06:36:47.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.348+0000 7fe100a48640 1 -- 172.21.15.169:0/1559064627 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0ec032440 con 0x7fe0fc0c83a0 2024-09-19T06:36:47.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.348+0000 7fe100a48640 1 -- 172.21.15.169:0/1559064627 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec032810 con 0x7fe0fc0c83a0 2024-09-19T06:36:47.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.349+0000 7fe103cae640 1 -- 172.21.15.169:0/1559064627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0fc0c83a0 msgr2=0x7fe0fc071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:47.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.349+0000 7fe103cae640 1 --2- 172.21.15.169:0/1559064627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0fc0c83a0 0x7fe0fc071420 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec0097a0 tx=0x7fe0ec02a230 comp rx=0 tx=0).stop 2024-09-19T06:36:47.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.349+0000 7fe103cae640 1 -- 172.21.15.169:0/1559064627 shutdown_connections 2024-09-19T06:36:47.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.349+0000 7fe103cae640 1 --2- 172.21.15.169:0/1559064627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0fc0c83a0 0x7fe0fc071420 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.349+0000 7fe103cae640 1 -- 172.21.15.169:0/1559064627 >> 172.21.15.169:0/1559064627 conn(0x7fe0fc073160 msgr2=0x7fe0fc073570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:47.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.349+0000 7fe103cae640 1 -- 172.21.15.169:0/1559064627 shutdown_connections 2024-09-19T06:36:47.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.349+0000 7fe103cae640 1 -- 172.21.15.169:0/1559064627 wait complete. 2024-09-19T06:36:47.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.350+0000 7fe103cae640 1 Processor -- start 2024-09-19T06:36:47.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.350+0000 7fe103cae640 1 -- start start 2024-09-19T06:36:47.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.351+0000 7fe103cae640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0fc0c5da0 0x7fe0fc156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:47.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.351+0000 7fe103cae640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0fc0c83a0 0x7fe0fc158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:47.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.351+0000 7fe103cae640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0fc0c8780 0x7fe0fc0ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:47.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.351+0000 7fe103cae640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc071960 con 0x7fe0fc0c83a0 2024-09-19T06:36:47.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.351+0000 7fe103cae640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc159f00 con 0x7fe0fc0c8780 2024-09-19T06:36:47.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.351+0000 7fe103cae640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe0fc073dd0 con 0x7fe0fc0c5da0 2024-09-19T06:36:47.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.351+0000 7fe101a4a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0fc0c5da0 0x7fe0fc156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:47.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.351+0000 7fe10224b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0fc0c8780 0x7fe0fc0ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:47.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.351+0000 7fe101a4a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0fc0c5da0 0x7fe0fc156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:49274/0 (socket says 172.21.15.169:49274) 2024-09-19T06:36:47.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.351+0000 7fe101a4a640 1 -- 172.21.15.169:0/1160496598 learned_addr learned my addr 172.21.15.169:0/1160496598 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T06:36:47.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.351+0000 7fe101249640 1 --2- 172.21.15.169:0/1160496598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0fc0c83a0 0x7fe0fc158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:47.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.351+0000 7fe101a4a640 1 -- 172.21.15.169:0/1160496598 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0fc0c8780 msgr2=0x7fe0fc0ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:47.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.351+0000 7fe101a4a640 1 --2- 172.21.15.169:0/1160496598 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0fc0c8780 0x7fe0fc0ca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.351+0000 7fe101a4a640 1 -- 172.21.15.169:0/1160496598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0fc0c83a0 msgr2=0x7fe0fc158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:47.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.351+0000 7fe101a4a640 1 --2- 172.21.15.169:0/1160496598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0fc0c83a0 0x7fe0fc158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.351+0000 7fe101a4a640 1 -- 172.21.15.169:0/1160496598 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0fc1571c0 con 0x7fe0fc0c5da0 2024-09-19T06:36:47.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.351+0000 7fe10224b640 1 --2- 172.21.15.169:0/1160496598 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0fc0c8780 0x7fe0fc0ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:36:47.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.351+0000 7fe101a4a640 1 --2- 172.21.15.169:0/1160496598 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0fc0c5da0 0x7fe0fc156c80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec035040 tx=0x7fe0ec0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:47.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.351+0000 7fe0f27fc640 1 -- 172.21.15.169:0/1160496598 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec037040 con 0x7fe0fc0c5da0 2024-09-19T06:36:47.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.352+0000 7fe0f27fc640 1 -- 172.21.15.169:0/1160496598 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0ec030770 con 0x7fe0fc0c5da0 2024-09-19T06:36:47.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.352+0000 7fe103cae640 1 -- 172.21.15.169:0/1160496598 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0fc1f1720 con 0x7fe0fc0c5da0 2024-09-19T06:36:47.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.352+0000 7fe0f27fc640 1 -- 172.21.15.169:0/1160496598 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec030b80 con 0x7fe0fc0c5da0 2024-09-19T06:36:47.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.352+0000 7fe103cae640 1 -- 172.21.15.169:0/1160496598 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0fc1584a0 con 0x7fe0fc0c5da0 2024-09-19T06:36:47.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.352+0000 7fe0f27fc640 1 -- 172.21.15.169:0/1160496598 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe0ec044020 con 0x7fe0fc0c5da0 2024-09-19T06:36:47.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.352+0000 7fe0f27fc640 1 -- 172.21.15.169:0/1160496598 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fe0ec046990 con 0x7fe0fc0c5da0 2024-09-19T06:36:47.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.352+0000 7fe103cae640 1 -- 172.21.15.169:0/1160496598 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0fc0cb6d0 con 0x7fe0fc0c5da0 2024-09-19T06:36:47.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.356+0000 7fe0f27fc640 1 -- 172.21.15.169:0/1160496598 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fe0fc0cb6d0 con 0x7fe0fc0c5da0 2024-09-19T06:36:47.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.425+0000 7fe103cae640 1 -- 172.21.15.169:0/1160496598 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "90fa5ca6-1815-4af1-a664-b45a9e19dd56", "id": 5} v 0) -- 0x7fe0fc15a490 con 0x7fe0fc0c5da0 2024-09-19T06:36:47.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.431+0000 7fe0f27fc640 1 -- 172.21.15.169:0/1160496598 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "90fa5ca6-1815-4af1-a664-b45a9e19dd56", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fe0ec032e20 con 0x7fe0fc0c5da0 2024-09-19T06:36:47.433 INFO:teuthology.orchestra.run.smithi169.stdout:5 2024-09-19T06:36:47.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.432+0000 7fe103cae640 1 -- 172.21.15.169:0/1160496598 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0fc0c5da0 msgr2=0x7fe0fc156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:47.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.432+0000 7fe103cae640 1 --2- 172.21.15.169:0/1160496598 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0fc0c5da0 0x7fe0fc156c80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec035040 tx=0x7fe0ec0046c0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.432+0000 7fe103cae640 1 -- 172.21.15.169:0/1160496598 shutdown_connections 2024-09-19T06:36:47.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.432+0000 7fe103cae640 1 --2- 172.21.15.169:0/1160496598 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0fc0c8780 0x7fe0fc0ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.432+0000 7fe103cae640 1 --2- 172.21.15.169:0/1160496598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0fc0c83a0 0x7fe0fc158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.432+0000 7fe103cae640 1 --2- 172.21.15.169:0/1160496598 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0fc0c5da0 0x7fe0fc156c80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.432+0000 7fe103cae640 1 -- 172.21.15.169:0/1160496598 >> 172.21.15.169:0/1160496598 conn(0x7fe0fc073160 msgr2=0x7fe0fc0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:47.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.432+0000 7fe103cae640 1 -- 172.21.15.169:0/1160496598 shutdown_connections 2024-09-19T06:36:47.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.432+0000 7fe103cae640 1 -- 172.21.15.169:0/1160496598 wait complete. 2024-09-19T06:36:47.444 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 8b2019fc-6cc2-4394-9a7c-7951544f7cec 6 2024-09-19T06:36:47.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.542+0000 7f61fa79f640 1 Processor -- start 2024-09-19T06:36:47.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.542+0000 7f61fa79f640 1 -- start start 2024-09-19T06:36:47.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.543+0000 7f61fa79f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61f4071dc0 0x7f61f4072250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:47.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.543+0000 7f61fa79f640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f61f406c6b0 0x7f61f40b1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:47.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.543+0000 7f61fa79f640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61f4067890 con 0x7f61f4073040 2024-09-19T06:36:47.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.543+0000 7f61fa79f640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f61f4067e10 con 0x7f61f406c6b0 2024-09-19T06:36:47.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.543+0000 7f61fa79f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f61f4067b30 con 0x7f61f4071dc0 2024-09-19T06:36:47.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.543+0000 7f61f8d3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f61f406c6b0 0x7f61f40b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:47.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.543+0000 7f61f37fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61f4071dc0 0x7f61f4072250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:47.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.543+0000 7f61f3fff640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f61f4073040 0x7f61f415bb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:53898/0 (socket says 172.21.15.169:53898) 2024-09-19T06:36:47.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.543+0000 7f61f3fff640 1 -- 172.21.15.169:0/810672529 learned_addr learned my addr 172.21.15.169:0/810672529 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-19T06:36:47.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.543+0000 7f61f37fe640 1 --2- 172.21.15.169:0/810672529 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61f4071dc0 0x7f61f4072250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:49276/0 (socket says 172.21.15.169:49276) 2024-09-19T06:36:47.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.543+0000 7f61f8d3c640 1 --2- 172.21.15.169:0/810672529 >> v2:172.21.15.169:3300/0 conn(0x7f61f406c6b0 0x7f61f40b1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:38406/0 (socket says 172.21.15.169:38406) 2024-09-19T06:36:47.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.543+0000 7f61f8d3c640 1 -- 172.21.15.169:0/810672529 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61f4071dc0 msgr2=0x7f61f4072250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:36:47.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.543+0000 7f61f8d3c640 1 --2- 172.21.15.169:0/810672529 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61f4071dc0 0x7f61f4072250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.543+0000 7f61f8d3c640 1 -- 172.21.15.169:0/810672529 >> v1:172.21.15.169:6789/0 conn(0x7f61f4073040 legacy=0x7f61f415bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:47.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.543+0000 7f61f2ffd640 1 -- 172.21.15.169:0/810672529 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1059815718 0 0) 0x7f61f4067890 con 0x7f61f4073040 2024-09-19T06:36:47.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.543+0000 7f61f8d3c640 1 -- 172.21.15.169:0/810672529 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f40b0590 con 0x7f61f406c6b0 2024-09-19T06:36:47.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.543+0000 7f61f37fe640 1 --2- 172.21.15.169:0/810672529 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61f4071dc0 0x7f61f4072250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:36:47.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.544+0000 7f61f8d3c640 1 --2- 172.21.15.169:0/810672529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f406c6b0 0x7f61f40b1070 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f61ec009d90 tx=0x7f61ec02a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e984fb5c8d6f05 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:47.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.544+0000 7f61f2ffd640 1 -- 172.21.15.169:0/810672529 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ec031600 con 0x7f61f406c6b0 2024-09-19T06:36:47.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.544+0000 7f61f2ffd640 1 -- 172.21.15.169:0/810672529 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61ec0317a0 con 0x7f61f406c6b0 2024-09-19T06:36:47.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.544+0000 7f61f2ffd640 1 -- 172.21.15.169:0/810672529 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ec031b70 con 0x7f61f406c6b0 2024-09-19T06:36:47.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.545+0000 7f61fa79f640 1 -- 172.21.15.169:0/810672529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f406c6b0 msgr2=0x7f61f40b1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:47.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.545+0000 7f61fa79f640 1 --2- 172.21.15.169:0/810672529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f406c6b0 0x7f61f40b1070 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f61ec009d90 tx=0x7f61ec02a5d0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.545+0000 7f61fa79f640 1 -- 172.21.15.169:0/810672529 shutdown_connections 2024-09-19T06:36:47.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.545+0000 7f61fa79f640 1 --2- 172.21.15.169:0/810672529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f406c6b0 0x7f61f40b1070 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.545+0000 7f61fa79f640 1 --2- 172.21.15.169:0/810672529 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61f4071dc0 0x7f61f4072250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.545+0000 7f61fa79f640 1 -- 172.21.15.169:0/810672529 >> 172.21.15.169:0/810672529 conn(0x7f61f406bbc0 msgr2=0x7f61f406bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:47.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.545+0000 7f61fa79f640 1 -- 172.21.15.169:0/810672529 shutdown_connections 2024-09-19T06:36:47.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.545+0000 7f61fa79f640 1 -- 172.21.15.169:0/810672529 wait complete. 2024-09-19T06:36:47.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.546+0000 7f61fa79f640 1 Processor -- start 2024-09-19T06:36:47.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.546+0000 7f61fa79f640 1 -- start start 2024-09-19T06:36:47.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.547+0000 7f61fa79f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61f406c6b0 0x7f61f4149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:47.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.547+0000 7f61fa79f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f4071dc0 0x7f61f41512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:47.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.547+0000 7f61fa79f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61f4073040 0x7f61f41f40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:47.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.547+0000 7f61fa79f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f61f415c270 con 0x7f61f4073040 2024-09-19T06:36:47.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.547+0000 7f61fa79f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f61f40b0b50 con 0x7f61f4071dc0 2024-09-19T06:36:47.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.547+0000 7f61fa79f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f61f415c3f0 con 0x7f61f406c6b0 2024-09-19T06:36:47.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.547+0000 7f61f37fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f4071dc0 0x7f61f41512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:47.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.547+0000 7f61f3fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61f406c6b0 0x7f61f4149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:47.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.547+0000 7f61f37fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f4071dc0 0x7f61f41512c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:38414/0 (socket says 172.21.15.169:38414) 2024-09-19T06:36:47.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.547+0000 7f61f37fe640 1 -- 172.21.15.169:0/1533522582 learned_addr learned my addr 172.21.15.169:0/1533522582 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T06:36:47.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.547+0000 7f61f8d3c640 1 --2- 172.21.15.169:0/1533522582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61f4073040 0x7f61f41f40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:47.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.547+0000 7f61f37fe640 1 -- 172.21.15.169:0/1533522582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61f406c6b0 msgr2=0x7f61f4149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:47.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.547+0000 7f61f37fe640 1 --2- 172.21.15.169:0/1533522582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61f406c6b0 0x7f61f4149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.547+0000 7f61f37fe640 1 -- 172.21.15.169:0/1533522582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61f4073040 msgr2=0x7f61f41f40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:47.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.547+0000 7f61f37fe640 1 --2- 172.21.15.169:0/1533522582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61f4073040 0x7f61f41f40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.547+0000 7f61f37fe640 1 -- 172.21.15.169:0/1533522582 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f414a490 con 0x7f61f4071dc0 2024-09-19T06:36:47.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.547+0000 7f61f3fff640 1 --2- 172.21.15.169:0/1533522582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61f406c6b0 0x7f61f4149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:36:47.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.547+0000 7f61f8d3c640 1 --2- 172.21.15.169:0/1533522582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61f4073040 0x7f61f41f40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:36:47.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.547+0000 7f61f37fe640 1 --2- 172.21.15.169:0/1533522582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f4071dc0 0x7f61f41512c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f61e800ea10 tx=0x7f61e800eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:47.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.548+0000 7f61f0ff9640 1 -- 172.21.15.169:0/1533522582 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e8017070 con 0x7f61f4071dc0 2024-09-19T06:36:47.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.548+0000 7f61f0ff9640 1 -- 172.21.15.169:0/1533522582 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61e800ca60 con 0x7f61f4071dc0 2024-09-19T06:36:47.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.548+0000 7f61fa79f640 1 -- 172.21.15.169:0/1533522582 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61f41f4bf0 con 0x7f61f4071dc0 2024-09-19T06:36:47.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.548+0000 7f61f0ff9640 1 -- 172.21.15.169:0/1533522582 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e800ce50 con 0x7f61f4071dc0 2024-09-19T06:36:47.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.548+0000 7f61fa79f640 1 -- 172.21.15.169:0/1533522582 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61f4153010 con 0x7f61f4071dc0 2024-09-19T06:36:47.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.548+0000 7f61f0ff9640 1 -- 172.21.15.169:0/1533522582 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f61e801a070 con 0x7f61f4071dc0 2024-09-19T06:36:47.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.548+0000 7f61f0ff9640 1 -- 172.21.15.169:0/1533522582 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f61e8003be0 con 0x7f61f4071dc0 2024-09-19T06:36:47.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.549+0000 7f61fa79f640 1 -- 172.21.15.169:0/1533522582 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61f406e340 con 0x7f61f4071dc0 2024-09-19T06:36:47.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.551+0000 7f61f0ff9640 1 -- 172.21.15.169:0/1533522582 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f61e8003610 con 0x7f61f4071dc0 2024-09-19T06:36:47.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.619+0000 7f61fa79f640 1 -- 172.21.15.169:0/1533522582 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8b2019fc-6cc2-4394-9a7c-7951544f7cec", "id": 6} v 0) -- 0x7f61f40c95f0 con 0x7f61f4071dc0 2024-09-19T06:36:47.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.624+0000 7f61f0ff9640 1 -- 172.21.15.169:0/1533522582 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8b2019fc-6cc2-4394-9a7c-7951544f7cec", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f61e8005990 con 0x7f61f4071dc0 2024-09-19T06:36:47.625 INFO:teuthology.orchestra.run.smithi169.stdout:6 2024-09-19T06:36:47.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.625+0000 7f61fa79f640 1 -- 172.21.15.169:0/1533522582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f4071dc0 msgr2=0x7f61f41512c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:47.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.625+0000 7f61fa79f640 1 --2- 172.21.15.169:0/1533522582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f4071dc0 0x7f61f41512c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f61e800ea10 tx=0x7f61e800eed0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.625+0000 7f61fa79f640 1 -- 172.21.15.169:0/1533522582 shutdown_connections 2024-09-19T06:36:47.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.625+0000 7f61fa79f640 1 --2- 172.21.15.169:0/1533522582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61f4073040 0x7f61f41f40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.625+0000 7f61fa79f640 1 --2- 172.21.15.169:0/1533522582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f4071dc0 0x7f61f41512c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.625+0000 7f61fa79f640 1 --2- 172.21.15.169:0/1533522582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61f406c6b0 0x7f61f4149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.625+0000 7f61fa79f640 1 -- 172.21.15.169:0/1533522582 >> 172.21.15.169:0/1533522582 conn(0x7f61f406bbc0 msgr2=0x7f61f406cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:47.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.625+0000 7f61fa79f640 1 -- 172.21.15.169:0/1533522582 shutdown_connections 2024-09-19T06:36:47.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.625+0000 7f61fa79f640 1 -- 172.21.15.169:0/1533522582 wait complete. 2024-09-19T06:36:47.637 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 622e3b2c-5302-4b0a-b7f2-f4050801401e 7 2024-09-19T06:36:47.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.736+0000 7f8d00986640 1 Processor -- start 2024-09-19T06:36:47.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.736+0000 7f8d00986640 1 -- start start 2024-09-19T06:36:47.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.737+0000 7f8d00986640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8cfc152160 0x7f8cfc158980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:47.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.737+0000 7f8d00986640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cfc0ca160 0x7f8cfc0ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:47.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.737+0000 7f8d00986640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cfc073550 con 0x7f8cfc072900 2024-09-19T06:36:47.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.737+0000 7f8d00986640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f8cfc158ec0 con 0x7f8cfc152160 2024-09-19T06:36:47.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.737+0000 7f8d00986640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8cfc15be40 con 0x7f8cfc0ca160 2024-09-19T06:36:47.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.737+0000 7f8cfad9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cfc0ca160 0x7f8cfc0ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:47.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.737+0000 7f8cfad9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cfc0ca160 0x7f8cfc0ca5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:49292/0 (socket says 172.21.15.169:49292) 2024-09-19T06:36:47.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.737+0000 7f8cfad9d640 1 -- 172.21.15.169:0/3858564728 learned_addr learned my addr 172.21.15.169:0/3858564728 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T06:36:47.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.737+0000 7f8cfa59c640 1 --2- 172.21.15.169:0/3858564728 >> v2:172.21.15.86:3300/0 conn(0x7f8cfc152160 0x7f8cfc158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:47.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.737+0000 7f8cfad9d640 1 -- 172.21.15.169:0/3858564728 >> v2:172.21.15.86:3300/0 conn(0x7f8cfc152160 msgr2=0x7f8cfc158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:36:47.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.737+0000 7f8cfad9d640 1 --2- 172.21.15.169:0/3858564728 >> v2:172.21.15.86:3300/0 conn(0x7f8cfc152160 0x7f8cfc158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.737+0000 7f8cfad9d640 1 -- 172.21.15.169:0/3858564728 >> v1:172.21.15.86:6789/0 conn(0x7f8cfc072900 legacy=0x7f8cfc072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:47.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.737+0000 7f8cfad9d640 1 -- 172.21.15.169:0/3858564728 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cfc0726b0 con 0x7f8cfc0ca160 2024-09-19T06:36:47.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.738+0000 7f8cfad9d640 1 --2- 172.21.15.169:0/3858564728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cfc0ca160 0x7f8cfc0ca5b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4009e50 tx=0x7f8cf402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=400fc60296e3cc88 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:47.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.738+0000 7f8cf959a640 1 -- 172.21.15.169:0/3858564728 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4036070 con 0x7f8cfc0ca160 2024-09-19T06:36:47.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.738+0000 7f8cf959a640 1 -- 172.21.15.169:0/3858564728 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf4031600 con 0x7f8cfc0ca160 2024-09-19T06:36:47.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.738+0000 7f8cf959a640 1 -- 172.21.15.169:0/3858564728 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf40319d0 con 0x7f8cfc0ca160 2024-09-19T06:36:47.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.739+0000 7f8d00986640 1 -- 172.21.15.169:0/3858564728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cfc0ca160 msgr2=0x7f8cfc0ca5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:47.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.739+0000 7f8d00986640 1 --2- 172.21.15.169:0/3858564728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cfc0ca160 0x7f8cfc0ca5b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4009e50 tx=0x7f8cf402a710 comp rx=0 tx=0).stop 2024-09-19T06:36:47.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.739+0000 7f8d00986640 1 -- 172.21.15.169:0/3858564728 shutdown_connections 2024-09-19T06:36:47.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.739+0000 7f8d00986640 1 --2- 172.21.15.169:0/3858564728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cfc0ca160 0x7f8cfc0ca5b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.739+0000 7f8d00986640 1 --2- 172.21.15.169:0/3858564728 >> v2:172.21.15.86:3300/0 conn(0x7f8cfc152160 0x7f8cfc158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.739+0000 7f8d00986640 1 -- 172.21.15.169:0/3858564728 >> 172.21.15.169:0/3858564728 conn(0x7f8cfc06fb80 msgr2=0x7f8cfc06ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:47.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.739+0000 7f8d00986640 1 -- 172.21.15.169:0/3858564728 shutdown_connections 2024-09-19T06:36:47.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.739+0000 7f8d00986640 1 -- 172.21.15.169:0/3858564728 wait complete. 2024-09-19T06:36:47.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.740+0000 7f8d00986640 1 Processor -- start 2024-09-19T06:36:47.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.741+0000 7f8d00986640 1 -- start start 2024-09-19T06:36:47.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.741+0000 7f8d00986640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cfc072900 0x7f8cfc1e1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:47.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.741+0000 7f8d00986640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cfc0ca160 0x7f8cfc14a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:47.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.741+0000 7f8d00986640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8cfc152160 0x7f8cfc14a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:47.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.741+0000 7f8d00986640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8cfc15b7f0 con 0x7f8cfc0ca160 2024-09-19T06:36:47.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.741+0000 7f8d00986640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8cfc15b510 con 0x7f8cfc152160 2024-09-19T06:36:47.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.741+0000 7f8d00986640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8cfc15bad0 con 0x7f8cfc072900 2024-09-19T06:36:47.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.741+0000 7f8cfa59c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cfc072900 0x7f8cfc1e1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:47.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.741+0000 7f8cfad9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8cfc152160 0x7f8cfc14a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:47.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.741+0000 7f8cfa59c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cfc072900 0x7f8cfc1e1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:49308/0 (socket says 172.21.15.169:49308) 2024-09-19T06:36:47.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.741+0000 7f8cfa59c640 1 -- 172.21.15.169:0/2575202706 learned_addr learned my addr 172.21.15.169:0/2575202706 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T06:36:47.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.741+0000 7f8cf9d9b640 1 --2- 172.21.15.169:0/2575202706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cfc0ca160 0x7f8cfc14a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:47.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.742+0000 7f8cfad9d640 1 -- 172.21.15.169:0/2575202706 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cfc072900 msgr2=0x7f8cfc1e1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:47.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.742+0000 7f8cfad9d640 1 --2- 172.21.15.169:0/2575202706 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cfc072900 0x7f8cfc1e1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.742+0000 7f8cfad9d640 1 -- 172.21.15.169:0/2575202706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cfc0ca160 msgr2=0x7f8cfc14a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:47.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.742+0000 7f8cfad9d640 1 --2- 172.21.15.169:0/2575202706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cfc0ca160 0x7f8cfc14a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.742+0000 7f8cfad9d640 1 -- 172.21.15.169:0/2575202706 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cfc1f4c80 con 0x7f8cfc152160 2024-09-19T06:36:47.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.742+0000 7f8cfa59c640 1 --2- 172.21.15.169:0/2575202706 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cfc072900 0x7f8cfc1e1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:36:47.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.742+0000 7f8cf9d9b640 1 --2- 172.21.15.169:0/2575202706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cfc0ca160 0x7f8cfc14a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:36:47.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.742+0000 7f8cfad9d640 1 --2- 172.21.15.169:0/2575202706 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8cfc152160 0x7f8cfc14a5d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4030000 tx=0x7f8cf4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:47.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.742+0000 7f8ceaffd640 1 -- 172.21.15.169:0/2575202706 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4036050 con 0x7f8cfc152160 2024-09-19T06:36:47.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.742+0000 7f8ceaffd640 1 -- 172.21.15.169:0/2575202706 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf4042070 con 0x7f8cfc152160 2024-09-19T06:36:47.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.742+0000 7f8ceaffd640 1 -- 172.21.15.169:0/2575202706 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4009510 con 0x7f8cfc152160 2024-09-19T06:36:47.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.742+0000 7f8d00986640 1 -- 172.21.15.169:0/2575202706 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cfc15ac20 con 0x7f8cfc152160 2024-09-19T06:36:47.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.742+0000 7f8d00986640 1 -- 172.21.15.169:0/2575202706 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cfc15a320 con 0x7f8cfc152160 2024-09-19T06:36:47.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.742+0000 7f8ceaffd640 1 -- 172.21.15.169:0/2575202706 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8cf4007c10 con 0x7f8cfc152160 2024-09-19T06:36:47.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.742+0000 7f8ceaffd640 1 -- 172.21.15.169:0/2575202706 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f8cf403dab0 con 0x7f8cfc152160 2024-09-19T06:36:47.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.743+0000 7f8d00986640 1 -- 172.21.15.169:0/2575202706 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cfc15c2d0 con 0x7f8cfc152160 2024-09-19T06:36:47.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.745+0000 7f8ceaffd640 1 -- 172.21.15.169:0/2575202706 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8cf403dd50 con 0x7f8cfc152160 2024-09-19T06:36:47.781 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:47.780+0000 7f82a0e21040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:36:47.807 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-19T06:36:47.806+0000 7fc026f42040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:36:47.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.815+0000 7f8d00986640 1 -- 172.21.15.169:0/2575202706 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "622e3b2c-5302-4b0a-b7f2-f4050801401e", "id": 7} v 0) -- 0x7f8cfc0c4460 con 0x7f8cfc152160 2024-09-19T06:36:47.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.823+0000 7f8ceaffd640 1 -- 172.21.15.169:0/2575202706 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "622e3b2c-5302-4b0a-b7f2-f4050801401e", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f8cf4047460 con 0x7f8cfc152160 2024-09-19T06:36:47.824 INFO:teuthology.orchestra.run.smithi169.stdout:7 2024-09-19T06:36:47.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.824+0000 7f8d00986640 1 -- 172.21.15.169:0/2575202706 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8cfc152160 msgr2=0x7f8cfc14a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:47.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.824+0000 7f8d00986640 1 --2- 172.21.15.169:0/2575202706 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8cfc152160 0x7f8cfc14a5d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4030000 tx=0x7f8cf4004a40 comp rx=0 tx=0).stop 2024-09-19T06:36:47.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.824+0000 7f8d00986640 1 -- 172.21.15.169:0/2575202706 shutdown_connections 2024-09-19T06:36:47.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.824+0000 7f8d00986640 1 --2- 172.21.15.169:0/2575202706 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8cfc152160 0x7f8cfc14a5d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.824+0000 7f8d00986640 1 --2- 172.21.15.169:0/2575202706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cfc0ca160 0x7f8cfc14a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.824+0000 7f8d00986640 1 --2- 172.21.15.169:0/2575202706 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cfc072900 0x7f8cfc1e1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.824+0000 7f8d00986640 1 -- 172.21.15.169:0/2575202706 >> 172.21.15.169:0/2575202706 conn(0x7f8cfc06fb80 msgr2=0x7f8cfc155b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:47.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.824+0000 7f8d00986640 1 -- 172.21.15.169:0/2575202706 shutdown_connections 2024-09-19T06:36:47.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:36:47.824+0000 7f8d00986640 1 -- 172.21.15.169:0/2575202706 wait complete. 2024-09-19T06:36:47.834 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:47.832+0000 7f82a0e21040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:36:47.835 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-19T06:36:47.836 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-19T06:36:47.838 INFO:tasks.ceph.osd.0:Started 2024-09-19T06:36:47.838 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-19T06:36:47.838 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-19T06:36:47.840 INFO:tasks.ceph.osd.1:Started 2024-09-19T06:36:47.840 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-19T06:36:47.840 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-19T06:36:47.842 INFO:tasks.ceph.osd.2:Started 2024-09-19T06:36:47.842 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-19T06:36:47.843 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-19T06:36:47.845 INFO:tasks.ceph.osd.3:Started 2024-09-19T06:36:47.845 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-19T06:36:47.845 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-19T06:36:47.848 INFO:tasks.ceph.osd.4:Started 2024-09-19T06:36:47.848 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-19T06:36:47.848 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-19T06:36:47.851 INFO:tasks.ceph.osd.5:Started 2024-09-19T06:36:47.851 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-19T06:36:47.851 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-19T06:36:47.853 INFO:tasks.ceph.osd.6:Started 2024-09-19T06:36:47.853 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-19T06:36:47.853 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-19T06:36:47.856 INFO:tasks.ceph.osd.7:Started 2024-09-19T06:36:47.857 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T06:36:47.867 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-19T06:36:47.866+0000 7fc026f42040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:36:47.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.973+0000 7f7f21415640 1 Processor -- start 2024-09-19T06:36:47.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.973+0000 7f7f21415640 1 -- start start 2024-09-19T06:36:47.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.974+0000 7f7f21415640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7f1c157530 0x7f7f1c0c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:47.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.974+0000 7f7f21415640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7f1c0c3430 0x7f7f1c0c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:47.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.974+0000 7f7f21415640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f1c0c8b20 con 0x7f7f1c151870 2024-09-19T06:36:47.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.974+0000 7f7f21415640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f7f1c0b0030 con 0x7f7f1c0c3430 2024-09-19T06:36:47.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.974+0000 7f7f21415640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7f1c06ccf0 con 0x7f7f1c157530 2024-09-19T06:36:47.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.974+0000 7f7f1a7fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7f1c157530 0x7f7f1c0c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:47.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.974+0000 7f7f1affd640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f7f1c151870 0x7f7f1c0c8f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:40960/0 (socket says 172.21.15.86:40960) 2024-09-19T06:36:47.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.974+0000 7f7f1affd640 1 -- 172.21.15.86:0/2174527939 learned_addr learned my addr 172.21.15.86:0/2174527939 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:36:47.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.975+0000 7f7f1b7fe640 1 --2- 172.21.15.86:0/2174527939 >> v2:172.21.15.169:3300/0 conn(0x7f7f1c0c3430 0x7f7f1c0c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:47.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.975+0000 7f7f19ffb640 1 -- 172.21.15.86:0/2174527939 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 512412766 0 0) 0x7f7f1c0c8b20 con 0x7f7f1c151870 2024-09-19T06:36:47.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.975+0000 7f7f19ffb640 1 -- 172.21.15.86:0/2174527939 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f04003520 con 0x7f7f1c151870 2024-09-19T06:36:47.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.975+0000 7f7f1b7fe640 1 -- 172.21.15.86:0/2174527939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7f1c157530 msgr2=0x7f7f1c0c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:36:47.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.975+0000 7f7f1b7fe640 1 --2- 172.21.15.86:0/2174527939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7f1c157530 0x7f7f1c0c7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.975+0000 7f7f1b7fe640 1 -- 172.21.15.86:0/2174527939 >> v1:172.21.15.169:6789/0 conn(0x7f7f1c151870 legacy=0x7f7f1c0c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:47.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.975+0000 7f7f1b7fe640 1 -- 172.21.15.86:0/2174527939 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f1c0c8280 con 0x7f7f1c0c3430 2024-09-19T06:36:47.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.975+0000 7f7f1a7fc640 1 --2- 172.21.15.86:0/2174527939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7f1c157530 0x7f7f1c0c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:36:47.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.976+0000 7f7f1b7fe640 1 --2- 172.21.15.86:0/2174527939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f1c0c3430 0x7f7f1c0c38e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7f14009d90 tx=0x7f7f1402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e80bb3be105fef14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:47.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.976+0000 7f7f19ffb640 1 -- 172.21.15.86:0/2174527939 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f14007740 con 0x7f7f1c0c3430 2024-09-19T06:36:47.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.976+0000 7f7f19ffb640 1 -- 172.21.15.86:0/2174527939 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f140078e0 con 0x7f7f1c0c3430 2024-09-19T06:36:47.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.976+0000 7f7f19ffb640 1 -- 172.21.15.86:0/2174527939 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f14007cb0 con 0x7f7f1c0c3430 2024-09-19T06:36:47.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.976+0000 7f7f21415640 1 -- 172.21.15.86:0/2174527939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f1c0c3430 msgr2=0x7f7f1c0c38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:47.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.976+0000 7f7f21415640 1 --2- 172.21.15.86:0/2174527939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f1c0c3430 0x7f7f1c0c38e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7f14009d90 tx=0x7f7f1402a6f0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.976+0000 7f7f21415640 1 -- 172.21.15.86:0/2174527939 shutdown_connections 2024-09-19T06:36:47.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.976+0000 7f7f21415640 1 --2- 172.21.15.86:0/2174527939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f1c0c3430 0x7f7f1c0c38e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.976+0000 7f7f21415640 1 --2- 172.21.15.86:0/2174527939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7f1c157530 0x7f7f1c0c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.976+0000 7f7f21415640 1 -- 172.21.15.86:0/2174527939 >> 172.21.15.86:0/2174527939 conn(0x7f7f1c06bbc0 msgr2=0x7f7f1c06bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:47.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.976+0000 7f7f21415640 1 -- 172.21.15.86:0/2174527939 shutdown_connections 2024-09-19T06:36:47.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.976+0000 7f7f21415640 1 -- 172.21.15.86:0/2174527939 wait complete. 2024-09-19T06:36:47.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.978+0000 7f7f21415640 1 Processor -- start 2024-09-19T06:36:47.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.978+0000 7f7f21415640 1 -- start start 2024-09-19T06:36:47.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.978+0000 7f7f21415640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f1c0c3430 0x7f7f1c1dfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:47.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.978+0000 7f7f21415640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f1c151870 0x7f7f1c1ec4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:47.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.978+0000 7f7f21415640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7f1c157530 0x7f7f1c14f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:47.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.978+0000 7f7f21415640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1c0c2c30 con 0x7f7f1c0c3430 2024-09-19T06:36:47.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.978+0000 7f7f21415640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1c0c8840 con 0x7f7f1c151870 2024-09-19T06:36:47.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.978+0000 7f7f21415640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7f1c0c2f10 con 0x7f7f1c157530 2024-09-19T06:36:47.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.978+0000 7f7f1affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f1c0c3430 0x7f7f1c1dfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:47.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.978+0000 7f7f1affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f1c0c3430 0x7f7f1c1dfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47240/0 (socket says 172.21.15.86:47240) 2024-09-19T06:36:47.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.978+0000 7f7f1affd640 1 -- 172.21.15.86:0/841216696 learned_addr learned my addr 172.21.15.86:0/841216696 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:36:47.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.978+0000 7f7f1a7fc640 1 --2- 172.21.15.86:0/841216696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f1c151870 0x7f7f1c1ec4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:47.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.978+0000 7f7f1b7fe640 1 --2- 172.21.15.86:0/841216696 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7f1c157530 0x7f7f1c14f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:47.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.979+0000 7f7f1affd640 1 -- 172.21.15.86:0/841216696 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7f1c157530 msgr2=0x7f7f1c14f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:47.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.979+0000 7f7f1affd640 1 --2- 172.21.15.86:0/841216696 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7f1c157530 0x7f7f1c14f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.979+0000 7f7f1affd640 1 -- 172.21.15.86:0/841216696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f1c151870 msgr2=0x7f7f1c1ec4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:47.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.979+0000 7f7f1affd640 1 --2- 172.21.15.86:0/841216696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f1c151870 0x7f7f1c1ec4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:47.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.979+0000 7f7f1affd640 1 -- 172.21.15.86:0/841216696 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f1c1df250 con 0x7f7f1c0c3430 2024-09-19T06:36:47.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.979+0000 7f7f1a7fc640 1 --2- 172.21.15.86:0/841216696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f1c151870 0x7f7f1c1ec4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:36:47.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.979+0000 7f7f1affd640 1 --2- 172.21.15.86:0/841216696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f1c0c3430 0x7f7f1c1dfc80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7f1000c530 tx=0x7f7f1000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:47.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.979+0000 7f7f037fe640 1 -- 172.21.15.86:0/841216696 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f10017070 con 0x7f7f1c0c3430 2024-09-19T06:36:47.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.979+0000 7f7f037fe640 1 -- 172.21.15.86:0/841216696 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f10005ce0 con 0x7f7f1c0c3430 2024-09-19T06:36:47.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.979+0000 7f7f037fe640 1 -- 172.21.15.86:0/841216696 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f100072b0 con 0x7f7f1c0c3430 2024-09-19T06:36:47.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.979+0000 7f7f21415640 1 -- 172.21.15.86:0/841216696 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f1c1f0890 con 0x7f7f1c0c3430 2024-09-19T06:36:47.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.979+0000 7f7f21415640 1 -- 172.21.15.86:0/841216696 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f1c1df7d0 con 0x7f7f1c0c3430 2024-09-19T06:36:47.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.979+0000 7f7f037fe640 1 -- 172.21.15.86:0/841216696 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7f1001a070 con 0x7f7f1c0c3430 2024-09-19T06:36:47.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.979+0000 7f7f037fe640 1 -- 172.21.15.86:0/841216696 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f7f10012ad0 con 0x7f7f1c0c3430 2024-09-19T06:36:47.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.980+0000 7f7f21415640 1 -- 172.21.15.86:0/841216696 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f1c151c50 con 0x7f7f1c0c3430 2024-09-19T06:36:47.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:47.982+0000 7f7f037fe640 1 -- 172.21.15.86:0/841216696 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f7f10021020 con 0x7f7f1c0c3430 2024-09-19T06:36:48.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:48.041+0000 7f7f21415640 1 -- 172.21.15.86:0/841216696 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f1c06c0d0 con 0x7f7f1c0c3430 2024-09-19T06:36:48.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:48.041+0000 7f7f037fe640 1 -- 172.21.15.86:0/841216696 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f7f10007470 con 0x7f7f1c0c3430 2024-09-19T06:36:48.043 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:36:48.043 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":10,"fsid":"1785f09f-0959-457d-8c4a-6cce2e655a37","created":"2024-09-19T06:36:45.671544+0000","modified":"2024-09-19T06:36:47.816681+0000","last_up_change":"0.000000","last_in_change":"2024-09-19T06:36:47.816681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bd3ce3f2-2a37-40ec-8dc3-69246437277c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"871d7d23-ed03-4629-bca9-5b71ad0d926a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"39d3562d-8c52-4af9-935a-2d90abb8b68d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7f88c5b1-042c-4a9f-a674-32456e0644a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"18aa391b-0863-48bf-bff6-107e22ee9752","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"90fa5ca6-1815-4af1-a664-b45a9e19dd56","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8b2019fc-6cc2-4394-9a7c-7951544f7cec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"622e3b2c-5302-4b0a-b7f2-f4050801401e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:36:48.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:48.042+0000 7f7f21415640 1 -- 172.21.15.86:0/841216696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f1c0c3430 msgr2=0x7f7f1c1dfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:48.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:48.042+0000 7f7f21415640 1 --2- 172.21.15.86:0/841216696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f1c0c3430 0x7f7f1c1dfc80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7f1000c530 tx=0x7f7f1000c9f0 comp rx=0 tx=0).stop 2024-09-19T06:36:48.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:48.042+0000 7f7f21415640 1 -- 172.21.15.86:0/841216696 shutdown_connections 2024-09-19T06:36:48.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:48.042+0000 7f7f21415640 1 --2- 172.21.15.86:0/841216696 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7f1c157530 0x7f7f1c14f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:48.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:48.042+0000 7f7f21415640 1 --2- 172.21.15.86:0/841216696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f1c151870 0x7f7f1c1ec4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:48.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:48.042+0000 7f7f21415640 1 --2- 172.21.15.86:0/841216696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f1c0c3430 0x7f7f1c1dfc80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:48.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:48.042+0000 7f7f21415640 1 -- 172.21.15.86:0/841216696 >> 172.21.15.86:0/841216696 conn(0x7f7f1c06bbc0 msgr2=0x7f7f1c1565e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:48.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:48.042+0000 7f7f21415640 1 -- 172.21.15.86:0/841216696 shutdown_connections 2024-09-19T06:36:48.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:36:48.042+0000 7f7f21415640 1 -- 172.21.15.86:0/841216696 wait complete. 2024-09-19T06:36:48.054 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-19T06:36:48.054 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-19T06:36:48.243 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:48.242+0000 7f82a0e21040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:36:48.262 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-19T06:36:48.260+0000 7fc026f42040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:36:48.330 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:48.329+0000 7f82a0e21040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:36:48.347 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-19T06:36:48.345+0000 7fc026f42040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:36:48.435 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:48.434+0000 7f82a0e21040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:36:48.453 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-19T06:36:48.452+0000 7fc026f42040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:36:48.481 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:48.480+0000 7f82a0e21040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:36:48.501 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-19T06:36:48.499+0000 7fc026f42040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:36:48.594 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:48.593+0000 7f82a0e21040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:36:48.617 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-19T06:36:48.616+0000 7fc026f42040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:36:48.647 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:48.646+0000 7f82a0e21040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:36:48.670 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-19T06:36:48.669+0000 7fc026f42040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:36:48.692 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:48.691+0000 7f82a0e21040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:36:48.716 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-19T06:36:48.715+0000 7fc026f42040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:36:48.805 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:48.804+0000 7f82a0e21040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:36:48.830 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-19T06:36:48.829+0000 7fc026f42040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:36:48.851 INFO:tasks.ceph.osd.2.smithi086.stderr:2024-09-19T06:36:48.849+0000 7fe8179a8640 -1 Falling back to public interface 2024-09-19T06:36:48.854 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:48.853+0000 7f82a0e21040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:36:48.859 DEBUG:teuthology.orchestra.run.smithi086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T06:36:48.881 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-19T06:36:48.880+0000 7fc026f42040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:36:48.908 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:48.907+0000 7f82a0e21040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:36:48.932 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-19T06:36:48.931+0000 7fc026f42040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:36:48.952 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.951+0000 7fc36e8b7640 1 Processor -- start 2024-09-19T06:36:48.953 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.951+0000 7fc36e8b7640 1 -- start start 2024-09-19T06:36:48.954 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.952+0000 7fc36e8b7640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc3680b4a20 0x7fc3680703d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:48.954 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.952+0000 7fc36e8b7640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc36815d130 0x7fc368152a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:48.954 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.952+0000 7fc36e8b7640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3680cb1a0 con 0x7fc3680b4e00 2024-09-19T06:36:48.954 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.952+0000 7fc36e8b7640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fc3680cb440 con 0x7fc3680b4a20 2024-09-19T06:36:48.954 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.952+0000 7fc36e8b7640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fc3680ca680 con 0x7fc36815d130 2024-09-19T06:36:48.955 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.952+0000 7fc367fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc3680b4a20 0x7fc3680703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:48.955 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.952+0000 7fc367fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc3680b4a20 0x7fc3680703d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47254/0 (socket says 172.21.15.86:47254) 2024-09-19T06:36:48.955 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.952+0000 7fc3677fe640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc3680b4e00 0x7fc36815ca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49798/0 (socket says 172.21.15.86:49798) 2024-09-19T06:36:48.955 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.952+0000 7fc367fff640 1 -- 172.21.15.86:0/3352645512 learned_addr learned my addr 172.21.15.86:0/3352645512 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:36:48.955 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.952+0000 7fc36ce54640 1 --2- 172.21.15.86:0/3352645512 >> v2:172.21.15.169:3300/0 conn(0x7fc36815d130 0x7fc368152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:48.955 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.952+0000 7fc367fff640 1 -- 172.21.15.86:0/3352645512 >> v2:172.21.15.169:3300/0 conn(0x7fc36815d130 msgr2=0x7fc368152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:36:48.955 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.952+0000 7fc367fff640 1 --2- 172.21.15.86:0/3352645512 >> v2:172.21.15.169:3300/0 conn(0x7fc36815d130 0x7fc368152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:48.955 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.952+0000 7fc367fff640 1 -- 172.21.15.86:0/3352645512 >> v1:172.21.15.86:6789/0 conn(0x7fc3680b4e00 legacy=0x7fc36815ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:48.955 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.952+0000 7fc367fff640 1 -- 172.21.15.86:0/3352645512 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36815c500 con 0x7fc3680b4a20 2024-09-19T06:36:48.955 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.952+0000 7fc366ffd640 1 -- 172.21.15.86:0/3352645512 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 39358640 0 0) 0x7fc3680cb1a0 con 0x7fc3680b4e00 2024-09-19T06:36:48.955 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.953+0000 7fc367fff640 1 --2- 172.21.15.86:0/3352645512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3680b4a20 0x7fc3680703d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc3680b53d0 tx=0x7fc35002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5977813803dfaf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:48.956 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.953+0000 7fc366ffd640 1 -- 172.21.15.86:0/3352645512 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc350037070 con 0x7fc3680b4a20 2024-09-19T06:36:48.956 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.953+0000 7fc366ffd640 1 -- 172.21.15.86:0/3352645512 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc35002ae50 con 0x7fc3680b4a20 2024-09-19T06:36:48.956 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.953+0000 7fc366ffd640 1 -- 172.21.15.86:0/3352645512 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc350032860 con 0x7fc3680b4a20 2024-09-19T06:36:48.957 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.954+0000 7fc36e8b7640 1 -- 172.21.15.86:0/3352645512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3680b4a20 msgr2=0x7fc3680703d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:48.957 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.954+0000 7fc36e8b7640 1 --2- 172.21.15.86:0/3352645512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3680b4a20 0x7fc3680703d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc3680b53d0 tx=0x7fc35002a300 comp rx=0 tx=0).stop 2024-09-19T06:36:48.958 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.954+0000 7fc36e8b7640 1 -- 172.21.15.86:0/3352645512 shutdown_connections 2024-09-19T06:36:48.958 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.954+0000 7fc36e8b7640 1 --2- 172.21.15.86:0/3352645512 >> v2:172.21.15.169:3300/0 conn(0x7fc36815d130 0x7fc368152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:48.958 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.954+0000 7fc36e8b7640 1 --2- 172.21.15.86:0/3352645512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3680b4a20 0x7fc3680703d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:48.958 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.954+0000 7fc36e8b7640 1 -- 172.21.15.86:0/3352645512 >> 172.21.15.86:0/3352645512 conn(0x7fc3680cee80 msgr2=0x7fc3680cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:48.958 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.954+0000 7fc36e8b7640 1 -- 172.21.15.86:0/3352645512 shutdown_connections 2024-09-19T06:36:48.958 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.954+0000 7fc36e8b7640 1 -- 172.21.15.86:0/3352645512 wait complete. 2024-09-19T06:36:48.958 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.955+0000 7fc36e8b7640 1 Processor -- start 2024-09-19T06:36:48.959 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.956+0000 7fc36e8b7640 1 -- start start 2024-09-19T06:36:48.963 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.957+0000 7fc36e8b7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3680b4a20 0x7fc36814c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:48.963 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.957+0000 7fc36e8b7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3680b4e00 0x7fc3681f1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:48.963 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.957+0000 7fc36e8b7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc36815d130 0x7fc368148750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:48.963 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.957+0000 7fc36e8b7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc3680c9a00 con 0x7fc36815d130 2024-09-19T06:36:48.963 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.957+0000 7fc36e8b7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc3680c9880 con 0x7fc3680b4a20 2024-09-19T06:36:48.964 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.957+0000 7fc36e8b7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc3680c9b80 con 0x7fc3680b4e00 2024-09-19T06:36:48.964 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.957+0000 7fc36ce54640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc36815d130 0x7fc368148750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:48.964 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.957+0000 7fc36ce54640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc36815d130 0x7fc368148750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47266/0 (socket says 172.21.15.86:47266) 2024-09-19T06:36:48.964 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.957+0000 7fc36ce54640 1 -- 172.21.15.86:0/2744636256 learned_addr learned my addr 172.21.15.86:0/2744636256 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:36:48.964 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.957+0000 7fc367fff640 1 --2- 172.21.15.86:0/2744636256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3680b4a20 0x7fc36814c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:48.964 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.957+0000 7fc3677fe640 1 --2- 172.21.15.86:0/2744636256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3680b4e00 0x7fc3681f1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:48.965 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.957+0000 7fc36ce54640 1 -- 172.21.15.86:0/2744636256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3680b4e00 msgr2=0x7fc3681f1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:48.965 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.957+0000 7fc36ce54640 1 --2- 172.21.15.86:0/2744636256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3680b4e00 0x7fc3681f1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:48.965 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.957+0000 7fc36ce54640 1 -- 172.21.15.86:0/2744636256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3680b4a20 msgr2=0x7fc36814c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:48.965 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.957+0000 7fc36ce54640 1 --2- 172.21.15.86:0/2744636256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3680b4a20 0x7fc36814c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:48.965 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.957+0000 7fc36ce54640 1 -- 172.21.15.86:0/2744636256 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc368152d80 con 0x7fc36815d130 2024-09-19T06:36:48.965 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.957+0000 7fc36ce54640 1 --2- 172.21.15.86:0/2744636256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc36815d130 0x7fc368148750 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc360007e60 tx=0x7fc36000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:48.966 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.958+0000 7fc364ff9640 1 -- 172.21.15.86:0/2744636256 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360014420 con 0x7fc36815d130 2024-09-19T06:36:48.966 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.958+0000 7fc364ff9640 1 -- 172.21.15.86:0/2744636256 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc360019070 con 0x7fc36815d130 2024-09-19T06:36:48.966 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.958+0000 7fc364ff9640 1 -- 172.21.15.86:0/2744636256 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360014820 con 0x7fc36815d130 2024-09-19T06:36:48.966 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.958+0000 7fc36e8b7640 1 -- 172.21.15.86:0/2744636256 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc36814b220 con 0x7fc36815d130 2024-09-19T06:36:48.966 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.958+0000 7fc36e8b7640 1 -- 172.21.15.86:0/2744636256 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc36814b4c0 con 0x7fc36815d130 2024-09-19T06:36:48.966 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.958+0000 7fc364ff9640 1 -- 172.21.15.86:0/2744636256 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc3600149c0 con 0x7fc36815d130 2024-09-19T06:36:48.967 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.958+0000 7fc364ff9640 1 -- 172.21.15.86:0/2744636256 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fc360014cb0 con 0x7fc36815d130 2024-09-19T06:36:48.967 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.959+0000 7fc36e8b7640 1 -- 172.21.15.86:0/2744636256 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3681519b0 con 0x7fc36815d130 2024-09-19T06:36:48.967 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:48.961+0000 7fc364ff9640 1 -- 172.21.15.86:0/2744636256 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc36001e460 con 0x7fc36815d130 2024-09-19T06:36:48.981 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:48.979+0000 7f82a0e21040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:36:49.000 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-19T06:36:48.998+0000 7fc026f42040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:36:49.021 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:49.019+0000 7fc36e8b7640 1 -- 172.21.15.86:0/2744636256 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3681516d0 con 0x7fc36815d130 2024-09-19T06:36:49.021 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:49.020+0000 7fc364ff9640 1 -- 172.21.15.86:0/2744636256 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fc36001e640 con 0x7fc36815d130 2024-09-19T06:36:49.022 INFO:teuthology.misc.health.smithi086.stdout: 2024-09-19T06:36:49.022 INFO:teuthology.misc.health.smithi086.stdout:{"epoch":10,"fsid":"1785f09f-0959-457d-8c4a-6cce2e655a37","created":"2024-09-19T06:36:45.671544+0000","modified":"2024-09-19T06:36:47.816681+0000","last_up_change":"0.000000","last_in_change":"2024-09-19T06:36:47.816681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bd3ce3f2-2a37-40ec-8dc3-69246437277c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"871d7d23-ed03-4629-bca9-5b71ad0d926a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"39d3562d-8c52-4af9-935a-2d90abb8b68d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7f88c5b1-042c-4a9f-a674-32456e0644a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"18aa391b-0863-48bf-bff6-107e22ee9752","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"90fa5ca6-1815-4af1-a664-b45a9e19dd56","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8b2019fc-6cc2-4394-9a7c-7951544f7cec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"622e3b2c-5302-4b0a-b7f2-f4050801401e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:36:49.023 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:49.021+0000 7fc36e8b7640 1 -- 172.21.15.86:0/2744636256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc36815d130 msgr2=0x7fc368148750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:49.023 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:49.021+0000 7fc36e8b7640 1 --2- 172.21.15.86:0/2744636256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc36815d130 0x7fc368148750 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc360007e60 tx=0x7fc36000e4b0 comp rx=0 tx=0).stop 2024-09-19T06:36:49.023 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:49.021+0000 7fc36e8b7640 1 -- 172.21.15.86:0/2744636256 shutdown_connections 2024-09-19T06:36:49.023 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:49.021+0000 7fc36e8b7640 1 --2- 172.21.15.86:0/2744636256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc36815d130 0x7fc368148750 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:49.023 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:49.021+0000 7fc36e8b7640 1 --2- 172.21.15.86:0/2744636256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3680b4e00 0x7fc3681f1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:49.023 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:49.021+0000 7fc36e8b7640 1 --2- 172.21.15.86:0/2744636256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3680b4a20 0x7fc36814c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:49.023 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:49.021+0000 7fc36e8b7640 1 -- 172.21.15.86:0/2744636256 >> 172.21.15.86:0/2744636256 conn(0x7fc3680cee80 msgr2=0x7fc3680cf260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:49.023 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:49.021+0000 7fc36e8b7640 1 -- 172.21.15.86:0/2744636256 shutdown_connections 2024-09-19T06:36:49.023 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:49.021+0000 7fc36e8b7640 1 -- 172.21.15.86:0/2744636256 wait complete. 2024-09-19T06:36:49.027 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:49.025+0000 7f82a0e21040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:36:49.031 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-19T06:36:49.045 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-19T06:36:49.044+0000 7fc026f42040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:36:49.073 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:49.071+0000 7f82a0e21040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:36:49.087 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-09-19T06:36:49.086+0000 7fb928618640 -1 Falling back to public interface 2024-09-19T06:36:49.090 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-19T06:36:49.089+0000 7fc026f42040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:36:49.562 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-09-19T06:36:49.560+0000 7f22c2a24640 -1 Falling back to public interface 2024-09-19T06:36:49.562 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-09-19T06:36:49.560+0000 7f9f13925640 -1 Falling back to public interface 2024-09-19T06:36:49.562 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-09-19T06:36:49.560+0000 7f9f128cd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6808/0: (98) Address already in use 2024-09-19T06:36:49.576 INFO:tasks.ceph.osd.3.smithi086.stderr:2024-09-19T06:36:49.575+0000 7fefa25ae640 -1 Falling back to public interface 2024-09-19T06:36:49.729 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:49.728+0000 7f82a0e21040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:36:49.756 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-19T06:36:49.755+0000 7fc026f42040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:36:49.808 INFO:tasks.ceph.osd.1.smithi086.stderr:2024-09-19T06:36:49.806+0000 7fad12cd4640 -1 Falling back to public interface 2024-09-19T06:36:49.811 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-09-19T06:36:49.810+0000 7fce9c3bb640 -1 Falling back to public interface 2024-09-19T06:36:49.817 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-09-19T06:36:49.816+0000 7f028fe31640 -1 Falling back to public interface 2024-09-19T06:36:50.745 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:50.744+0000 7f8240a27640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-19T06:36:50.746 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-09-19T06:36:50.745+0000 7f8240a27640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-19T06:36:52.370 INFO:tasks.ceph.osd.2.smithi086.stderr:2024-09-19T06:36:52.368+0000 7fe8179a8640 -1 osd.2 0 log_to_monitors true 2024-09-19T06:36:53.123 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-09-19T06:36:53.120+0000 7fb928618640 -1 osd.7 0 log_to_monitors true 2024-09-19T06:36:53.349 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-09-19T06:36:53.347+0000 7f22c2a24640 -1 osd.6 0 log_to_monitors true 2024-09-19T06:36:53.602 INFO:tasks.ceph.osd.3.smithi086.stderr:2024-09-19T06:36:53.601+0000 7fefa25ae640 -1 osd.3 0 log_to_monitors true 2024-09-19T06:36:53.626 INFO:tasks.ceph.osd.1.smithi086.stderr:2024-09-19T06:36:53.625+0000 7fad12cd4640 -1 osd.1 0 log_to_monitors true 2024-09-19T06:36:53.810 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-09-19T06:36:53.808+0000 7f028fe31640 -1 osd.5 0 log_to_monitors true 2024-09-19T06:36:54.111 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-09-19T06:36:54.109+0000 7fce9c3bb640 -1 osd.0 0 log_to_monitors true 2024-09-19T06:36:54.114 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-09-19T06:36:54.112+0000 7f9f13925640 -1 osd.4 0 log_to_monitors true 2024-09-19T06:36:54.337 INFO:tasks.ceph.osd.2.smithi086.stderr:2024-09-19T06:36:54.333+0000 7fe81414b640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T06:36:54.346 INFO:tasks.ceph.osd.2.smithi086.stderr:2024-09-19T06:36:54.345+0000 7fe80b757640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:36:55.462 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-09-19T06:36:55.460+0000 7fb923fe1640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T06:36:55.471 INFO:tasks.ceph.osd.1.smithi086.stderr:2024-09-19T06:36:55.470+0000 7fad0ec63640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T06:36:55.474 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-09-19T06:36:55.472+0000 7fb91be01640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:36:55.483 INFO:tasks.ceph.osd.1.smithi086.stderr:2024-09-19T06:36:55.482+0000 7fad06a83640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:36:55.484 INFO:tasks.ceph.osd.3.smithi086.stderr:2024-09-19T06:36:55.483+0000 7fef9ed51640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T06:36:55.491 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-09-19T06:36:55.489+0000 7f22be314640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T06:36:55.500 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-09-19T06:36:55.498+0000 7f22b6134640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:36:55.501 INFO:tasks.ceph.osd.3.smithi086.stderr:2024-09-19T06:36:55.500+0000 7fef9635d640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:36:55.839 DEBUG:teuthology.orchestra.run.smithi086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T06:36:55.936 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.935+0000 7ff2e1cd0640 1 Processor -- start 2024-09-19T06:36:55.936 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.935+0000 7ff2e1cd0640 1 -- start start 2024-09-19T06:36:55.938 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.935+0000 7ff2e1cd0640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff2dc0ccf80 0x7ff2dc0d1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:55.938 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.935+0000 7ff2e1cd0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2dc0d15c0 0x7ff2dc15ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:55.938 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.935+0000 7ff2e1cd0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2dc155930 con 0x7ff2dc155550 2024-09-19T06:36:55.938 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.935+0000 7ff2e1cd0640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7ff2dc15c140 con 0x7ff2dc0ccf80 2024-09-19T06:36:55.938 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.935+0000 7ff2e1cd0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff2dc15b530 con 0x7ff2dc0d15c0 2024-09-19T06:36:55.938 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.936+0000 7ff2dbfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2dc0d15c0 0x7ff2dc15ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:55.938 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.936+0000 7ff2dbfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2dc0d15c0 0x7ff2dc15ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:53434/0 (socket says 172.21.15.86:53434) 2024-09-19T06:36:55.939 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.936+0000 7ff2dbfff640 1 -- 172.21.15.86:0/4136036146 learned_addr learned my addr 172.21.15.86:0/4136036146 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:36:55.939 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.936+0000 7ff2daffd640 1 --2- 172.21.15.86:0/4136036146 >> v2:172.21.15.169:3300/0 conn(0x7ff2dc0ccf80 0x7ff2dc0d1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:55.939 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.936+0000 7ff2daffd640 1 -- 172.21.15.86:0/4136036146 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2dc0d15c0 msgr2=0x7ff2dc15ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:36:55.939 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.936+0000 7ff2daffd640 1 --2- 172.21.15.86:0/4136036146 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2dc0d15c0 0x7ff2dc15ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:55.939 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.936+0000 7ff2daffd640 1 -- 172.21.15.86:0/4136036146 >> v1:172.21.15.169:6789/0 conn(0x7ff2dc155550 legacy=0x7ff2dc0cbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:55.939 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.936+0000 7ff2daffd640 1 -- 172.21.15.86:0/4136036146 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2dc15b810 con 0x7ff2dc0ccf80 2024-09-19T06:36:55.939 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.936+0000 7ff2dbfff640 1 --2- 172.21.15.86:0/4136036146 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2dc0d15c0 0x7ff2dc15ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:36:55.944 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.937+0000 7ff2daffd640 1 --2- 172.21.15.86:0/4136036146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2dc0ccf80 0x7ff2dc0d1080 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0009790 tx=0x7ff2d002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a34412730720e2e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:55.944 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.937+0000 7ff2da7fc640 1 -- 172.21.15.86:0/4136036146 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0037070 con 0x7ff2dc0ccf80 2024-09-19T06:36:55.944 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.937+0000 7ff2da7fc640 1 -- 172.21.15.86:0/4136036146 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d0032440 con 0x7ff2dc0ccf80 2024-09-19T06:36:55.944 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.937+0000 7ff2da7fc640 1 -- 172.21.15.86:0/4136036146 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0032810 con 0x7ff2dc0ccf80 2024-09-19T06:36:55.944 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.938+0000 7ff2e1cd0640 1 -- 172.21.15.86:0/4136036146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2dc0ccf80 msgr2=0x7ff2dc0d1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:55.944 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.938+0000 7ff2e1cd0640 1 --2- 172.21.15.86:0/4136036146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2dc0ccf80 0x7ff2dc0d1080 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0009790 tx=0x7ff2d002a210 comp rx=0 tx=0).stop 2024-09-19T06:36:55.944 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.938+0000 7ff2e1cd0640 1 -- 172.21.15.86:0/4136036146 shutdown_connections 2024-09-19T06:36:55.945 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.938+0000 7ff2e1cd0640 1 --2- 172.21.15.86:0/4136036146 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2dc0d15c0 0x7ff2dc15ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:55.945 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.938+0000 7ff2e1cd0640 1 --2- 172.21.15.86:0/4136036146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2dc0ccf80 0x7ff2dc0d1080 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:55.945 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.938+0000 7ff2e1cd0640 1 -- 172.21.15.86:0/4136036146 >> 172.21.15.86:0/4136036146 conn(0x7ff2dc06df80 msgr2=0x7ff2dc06e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:55.945 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.938+0000 7ff2e1cd0640 1 -- 172.21.15.86:0/4136036146 shutdown_connections 2024-09-19T06:36:55.945 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.938+0000 7ff2e1cd0640 1 -- 172.21.15.86:0/4136036146 wait complete. 2024-09-19T06:36:55.945 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.939+0000 7ff2e1cd0640 1 Processor -- start 2024-09-19T06:36:55.945 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.939+0000 7ff2e1cd0640 1 -- start start 2024-09-19T06:36:55.945 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.940+0000 7ff2e1cd0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2dc0ccf80 0x7ff2dc15a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:55.945 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.940+0000 7ff2e1cd0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2dc0d15c0 0x7ff2dc149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:55.946 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.940+0000 7ff2e1cd0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2dc155550 0x7ff2dc149ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:55.946 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.940+0000 7ff2e1cd0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc15b220 con 0x7ff2dc0ccf80 2024-09-19T06:36:55.946 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.940+0000 7ff2e1cd0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc15bdd0 con 0x7ff2dc155550 2024-09-19T06:36:55.946 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.940+0000 7ff2e1cd0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff2dc0cc300 con 0x7ff2dc0d15c0 2024-09-19T06:36:55.946 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.940+0000 7ff2db7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2dc0ccf80 0x7ff2dc15a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:55.946 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.940+0000 7ff2db7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2dc0ccf80 0x7ff2dc15a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47566/0 (socket says 172.21.15.86:47566) 2024-09-19T06:36:55.946 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.940+0000 7ff2db7fe640 1 -- 172.21.15.86:0/3902019880 learned_addr learned my addr 172.21.15.86:0/3902019880 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:36:55.946 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.940+0000 7ff2daffd640 1 --2- 172.21.15.86:0/3902019880 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2dc0d15c0 0x7ff2dc149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:55.946 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.940+0000 7ff2dbfff640 1 --2- 172.21.15.86:0/3902019880 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2dc155550 0x7ff2dc149ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:55.946 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.941+0000 7ff2db7fe640 1 -- 172.21.15.86:0/3902019880 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2dc0d15c0 msgr2=0x7ff2dc149570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:55.946 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.941+0000 7ff2db7fe640 1 --2- 172.21.15.86:0/3902019880 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2dc0d15c0 0x7ff2dc149570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:55.947 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.941+0000 7ff2db7fe640 1 -- 172.21.15.86:0/3902019880 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2dc155550 msgr2=0x7ff2dc149ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:55.947 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.941+0000 7ff2db7fe640 1 --2- 172.21.15.86:0/3902019880 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2dc155550 0x7ff2dc149ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:55.947 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.941+0000 7ff2db7fe640 1 -- 172.21.15.86:0/3902019880 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2dc15ab70 con 0x7ff2dc0ccf80 2024-09-19T06:36:55.947 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.941+0000 7ff2dbfff640 1 --2- 172.21.15.86:0/3902019880 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2dc155550 0x7ff2dc149ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:36:55.947 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.941+0000 7ff2daffd640 1 --2- 172.21.15.86:0/3902019880 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2dc0d15c0 0x7ff2dc149570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:36:55.947 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.941+0000 7ff2db7fe640 1 --2- 172.21.15.86:0/3902019880 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2dc0ccf80 0x7ff2dc15a080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00c430 tx=0x7ff2cc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:55.947 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.941+0000 7ff2c3fff640 1 -- 172.21.15.86:0/3902019880 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc0052d0 con 0x7ff2dc0ccf80 2024-09-19T06:36:55.947 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.941+0000 7ff2c3fff640 1 -- 172.21.15.86:0/3902019880 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2cc005490 con 0x7ff2dc0ccf80 2024-09-19T06:36:55.947 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.941+0000 7ff2e1cd0640 1 -- 172.21.15.86:0/3902019880 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2dc1f47c0 con 0x7ff2dc0ccf80 2024-09-19T06:36:55.947 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.941+0000 7ff2c3fff640 1 -- 172.21.15.86:0/3902019880 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc007260 con 0x7ff2dc0ccf80 2024-09-19T06:36:55.947 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.941+0000 7ff2e1cd0640 1 -- 172.21.15.86:0/3902019880 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2dc1f4d80 con 0x7ff2dc0ccf80 2024-09-19T06:36:55.947 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.942+0000 7ff2e1cd0640 1 -- 172.21.15.86:0/3902019880 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2dc0b45a0 con 0x7ff2dc0ccf80 2024-09-19T06:36:55.948 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.943+0000 7ff2c3fff640 1 -- 172.21.15.86:0/3902019880 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) ==== 90790+0+0 (secure 0 0 0) 0x7ff2cc007400 con 0x7ff2dc0ccf80 2024-09-19T06:36:55.948 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.943+0000 7ff2c3fff640 1 --2- 172.21.15.86:0/3902019880 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff2c806c220 0x7ff2c806e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:55.949 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.943+0000 7ff2c3fff640 1 -- 172.21.15.86:0/3902019880 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3631+0+0 (secure 0 0 0) 0x7ff2cc089ff0 con 0x7ff2dc0ccf80 2024-09-19T06:36:55.949 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.944+0000 7ff2daffd640 1 --2- 172.21.15.86:0/3902019880 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff2c806c220 0x7ff2c806e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:55.949 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.944+0000 7ff2daffd640 1 --2- 172.21.15.86:0/3902019880 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff2c806c220 0x7ff2c806e6e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0034000 tx=0x7ff2d002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:55.953 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:55.952+0000 7ff2c3fff640 1 -- 172.21.15.86:0/3902019880 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff2dc0b45a0 con 0x7ff2dc0ccf80 2024-09-19T06:36:56.192 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:56.191+0000 7ff2e1cd0640 1 -- 172.21.15.86:0/3902019880 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2dc0d1080 con 0x7ff2dc0ccf80 2024-09-19T06:36:56.193 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:56.192+0000 7ff2c3fff640 1 -- 172.21.15.86:0/3902019880 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+9462 (secure 0 0 0) 0x7ff2dc15ab70 con 0x7ff2dc0ccf80 2024-09-19T06:36:56.193 INFO:teuthology.misc.health.smithi086.stdout: 2024-09-19T06:36:56.193 INFO:teuthology.misc.health.smithi086.stdout:{"epoch":14,"fsid":"1785f09f-0959-457d-8c4a-6cce2e655a37","created":"2024-09-19T06:36:45.671544+0000","modified":"2024-09-19T06:36:55.753934+0000","last_up_change":"2024-09-19T06:36:55.753934+0000","last_in_change":"2024-09-19T06:36:47.816681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bd3ce3f2-2a37-40ec-8dc3-69246437277c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"871d7d23-ed03-4629-bca9-5b71ad0d926a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6819","nonce":1785682938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6821","nonce":1785682938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6825","nonce":1785682938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6823","nonce":1785682938}]},"public_addr":"172.21.15.86:6819/1785682938","cluster_addr":"172.21.15.86:6821/1785682938","heartbeat_back_addr":"172.21.15.86:6825/1785682938","heartbeat_front_addr":"172.21.15.86:6823/1785682938","state":["exists","up"]},{"osd":2,"uuid":"39d3562d-8c52-4af9-935a-2d90abb8b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6801","nonce":3306127846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6803","nonce":3306127846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6807","nonce":3306127846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6805","nonce":3306127846}]},"public_addr":"172.21.15.86:6801/3306127846","cluster_addr":"172.21.15.86:6803/3306127846","heartbeat_back_addr":"172.21.15.86:6807/3306127846","heartbeat_front_addr":"172.21.15.86:6805/3306127846","state":["exists","up"]},{"osd":3,"uuid":"7f88c5b1-042c-4a9f-a674-32456e0644a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6809","nonce":694275178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6811","nonce":694275178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6815","nonce":694275178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6813","nonce":694275178}]},"public_addr":"172.21.15.86:6809/694275178","cluster_addr":"172.21.15.86:6811/694275178","heartbeat_back_addr":"172.21.15.86:6815/694275178","heartbeat_front_addr":"172.21.15.86:6813/694275178","state":["exists","up"]},{"osd":4,"uuid":"18aa391b-0863-48bf-bff6-107e22ee9752","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"90fa5ca6-1815-4af1-a664-b45a9e19dd56","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8b2019fc-6cc2-4394-9a7c-7951544f7cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6810","nonce":494424253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6814","nonce":494424253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6822","nonce":494424253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6818","nonce":494424253}]},"public_addr":"172.21.15.169:6810/494424253","cluster_addr":"172.21.15.169:6814/494424253","heartbeat_back_addr":"172.21.15.169:6822/494424253","heartbeat_front_addr":"172.21.15.169:6818/494424253","state":["exists","up"]},{"osd":7,"uuid":"622e3b2c-5302-4b0a-b7f2-f4050801401e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6801","nonce":797235989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6803","nonce":797235989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6807","nonce":797235989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6805","nonce":797235989}]},"public_addr":"172.21.15.169:6801/797235989","cluster_addr":"172.21.15.169:6803/797235989","heartbeat_back_addr":"172.21.15.169:6807/797235989","heartbeat_front_addr":"172.21.15.169:6805/797235989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:53.419992+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:36:56.196 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:56.194+0000 7ff2e1cd0640 1 -- 172.21.15.86:0/3902019880 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff2c806c220 msgr2=0x7ff2c806e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:56.196 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:56.194+0000 7ff2e1cd0640 1 --2- 172.21.15.86:0/3902019880 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff2c806c220 0x7ff2c806e6e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0034000 tx=0x7ff2d002e000 comp rx=0 tx=0).stop 2024-09-19T06:36:56.196 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:56.194+0000 7ff2e1cd0640 1 -- 172.21.15.86:0/3902019880 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2dc0ccf80 msgr2=0x7ff2dc15a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:56.196 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:56.194+0000 7ff2e1cd0640 1 --2- 172.21.15.86:0/3902019880 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2dc0ccf80 0x7ff2dc15a080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00c430 tx=0x7ff2cc00c8f0 comp rx=0 tx=0).stop 2024-09-19T06:36:56.196 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:56.194+0000 7ff2e1cd0640 1 -- 172.21.15.86:0/3902019880 shutdown_connections 2024-09-19T06:36:56.196 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:56.194+0000 7ff2e1cd0640 1 --2- 172.21.15.86:0/3902019880 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff2c806c220 0x7ff2c806e6e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:56.196 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:56.194+0000 7ff2e1cd0640 1 --2- 172.21.15.86:0/3902019880 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2dc155550 0x7ff2dc149ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:56.196 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:56.194+0000 7ff2e1cd0640 1 --2- 172.21.15.86:0/3902019880 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2dc0d15c0 0x7ff2dc149570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:56.196 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:56.194+0000 7ff2e1cd0640 1 --2- 172.21.15.86:0/3902019880 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2dc0ccf80 0x7ff2dc15a080 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:56.196 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:56.194+0000 7ff2e1cd0640 1 -- 172.21.15.86:0/3902019880 >> 172.21.15.86:0/3902019880 conn(0x7ff2dc06df80 msgr2=0x7ff2dc06e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:56.197 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:56.194+0000 7ff2e1cd0640 1 -- 172.21.15.86:0/3902019880 shutdown_connections 2024-09-19T06:36:56.197 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:36:56.194+0000 7ff2e1cd0640 1 -- 172.21.15.86:0/3902019880 wait complete. 2024-09-19T06:36:56.207 DEBUG:teuthology.misc:5 of 8 OSDs are up 2024-09-19T06:36:56.346 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-09-19T06:36:56.345+0000 7fce9834a640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T06:36:56.361 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-09-19T06:36:56.360+0000 7fce9016a640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:36:56.520 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-09-19T06:36:56.518+0000 7f9f0f8b4640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T06:36:56.526 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-09-19T06:36:56.523+0000 7f028bdc0640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T06:36:56.530 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-09-19T06:36:56.528+0000 7f9f076d4640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:36:56.543 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-09-19T06:36:56.542+0000 7f0283be0640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:37:03.015 DEBUG:teuthology.orchestra.run.smithi086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T06:37:03.116 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.114+0000 7f5973181640 1 Processor -- start 2024-09-19T06:37:03.116 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.114+0000 7f5973181640 1 -- start start 2024-09-19T06:37:03.118 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.115+0000 7f5973181640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f596c0cb340 0x7f596c0cc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:03.118 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.115+0000 7f5973181640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f596c13ecd0 0x7f596c158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:03.118 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.115+0000 7f5973181640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f596c0cebc0 0x7f596c073390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:03.118 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.115+0000 7f5973181640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f596c0cfa80 con 0x7f596c13ecd0 2024-09-19T06:37:03.118 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.115+0000 7f5973181640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f596c0cc5b0 con 0x7f596c0cb340 2024-09-19T06:37:03.118 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.115+0000 7f5973181640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f596c0cf4c0 con 0x7f596c0cebc0 2024-09-19T06:37:03.118 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.115+0000 7f596bfff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f596c13ecd0 0x7f596c158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:03.118 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.115+0000 7f596bfff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f596c13ecd0 0x7f596c158ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36180/0 (socket says 172.21.15.86:36180) 2024-09-19T06:37:03.118 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.115+0000 7f596bfff640 1 -- 172.21.15.86:0/2018442399 learned_addr learned my addr 172.21.15.86:0/2018442399 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:03.119 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.115+0000 7f597171e640 1 --2- 172.21.15.86:0/2018442399 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f596c0cebc0 0x7f596c073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:03.119 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.115+0000 7f5970f1d640 1 --2- 172.21.15.86:0/2018442399 >> v2:172.21.15.169:3300/0 conn(0x7f596c0cb340 0x7f596c0cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:03.119 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.115+0000 7f596bfff640 1 -- 172.21.15.86:0/2018442399 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f596c0cebc0 msgr2=0x7f596c073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:03.119 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.115+0000 7f596bfff640 1 --2- 172.21.15.86:0/2018442399 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f596c0cebc0 0x7f596c073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.119 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.116+0000 7f596bfff640 1 -- 172.21.15.86:0/2018442399 >> v2:172.21.15.169:3300/0 conn(0x7f596c0cb340 msgr2=0x7f596c0cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:03.119 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.116+0000 7f596bfff640 1 --2- 172.21.15.86:0/2018442399 >> v2:172.21.15.169:3300/0 conn(0x7f596c0cb340 0x7f596c0cc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.119 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.116+0000 7f596bfff640 1 -- 172.21.15.86:0/2018442399 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596c0cf7a0 con 0x7f596c13ecd0 2024-09-19T06:37:03.119 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.116+0000 7f5970f1d640 1 --2- 172.21.15.86:0/2018442399 >> v2:172.21.15.169:3300/0 conn(0x7f596c0cb340 0x7f596c0cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:03.119 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.116+0000 7f597171e640 1 --2- 172.21.15.86:0/2018442399 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f596c0cebc0 0x7f596c073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:03.119 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.116+0000 7f596bfff640 1 --2- 172.21.15.86:0/2018442399 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f596c13ecd0 0x7f596c158ea0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f596c0cfce0 tx=0x7f596002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c1199e71f0eaf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:03.119 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.116+0000 7f596b7fe640 1 -- 172.21.15.86:0/2018442399 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5960037070 con 0x7f596c13ecd0 2024-09-19T06:37:03.119 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.116+0000 7f596b7fe640 1 -- 172.21.15.86:0/2018442399 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5960032440 con 0x7f596c13ecd0 2024-09-19T06:37:03.120 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.116+0000 7f596b7fe640 1 -- 172.21.15.86:0/2018442399 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5960032810 con 0x7f596c13ecd0 2024-09-19T06:37:03.123 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.117+0000 7f5973181640 1 -- 172.21.15.86:0/2018442399 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f596c13ecd0 msgr2=0x7f596c158ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:03.123 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.117+0000 7f5973181640 1 --2- 172.21.15.86:0/2018442399 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f596c13ecd0 0x7f596c158ea0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f596c0cfce0 tx=0x7f596002a1e0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.123 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.117+0000 7f5973181640 1 -- 172.21.15.86:0/2018442399 shutdown_connections 2024-09-19T06:37:03.123 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.117+0000 7f5973181640 1 --2- 172.21.15.86:0/2018442399 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f596c13ecd0 0x7f596c158ea0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.123 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.117+0000 7f5973181640 1 --2- 172.21.15.86:0/2018442399 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f596c0cebc0 0x7f596c073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.123 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.117+0000 7f5973181640 1 --2- 172.21.15.86:0/2018442399 >> v2:172.21.15.169:3300/0 conn(0x7f596c0cb340 0x7f596c0cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.123 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.117+0000 7f5973181640 1 -- 172.21.15.86:0/2018442399 >> 172.21.15.86:0/2018442399 conn(0x7f596c070f80 msgr2=0x7f596c071360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:03.123 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.117+0000 7f5973181640 1 -- 172.21.15.86:0/2018442399 shutdown_connections 2024-09-19T06:37:03.123 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.117+0000 7f5973181640 1 -- 172.21.15.86:0/2018442399 wait complete. 2024-09-19T06:37:03.124 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.118+0000 7f5973181640 1 Processor -- start 2024-09-19T06:37:03.124 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.118+0000 7f5973181640 1 -- start start 2024-09-19T06:37:03.124 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.119+0000 7f5973181640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f596c0cb340 0x7f596c0ba0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:03.124 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.119+0000 7f5973181640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f596c0cebc0 0x7f596c0c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:03.124 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.119+0000 7f5973181640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f596c13ecd0 0x7f596c1e3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:03.124 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.119+0000 7f5973181640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f596c1593e0 con 0x7f596c0cebc0 2024-09-19T06:37:03.124 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.119+0000 7f5973181640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f596c13e4d0 con 0x7f596c0cb340 2024-09-19T06:37:03.124 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.119+0000 7f5973181640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f596c0cb720 con 0x7f596c13ecd0 2024-09-19T06:37:03.124 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.119+0000 7f596bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f596c0cebc0 0x7f596c0c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:03.124 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.119+0000 7f596bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f596c0cebc0 0x7f596c0c67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36186/0 (socket says 172.21.15.86:36186) 2024-09-19T06:37:03.124 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.119+0000 7f596bfff640 1 -- 172.21.15.86:0/1540390392 learned_addr learned my addr 172.21.15.86:0/1540390392 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:03.124 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.119+0000 7f5970f1d640 1 --2- 172.21.15.86:0/1540390392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f596c0cb340 0x7f596c0ba0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:03.125 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.119+0000 7f597171e640 1 --2- 172.21.15.86:0/1540390392 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f596c13ecd0 0x7f596c1e3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:03.125 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.120+0000 7f596bfff640 1 -- 172.21.15.86:0/1540390392 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f596c13ecd0 msgr2=0x7f596c1e3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:03.125 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.120+0000 7f596bfff640 1 --2- 172.21.15.86:0/1540390392 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f596c13ecd0 0x7f596c1e3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.125 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.120+0000 7f596bfff640 1 -- 172.21.15.86:0/1540390392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f596c0cb340 msgr2=0x7f596c0ba0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:03.125 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.120+0000 7f596bfff640 1 --2- 172.21.15.86:0/1540390392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f596c0cb340 0x7f596c0ba0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.125 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.120+0000 7f596bfff640 1 -- 172.21.15.86:0/1540390392 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596c1560e0 con 0x7f596c0cebc0 2024-09-19T06:37:03.125 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.120+0000 7f596bfff640 1 --2- 172.21.15.86:0/1540390392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f596c0cebc0 0x7f596c0c67c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f596002a220 tx=0x7f59600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:03.125 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.120+0000 7f59697fa640 1 -- 172.21.15.86:0/1540390392 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5960041020 con 0x7f596c0cebc0 2024-09-19T06:37:03.125 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.120+0000 7f59697fa640 1 -- 172.21.15.86:0/1540390392 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59600306c0 con 0x7f596c0cebc0 2024-09-19T06:37:03.125 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.120+0000 7f5973181640 1 -- 172.21.15.86:0/1540390392 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f596c1563c0 con 0x7f596c0cebc0 2024-09-19T06:37:03.125 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.120+0000 7f59697fa640 1 -- 172.21.15.86:0/1540390392 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5960037040 con 0x7f596c0cebc0 2024-09-19T06:37:03.125 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.120+0000 7f5973181640 1 -- 172.21.15.86:0/1540390392 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f596c0c6d00 con 0x7f596c0cebc0 2024-09-19T06:37:03.126 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.121+0000 7f5973181640 1 -- 172.21.15.86:0/1540390392 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f596c0cefd0 con 0x7f596c0cebc0 2024-09-19T06:37:03.126 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.121+0000 7f59697fa640 1 -- 172.21.15.86:0/1540390392 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5960044020 con 0x7f596c0cebc0 2024-09-19T06:37:03.126 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.122+0000 7f59697fa640 1 --2- 172.21.15.86:0/1540390392 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f595806c2b0 0x7f595806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:03.126 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.122+0000 7f59697fa640 1 -- 172.21.15.86:0/1540390392 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f59600ab6f0 con 0x7f596c0cebc0 2024-09-19T06:37:03.126 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.122+0000 7f5970f1d640 1 --2- 172.21.15.86:0/1540390392 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f595806c2b0 0x7f595806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:03.126 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.122+0000 7f5970f1d640 1 --2- 172.21.15.86:0/1540390392 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f595806c2b0 0x7f595806e770 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f595c009950 tx=0x7f595c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:03.128 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.126+0000 7f59697fa640 1 -- 172.21.15.86:0/1540390392 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f596004b030 con 0x7f596c0cebc0 2024-09-19T06:37:03.295 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.294+0000 7f5973181640 1 -- 172.21.15.86:0/1540390392 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f596c0c97b0 con 0x7f596c0cebc0 2024-09-19T06:37:03.296 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.294+0000 7f59697fa640 1 -- 172.21.15.86:0/1540390392 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12884 (secure 0 0 0) 0x7f5960079bf0 con 0x7f596c0cebc0 2024-09-19T06:37:03.296 INFO:teuthology.misc.health.smithi086.stdout: 2024-09-19T06:37:03.296 INFO:teuthology.misc.health.smithi086.stdout:{"epoch":18,"fsid":"1785f09f-0959-457d-8c4a-6cce2e655a37","created":"2024-09-19T06:36:45.671544+0000","modified":"2024-09-19T06:36:59.780350+0000","last_up_change":"2024-09-19T06:36:56.765680+0000","last_in_change":"2024-09-19T06:36:47.816681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:36:57.770634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bd3ce3f2-2a37-40ec-8dc3-69246437277c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6827","nonce":1588074611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6829","nonce":1588074611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6833","nonce":1588074611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6831","nonce":1588074611}]},"public_addr":"172.21.15.86:6827/1588074611","cluster_addr":"172.21.15.86:6829/1588074611","heartbeat_back_addr":"172.21.15.86:6833/1588074611","heartbeat_front_addr":"172.21.15.86:6831/1588074611","state":["exists","up"]},{"osd":1,"uuid":"871d7d23-ed03-4629-bca9-5b71ad0d926a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6819","nonce":1785682938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6821","nonce":1785682938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6825","nonce":1785682938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6823","nonce":1785682938}]},"public_addr":"172.21.15.86:6819/1785682938","cluster_addr":"172.21.15.86:6821/1785682938","heartbeat_back_addr":"172.21.15.86:6825/1785682938","heartbeat_front_addr":"172.21.15.86:6823/1785682938","state":["exists","up"]},{"osd":2,"uuid":"39d3562d-8c52-4af9-935a-2d90abb8b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6801","nonce":3306127846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6803","nonce":3306127846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6807","nonce":3306127846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6805","nonce":3306127846}]},"public_addr":"172.21.15.86:6801/3306127846","cluster_addr":"172.21.15.86:6803/3306127846","heartbeat_back_addr":"172.21.15.86:6807/3306127846","heartbeat_front_addr":"172.21.15.86:6805/3306127846","state":["exists","up"]},{"osd":3,"uuid":"7f88c5b1-042c-4a9f-a674-32456e0644a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6809","nonce":694275178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6811","nonce":694275178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6815","nonce":694275178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6813","nonce":694275178}]},"public_addr":"172.21.15.86:6809/694275178","cluster_addr":"172.21.15.86:6811/694275178","heartbeat_back_addr":"172.21.15.86:6815/694275178","heartbeat_front_addr":"172.21.15.86:6813/694275178","state":["exists","up"]},{"osd":4,"uuid":"18aa391b-0863-48bf-bff6-107e22ee9752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6811","nonce":1326795640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6815","nonce":1326795640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6823","nonce":1326795640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6819","nonce":1326795640}]},"public_addr":"172.21.15.169:6811/1326795640","cluster_addr":"172.21.15.169:6815/1326795640","heartbeat_back_addr":"172.21.15.169:6823/1326795640","heartbeat_front_addr":"172.21.15.169:6819/1326795640","state":["exists","up"]},{"osd":5,"uuid":"90fa5ca6-1815-4af1-a664-b45a9e19dd56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6825","nonce":3538913242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6827","nonce":3538913242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6831","nonce":3538913242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6829","nonce":3538913242}]},"public_addr":"172.21.15.169:6825/3538913242","cluster_addr":"172.21.15.169:6827/3538913242","heartbeat_back_addr":"172.21.15.169:6831/3538913242","heartbeat_front_addr":"172.21.15.169:6829/3538913242","state":["exists","up"]},{"osd":6,"uuid":"8b2019fc-6cc2-4394-9a7c-7951544f7cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6810","nonce":494424253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6814","nonce":494424253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6822","nonce":494424253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6818","nonce":494424253}]},"public_addr":"172.21.15.169:6810/494424253","cluster_addr":"172.21.15.169:6814/494424253","heartbeat_back_addr":"172.21.15.169:6822/494424253","heartbeat_front_addr":"172.21.15.169:6818/494424253","state":["exists","up"]},{"osd":7,"uuid":"622e3b2c-5302-4b0a-b7f2-f4050801401e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6801","nonce":797235989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6803","nonce":797235989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6807","nonce":797235989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6805","nonce":797235989}]},"public_addr":"172.21.15.169:6801/797235989","cluster_addr":"172.21.15.169:6803/797235989","heartbeat_back_addr":"172.21.15.169:6807/797235989","heartbeat_front_addr":"172.21.15.169:6805/797235989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.130643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.611572+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:53.419992+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.560112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.112065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.774642+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.341946+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.117884+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:37:03.298 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.296+0000 7f5973181640 1 -- 172.21.15.86:0/1540390392 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f595806c2b0 msgr2=0x7f595806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:03.298 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.296+0000 7f5973181640 1 --2- 172.21.15.86:0/1540390392 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f595806c2b0 0x7f595806e770 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f595c009950 tx=0x7f595c008040 comp rx=0 tx=0).stop 2024-09-19T06:37:03.298 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.296+0000 7f5973181640 1 -- 172.21.15.86:0/1540390392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f596c0cebc0 msgr2=0x7f596c0c67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:03.298 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.296+0000 7f5973181640 1 --2- 172.21.15.86:0/1540390392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f596c0cebc0 0x7f596c0c67c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f596002a220 tx=0x7f59600046c0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.299 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.297+0000 7f5973181640 1 -- 172.21.15.86:0/1540390392 shutdown_connections 2024-09-19T06:37:03.299 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.297+0000 7f5973181640 1 --2- 172.21.15.86:0/1540390392 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f595806c2b0 0x7f595806e770 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.299 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.297+0000 7f5973181640 1 --2- 172.21.15.86:0/1540390392 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f596c13ecd0 0x7f596c1e3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.299 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.297+0000 7f5973181640 1 --2- 172.21.15.86:0/1540390392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f596c0cebc0 0x7f596c0c67c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.299 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.297+0000 7f5973181640 1 --2- 172.21.15.86:0/1540390392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f596c0cb340 0x7f596c0ba0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.299 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.297+0000 7f5973181640 1 -- 172.21.15.86:0/1540390392 >> 172.21.15.86:0/1540390392 conn(0x7f596c070f80 msgr2=0x7f596c158100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:03.299 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.297+0000 7f5973181640 1 -- 172.21.15.86:0/1540390392 shutdown_connections 2024-09-19T06:37:03.299 INFO:teuthology.misc.health.smithi086.stderr:2024-09-19T06:37:03.297+0000 7f5973181640 1 -- 172.21.15.86:0/1540390392 wait complete. 2024-09-19T06:37:03.307 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-19T06:37:03.308 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-19T06:37:03.308 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T06:37:03.308 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T06:37:03.310 INFO:tasks.ceph.mds.a:Started 2024-09-19T06:37:03.310 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T06:37:03.310 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T06:37:03.312 INFO:tasks.ceph.mds.c:Started 2024-09-19T06:37:03.312 INFO:tasks.ceph.mds.e:Restarting daemon 2024-09-19T06:37:03.312 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-09-19T06:37:03.314 INFO:tasks.ceph.mds.e:Started 2024-09-19T06:37:03.314 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T06:37:03.314 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T06:37:03.317 INFO:tasks.ceph.mds.b:Started 2024-09-19T06:37:03.318 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T06:37:03.318 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T06:37:03.320 INFO:tasks.ceph.mds.d:Started 2024-09-19T06:37:03.321 INFO:tasks.ceph.mds.f:Restarting daemon 2024-09-19T06:37:03.321 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-09-19T06:37:03.323 INFO:tasks.ceph.mds.f:Started 2024-09-19T06:37:03.323 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-19T06:37:03.323 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:37:03.387 INFO:tasks.ceph.mds.a.smithi086.stdout:starting mds.a at 2024-09-19T06:37:03.387 INFO:tasks.ceph.mds.c.smithi086.stdout:starting mds.c at 2024-09-19T06:37:03.387 INFO:tasks.ceph.mds.a.smithi086.stderr:2024-09-19T06:37:03.386+0000 7ff6e606f640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-19T06:37:03.388 INFO:tasks.ceph.mds.a.smithi086.stderr:2024-09-19T06:37:03.387+0000 7ff6e606f640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6836/0: (98) Address already in use 2024-09-19T06:37:03.392 INFO:tasks.ceph.mds.e.smithi086.stdout:starting mds.e at 2024-09-19T06:37:03.407 INFO:tasks.ceph.mds.b.smithi169.stdout:starting mds.b at 2024-09-19T06:37:03.407 INFO:tasks.ceph.mds.f.smithi169.stdout:starting mds.f at 2024-09-19T06:37:03.408 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2024-09-19T06:37:03.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.431+0000 7f9637d78640 1 Processor -- start 2024-09-19T06:37:03.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.432+0000 7f9637d78640 1 -- start start 2024-09-19T06:37:03.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.432+0000 7f9637d78640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9630155130 0x7f963015b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:03.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.432+0000 7f9637d78640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f96300ca460 0x7f96300ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:03.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.433+0000 7f9637d78640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f963015e5a0 con 0x7f9630154d50 2024-09-19T06:37:03.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.433+0000 7f9637d78640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f96300728f0 con 0x7f96300ca460 2024-09-19T06:37:03.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.433+0000 7f9637d78640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f963015e880 con 0x7f9630155130 2024-09-19T06:37:03.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.433+0000 7f9636315640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f96300ca460 0x7f96300ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:03.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.433+0000 7f9636315640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f96300ca460 0x7f96300ca8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36232/0 (socket says 172.21.15.86:36232) 2024-09-19T06:37:03.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.433+0000 7f9635313640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9630155130 0x7f963015b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:03.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.433+0000 7f9636315640 1 -- 172.21.15.86:0/2164464905 learned_addr learned my addr 172.21.15.86:0/2164464905 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:03.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.433+0000 7f9636315640 1 -- 172.21.15.86:0/2164464905 >> v2:172.21.15.169:3300/0 conn(0x7f9630155130 msgr2=0x7f963015b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:03.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.433+0000 7f9636315640 1 --2- 172.21.15.86:0/2164464905 >> v2:172.21.15.169:3300/0 conn(0x7f9630155130 0x7f963015b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.433+0000 7f9636315640 1 -- 172.21.15.86:0/2164464905 >> v1:172.21.15.169:6789/0 conn(0x7f9630154d50 legacy=0x7f9630071eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:03.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.433+0000 7f9636315640 1 -- 172.21.15.86:0/2164464905 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f963015eb60 con 0x7f96300ca460 2024-09-19T06:37:03.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.434+0000 7f9636315640 1 --2- 172.21.15.86:0/2164464905 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96300ca460 0x7f96300ca8f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f963006de00 tx=0x7f962802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ef3d69c3986a93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:03.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.434+0000 7f9634b12640 1 -- 172.21.15.86:0/2164464905 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9628036070 con 0x7f96300ca460 2024-09-19T06:37:03.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.434+0000 7f9634b12640 1 -- 172.21.15.86:0/2164464905 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9628031600 con 0x7f96300ca460 2024-09-19T06:37:03.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.434+0000 7f9634b12640 1 -- 172.21.15.86:0/2164464905 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96280319d0 con 0x7f96300ca460 2024-09-19T06:37:03.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.434+0000 7f9637d78640 1 -- 172.21.15.86:0/2164464905 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96300ca460 msgr2=0x7f96300ca8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:03.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.434+0000 7f9637d78640 1 --2- 172.21.15.86:0/2164464905 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96300ca460 0x7f96300ca8f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f963006de00 tx=0x7f962802a610 comp rx=0 tx=0).stop 2024-09-19T06:37:03.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.434+0000 7f9637d78640 1 -- 172.21.15.86:0/2164464905 shutdown_connections 2024-09-19T06:37:03.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.434+0000 7f9637d78640 1 --2- 172.21.15.86:0/2164464905 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96300ca460 0x7f96300ca8f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.434+0000 7f9637d78640 1 --2- 172.21.15.86:0/2164464905 >> v2:172.21.15.169:3300/0 conn(0x7f9630155130 0x7f963015b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.434+0000 7f9637d78640 1 -- 172.21.15.86:0/2164464905 >> 172.21.15.86:0/2164464905 conn(0x7f963006fd60 msgr2=0x7f9630070140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:03.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.434+0000 7f9637d78640 1 -- 172.21.15.86:0/2164464905 shutdown_connections 2024-09-19T06:37:03.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.434+0000 7f9637d78640 1 -- 172.21.15.86:0/2164464905 wait complete. 2024-09-19T06:37:03.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.436+0000 7f9637d78640 1 Processor -- start 2024-09-19T06:37:03.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.436+0000 7f9637d78640 1 -- start start 2024-09-19T06:37:03.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.436+0000 7f9637d78640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96300ca460 0x7f96301f16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:03.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.436+0000 7f9637d78640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9630154d50 0x7f96301f4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:03.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.436+0000 7f9637d78640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9630155130 0x7f963015ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:03.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.436+0000 7f9637d78640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9630073160 con 0x7f9630155130 2024-09-19T06:37:03.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.436+0000 7f9637d78640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f96300725c0 con 0x7f9630154d50 2024-09-19T06:37:03.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.436+0000 7f9637d78640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f96300732e0 con 0x7f96300ca460 2024-09-19T06:37:03.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.436+0000 7f9636315640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9630155130 0x7f963015ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:03.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.436+0000 7f9636315640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9630155130 0x7f963015ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36240/0 (socket says 172.21.15.86:36240) 2024-09-19T06:37:03.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.436+0000 7f9636315640 1 -- 172.21.15.86:0/1977692290 learned_addr learned my addr 172.21.15.86:0/1977692290 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:03.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.436+0000 7f9635313640 1 --2- 172.21.15.86:0/1977692290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9630154d50 0x7f96301f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:03.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.436+0000 7f9635b14640 1 --2- 172.21.15.86:0/1977692290 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96300ca460 0x7f96301f16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:03.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.437+0000 7f9636315640 1 -- 172.21.15.86:0/1977692290 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96300ca460 msgr2=0x7f96301f16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:03.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.437+0000 7f9636315640 1 --2- 172.21.15.86:0/1977692290 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96300ca460 0x7f96301f16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.437+0000 7f9636315640 1 -- 172.21.15.86:0/1977692290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9630154d50 msgr2=0x7f96301f4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:03.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.437+0000 7f9636315640 1 --2- 172.21.15.86:0/1977692290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9630154d50 0x7f96301f4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.437+0000 7f9636315640 1 -- 172.21.15.86:0/1977692290 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9630153c00 con 0x7f9630155130 2024-09-19T06:37:03.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.437+0000 7f9636315640 1 --2- 172.21.15.86:0/1977692290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9630155130 0x7f963015ca10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f962802ac00 tx=0x7f9628004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:03.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.437+0000 7f96267fc640 1 -- 172.21.15.86:0/1977692290 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962803f020 con 0x7f9630155130 2024-09-19T06:37:03.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.437+0000 7f96267fc640 1 -- 172.21.15.86:0/1977692290 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9628037040 con 0x7f9630155130 2024-09-19T06:37:03.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.437+0000 7f9637d78640 1 -- 172.21.15.86:0/1977692290 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9630153030 con 0x7f9630155130 2024-09-19T06:37:03.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.437+0000 7f96267fc640 1 -- 172.21.15.86:0/1977692290 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9628036070 con 0x7f9630155130 2024-09-19T06:37:03.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.437+0000 7f9637d78640 1 -- 172.21.15.86:0/1977692290 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96301f44b0 con 0x7f9630155130 2024-09-19T06:37:03.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.438+0000 7f9637d78640 1 -- 172.21.15.86:0/1977692290 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96301f4680 con 0x7f9630155130 2024-09-19T06:37:03.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.438+0000 7f96267fc640 1 -- 172.21.15.86:0/1977692290 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9628042020 con 0x7f9630155130 2024-09-19T06:37:03.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.439+0000 7f96267fc640 1 --2- 172.21.15.86:0/1977692290 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f961406c2e0 0x7f961406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:03.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.439+0000 7f96267fc640 1 -- 172.21.15.86:0/1977692290 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f96280ab790 con 0x7f9630155130 2024-09-19T06:37:03.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.439+0000 7f9635b14640 1 --2- 172.21.15.86:0/1977692290 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f961406c2e0 0x7f961406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:03.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.439+0000 7f9635b14640 1 --2- 172.21.15.86:0/1977692290 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f961406c2e0 0x7f961406e7a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f962c000f60 tx=0x7f962c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:03.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.443+0000 7f96267fc640 1 -- 172.21.15.86:0/1977692290 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9628049020 con 0x7f9630155130 2024-09-19T06:37:03.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.645+0000 7f9637d78640 1 -- 172.21.15.86:0/1977692290 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f963006d3d0 con 0x7f9630155130 2024-09-19T06:37:03.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.645+0000 7f96267fc640 1 -- 172.21.15.86:0/1977692290 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7f963006d3d0 con 0x7f9630155130 2024-09-19T06:37:03.647 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:03.647 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":2,"btime":"2024-09-19T06:37:03:392412+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T06:37:03.647 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 2 2024-09-19T06:37:03.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.647+0000 7f9637d78640 1 -- 172.21.15.86:0/1977692290 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f961406c2e0 msgr2=0x7f961406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:03.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.647+0000 7f9637d78640 1 --2- 172.21.15.86:0/1977692290 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f961406c2e0 0x7f961406e7a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f962c000f60 tx=0x7f962c009040 comp rx=0 tx=0).stop 2024-09-19T06:37:03.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.647+0000 7f9637d78640 1 -- 172.21.15.86:0/1977692290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9630155130 msgr2=0x7f963015ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:03.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.647+0000 7f9637d78640 1 --2- 172.21.15.86:0/1977692290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9630155130 0x7f963015ca10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f962802ac00 tx=0x7f9628004a40 comp rx=0 tx=0).stop 2024-09-19T06:37:03.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.647+0000 7f9637d78640 1 -- 172.21.15.86:0/1977692290 shutdown_connections 2024-09-19T06:37:03.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.647+0000 7f9637d78640 1 --2- 172.21.15.86:0/1977692290 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f961406c2e0 0x7f961406e7a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.647+0000 7f9637d78640 1 --2- 172.21.15.86:0/1977692290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9630155130 0x7f963015ca10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.647+0000 7f9637d78640 1 --2- 172.21.15.86:0/1977692290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9630154d50 0x7f96301f4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.647+0000 7f9637d78640 1 --2- 172.21.15.86:0/1977692290 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96300ca460 0x7f96301f16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.647+0000 7f9637d78640 1 -- 172.21.15.86:0/1977692290 >> 172.21.15.86:0/1977692290 conn(0x7f963006fd60 msgr2=0x7f96300735e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:03.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.647+0000 7f9637d78640 1 -- 172.21.15.86:0/1977692290 shutdown_connections 2024-09-19T06:37:03.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:03.647+0000 7f9637d78640 1 -- 172.21.15.86:0/1977692290 wait complete. 2024-09-19T06:37:05.660 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:37:05.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.772+0000 7f6eeda65640 1 Processor -- start 2024-09-19T06:37:05.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.772+0000 7f6eeda65640 1 -- start start 2024-09-19T06:37:05.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.772+0000 7f6eeda65640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6ee80d1120 0x7f6ee815da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:05.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.772+0000 7f6eeda65640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6ee815dfa0 0x7f6ee80b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:05.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.772+0000 7f6eeda65640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ee815e410 con 0x7f6ee80d0d40 2024-09-19T06:37:05.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.772+0000 7f6eeda65640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f6ee815c770 con 0x7f6ee815dfa0 2024-09-19T06:37:05.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.772+0000 7f6eeda65640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f6ee80b3f20 con 0x7f6ee80d1120 2024-09-19T06:37:05.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.772+0000 7f6ee7fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6ee815dfa0 0x7f6ee80b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:05.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.773+0000 7f6ee7fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6ee815dfa0 0x7f6ee80b4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36248/0 (socket says 172.21.15.86:36248) 2024-09-19T06:37:05.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.773+0000 7f6ee7fff640 1 -- 172.21.15.86:0/931957553 learned_addr learned my addr 172.21.15.86:0/931957553 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:05.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.773+0000 7f6ee77fe640 1 --1- 172.21.15.86:0/931957553 >> v1:172.21.15.86:6789/0 conn(0x7f6ee80d0d40 0x7f6ee80ca6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:44594/0 (socket says 172.21.15.86:44594) 2024-09-19T06:37:05.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.773+0000 7f6ee7fff640 1 -- 172.21.15.86:0/931957553 >> v2:172.21.15.169:3300/0 conn(0x7f6ee80d1120 msgr2=0x7f6ee815da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:05.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.773+0000 7f6ee6ffd640 1 --2- 172.21.15.86:0/931957553 >> v2:172.21.15.169:3300/0 conn(0x7f6ee80d1120 0x7f6ee815da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:05.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.773+0000 7f6ee67fc640 1 -- 172.21.15.86:0/931957553 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3355714424 0 0) 0x7f6ee815e410 con 0x7f6ee80d0d40 2024-09-19T06:37:05.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.773+0000 7f6ee7fff640 1 --2- 172.21.15.86:0/931957553 >> v2:172.21.15.169:3300/0 conn(0x7f6ee80d1120 0x7f6ee815da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:05.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.773+0000 7f6ee7fff640 1 -- 172.21.15.86:0/931957553 >> v1:172.21.15.86:6789/0 conn(0x7f6ee80d0d40 legacy=0x7f6ee80ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:05.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.773+0000 7f6ee7fff640 1 -- 172.21.15.86:0/931957553 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee815c9c0 con 0x7f6ee815dfa0 2024-09-19T06:37:05.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.774+0000 7f6ee7fff640 1 --2- 172.21.15.86:0/931957553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ee815dfa0 0x7f6ee80b4b60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6ee806bd40 tx=0x7f6ee002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dff1aea9686247b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:05.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.774+0000 7f6ee67fc640 1 -- 172.21.15.86:0/931957553 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0036070 con 0x7f6ee815dfa0 2024-09-19T06:37:05.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.774+0000 7f6ee67fc640 1 -- 172.21.15.86:0/931957553 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee0031600 con 0x7f6ee815dfa0 2024-09-19T06:37:05.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.774+0000 7f6ee67fc640 1 -- 172.21.15.86:0/931957553 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee00319d0 con 0x7f6ee815dfa0 2024-09-19T06:37:05.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.774+0000 7f6eeda65640 1 -- 172.21.15.86:0/931957553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ee815dfa0 msgr2=0x7f6ee80b4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:05.779 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.774+0000 7f6eeda65640 1 --2- 172.21.15.86:0/931957553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ee815dfa0 0x7f6ee80b4b60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6ee806bd40 tx=0x7f6ee002a730 comp rx=0 tx=0).stop 2024-09-19T06:37:05.779 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.774+0000 7f6eeda65640 1 -- 172.21.15.86:0/931957553 shutdown_connections 2024-09-19T06:37:05.779 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.774+0000 7f6eeda65640 1 --2- 172.21.15.86:0/931957553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ee815dfa0 0x7f6ee80b4b60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:05.779 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.774+0000 7f6eeda65640 1 --2- 172.21.15.86:0/931957553 >> v2:172.21.15.169:3300/0 conn(0x7f6ee80d1120 0x7f6ee815da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:05.779 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.774+0000 7f6eeda65640 1 -- 172.21.15.86:0/931957553 >> 172.21.15.86:0/931957553 conn(0x7f6ee806d910 msgr2=0x7f6ee806dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:05.779 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.774+0000 7f6eeda65640 1 -- 172.21.15.86:0/931957553 shutdown_connections 2024-09-19T06:37:05.779 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.774+0000 7f6eeda65640 1 -- 172.21.15.86:0/931957553 wait complete. 2024-09-19T06:37:05.779 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.776+0000 7f6eeda65640 1 Processor -- start 2024-09-19T06:37:05.779 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.776+0000 7f6eeda65640 1 -- start start 2024-09-19T06:37:05.779 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.776+0000 7f6eeda65640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ee80d0d40 0x7f6ee80ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:05.779 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.776+0000 7f6eeda65640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ee80d1120 0x7f6ee8150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:05.779 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.776+0000 7f6eeda65640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ee815dfa0 0x7f6ee81513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:05.780 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.776+0000 7f6eeda65640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee815d260 con 0x7f6ee80d1120 2024-09-19T06:37:05.780 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.776+0000 7f6eeda65640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee815cf80 con 0x7f6ee80d0d40 2024-09-19T06:37:05.780 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.776+0000 7f6eeda65640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6ee80cadd0 con 0x7f6ee815dfa0 2024-09-19T06:37:05.780 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.777+0000 7f6ee6ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ee80d1120 0x7f6ee8150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:05.780 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.777+0000 7f6ee6ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ee80d1120 0x7f6ee8150e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36250/0 (socket says 172.21.15.86:36250) 2024-09-19T06:37:05.780 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.777+0000 7f6ee6ffd640 1 -- 172.21.15.86:0/1803550813 learned_addr learned my addr 172.21.15.86:0/1803550813 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:05.780 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.777+0000 7f6ee77fe640 1 --2- 172.21.15.86:0/1803550813 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ee80d0d40 0x7f6ee80ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:05.780 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.777+0000 7f6ee7fff640 1 --2- 172.21.15.86:0/1803550813 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ee815dfa0 0x7f6ee81513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:05.780 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.777+0000 7f6ee6ffd640 1 -- 172.21.15.86:0/1803550813 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ee815dfa0 msgr2=0x7f6ee81513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:05.780 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.777+0000 7f6ee6ffd640 1 --2- 172.21.15.86:0/1803550813 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ee815dfa0 0x7f6ee81513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:05.780 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.777+0000 7f6ee6ffd640 1 -- 172.21.15.86:0/1803550813 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ee80d0d40 msgr2=0x7f6ee80ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:05.780 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.777+0000 7f6ee6ffd640 1 --2- 172.21.15.86:0/1803550813 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ee80d0d40 0x7f6ee80ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:05.781 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.777+0000 7f6ee6ffd640 1 -- 172.21.15.86:0/1803550813 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee80c6360 con 0x7f6ee80d1120 2024-09-19T06:37:05.781 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.777+0000 7f6ee6ffd640 1 --2- 172.21.15.86:0/1803550813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ee80d1120 0x7f6ee8150e80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6edc00c7f0 tx=0x7f6edc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:05.781 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.777+0000 7f6ecffff640 1 -- 172.21.15.86:0/1803550813 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6edc015070 con 0x7f6ee80d1120 2024-09-19T06:37:05.781 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.777+0000 7f6ecffff640 1 -- 172.21.15.86:0/1803550813 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6edc004240 con 0x7f6ee80d1120 2024-09-19T06:37:05.781 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.777+0000 7f6eeda65640 1 -- 172.21.15.86:0/1803550813 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee80c6640 con 0x7f6ee80d1120 2024-09-19T06:37:05.781 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.777+0000 7f6ecffff640 1 -- 172.21.15.86:0/1803550813 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6edc007620 con 0x7f6ee80d1120 2024-09-19T06:37:05.781 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.777+0000 7f6eeda65640 1 -- 172.21.15.86:0/1803550813 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee80c73d0 con 0x7f6ee80d1120 2024-09-19T06:37:05.781 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.778+0000 7f6eeda65640 1 -- 172.21.15.86:0/1803550813 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ee80c75a0 con 0x7f6ee80d1120 2024-09-19T06:37:05.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.779+0000 7f6ecffff640 1 -- 172.21.15.86:0/1803550813 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6edc0079d0 con 0x7f6ee80d1120 2024-09-19T06:37:05.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.779+0000 7f6ecffff640 1 --2- 172.21.15.86:0/1803550813 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6ed406c2b0 0x7f6ed406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:05.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.779+0000 7f6ee77fe640 1 --2- 172.21.15.86:0/1803550813 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6ed406c2b0 0x7f6ed406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:05.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.779+0000 7f6ecffff640 1 -- 172.21.15.86:0/1803550813 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f6edc08b480 con 0x7f6ee80d1120 2024-09-19T06:37:05.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.780+0000 7f6ee77fe640 1 --2- 172.21.15.86:0/1803550813 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6ed406c2b0 0x7f6ed406e770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8007fd0 tx=0x7f6ed8007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:05.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.784+0000 7f6ecffff640 1 -- 172.21.15.86:0/1803550813 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6edc0598f0 con 0x7f6ee80d1120 2024-09-19T06:37:05.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.982+0000 7f6eeda65640 1 -- 172.21.15.86:0/1803550813 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ee80c6810 con 0x7f6ee80d1120 2024-09-19T06:37:05.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.982+0000 7f6ecffff640 1 -- 172.21.15.86:0/1803550813 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5557 (secure 0 0 0) 0x7f6edc05dbf0 con 0x7f6ee80d1120 2024-09-19T06:37:05.983 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:05.983 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":3,"btime":"2024-09-19T06:37:04:393973+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/201961024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":201961024},{"type":"v1","addr":"172.21.15.169:6837","nonce":201961024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T06:37:05.983 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 3 2024-09-19T06:37:05.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.984+0000 7f6eeda65640 1 -- 172.21.15.86:0/1803550813 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6ed406c2b0 msgr2=0x7f6ed406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:05.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.984+0000 7f6eeda65640 1 --2- 172.21.15.86:0/1803550813 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6ed406c2b0 0x7f6ed406e770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8007fd0 tx=0x7f6ed8007de0 comp rx=0 tx=0).stop 2024-09-19T06:37:05.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.984+0000 7f6eeda65640 1 -- 172.21.15.86:0/1803550813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ee80d1120 msgr2=0x7f6ee8150e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:05.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.984+0000 7f6eeda65640 1 --2- 172.21.15.86:0/1803550813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ee80d1120 0x7f6ee8150e80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6edc00c7f0 tx=0x7f6edc00ccb0 comp rx=0 tx=0).stop 2024-09-19T06:37:05.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.984+0000 7f6eeda65640 1 -- 172.21.15.86:0/1803550813 shutdown_connections 2024-09-19T06:37:05.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.984+0000 7f6eeda65640 1 --2- 172.21.15.86:0/1803550813 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6ed406c2b0 0x7f6ed406e770 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:05.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.984+0000 7f6eeda65640 1 --2- 172.21.15.86:0/1803550813 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ee815dfa0 0x7f6ee81513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:05.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.984+0000 7f6eeda65640 1 --2- 172.21.15.86:0/1803550813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ee80d1120 0x7f6ee8150e80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:05.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.984+0000 7f6eeda65640 1 --2- 172.21.15.86:0/1803550813 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ee80d0d40 0x7f6ee80ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:05.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.984+0000 7f6eeda65640 1 -- 172.21.15.86:0/1803550813 >> 172.21.15.86:0/1803550813 conn(0x7f6ee806d910 msgr2=0x7f6ee8153f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:05.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.984+0000 7f6eeda65640 1 -- 172.21.15.86:0/1803550813 shutdown_connections 2024-09-19T06:37:05.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:05.984+0000 7f6eeda65640 1 -- 172.21.15.86:0/1803550813 wait complete. 2024-09-19T06:37:05.995 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T06:37:06.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.093+0000 7f3a8d142640 1 Processor -- start 2024-09-19T06:37:06.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.093+0000 7f3a8d142640 1 -- start start 2024-09-19T06:37:06.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.094+0000 7f3a8d142640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3a88073120 0x7f3a88073590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:06.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.094+0000 7f3a8d142640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a880cc040 con 0x7f3a88153050 2024-09-19T06:37:06.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.094+0000 7f3a8d142640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a880c5da0 con 0x7f3a880c8b20 2024-09-19T06:37:06.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.094+0000 7f3a8d142640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f3a88153430 con 0x7f3a88073120 2024-09-19T06:37:06.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.094+0000 7f3a86d9d640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f3a88153050 0x7f3a880cb930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:44598/0 (socket says 172.21.15.86:44598) 2024-09-19T06:37:06.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.094+0000 7f3a86d9d640 1 -- 172.21.15.86:0/64697592 learned_addr learned my addr 172.21.15.86:0/64697592 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:06.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.094+0000 7f3a8659c640 1 -- 172.21.15.86:0/64697592 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3452609345 0 0) 0x7f3a78001110 con 0x7f3a88153050 2024-09-19T06:37:06.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.094+0000 7f3a8759e640 1 --2- 172.21.15.86:0/64697592 >> v2:172.21.15.169:3300/0 conn(0x7f3a88073120 0x7f3a88073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:06.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.094+0000 7f3a8659c640 1 -- 172.21.15.86:0/64697592 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a74003520 con 0x7f3a88153050 2024-09-19T06:37:06.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.094+0000 7f3a8659c640 1 -- 172.21.15.86:0/64697592 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4066091335 0 0) 0x7f3a74003520 con 0x7f3a88153050 2024-09-19T06:37:06.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.094+0000 7f3a8659c640 1 -- 172.21.15.86:0/64697592 >> v2:172.21.15.169:3300/0 conn(0x7f3a88073120 msgr2=0x7f3a88073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:06.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.094+0000 7f3a8659c640 1 --2- 172.21.15.86:0/64697592 >> v2:172.21.15.169:3300/0 conn(0x7f3a88073120 0x7f3a88073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:06.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.094+0000 7f3a8659c640 1 -- 172.21.15.86:0/64697592 >> v1:172.21.15.169:6789/0 conn(0x7f3a880c8b20 legacy=0x7f3a8815ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:06.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.094+0000 7f3a8659c640 1 -- 172.21.15.86:0/64697592 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a880c6040 con 0x7f3a88153050 2024-09-19T06:37:06.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.094+0000 7f3a8659c640 1 -- 172.21.15.86:0/64697592 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f3a78001840 con 0x7f3a88153050 2024-09-19T06:37:06.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.094+0000 7f3a8659c640 1 -- 172.21.15.86:0/64697592 >> v1:172.21.15.86:6789/0 conn(0x7f3a88153050 legacy=0x7f3a880cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:06.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.094+0000 7f3a8659c640 1 --2- 172.21.15.86:0/64697592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a740039b0 0x7f3a74003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:06.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.094+0000 7f3a8659c640 1 --2- 172.21.15.86:0/64697592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a74004800 0x7f3a74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:06.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.094+0000 7f3a8659c640 1 --2- 172.21.15.86:0/64697592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a740051c0 0x7f3a7400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:06.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.094+0000 7f3a8659c640 1 -- 172.21.15.86:0/64697592 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3a88153430 con 0x7f3a740039b0 2024-09-19T06:37:06.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.094+0000 7f3a8659c640 1 -- 172.21.15.86:0/64697592 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7400c060 con 0x7f3a74004800 2024-09-19T06:37:06.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.094+0000 7f3a8659c640 1 -- 172.21.15.86:0/64697592 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3a7400c260 con 0x7f3a740051c0 2024-09-19T06:37:06.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.095+0000 7f3a86d9d640 1 --2- 172.21.15.86:0/64697592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a740039b0 0x7f3a74003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:06.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.095+0000 7f3a7ffff640 1 --2- 172.21.15.86:0/64697592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a74004800 0x7f3a74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:06.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.095+0000 7f3a8759e640 1 --2- 172.21.15.86:0/64697592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a740051c0 0x7f3a7400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:06.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.095+0000 7f3a86d9d640 1 -- 172.21.15.86:0/64697592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a740051c0 msgr2=0x7f3a7400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:06.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.095+0000 7f3a86d9d640 1 --2- 172.21.15.86:0/64697592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a740051c0 0x7f3a7400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:06.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.095+0000 7f3a86d9d640 1 -- 172.21.15.86:0/64697592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a74004800 msgr2=0x7f3a74004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:06.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.095+0000 7f3a86d9d640 1 --2- 172.21.15.86:0/64697592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a74004800 0x7f3a74004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:06.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.095+0000 7f3a86d9d640 1 -- 172.21.15.86:0/64697592 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a74003520 con 0x7f3a740039b0 2024-09-19T06:37:06.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.095+0000 7f3a8759e640 1 --2- 172.21.15.86:0/64697592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a740051c0 0x7f3a7400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:06.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.095+0000 7f3a8759e640 1 -- 172.21.15.86:0/64697592 reap_dead start 2024-09-19T06:37:06.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.095+0000 7f3a86d9d640 1 --2- 172.21.15.86:0/64697592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a740039b0 0x7f3a74003dd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3a7800c490 tx=0x7f3a74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5725213530e2963 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:06.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.096+0000 7f3a8659c640 1 -- 172.21.15.86:0/64697592 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a78035070 con 0x7f3a740039b0 2024-09-19T06:37:06.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.096+0000 7f3a8659c640 1 -- 172.21.15.86:0/64697592 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a7802c040 con 0x7f3a740039b0 2024-09-19T06:37:06.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.096+0000 7f3a8659c640 1 -- 172.21.15.86:0/64697592 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7800c0e0 con 0x7f3a740039b0 2024-09-19T06:37:06.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.096+0000 7f3a8d142640 1 -- 172.21.15.86:0/64697592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a740039b0 msgr2=0x7f3a74003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:06.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.096+0000 7f3a8d142640 1 --2- 172.21.15.86:0/64697592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a740039b0 0x7f3a74003dd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3a7800c490 tx=0x7f3a74005830 comp rx=0 tx=0).stop 2024-09-19T06:37:06.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.096+0000 7f3a8d142640 1 -- 172.21.15.86:0/64697592 shutdown_connections 2024-09-19T06:37:06.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.096+0000 7f3a8d142640 1 --2- 172.21.15.86:0/64697592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a740039b0 0x7f3a74003dd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:06.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.096+0000 7f3a8d142640 1 -- 172.21.15.86:0/64697592 >> 172.21.15.86:0/64697592 conn(0x7f3a88070d10 msgr2=0x7f3a880710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:06.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.096+0000 7f3a8d142640 1 -- 172.21.15.86:0/64697592 shutdown_connections 2024-09-19T06:37:06.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.096+0000 7f3a8d142640 1 -- 172.21.15.86:0/64697592 wait complete. 2024-09-19T06:37:06.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.097+0000 7f3a8d142640 1 Processor -- start 2024-09-19T06:37:06.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.097+0000 7f3a8d142640 1 -- start start 2024-09-19T06:37:06.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.098+0000 7f3a8d142640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a740039b0 0x7f3a880cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:06.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.098+0000 7f3a8d142640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a880c4950 0x7f3a880ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:06.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.098+0000 7f3a8d142640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a881f22b0 0x7f3a881f2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:06.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.098+0000 7f3a8d142640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3a880c68e0 con 0x7f3a880c4950 2024-09-19T06:37:06.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.098+0000 7f3a8d142640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3a880c6600 con 0x7f3a740039b0 2024-09-19T06:37:06.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.098+0000 7f3a8d142640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3a8815c500 con 0x7f3a881f22b0 2024-09-19T06:37:06.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.098+0000 7f3a7ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a880c4950 0x7f3a880ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:06.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.098+0000 7f3a7ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a880c4950 0x7f3a880ce8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36254/0 (socket says 172.21.15.86:36254) 2024-09-19T06:37:06.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.098+0000 7f3a7ffff640 1 -- 172.21.15.86:0/1200798877 learned_addr learned my addr 172.21.15.86:0/1200798877 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:06.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.098+0000 7f3a8759e640 1 --2- 172.21.15.86:0/1200798877 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a881f22b0 0x7f3a881f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:06.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.098+0000 7f3a86d9d640 1 --2- 172.21.15.86:0/1200798877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a740039b0 0x7f3a880cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:06.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.098+0000 7f3a7ffff640 1 -- 172.21.15.86:0/1200798877 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a881f22b0 msgr2=0x7f3a881f2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:06.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.098+0000 7f3a7ffff640 1 --2- 172.21.15.86:0/1200798877 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a881f22b0 0x7f3a881f2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:06.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.099+0000 7f3a7ffff640 1 -- 172.21.15.86:0/1200798877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a740039b0 msgr2=0x7f3a880cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:06.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.099+0000 7f3a7ffff640 1 --2- 172.21.15.86:0/1200798877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a740039b0 0x7f3a880cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:06.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.099+0000 7f3a7ffff640 1 -- 172.21.15.86:0/1200798877 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a880c55e0 con 0x7f3a880c4950 2024-09-19T06:37:06.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.099+0000 7f3a86d9d640 1 --2- 172.21.15.86:0/1200798877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a740039b0 0x7f3a880cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:06.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.099+0000 7f3a7ffff640 1 --2- 172.21.15.86:0/1200798877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a880c4950 0x7f3a880ce8e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3a7000f620 tx=0x7f3a7000fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:06.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.099+0000 7f3a7f7fe640 1 -- 172.21.15.86:0/1200798877 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a700052e0 con 0x7f3a880c4950 2024-09-19T06:37:06.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.099+0000 7f3a7f7fe640 1 -- 172.21.15.86:0/1200798877 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a70018070 con 0x7f3a880c4950 2024-09-19T06:37:06.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.099+0000 7f3a7f7fe640 1 -- 172.21.15.86:0/1200798877 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a70003810 con 0x7f3a880c4950 2024-09-19T06:37:06.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.099+0000 7f3a8d142640 1 -- 172.21.15.86:0/1200798877 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a880c5300 con 0x7f3a880c4950 2024-09-19T06:37:06.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.099+0000 7f3a8d142640 1 -- 172.21.15.86:0/1200798877 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a880ce0e0 con 0x7f3a880c4950 2024-09-19T06:37:06.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.100+0000 7f3a8d142640 1 -- 172.21.15.86:0/1200798877 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a88073590 con 0x7f3a880c4950 2024-09-19T06:37:06.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.100+0000 7f3a7f7fe640 1 -- 172.21.15.86:0/1200798877 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3a700039b0 con 0x7f3a880c4950 2024-09-19T06:37:06.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.101+0000 7f3a7f7fe640 1 --2- 172.21.15.86:0/1200798877 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f3a6806c2e0 0x7f3a6806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:06.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.101+0000 7f3a7f7fe640 1 -- 172.21.15.86:0/1200798877 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f3a7008aee0 con 0x7f3a880c4950 2024-09-19T06:37:06.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.101+0000 7f3a86d9d640 1 --2- 172.21.15.86:0/1200798877 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f3a6806c2e0 0x7f3a6806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:06.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.101+0000 7f3a86d9d640 1 --2- 172.21.15.86:0/1200798877 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f3a6806c2e0 0x7f3a6806e7a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3a78032000 tx=0x7f3a78009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:06.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.105+0000 7f3a7f7fe640 1 -- 172.21.15.86:0/1200798877 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3a70059910 con 0x7f3a880c4950 2024-09-19T06:37:06.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.273+0000 7f3a8d142640 1 -- 172.21.15.86:0/1200798877 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3a880c5a80 con 0x7f3a880c4950 2024-09-19T06:37:06.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.273+0000 7f3a7f7fe640 1 -- 172.21.15.86:0/1200798877 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f3a70059210 con 0x7f3a880c4950 2024-09-19T06:37:06.274 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:06.274 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2024-09-19T06:37:06.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-19T06:37:06.274 INFO:teuthology.orchestra.run.smithi086.stdout: "poolnum": 1, 2024-09-19T06:37:06.274 INFO:teuthology.orchestra.run.smithi086.stdout: "poolname": ".mgr" 2024-09-19T06:37:06.274 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T06:37:06.274 INFO:teuthology.orchestra.run.smithi086.stdout:] 2024-09-19T06:37:06.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.275+0000 7f3a8d142640 1 -- 172.21.15.86:0/1200798877 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f3a6806c2e0 msgr2=0x7f3a6806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:06.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.275+0000 7f3a8d142640 1 --2- 172.21.15.86:0/1200798877 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f3a6806c2e0 0x7f3a6806e7a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3a78032000 tx=0x7f3a78009030 comp rx=0 tx=0).stop 2024-09-19T06:37:06.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.275+0000 7f3a8d142640 1 -- 172.21.15.86:0/1200798877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a880c4950 msgr2=0x7f3a880ce8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:06.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.275+0000 7f3a8d142640 1 --2- 172.21.15.86:0/1200798877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a880c4950 0x7f3a880ce8e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3a7000f620 tx=0x7f3a7000fae0 comp rx=0 tx=0).stop 2024-09-19T06:37:06.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.275+0000 7f3a8d142640 1 -- 172.21.15.86:0/1200798877 shutdown_connections 2024-09-19T06:37:06.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.275+0000 7f3a8d142640 1 --2- 172.21.15.86:0/1200798877 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f3a6806c2e0 0x7f3a6806e7a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:06.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.275+0000 7f3a8d142640 1 --2- 172.21.15.86:0/1200798877 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a881f22b0 0x7f3a881f2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:06.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.275+0000 7f3a8d142640 1 --2- 172.21.15.86:0/1200798877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a880c4950 0x7f3a880ce8e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:06.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.275+0000 7f3a8d142640 1 --2- 172.21.15.86:0/1200798877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a740039b0 0x7f3a880cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:06.277 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.275+0000 7f3a8d142640 1 -- 172.21.15.86:0/1200798877 >> 172.21.15.86:0/1200798877 conn(0x7f3a88070d10 msgr2=0x7f3a8814e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:06.277 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.275+0000 7f3a8d142640 1 -- 172.21.15.86:0/1200798877 shutdown_connections 2024-09-19T06:37:06.277 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.275+0000 7f3a8d142640 1 -- 172.21.15.86:0/1200798877 wait complete. 2024-09-19T06:37:06.286 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T06:37:06.286 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T06:37:06.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.388+0000 7f038259d640 1 Processor -- start 2024-09-19T06:37:06.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.388+0000 7f038259d640 1 -- start start 2024-09-19T06:37:06.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.389+0000 7f038259d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f037c0d0780 0x7f037c0d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:06.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.389+0000 7f038259d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f037c0cb7c0 0x7f037c0c5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:06.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.389+0000 7f038259d640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f037c0d10a0 con 0x7f037c0d1350 2024-09-19T06:37:06.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.389+0000 7f038259d640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f037c0cbd90 con 0x7f037c0cb7c0 2024-09-19T06:37:06.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.389+0000 7f038259d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f037c0ccb60 con 0x7f037c0d0780 2024-09-19T06:37:06.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.389+0000 7f0381d9c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f037c0cb7c0 0x7f037c0c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:06.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.389+0000 7f0381d9c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f037c0cb7c0 0x7f037c0c5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36264/0 (socket says 172.21.15.86:36264) 2024-09-19T06:37:06.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.389+0000 7f0381d9c640 1 -- 172.21.15.86:0/131041172 learned_addr learned my addr 172.21.15.86:0/131041172 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:06.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.389+0000 7f038159b640 1 --2- 172.21.15.86:0/131041172 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f037c0d0780 0x7f037c0d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:06.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.389+0000 7f0381d9c640 1 -- 172.21.15.86:0/131041172 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f037c0d0780 msgr2=0x7f037c0d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:06.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.389+0000 7f0381d9c640 1 --2- 172.21.15.86:0/131041172 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f037c0d0780 0x7f037c0d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:06.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.389+0000 7f0381d9c640 1 -- 172.21.15.86:0/131041172 >> v1:172.21.15.169:6789/0 conn(0x7f037c0d1350 legacy=0x7f037c15ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:06.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.389+0000 7f0381d9c640 1 -- 172.21.15.86:0/131041172 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f037c0cce40 con 0x7f037c0cb7c0 2024-09-19T06:37:06.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.390+0000 7f0381d9c640 1 --2- 172.21.15.86:0/131041172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037c0cb7c0 0x7f037c0c5850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0374009e50 tx=0x7f037402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ef6acefcde2881 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:06.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.390+0000 7f0373fff640 1 -- 172.21.15.86:0/131041172 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0374036070 con 0x7f037c0cb7c0 2024-09-19T06:37:06.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.390+0000 7f0373fff640 1 -- 172.21.15.86:0/131041172 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0374031600 con 0x7f037c0cb7c0 2024-09-19T06:37:06.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.390+0000 7f0373fff640 1 -- 172.21.15.86:0/131041172 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03740319d0 con 0x7f037c0cb7c0 2024-09-19T06:37:06.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.391+0000 7f038259d640 1 -- 172.21.15.86:0/131041172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037c0cb7c0 msgr2=0x7f037c0c5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:06.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.391+0000 7f038259d640 1 --2- 172.21.15.86:0/131041172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037c0cb7c0 0x7f037c0c5850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0374009e50 tx=0x7f037402a7a0 comp rx=0 tx=0).stop 2024-09-19T06:37:06.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.391+0000 7f038259d640 1 -- 172.21.15.86:0/131041172 shutdown_connections 2024-09-19T06:37:06.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.391+0000 7f038259d640 1 --2- 172.21.15.86:0/131041172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037c0cb7c0 0x7f037c0c5850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:06.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.391+0000 7f038259d640 1 --2- 172.21.15.86:0/131041172 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f037c0d0780 0x7f037c0d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:06.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.391+0000 7f038259d640 1 -- 172.21.15.86:0/131041172 >> 172.21.15.86:0/131041172 conn(0x7f037c06c1f0 msgr2=0x7f037c06d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:06.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.391+0000 7f038259d640 1 -- 172.21.15.86:0/131041172 shutdown_connections 2024-09-19T06:37:06.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.391+0000 7f038259d640 1 -- 172.21.15.86:0/131041172 wait complete. 2024-09-19T06:37:06.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.392+0000 7f038259d640 1 Processor -- start 2024-09-19T06:37:06.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.392+0000 7f038259d640 1 -- start start 2024-09-19T06:37:06.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.393+0000 7f038259d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f037c0cb7c0 0x7f037c1f4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:06.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.393+0000 7f038259d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037c0d0780 0x7f037c0c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:06.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.393+0000 7f038259d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f037c0d1350 0x7f037c1e4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:06.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.393+0000 7f038259d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f037c0cd6e0 con 0x7f037c0d0780 2024-09-19T06:37:06.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.393+0000 7f038259d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f037c0cd400 con 0x7f037c0cb7c0 2024-09-19T06:37:06.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.393+0000 7f038259d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f037c1552a0 con 0x7f037c0d1350 2024-09-19T06:37:06.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.393+0000 7f0380d9a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037c0d0780 0x7f037c0c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:06.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.393+0000 7f0380d9a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037c0d0780 0x7f037c0c7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36270/0 (socket says 172.21.15.86:36270) 2024-09-19T06:37:06.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.393+0000 7f0380d9a640 1 -- 172.21.15.86:0/3566810711 learned_addr learned my addr 172.21.15.86:0/3566810711 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:06.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.393+0000 7f038159b640 1 --2- 172.21.15.86:0/3566810711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f037c0cb7c0 0x7f037c1f4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:06.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.393+0000 7f0381d9c640 1 --2- 172.21.15.86:0/3566810711 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f037c0d1350 0x7f037c1e4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:06.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.393+0000 7f0380d9a640 1 -- 172.21.15.86:0/3566810711 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f037c0d1350 msgr2=0x7f037c1e4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:06.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.393+0000 7f0380d9a640 1 --2- 172.21.15.86:0/3566810711 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f037c0d1350 0x7f037c1e4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:06.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.393+0000 7f0380d9a640 1 -- 172.21.15.86:0/3566810711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f037c0cb7c0 msgr2=0x7f037c1f4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:06.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.393+0000 7f0380d9a640 1 --2- 172.21.15.86:0/3566810711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f037c0cb7c0 0x7f037c1f4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:06.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.393+0000 7f0380d9a640 1 -- 172.21.15.86:0/3566810711 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f037c15d0e0 con 0x7f037c0d0780 2024-09-19T06:37:06.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.393+0000 7f0380d9a640 1 --2- 172.21.15.86:0/3566810711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037c0d0780 0x7f037c0c7c30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f036c00c3c0 tx=0x7f036c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:06.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.393+0000 7f0371ffb640 1 -- 172.21.15.86:0/3566810711 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c0052d0 con 0x7f037c0d0780 2024-09-19T06:37:06.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.393+0000 7f0371ffb640 1 -- 172.21.15.86:0/3566810711 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f036c005490 con 0x7f037c0d0780 2024-09-19T06:37:06.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.393+0000 7f038259d640 1 -- 172.21.15.86:0/3566810711 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f037c0b6720 con 0x7f037c0d0780 2024-09-19T06:37:06.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.393+0000 7f0371ffb640 1 -- 172.21.15.86:0/3566810711 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c006a20 con 0x7f037c0d0780 2024-09-19T06:37:06.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.394+0000 7f038259d640 1 -- 172.21.15.86:0/3566810711 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f037c0c9f20 con 0x7f037c0d0780 2024-09-19T06:37:06.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.394+0000 7f038259d640 1 -- 172.21.15.86:0/3566810711 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f037c069400 con 0x7f037c0d0780 2024-09-19T06:37:06.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.395+0000 7f0371ffb640 1 -- 172.21.15.86:0/3566810711 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f036c003640 con 0x7f037c0d0780 2024-09-19T06:37:06.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.395+0000 7f0371ffb640 1 --2- 172.21.15.86:0/3566810711 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f036006c2b0 0x7f036006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:06.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.395+0000 7f038159b640 1 --2- 172.21.15.86:0/3566810711 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f036006c2b0 0x7f036006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:06.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.395+0000 7f0371ffb640 1 -- 172.21.15.86:0/3566810711 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f036c08a530 con 0x7f037c0d0780 2024-09-19T06:37:06.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.396+0000 7f038159b640 1 --2- 172.21.15.86:0/3566810711 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f036006c2b0 0x7f036006e770 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0378009aa0 tx=0x7f0378009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:06.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.399+0000 7f0371ffb640 1 -- 172.21.15.86:0/3566810711 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f036c0589a0 con 0x7f037c0d0780 2024-09-19T06:37:06.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:06.570+0000 7f038259d640 1 -- 172.21.15.86:0/3566810711 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f037c0cdc00 con 0x7f037c0d0780 2024-09-19T06:37:07.195 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:37:07.198 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:37:07.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.414+0000 7f0371ffb640 1 -- 172.21.15.86:0/3566810711 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7f036c05cca0 con 0x7f037c0d0780 2024-09-19T06:37:07.416 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' created 2024-09-19T06:37:07.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.417+0000 7f038259d640 1 -- 172.21.15.86:0/3566810711 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f036006c2b0 msgr2=0x7f036006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:07.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.417+0000 7f038259d640 1 --2- 172.21.15.86:0/3566810711 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f036006c2b0 0x7f036006e770 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0378009aa0 tx=0x7f0378009190 comp rx=0 tx=0).stop 2024-09-19T06:37:07.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.417+0000 7f038259d640 1 -- 172.21.15.86:0/3566810711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037c0d0780 msgr2=0x7f037c0c7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:07.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.417+0000 7f038259d640 1 --2- 172.21.15.86:0/3566810711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037c0d0780 0x7f037c0c7c30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f036c00c3c0 tx=0x7f036c00c880 comp rx=0 tx=0).stop 2024-09-19T06:37:07.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.417+0000 7f038259d640 1 -- 172.21.15.86:0/3566810711 shutdown_connections 2024-09-19T06:37:07.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.417+0000 7f038259d640 1 --2- 172.21.15.86:0/3566810711 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f036006c2b0 0x7f036006e770 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:07.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.417+0000 7f038259d640 1 --2- 172.21.15.86:0/3566810711 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f037c0d1350 0x7f037c1e4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:07.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.417+0000 7f038259d640 1 --2- 172.21.15.86:0/3566810711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037c0d0780 0x7f037c0c7c30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:07.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.417+0000 7f038259d640 1 --2- 172.21.15.86:0/3566810711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f037c0cb7c0 0x7f037c1f4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:07.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.417+0000 7f038259d640 1 -- 172.21.15.86:0/3566810711 >> 172.21.15.86:0/3566810711 conn(0x7f037c06c1f0 msgr2=0x7f037c152ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:07.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.417+0000 7f038259d640 1 -- 172.21.15.86:0/3566810711 shutdown_connections 2024-09-19T06:37:07.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.417+0000 7f038259d640 1 -- 172.21.15.86:0/3566810711 wait complete. 2024-09-19T06:37:07.434 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-19T06:37:07.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.539+0000 7fc52078f640 1 Processor -- start 2024-09-19T06:37:07.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.539+0000 7fc52078f640 1 -- start start 2024-09-19T06:37:07.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.540+0000 7fc52078f640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc5180c8ca0 0x7fc5180ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:07.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.540+0000 7fc52078f640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc51806d320 0x7fc518071730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:07.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.540+0000 7fc52078f640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc51806da00 con 0x7fc51806cf40 2024-09-19T06:37:07.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.540+0000 7fc52078f640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fc518073cc0 con 0x7fc51806d320 2024-09-19T06:37:07.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.540+0000 7fc52078f640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fc518073fa0 con 0x7fc5180c8ca0 2024-09-19T06:37:07.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.540+0000 7fc51ed2c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc51806d320 0x7fc518071730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:07.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.540+0000 7fc51e52b640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc51806cf40 0x7fc5180c8590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:44608/0 (socket says 172.21.15.86:44608) 2024-09-19T06:37:07.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.540+0000 7fc51e52b640 1 -- 172.21.15.86:0/997343197 learned_addr learned my addr 172.21.15.86:0/997343197 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:07.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.540+0000 7fc51dd2a640 1 --2- 172.21.15.86:0/997343197 >> v2:172.21.15.169:3300/0 conn(0x7fc5180c8ca0 0x7fc5180ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:07.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.540+0000 7fc51ed2c640 1 -- 172.21.15.86:0/997343197 >> v2:172.21.15.169:3300/0 conn(0x7fc5180c8ca0 msgr2=0x7fc5180ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:07.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.540+0000 7fc51ed2c640 1 --2- 172.21.15.86:0/997343197 >> v2:172.21.15.169:3300/0 conn(0x7fc5180c8ca0 0x7fc5180ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:07.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.540+0000 7fc51ed2c640 1 -- 172.21.15.86:0/997343197 >> v1:172.21.15.86:6789/0 conn(0x7fc51806cf40 legacy=0x7fc5180c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:07.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.540+0000 7fc51ed2c640 1 -- 172.21.15.86:0/997343197 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc518070c50 con 0x7fc51806d320 2024-09-19T06:37:07.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.540+0000 7fc51d529640 1 -- 172.21.15.86:0/997343197 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 212501232 0 0) 0x7fc51806da00 con 0x7fc51806cf40 2024-09-19T06:37:07.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.541+0000 7fc51ed2c640 1 --2- 172.21.15.86:0/997343197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc51806d320 0x7fc518071730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc51806eaf0 tx=0x7fc51002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2630ae57f4b3ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:07.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.541+0000 7fc51d529640 1 -- 172.21.15.86:0/997343197 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc510007740 con 0x7fc51806d320 2024-09-19T06:37:07.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.541+0000 7fc51d529640 1 -- 172.21.15.86:0/997343197 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5100078e0 con 0x7fc51806d320 2024-09-19T06:37:07.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.541+0000 7fc51d529640 1 -- 172.21.15.86:0/997343197 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc510007cb0 con 0x7fc51806d320 2024-09-19T06:37:07.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.542+0000 7fc52078f640 1 -- 172.21.15.86:0/997343197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc51806d320 msgr2=0x7fc518071730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:07.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.542+0000 7fc52078f640 1 --2- 172.21.15.86:0/997343197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc51806d320 0x7fc518071730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc51806eaf0 tx=0x7fc51002a710 comp rx=0 tx=0).stop 2024-09-19T06:37:07.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.542+0000 7fc52078f640 1 -- 172.21.15.86:0/997343197 shutdown_connections 2024-09-19T06:37:07.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.542+0000 7fc52078f640 1 --2- 172.21.15.86:0/997343197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc51806d320 0x7fc518071730 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:07.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.542+0000 7fc52078f640 1 --2- 172.21.15.86:0/997343197 >> v2:172.21.15.169:3300/0 conn(0x7fc5180c8ca0 0x7fc5180ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:07.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.542+0000 7fc52078f640 1 -- 172.21.15.86:0/997343197 >> 172.21.15.86:0/997343197 conn(0x7fc518067890 msgr2=0x7fc518067c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:07.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.542+0000 7fc52078f640 1 -- 172.21.15.86:0/997343197 shutdown_connections 2024-09-19T06:37:07.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.542+0000 7fc52078f640 1 -- 172.21.15.86:0/997343197 wait complete. 2024-09-19T06:37:07.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.543+0000 7fc52078f640 1 Processor -- start 2024-09-19T06:37:07.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.543+0000 7fc52078f640 1 -- start start 2024-09-19T06:37:07.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.544+0000 7fc52078f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc51806cf40 0x7fc5180ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:07.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.544+0000 7fc52078f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc51806d320 0x7fc5181f1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:07.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.544+0000 7fc52078f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5180c8ca0 0x7fc5181e2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:07.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.544+0000 7fc52078f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc51815bc60 con 0x7fc51806cf40 2024-09-19T06:37:07.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.544+0000 7fc52078f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc518071210 con 0x7fc5180c8ca0 2024-09-19T06:37:07.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.544+0000 7fc52078f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc51815bde0 con 0x7fc51806d320 2024-09-19T06:37:07.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.544+0000 7fc51e52b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc51806cf40 0x7fc5180ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:07.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.544+0000 7fc51e52b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc51806cf40 0x7fc5180ceb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36292/0 (socket says 172.21.15.86:36292) 2024-09-19T06:37:07.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.544+0000 7fc51e52b640 1 -- 172.21.15.86:0/3480872220 learned_addr learned my addr 172.21.15.86:0/3480872220 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:07.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.544+0000 7fc51e52b640 1 -- 172.21.15.86:0/3480872220 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc51806d320 msgr2=0x7fc5181f1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:07.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.544+0000 7fc51e52b640 1 --2- 172.21.15.86:0/3480872220 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc51806d320 0x7fc5181f1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:07.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.544+0000 7fc51e52b640 1 -- 172.21.15.86:0/3480872220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5180c8ca0 msgr2=0x7fc5181e2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:07.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.544+0000 7fc51e52b640 1 --2- 172.21.15.86:0/3480872220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5180c8ca0 0x7fc5181e2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:07.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.544+0000 7fc51e52b640 1 -- 172.21.15.86:0/3480872220 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5181573a0 con 0x7fc51806cf40 2024-09-19T06:37:07.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.544+0000 7fc51e52b640 1 --2- 172.21.15.86:0/3480872220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc51806cf40 0x7fc5180ceb60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc51400c500 tx=0x7fc51400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:07.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.544+0000 7fc50effd640 1 -- 172.21.15.86:0/3480872220 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc514018070 con 0x7fc51806cf40 2024-09-19T06:37:07.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.544+0000 7fc50effd640 1 -- 172.21.15.86:0/3480872220 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc514007580 con 0x7fc51806cf40 2024-09-19T06:37:07.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.544+0000 7fc52078f640 1 -- 172.21.15.86:0/3480872220 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc518155b30 con 0x7fc51806cf40 2024-09-19T06:37:07.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.544+0000 7fc50effd640 1 -- 172.21.15.86:0/3480872220 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc514004a20 con 0x7fc51806cf40 2024-09-19T06:37:07.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.544+0000 7fc52078f640 1 -- 172.21.15.86:0/3480872220 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc518157640 con 0x7fc51806cf40 2024-09-19T06:37:07.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.545+0000 7fc52078f640 1 -- 172.21.15.86:0/3480872220 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5180ca280 con 0x7fc51806cf40 2024-09-19T06:37:07.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.546+0000 7fc50effd640 1 -- 172.21.15.86:0/3480872220 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc51401b070 con 0x7fc51806cf40 2024-09-19T06:37:07.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.546+0000 7fc50effd640 1 --2- 172.21.15.86:0/3480872220 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc4fc06c2b0 0x7fc4fc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:07.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.547+0000 7fc51dd2a640 1 --2- 172.21.15.86:0/3480872220 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc4fc06c2b0 0x7fc4fc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:07.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.547+0000 7fc50effd640 1 -- 172.21.15.86:0/3480872220 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7fc51408a4c0 con 0x7fc51806cf40 2024-09-19T06:37:07.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.547+0000 7fc51dd2a640 1 --2- 172.21.15.86:0/3480872220 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc4fc06c2b0 0x7fc4fc06e770 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc508006fd0 tx=0x7fc508008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:07.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.551+0000 7fc50effd640 1 -- 172.21.15.86:0/3480872220 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc514058ea0 con 0x7fc51806cf40 2024-09-19T06:37:07.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:07.720+0000 7fc52078f640 1 -- 172.21.15.86:0/3480872220 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fc5180c9360 con 0x7fc51806cf40 2024-09-19T06:37:08.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.419+0000 7fc50effd640 1 -- 172.21.15.86:0/3480872220 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) ==== 171+0+0 (secure 0 0 0) 0x7fc5140587a0 con 0x7fc51806cf40 2024-09-19T06:37:08.420 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' created 2024-09-19T06:37:08.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.423+0000 7fc52078f640 1 -- 172.21.15.86:0/3480872220 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc4fc06c2b0 msgr2=0x7fc4fc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:08.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.423+0000 7fc52078f640 1 --2- 172.21.15.86:0/3480872220 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc4fc06c2b0 0x7fc4fc06e770 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc508006fd0 tx=0x7fc508008040 comp rx=0 tx=0).stop 2024-09-19T06:37:08.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.423+0000 7fc52078f640 1 -- 172.21.15.86:0/3480872220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc51806cf40 msgr2=0x7fc5180ceb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:08.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.423+0000 7fc52078f640 1 --2- 172.21.15.86:0/3480872220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc51806cf40 0x7fc5180ceb60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc51400c500 tx=0x7fc51400c9c0 comp rx=0 tx=0).stop 2024-09-19T06:37:08.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.425+0000 7fc52078f640 1 -- 172.21.15.86:0/3480872220 shutdown_connections 2024-09-19T06:37:08.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.425+0000 7fc52078f640 1 --2- 172.21.15.86:0/3480872220 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc4fc06c2b0 0x7fc4fc06e770 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:08.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.425+0000 7fc52078f640 1 --2- 172.21.15.86:0/3480872220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5180c8ca0 0x7fc5181e2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:08.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.425+0000 7fc52078f640 1 --2- 172.21.15.86:0/3480872220 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc51806d320 0x7fc5181f1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:08.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.425+0000 7fc52078f640 1 --2- 172.21.15.86:0/3480872220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc51806cf40 0x7fc5180ceb60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:08.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.425+0000 7fc52078f640 1 -- 172.21.15.86:0/3480872220 >> 172.21.15.86:0/3480872220 conn(0x7fc518067890 msgr2=0x7fc5180716a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:08.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.426+0000 7fc52078f640 1 -- 172.21.15.86:0/3480872220 shutdown_connections 2024-09-19T06:37:08.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.426+0000 7fc52078f640 1 -- 172.21.15.86:0/3480872220 wait complete. 2024-09-19T06:37:08.445 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T06:37:08.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.545+0000 7f8e0bd6d640 1 Processor -- start 2024-09-19T06:37:08.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.545+0000 7f8e0bd6d640 1 -- start start 2024-09-19T06:37:08.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.546+0000 7f8e0bd6d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8e040cb800 0x7f8e040cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:08.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.546+0000 7f8e0bd6d640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e040c5e70 con 0x7f8e040cc610 2024-09-19T06:37:08.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.546+0000 7f8e0bd6d640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e040cd140 con 0x7f8e04155520 2024-09-19T06:37:08.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.546+0000 7f8e0bd6d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8e04155900 con 0x7f8e040cb800 2024-09-19T06:37:08.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.546+0000 7f8e09308640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f8e040cc610 0x7f8e040cdbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:44612/0 (socket says 172.21.15.86:44612) 2024-09-19T06:37:08.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.546+0000 7f8e09308640 1 -- 172.21.15.86:0/1625389589 learned_addr learned my addr 172.21.15.86:0/1625389589 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:08.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.546+0000 7f8e08b07640 1 -- 172.21.15.86:0/1625389589 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1195925584 0 0) 0x7f8e040c5e70 con 0x7f8e040cc610 2024-09-19T06:37:08.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.546+0000 7f8e08b07640 1 -- 172.21.15.86:0/1625389589 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8df0003520 con 0x7f8e040cc610 2024-09-19T06:37:08.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.546+0000 7f8e0a30a640 1 --2- 172.21.15.86:0/1625389589 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8e040cb800 0x7f8e040cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:08.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.546+0000 7f8e08b07640 1 -- 172.21.15.86:0/1625389589 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2918442941 0 0) 0x7f8df0003520 con 0x7f8e040cc610 2024-09-19T06:37:08.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.546+0000 7f8e08b07640 1 -- 172.21.15.86:0/1625389589 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8e040cb800 msgr2=0x7f8e040cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:08.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.546+0000 7f8e08b07640 1 --2- 172.21.15.86:0/1625389589 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8e040cb800 0x7f8e040cbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:08.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.546+0000 7f8e08b07640 1 -- 172.21.15.86:0/1625389589 >> v1:172.21.15.169:6789/0 conn(0x7f8e04155520 legacy=0x7f8e0415b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:08.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.546+0000 7f8e08b07640 1 -- 172.21.15.86:0/1625389589 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e0415bae0 con 0x7f8e040cc610 2024-09-19T06:37:08.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.546+0000 7f8e08b07640 1 -- 172.21.15.86:0/1625389589 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f8df4001670 con 0x7f8e040cc610 2024-09-19T06:37:08.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.546+0000 7f8e08b07640 1 -- 172.21.15.86:0/1625389589 >> v1:172.21.15.86:6789/0 conn(0x7f8e040cc610 legacy=0x7f8e040cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:08.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.547+0000 7f8e08b07640 1 --2- 172.21.15.86:0/1625389589 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8e040cb800 0x7f8df00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:08.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.547+0000 7f8e08b07640 1 --2- 172.21.15.86:0/1625389589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8df0003f60 0x7f8df0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:08.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.547+0000 7f8e08b07640 1 --2- 172.21.15.86:0/1625389589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8df0004d40 0x7f8df00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:08.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.547+0000 7f8e08b07640 1 -- 172.21.15.86:0/1625389589 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8e04155900 con 0x7f8df0004d40 2024-09-19T06:37:08.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.547+0000 7f8e08b07640 1 -- 172.21.15.86:0/1625389589 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8df000baa0 con 0x7f8df0003f60 2024-09-19T06:37:08.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.547+0000 7f8e08b07640 1 -- 172.21.15.86:0/1625389589 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8df000bca0 con 0x7f8e040cb800 2024-09-19T06:37:08.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.547+0000 7f8e0a30a640 1 --2- 172.21.15.86:0/1625389589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8df0004d40 0x7f8df00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:08.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.547+0000 7f8e09b09640 1 --2- 172.21.15.86:0/1625389589 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8e040cb800 0x7f8df00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:08.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.547+0000 7f8e09308640 1 --2- 172.21.15.86:0/1625389589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8df0003f60 0x7f8df0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:08.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.547+0000 7f8e0a30a640 1 -- 172.21.15.86:0/1625389589 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8e040cb800 msgr2=0x7f8df00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:08.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.547+0000 7f8e0a30a640 1 --2- 172.21.15.86:0/1625389589 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8e040cb800 0x7f8df00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:08.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.547+0000 7f8e0a30a640 1 -- 172.21.15.86:0/1625389589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8df0003f60 msgr2=0x7f8df0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:08.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.547+0000 7f8e0a30a640 1 --2- 172.21.15.86:0/1625389589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8df0003f60 0x7f8df0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:08.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.547+0000 7f8e0a30a640 1 -- 172.21.15.86:0/1625389589 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df0003520 con 0x7f8df0004d40 2024-09-19T06:37:08.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.548+0000 7f8e0a30a640 1 --2- 172.21.15.86:0/1625389589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8df0004d40 0x7f8df00051c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc009fc0 tx=0x7f8df0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c488b71bc53b5a88 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:08.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.548+0000 7f8e08b07640 1 -- 172.21.15.86:0/1625389589 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc009c10 con 0x7f8df0004d40 2024-09-19T06:37:08.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.548+0000 7f8e08b07640 1 -- 172.21.15.86:0/1625389589 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dfc036070 con 0x7f8df0004d40 2024-09-19T06:37:08.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.548+0000 7f8e08b07640 1 -- 172.21.15.86:0/1625389589 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc031880 con 0x7f8df0004d40 2024-09-19T06:37:08.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.548+0000 7f8e0bd6d640 1 -- 172.21.15.86:0/1625389589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8df0004d40 msgr2=0x7f8df00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:08.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.548+0000 7f8e0bd6d640 1 --2- 172.21.15.86:0/1625389589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8df0004d40 0x7f8df00051c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc009fc0 tx=0x7f8df0005830 comp rx=0 tx=0).stop 2024-09-19T06:37:08.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.548+0000 7f8e0a30a640 1 -- 172.21.15.86:0/1625389589 reap_dead start 2024-09-19T06:37:08.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.548+0000 7f8e0bd6d640 1 -- 172.21.15.86:0/1625389589 shutdown_connections 2024-09-19T06:37:08.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.548+0000 7f8e0bd6d640 1 -- 172.21.15.86:0/1625389589 >> 172.21.15.86:0/1625389589 conn(0x7f8e04067a70 msgr2=0x7f8e04067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:08.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.548+0000 7f8e0bd6d640 1 -- 172.21.15.86:0/1625389589 shutdown_connections 2024-09-19T06:37:08.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.548+0000 7f8e0bd6d640 1 -- 172.21.15.86:0/1625389589 wait complete. 2024-09-19T06:37:08.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.549+0000 7f8e0bd6d640 1 Processor -- start 2024-09-19T06:37:08.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.550+0000 7f8e0bd6d640 1 -- start start 2024-09-19T06:37:08.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.550+0000 7f8e0bd6d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8df0004d40 0x7f8e0414a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:08.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.550+0000 7f8e0bd6d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8e040b6870 0x7f8e041457e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:08.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.550+0000 7f8e0bd6d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e04145d20 0x7f8e041443c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:08.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.550+0000 7f8e0bd6d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8e040cd6c0 con 0x7f8e04145d20 2024-09-19T06:37:08.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.550+0000 7f8e0bd6d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8e040cd3e0 con 0x7f8df0004d40 2024-09-19T06:37:08.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.550+0000 7f8e0bd6d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8e0415c0a0 con 0x7f8e040b6870 2024-09-19T06:37:08.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.550+0000 7f8e0a30a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e04145d20 0x7f8e041443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:08.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.550+0000 7f8e0a30a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e04145d20 0x7f8e041443c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36306/0 (socket says 172.21.15.86:36306) 2024-09-19T06:37:08.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.550+0000 7f8e0a30a640 1 -- 172.21.15.86:0/1765192201 learned_addr learned my addr 172.21.15.86:0/1765192201 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:08.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.550+0000 7f8e09308640 1 --2- 172.21.15.86:0/1765192201 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8e040b6870 0x7f8e041457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:08.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.550+0000 7f8e09b09640 1 --2- 172.21.15.86:0/1765192201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8df0004d40 0x7f8e0414a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:08.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.551+0000 7f8e0a30a640 1 -- 172.21.15.86:0/1765192201 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8e040b6870 msgr2=0x7f8e041457e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:08.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.551+0000 7f8e0a30a640 1 --2- 172.21.15.86:0/1765192201 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8e040b6870 0x7f8e041457e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:08.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.551+0000 7f8e0a30a640 1 -- 172.21.15.86:0/1765192201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8df0004d40 msgr2=0x7f8e0414a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:08.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.551+0000 7f8e0a30a640 1 --2- 172.21.15.86:0/1765192201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8df0004d40 0x7f8e0414a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:08.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.551+0000 7f8e0a30a640 1 -- 172.21.15.86:0/1765192201 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e04148010 con 0x7f8e04145d20 2024-09-19T06:37:08.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.551+0000 7f8e09308640 1 --2- 172.21.15.86:0/1765192201 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8e040b6870 0x7f8e041457e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:08.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.551+0000 7f8e0a30a640 1 --2- 172.21.15.86:0/1765192201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e04145d20 0x7f8e041443c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc00e230 tx=0x7f8dfc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:08.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.551+0000 7f8dfa7fc640 1 -- 172.21.15.86:0/1765192201 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc009c10 con 0x7f8e04145d20 2024-09-19T06:37:08.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.551+0000 7f8dfa7fc640 1 -- 172.21.15.86:0/1765192201 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dfc040030 con 0x7f8e04145d20 2024-09-19T06:37:08.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.551+0000 7f8e0bd6d640 1 -- 172.21.15.86:0/1765192201 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e041e6b30 con 0x7f8e04145d20 2024-09-19T06:37:08.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.551+0000 7f8dfa7fc640 1 -- 172.21.15.86:0/1765192201 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc003bd0 con 0x7f8e04145d20 2024-09-19T06:37:08.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.551+0000 7f8e0bd6d640 1 -- 172.21.15.86:0/1765192201 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e04147770 con 0x7f8e04145d20 2024-09-19T06:37:08.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.552+0000 7f8e0bd6d640 1 -- 172.21.15.86:0/1765192201 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e040cccb0 con 0x7f8e04145d20 2024-09-19T06:37:08.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.552+0000 7f8dfa7fc640 1 -- 172.21.15.86:0/1765192201 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8dfc005d10 con 0x7f8e04145d20 2024-09-19T06:37:08.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.553+0000 7f8dfa7fc640 1 --2- 172.21.15.86:0/1765192201 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8de806c2e0 0x7f8de806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:08.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.553+0000 7f8e09b09640 1 --2- 172.21.15.86:0/1765192201 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8de806c2e0 0x7f8de806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:08.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.553+0000 7f8dfa7fc640 1 -- 172.21.15.86:0/1765192201 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7f8dfc0ac750 con 0x7f8e04145d20 2024-09-19T06:37:08.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.553+0000 7f8e09b09640 1 --2- 172.21.15.86:0/1765192201 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8de806c2e0 0x7f8de806e7a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8e0415f4b0 tx=0x7f8e00009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:08.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.557+0000 7f8dfa7fc640 1 -- 172.21.15.86:0/1765192201 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8dfc04a020 con 0x7f8e04145d20 2024-09-19T06:37:08.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:08.761+0000 7f8e0bd6d640 1 -- 172.21.15.86:0/1765192201 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8e040cc340 con 0x7f8e04145d20 2024-09-19T06:37:09.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.420+0000 7f8dfa7fc640 1 -- 172.21.15.86:0/1765192201 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f8dfc07afb0 con 0x7f8e04145d20 2024-09-19T06:37:09.422 INFO:teuthology.orchestra.run.smithi086.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T06:37:09.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.425+0000 7f8e0bd6d640 1 -- 172.21.15.86:0/1765192201 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8de806c2e0 msgr2=0x7f8de806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:09.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.425+0000 7f8e0bd6d640 1 --2- 172.21.15.86:0/1765192201 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8de806c2e0 0x7f8de806e7a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8e0415f4b0 tx=0x7f8e00009040 comp rx=0 tx=0).stop 2024-09-19T06:37:09.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.425+0000 7f8e0bd6d640 1 -- 172.21.15.86:0/1765192201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e04145d20 msgr2=0x7f8e041443c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:09.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.425+0000 7f8e0bd6d640 1 --2- 172.21.15.86:0/1765192201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e04145d20 0x7f8e041443c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc00e230 tx=0x7f8dfc009750 comp rx=0 tx=0).stop 2024-09-19T06:37:09.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.425+0000 7f8e0bd6d640 1 -- 172.21.15.86:0/1765192201 shutdown_connections 2024-09-19T06:37:09.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.425+0000 7f8e0bd6d640 1 --2- 172.21.15.86:0/1765192201 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8de806c2e0 0x7f8de806e7a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:09.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.425+0000 7f8e0bd6d640 1 --2- 172.21.15.86:0/1765192201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e04145d20 0x7f8e041443c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:09.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.425+0000 7f8e0bd6d640 1 --2- 172.21.15.86:0/1765192201 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8e040b6870 0x7f8e041457e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:09.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.425+0000 7f8e0bd6d640 1 --2- 172.21.15.86:0/1765192201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8df0004d40 0x7f8e0414a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:09.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.425+0000 7f8e0bd6d640 1 -- 172.21.15.86:0/1765192201 >> 172.21.15.86:0/1765192201 conn(0x7f8e04067a70 msgr2=0x7f8e0414b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:09.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.426+0000 7f8e0bd6d640 1 -- 172.21.15.86:0/1765192201 shutdown_connections 2024-09-19T06:37:09.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.426+0000 7f8e0bd6d640 1 -- 172.21.15.86:0/1765192201 wait complete. 2024-09-19T06:37:09.453 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-19T06:37:09.453 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-19T06:37:09.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.558+0000 7fa877f66640 1 Processor -- start 2024-09-19T06:37:09.560 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.558+0000 7fa877f66640 1 -- start start 2024-09-19T06:37:09.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.559+0000 7fa877f66640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa870152060 0x7fa8700c7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:09.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.559+0000 7fa877f66640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa87006f6e0 0x7fa87015bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:09.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.559+0000 7fa877f66640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa87015c170 con 0x7fa8700685d0 2024-09-19T06:37:09.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.559+0000 7fa877f66640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fa8700c70b0 con 0x7fa87006f6e0 2024-09-19T06:37:09.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.559+0000 7fa877f66640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fa8700cafc0 con 0x7fa870152060 2024-09-19T06:37:09.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.559+0000 7fa876503640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa87006f6e0 0x7fa87015bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:09.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.559+0000 7fa876503640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa87006f6e0 0x7fa87015bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36318/0 (socket says 172.21.15.86:36318) 2024-09-19T06:37:09.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.559+0000 7fa876503640 1 -- 172.21.15.86:0/1981898931 learned_addr learned my addr 172.21.15.86:0/1981898931 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:09.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.559+0000 7fa876503640 1 -- 172.21.15.86:0/1981898931 >> v2:172.21.15.169:3300/0 conn(0x7fa870152060 msgr2=0x7fa8700c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:09.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.559+0000 7fa876503640 1 --2- 172.21.15.86:0/1981898931 >> v2:172.21.15.169:3300/0 conn(0x7fa870152060 0x7fa8700c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:09.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.559+0000 7fa876503640 1 -- 172.21.15.86:0/1981898931 >> v1:172.21.15.169:6789/0 conn(0x7fa8700685d0 legacy=0x7fa87015b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:09.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.559+0000 7fa876503640 1 -- 172.21.15.86:0/1981898931 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8700c6a60 con 0x7fa87006f6e0 2024-09-19T06:37:09.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.560+0000 7fa876503640 1 --2- 172.21.15.86:0/1981898931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa87006f6e0 0x7fa87015bb10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa8700cb3e0 tx=0x7fa86802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a940febf34af3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:09.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.560+0000 7fa874d00640 1 -- 172.21.15.86:0/1981898931 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa868036070 con 0x7fa87006f6e0 2024-09-19T06:37:09.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.560+0000 7fa874d00640 1 -- 172.21.15.86:0/1981898931 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa868031600 con 0x7fa87006f6e0 2024-09-19T06:37:09.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.560+0000 7fa874d00640 1 -- 172.21.15.86:0/1981898931 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8680319d0 con 0x7fa87006f6e0 2024-09-19T06:37:09.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.561+0000 7fa877f66640 1 -- 172.21.15.86:0/1981898931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa87006f6e0 msgr2=0x7fa87015bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:09.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.561+0000 7fa877f66640 1 --2- 172.21.15.86:0/1981898931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa87006f6e0 0x7fa87015bb10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa8700cb3e0 tx=0x7fa86802a6f0 comp rx=0 tx=0).stop 2024-09-19T06:37:09.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.561+0000 7fa877f66640 1 -- 172.21.15.86:0/1981898931 shutdown_connections 2024-09-19T06:37:09.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.561+0000 7fa877f66640 1 --2- 172.21.15.86:0/1981898931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa87006f6e0 0x7fa87015bb10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:09.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.561+0000 7fa877f66640 1 --2- 172.21.15.86:0/1981898931 >> v2:172.21.15.169:3300/0 conn(0x7fa870152060 0x7fa8700c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:09.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.561+0000 7fa877f66640 1 -- 172.21.15.86:0/1981898931 >> 172.21.15.86:0/1981898931 conn(0x7fa8700ca320 msgr2=0x7fa8700ca730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:09.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.561+0000 7fa877f66640 1 -- 172.21.15.86:0/1981898931 shutdown_connections 2024-09-19T06:37:09.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.561+0000 7fa877f66640 1 -- 172.21.15.86:0/1981898931 wait complete. 2024-09-19T06:37:09.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.562+0000 7fa877f66640 1 Processor -- start 2024-09-19T06:37:09.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.562+0000 7fa877f66640 1 -- start start 2024-09-19T06:37:09.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.562+0000 7fa877f66640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8700685d0 0x7fa8701f2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:09.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.563+0000 7fa877f66640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa87006f6e0 0x7fa8701e2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:09.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.563+0000 7fa877f66640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa870152060 0x7fa8701e2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:09.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.563+0000 7fa877f66640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa87006dce0 con 0x7fa8700685d0 2024-09-19T06:37:09.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.563+0000 7fa877f66640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa8700c8220 con 0x7fa870152060 2024-09-19T06:37:09.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.563+0000 7fa877f66640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa8700c4890 con 0x7fa87006f6e0 2024-09-19T06:37:09.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.563+0000 7fa875d02640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8700685d0 0x7fa8701f2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:09.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.563+0000 7fa875d02640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8700685d0 0x7fa8701f2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36324/0 (socket says 172.21.15.86:36324) 2024-09-19T06:37:09.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.563+0000 7fa875d02640 1 -- 172.21.15.86:0/3792958960 learned_addr learned my addr 172.21.15.86:0/3792958960 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:09.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.563+0000 7fa875d02640 1 -- 172.21.15.86:0/3792958960 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa87006f6e0 msgr2=0x7fa8701e2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:09.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.563+0000 7fa876503640 1 --2- 172.21.15.86:0/3792958960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa870152060 0x7fa8701e2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:09.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.563+0000 7fa875501640 1 --2- 172.21.15.86:0/3792958960 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa87006f6e0 0x7fa8701e2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:09.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.563+0000 7fa875d02640 1 --2- 172.21.15.86:0/3792958960 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa87006f6e0 0x7fa8701e2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:09.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.563+0000 7fa875d02640 1 -- 172.21.15.86:0/3792958960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa870152060 msgr2=0x7fa8701e2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:09.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.563+0000 7fa875d02640 1 --2- 172.21.15.86:0/3792958960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa870152060 0x7fa8701e2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:09.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.563+0000 7fa875d02640 1 -- 172.21.15.86:0/3792958960 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87014ec90 con 0x7fa8700685d0 2024-09-19T06:37:09.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.563+0000 7fa875d02640 1 --2- 172.21.15.86:0/3792958960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8700685d0 0x7fa8701f2540 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa86c00b440 tx=0x7fa86c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:09.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.563+0000 7fa8667fc640 1 -- 172.21.15.86:0/3792958960 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86c015020 con 0x7fa8700685d0 2024-09-19T06:37:09.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.563+0000 7fa8667fc640 1 -- 172.21.15.86:0/3792958960 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa86c011890 con 0x7fa8700685d0 2024-09-19T06:37:09.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.563+0000 7fa877f66640 1 -- 172.21.15.86:0/3792958960 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa87014ef70 con 0x7fa8700685d0 2024-09-19T06:37:09.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.563+0000 7fa8667fc640 1 -- 172.21.15.86:0/3792958960 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86c011c80 con 0x7fa8700685d0 2024-09-19T06:37:09.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.563+0000 7fa877f66640 1 -- 172.21.15.86:0/3792958960 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8701e2a90 con 0x7fa8700685d0 2024-09-19T06:37:09.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.564+0000 7fa877f66640 1 -- 172.21.15.86:0/3792958960 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8701e2c90 con 0x7fa8700685d0 2024-09-19T06:37:09.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.565+0000 7fa8667fc640 1 -- 172.21.15.86:0/3792958960 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa86c018020 con 0x7fa8700685d0 2024-09-19T06:37:09.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.565+0000 7fa8667fc640 1 --2- 172.21.15.86:0/3792958960 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa85406c2b0 0x7fa85406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:09.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.565+0000 7fa875501640 1 --2- 172.21.15.86:0/3792958960 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa85406c2b0 0x7fa85406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:09.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.565+0000 7fa8667fc640 1 -- 172.21.15.86:0/3792958960 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa86c08b610 con 0x7fa8700685d0 2024-09-19T06:37:09.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.565+0000 7fa875501640 1 --2- 172.21.15.86:0/3792958960 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa85406c2b0 0x7fa85406e770 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa870145100 tx=0x7fa860009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:09.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.569+0000 7fa8667fc640 1 -- 172.21.15.86:0/3792958960 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa8701e2c90 con 0x7fa8700685d0 2024-09-19T06:37:09.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:09.749+0000 7fa877f66640 1 -- 172.21.15.86:0/3792958960 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fa870152440 con 0x7fa8700685d0 2024-09-19T06:37:10.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.435+0000 7fa8667fc640 1 -- 172.21.15.86:0/3792958960 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) ==== 157+0+0 (secure 0 0 0) 0x7fa86c01f020 con 0x7fa8700685d0 2024-09-19T06:37:10.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.438+0000 7fa877f66640 1 -- 172.21.15.86:0/3792958960 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa85406c2b0 msgr2=0x7fa85406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:10.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.438+0000 7fa877f66640 1 --2- 172.21.15.86:0/3792958960 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa85406c2b0 0x7fa85406e770 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa870145100 tx=0x7fa860009040 comp rx=0 tx=0).stop 2024-09-19T06:37:10.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.438+0000 7fa877f66640 1 -- 172.21.15.86:0/3792958960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8700685d0 msgr2=0x7fa8701f2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:10.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.438+0000 7fa877f66640 1 --2- 172.21.15.86:0/3792958960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8700685d0 0x7fa8701f2540 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa86c00b440 tx=0x7fa86c00b900 comp rx=0 tx=0).stop 2024-09-19T06:37:10.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.438+0000 7fa877f66640 1 -- 172.21.15.86:0/3792958960 shutdown_connections 2024-09-19T06:37:10.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.438+0000 7fa877f66640 1 --2- 172.21.15.86:0/3792958960 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa85406c2b0 0x7fa85406e770 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:10.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.438+0000 7fa877f66640 1 --2- 172.21.15.86:0/3792958960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa870152060 0x7fa8701e2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:10.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.438+0000 7fa877f66640 1 --2- 172.21.15.86:0/3792958960 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa87006f6e0 0x7fa8701e2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:10.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.438+0000 7fa877f66640 1 --2- 172.21.15.86:0/3792958960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8700685d0 0x7fa8701f2540 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:10.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.438+0000 7fa877f66640 1 -- 172.21.15.86:0/3792958960 >> 172.21.15.86:0/3792958960 conn(0x7fa8700ca320 msgr2=0x7fa870147c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:10.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.438+0000 7fa877f66640 1 -- 172.21.15.86:0/3792958960 shutdown_connections 2024-09-19T06:37:10.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.438+0000 7fa877f66640 1 -- 172.21.15.86:0/3792958960 wait complete. 2024-09-19T06:37:10.452 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T06:37:10.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.563+0000 7fe7bb40e640 1 Processor -- start 2024-09-19T06:37:10.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.563+0000 7fe7bb40e640 1 -- start start 2024-09-19T06:37:10.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.564+0000 7fe7bb40e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7b4155330 0x7fe7b4073e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:10.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.564+0000 7fe7bb40e640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe7b415cc80 0x7fe7b406bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:10.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.564+0000 7fe7bb40e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7b415b080 con 0x7fe7b4072020 2024-09-19T06:37:10.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.564+0000 7fe7bb40e640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fe7b4072560 con 0x7fe7b415cc80 2024-09-19T06:37:10.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.564+0000 7fe7bb40e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe7b415b340 con 0x7fe7b4155330 2024-09-19T06:37:10.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.564+0000 7fe7b99ab640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe7b415cc80 0x7fe7b406bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:10.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.564+0000 7fe7b99ab640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe7b415cc80 0x7fe7b406bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36340/0 (socket says 172.21.15.86:36340) 2024-09-19T06:37:10.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.564+0000 7fe7b99ab640 1 -- 172.21.15.86:0/1802610439 learned_addr learned my addr 172.21.15.86:0/1802610439 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:10.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.564+0000 7fe7b91aa640 1 --2- 172.21.15.86:0/1802610439 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7b4155330 0x7fe7b4073e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:10.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.564+0000 7fe7b99ab640 1 -- 172.21.15.86:0/1802610439 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7b4155330 msgr2=0x7fe7b4073e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:10.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.564+0000 7fe7b99ab640 1 --2- 172.21.15.86:0/1802610439 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7b4155330 0x7fe7b4073e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:10.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.564+0000 7fe7b99ab640 1 -- 172.21.15.86:0/1802610439 >> v1:172.21.15.169:6789/0 conn(0x7fe7b4072020 legacy=0x7fe7b415c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:10.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.564+0000 7fe7b99ab640 1 -- 172.21.15.86:0/1802610439 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b415b620 con 0x7fe7b415cc80 2024-09-19T06:37:10.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.565+0000 7fe7b99ab640 1 --2- 172.21.15.86:0/1802610439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7b415cc80 0x7fe7b406bbc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac009870 tx=0x7fe7ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=345fa17193427854 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:10.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.565+0000 7fe7b3fff640 1 -- 172.21.15.86:0/1802610439 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac037070 con 0x7fe7b415cc80 2024-09-19T06:37:10.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.565+0000 7fe7b3fff640 1 -- 172.21.15.86:0/1802610439 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7ac032440 con 0x7fe7b415cc80 2024-09-19T06:37:10.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.565+0000 7fe7b3fff640 1 -- 172.21.15.86:0/1802610439 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac032810 con 0x7fe7b415cc80 2024-09-19T06:37:10.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.566+0000 7fe7bb40e640 1 -- 172.21.15.86:0/1802610439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7b415cc80 msgr2=0x7fe7b406bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:10.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.566+0000 7fe7bb40e640 1 --2- 172.21.15.86:0/1802610439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7b415cc80 0x7fe7b406bbc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac009870 tx=0x7fe7ac02a270 comp rx=0 tx=0).stop 2024-09-19T06:37:10.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.566+0000 7fe7bb40e640 1 -- 172.21.15.86:0/1802610439 shutdown_connections 2024-09-19T06:37:10.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.566+0000 7fe7bb40e640 1 --2- 172.21.15.86:0/1802610439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7b415cc80 0x7fe7b406bbc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:10.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.566+0000 7fe7bb40e640 1 --2- 172.21.15.86:0/1802610439 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7b4155330 0x7fe7b4073e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:10.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.566+0000 7fe7bb40e640 1 -- 172.21.15.86:0/1802610439 >> 172.21.15.86:0/1802610439 conn(0x7fe7b40ca320 msgr2=0x7fe7b40ca700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:10.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.566+0000 7fe7bb40e640 1 -- 172.21.15.86:0/1802610439 shutdown_connections 2024-09-19T06:37:10.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.566+0000 7fe7bb40e640 1 -- 172.21.15.86:0/1802610439 wait complete. 2024-09-19T06:37:10.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.567+0000 7fe7bb40e640 1 Processor -- start 2024-09-19T06:37:10.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.567+0000 7fe7bb40e640 1 -- start start 2024-09-19T06:37:10.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.568+0000 7fe7bb40e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7b4072020 0x7fe7b41f1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:10.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.568+0000 7fe7bb40e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7b4155330 0x7fe7b41f1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:10.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.568+0000 7fe7bb40e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7b415cc80 0x7fe7b414e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:10.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.568+0000 7fe7bb40e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b4155710 con 0x7fe7b4072020 2024-09-19T06:37:10.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.568+0000 7fe7bb40e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b415bbe0 con 0x7fe7b4155330 2024-09-19T06:37:10.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.568+0000 7fe7bb40e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe7b406c100 con 0x7fe7b415cc80 2024-09-19T06:37:10.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.568+0000 7fe7b91aa640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7b4072020 0x7fe7b41f1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:10.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.568+0000 7fe7b91aa640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7b4072020 0x7fe7b41f1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36344/0 (socket says 172.21.15.86:36344) 2024-09-19T06:37:10.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.568+0000 7fe7b91aa640 1 -- 172.21.15.86:0/2665170551 learned_addr learned my addr 172.21.15.86:0/2665170551 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:10.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.568+0000 7fe7b89a9640 1 --2- 172.21.15.86:0/2665170551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7b4155330 0x7fe7b41f1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:10.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.568+0000 7fe7b99ab640 1 --2- 172.21.15.86:0/2665170551 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7b415cc80 0x7fe7b414e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:10.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.568+0000 7fe7b91aa640 1 -- 172.21.15.86:0/2665170551 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7b415cc80 msgr2=0x7fe7b414e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:10.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.568+0000 7fe7b91aa640 1 --2- 172.21.15.86:0/2665170551 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7b415cc80 0x7fe7b414e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:10.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.568+0000 7fe7b91aa640 1 -- 172.21.15.86:0/2665170551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7b4155330 msgr2=0x7fe7b41f1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:10.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.568+0000 7fe7b91aa640 1 --2- 172.21.15.86:0/2665170551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7b4155330 0x7fe7b41f1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:10.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.568+0000 7fe7b91aa640 1 -- 172.21.15.86:0/2665170551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b4158ca0 con 0x7fe7b4072020 2024-09-19T06:37:10.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.568+0000 7fe7b91aa640 1 --2- 172.21.15.86:0/2665170551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7b4072020 0x7fe7b41f1150 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4007f20 tx=0x7fe7a400e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:10.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.568+0000 7fe7b1ffb640 1 -- 172.21.15.86:0/2665170551 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4014620 con 0x7fe7b4072020 2024-09-19T06:37:10.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.568+0000 7fe7b1ffb640 1 -- 172.21.15.86:0/2665170551 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7a4019070 con 0x7fe7b4072020 2024-09-19T06:37:10.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.569+0000 7fe7bb40e640 1 -- 172.21.15.86:0/2665170551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7b414b4e0 con 0x7fe7b4072020 2024-09-19T06:37:10.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.569+0000 7fe7b1ffb640 1 -- 172.21.15.86:0/2665170551 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4014a00 con 0x7fe7b4072020 2024-09-19T06:37:10.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.569+0000 7fe7bb40e640 1 -- 172.21.15.86:0/2665170551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7b41589c0 con 0x7fe7b4072020 2024-09-19T06:37:10.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.570+0000 7fe7bb40e640 1 -- 172.21.15.86:0/2665170551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7b4073e30 con 0x7fe7b4072020 2024-09-19T06:37:10.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.570+0000 7fe7b1ffb640 1 -- 172.21.15.86:0/2665170551 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe7a4014ba0 con 0x7fe7b4072020 2024-09-19T06:37:10.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.570+0000 7fe7b1ffb640 1 --2- 172.21.15.86:0/2665170551 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe7a006c2e0 0x7fe7a006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:10.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.571+0000 7fe7b89a9640 1 --2- 172.21.15.86:0/2665170551 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe7a006c2e0 0x7fe7a006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:10.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.571+0000 7fe7b1ffb640 1 -- 172.21.15.86:0/2665170551 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6007+0+0 (secure 0 0 0) 0x7fe7a408bcf0 con 0x7fe7b4072020 2024-09-19T06:37:10.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.571+0000 7fe7b89a9640 1 --2- 172.21.15.86:0/2665170551 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe7a006c2e0 0x7fe7a006e7a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe7b415f3c0 tx=0x7fe7a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:10.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.575+0000 7fe7b1ffb640 1 -- 172.21.15.86:0/2665170551 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe7a4090070 con 0x7fe7b4072020 2024-09-19T06:37:10.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:10.743+0000 7fe7bb40e640 1 -- 172.21.15.86:0/2665170551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe7b41549c0 con 0x7fe7b4072020 2024-09-19T06:37:12.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.438+0000 7fe7b1ffb640 1 -- 172.21.15.86:0/2665170551 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) ==== 228+0+0 (secure 0 0 0) 0x7fe7a4059ce0 con 0x7fe7b4072020 2024-09-19T06:37:12.440 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data_ec' created 2024-09-19T06:37:12.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.442+0000 7fe7bb40e640 1 -- 172.21.15.86:0/2665170551 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe7a006c2e0 msgr2=0x7fe7a006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:12.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.442+0000 7fe7bb40e640 1 --2- 172.21.15.86:0/2665170551 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe7a006c2e0 0x7fe7a006e7a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe7b415f3c0 tx=0x7fe7a8009040 comp rx=0 tx=0).stop 2024-09-19T06:37:12.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.442+0000 7fe7bb40e640 1 -- 172.21.15.86:0/2665170551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7b4072020 msgr2=0x7fe7b41f1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:12.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.442+0000 7fe7bb40e640 1 --2- 172.21.15.86:0/2665170551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7b4072020 0x7fe7b41f1150 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4007f20 tx=0x7fe7a400e570 comp rx=0 tx=0).stop 2024-09-19T06:37:12.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.442+0000 7fe7bb40e640 1 -- 172.21.15.86:0/2665170551 shutdown_connections 2024-09-19T06:37:12.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.442+0000 7fe7bb40e640 1 --2- 172.21.15.86:0/2665170551 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe7a006c2e0 0x7fe7a006e7a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:12.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.442+0000 7fe7bb40e640 1 --2- 172.21.15.86:0/2665170551 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7b415cc80 0x7fe7b414e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:12.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.442+0000 7fe7bb40e640 1 --2- 172.21.15.86:0/2665170551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7b4155330 0x7fe7b41f1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:12.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.442+0000 7fe7bb40e640 1 --2- 172.21.15.86:0/2665170551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7b4072020 0x7fe7b41f1150 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:12.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.442+0000 7fe7bb40e640 1 -- 172.21.15.86:0/2665170551 >> 172.21.15.86:0/2665170551 conn(0x7fe7b40ca320 msgr2=0x7fe7b40cc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:12.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.442+0000 7fe7bb40e640 1 -- 172.21.15.86:0/2665170551 shutdown_connections 2024-09-19T06:37:12.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.442+0000 7fe7bb40e640 1 -- 172.21.15.86:0/2665170551 wait complete. 2024-09-19T06:37:12.462 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-19T06:37:12.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.568+0000 7f7e2b850640 1 Processor -- start 2024-09-19T06:37:12.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.568+0000 7f7e2b850640 1 -- start start 2024-09-19T06:37:12.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.569+0000 7f7e2b850640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7e240ccde0 0x7f7e240d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:12.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.569+0000 7f7e2b850640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7e240d0f30 0x7f7e240c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:12.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.569+0000 7f7e2b850640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e240cbc60 con 0x7f7e24155290 2024-09-19T06:37:12.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.569+0000 7f7e2b850640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f7e240cba00 con 0x7f7e240ccde0 2024-09-19T06:37:12.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.569+0000 7f7e2b850640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f7e240cbf20 con 0x7f7e240d0f30 2024-09-19T06:37:12.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.569+0000 7f7e28deb640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7e240ccde0 0x7f7e240d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:12.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.569+0000 7f7e28deb640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7e240ccde0 0x7f7e240d09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40776/0 (socket says 172.21.15.86:40776) 2024-09-19T06:37:12.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.569+0000 7f7e28deb640 1 -- 172.21.15.86:0/1402569401 learned_addr learned my addr 172.21.15.86:0/1402569401 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:12.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.569+0000 7f7e29ded640 1 --2- 172.21.15.86:0/1402569401 >> v2:172.21.15.169:3300/0 conn(0x7f7e240d0f30 0x7f7e240c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:12.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.569+0000 7f7e28deb640 1 -- 172.21.15.86:0/1402569401 >> v2:172.21.15.169:3300/0 conn(0x7f7e240d0f30 msgr2=0x7f7e240c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:12.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.570+0000 7f7e28deb640 1 --2- 172.21.15.86:0/1402569401 >> v2:172.21.15.169:3300/0 conn(0x7f7e240d0f30 0x7f7e240c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:12.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.570+0000 7f7e28deb640 1 -- 172.21.15.86:0/1402569401 >> v1:172.21.15.169:6789/0 conn(0x7f7e24155290 legacy=0x7f7e2415bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:12.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.570+0000 7f7e28deb640 1 -- 172.21.15.86:0/1402569401 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2415e6c0 con 0x7f7e240ccde0 2024-09-19T06:37:12.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.570+0000 7f7e29ded640 1 --2- 172.21.15.86:0/1402569401 >> v2:172.21.15.169:3300/0 conn(0x7f7e240d0f30 0x7f7e240c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:12.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.570+0000 7f7e28deb640 1 --2- 172.21.15.86:0/1402569401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e240ccde0 0x7f7e240d09f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7e2406e8b0 tx=0x7f7e1402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d46bbd6a8f3e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:12.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.570+0000 7f7e1bfff640 1 -- 172.21.15.86:0/1402569401 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e14037070 con 0x7f7e240ccde0 2024-09-19T06:37:12.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.570+0000 7f7e1bfff640 1 -- 172.21.15.86:0/1402569401 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e14032440 con 0x7f7e240ccde0 2024-09-19T06:37:12.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.570+0000 7f7e1bfff640 1 -- 172.21.15.86:0/1402569401 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e14032810 con 0x7f7e240ccde0 2024-09-19T06:37:12.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.571+0000 7f7e2b850640 1 -- 172.21.15.86:0/1402569401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e240ccde0 msgr2=0x7f7e240d09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:12.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.571+0000 7f7e2b850640 1 --2- 172.21.15.86:0/1402569401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e240ccde0 0x7f7e240d09f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7e2406e8b0 tx=0x7f7e1402a2c0 comp rx=0 tx=0).stop 2024-09-19T06:37:12.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.571+0000 7f7e2b850640 1 -- 172.21.15.86:0/1402569401 shutdown_connections 2024-09-19T06:37:12.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.571+0000 7f7e2b850640 1 --2- 172.21.15.86:0/1402569401 >> v2:172.21.15.169:3300/0 conn(0x7f7e240d0f30 0x7f7e240c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:12.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.571+0000 7f7e2b850640 1 --2- 172.21.15.86:0/1402569401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e240ccde0 0x7f7e240d09f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:12.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.571+0000 7f7e2b850640 1 -- 172.21.15.86:0/1402569401 >> 172.21.15.86:0/1402569401 conn(0x7f7e2406d980 msgr2=0x7f7e2406dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:12.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.571+0000 7f7e2b850640 1 -- 172.21.15.86:0/1402569401 shutdown_connections 2024-09-19T06:37:12.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.571+0000 7f7e2b850640 1 -- 172.21.15.86:0/1402569401 wait complete. 2024-09-19T06:37:12.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.572+0000 7f7e2b850640 1 Processor -- start 2024-09-19T06:37:12.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.572+0000 7f7e2b850640 1 -- start start 2024-09-19T06:37:12.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.573+0000 7f7e2b850640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e240ccde0 0x7f7e241f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:12.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.573+0000 7f7e2b850640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e240d0f30 0x7f7e241e50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:12.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.573+0000 7f7e2b850640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e24155290 0x7f7e240cf580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:12.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.573+0000 7f7e2b850640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2415ef60 con 0x7f7e24155290 2024-09-19T06:37:12.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.573+0000 7f7e2b850640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2415ec80 con 0x7f7e240ccde0 2024-09-19T06:37:12.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.573+0000 7f7e2b850640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7e2415f240 con 0x7f7e240d0f30 2024-09-19T06:37:12.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.573+0000 7f7e29ded640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e24155290 0x7f7e240cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:12.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.573+0000 7f7e29ded640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e24155290 0x7f7e240cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40790/0 (socket says 172.21.15.86:40790) 2024-09-19T06:37:12.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.573+0000 7f7e29ded640 1 -- 172.21.15.86:0/3981998418 learned_addr learned my addr 172.21.15.86:0/3981998418 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:12.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.573+0000 7f7e295ec640 1 --2- 172.21.15.86:0/3981998418 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e240ccde0 0x7f7e241f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:12.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.573+0000 7f7e28deb640 1 --2- 172.21.15.86:0/3981998418 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e240d0f30 0x7f7e241e50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:12.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.573+0000 7f7e29ded640 1 -- 172.21.15.86:0/3981998418 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e240d0f30 msgr2=0x7f7e241e50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:12.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.573+0000 7f7e29ded640 1 --2- 172.21.15.86:0/3981998418 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e240d0f30 0x7f7e241e50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:12.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.573+0000 7f7e29ded640 1 -- 172.21.15.86:0/3981998418 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e240ccde0 msgr2=0x7f7e241f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:12.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.573+0000 7f7e29ded640 1 --2- 172.21.15.86:0/3981998418 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e240ccde0 0x7f7e241f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:12.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.573+0000 7f7e29ded640 1 -- 172.21.15.86:0/3981998418 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e240cfac0 con 0x7f7e24155290 2024-09-19T06:37:12.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.573+0000 7f7e29ded640 1 --2- 172.21.15.86:0/3981998418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e24155290 0x7f7e240cf580 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00cef0 tx=0x7f7e1c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:12.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.574+0000 7f7e19ffb640 1 -- 172.21.15.86:0/3981998418 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c01a070 con 0x7f7e24155290 2024-09-19T06:37:12.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.574+0000 7f7e19ffb640 1 -- 172.21.15.86:0/3981998418 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e1c00d860 con 0x7f7e24155290 2024-09-19T06:37:12.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.574+0000 7f7e2b850640 1 -- 172.21.15.86:0/3981998418 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e241e6330 con 0x7f7e24155290 2024-09-19T06:37:12.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.574+0000 7f7e19ffb640 1 -- 172.21.15.86:0/3981998418 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c00dc50 con 0x7f7e24155290 2024-09-19T06:37:12.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.574+0000 7f7e2b850640 1 -- 172.21.15.86:0/3981998418 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e241e45c0 con 0x7f7e24155290 2024-09-19T06:37:12.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.575+0000 7f7e2b850640 1 -- 172.21.15.86:0/3981998418 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e24153a80 con 0x7f7e24155290 2024-09-19T06:37:12.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.575+0000 7f7e19ffb640 1 -- 172.21.15.86:0/3981998418 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7e1c01d070 con 0x7f7e24155290 2024-09-19T06:37:12.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.576+0000 7f7e19ffb640 1 --2- 172.21.15.86:0/3981998418 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7e0806c2b0 0x7f7e0806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:12.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.576+0000 7f7e19ffb640 1 -- 172.21.15.86:0/3981998418 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f7e1c08bf00 con 0x7f7e24155290 2024-09-19T06:37:12.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.576+0000 7f7e295ec640 1 --2- 172.21.15.86:0/3981998418 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7e0806c2b0 0x7f7e0806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:12.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.576+0000 7f7e295ec640 1 --2- 172.21.15.86:0/3981998418 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7e0806c2b0 0x7f7e0806e770 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7e20006fd0 tx=0x7f7e20009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:12.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.580+0000 7f7e19ffb640 1 -- 172.21.15.86:0/3981998418 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7e24153a80 con 0x7f7e24155290 2024-09-19T06:37:12.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:12.747+0000 7f7e2b850640 1 -- 172.21.15.86:0/3981998418 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f7e24155670 con 0x7f7e24155290 2024-09-19T06:37:13.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.440+0000 7f7e19ffb640 1 -- 172.21.15.86:0/3981998418 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) ==== 169+0+0 (secure 0 0 0) 0x7f7e1c059e50 con 0x7f7e24155290 2024-09-19T06:37:13.441 INFO:teuthology.orchestra.run.smithi086.stderr:set pool 4 allow_ec_overwrites to true 2024-09-19T06:37:13.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.444+0000 7f7e2b850640 1 -- 172.21.15.86:0/3981998418 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7e0806c2b0 msgr2=0x7f7e0806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:13.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.444+0000 7f7e2b850640 1 --2- 172.21.15.86:0/3981998418 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7e0806c2b0 0x7f7e0806e770 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7e20006fd0 tx=0x7f7e20009060 comp rx=0 tx=0).stop 2024-09-19T06:37:13.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.444+0000 7f7e2b850640 1 -- 172.21.15.86:0/3981998418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e24155290 msgr2=0x7f7e240cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:13.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.444+0000 7f7e2b850640 1 --2- 172.21.15.86:0/3981998418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e24155290 0x7f7e240cf580 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00cef0 tx=0x7f7e1c00a710 comp rx=0 tx=0).stop 2024-09-19T06:37:13.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.444+0000 7f7e2b850640 1 -- 172.21.15.86:0/3981998418 shutdown_connections 2024-09-19T06:37:13.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.444+0000 7f7e2b850640 1 --2- 172.21.15.86:0/3981998418 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7e0806c2b0 0x7f7e0806e770 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:13.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.444+0000 7f7e2b850640 1 --2- 172.21.15.86:0/3981998418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e24155290 0x7f7e240cf580 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:13.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.444+0000 7f7e2b850640 1 --2- 172.21.15.86:0/3981998418 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e240d0f30 0x7f7e241e50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:13.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.444+0000 7f7e2b850640 1 --2- 172.21.15.86:0/3981998418 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e240ccde0 0x7f7e241f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:13.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.444+0000 7f7e2b850640 1 -- 172.21.15.86:0/3981998418 >> 172.21.15.86:0/3981998418 conn(0x7f7e2406d980 msgr2=0x7f7e240cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:13.447 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.445+0000 7f7e2b850640 1 -- 172.21.15.86:0/3981998418 shutdown_connections 2024-09-19T06:37:13.447 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.445+0000 7f7e2b850640 1 -- 172.21.15.86:0/3981998418 wait complete. 2024-09-19T06:37:13.477 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-19T06:37:13.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.578+0000 7f0f4a4ba640 1 Processor -- start 2024-09-19T06:37:13.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.578+0000 7f0f4a4ba640 1 -- start start 2024-09-19T06:37:13.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.579+0000 7f0f4a4ba640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f4406cf40 0x7f0f440ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:13.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.579+0000 7f0f4a4ba640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0f440c8ca0 0x7f0f44071730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:13.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.579+0000 7f0f4a4ba640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f4406da00 con 0x7f0f4406d320 2024-09-19T06:37:13.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.579+0000 7f0f4a4ba640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f0f44073cc0 con 0x7f0f440c8ca0 2024-09-19T06:37:13.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.579+0000 7f0f4a4ba640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0f44073fa0 con 0x7f0f4406cf40 2024-09-19T06:37:13.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.579+0000 7f0f437fe640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f0f4406d320 0x7f0f440c8590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:52682/0 (socket says 172.21.15.86:52682) 2024-09-19T06:37:13.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.579+0000 7f0f437fe640 1 -- 172.21.15.86:0/4270776283 learned_addr learned my addr 172.21.15.86:0/4270776283 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:13.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.579+0000 7f0f43fff640 1 --2- 172.21.15.86:0/4270776283 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f4406cf40 0x7f0f440ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:13.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.579+0000 7f0f48a57640 1 --2- 172.21.15.86:0/4270776283 >> v2:172.21.15.169:3300/0 conn(0x7f0f440c8ca0 0x7f0f44071730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:13.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.579+0000 7f0f42ffd640 1 -- 172.21.15.86:0/4270776283 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3172137858 0 0) 0x7f0f4406da00 con 0x7f0f4406d320 2024-09-19T06:37:13.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.579+0000 7f0f42ffd640 1 -- 172.21.15.86:0/4270776283 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f2c003520 con 0x7f0f4406d320 2024-09-19T06:37:13.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.579+0000 7f0f42ffd640 1 -- 172.21.15.86:0/4270776283 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2917450391 0 0) 0x7f0f2c003520 con 0x7f0f4406d320 2024-09-19T06:37:13.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.579+0000 7f0f48a57640 1 -- 172.21.15.86:0/4270776283 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f4406cf40 msgr2=0x7f0f440ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:13.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.579+0000 7f0f48a57640 1 --2- 172.21.15.86:0/4270776283 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f4406cf40 0x7f0f440ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:13.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.579+0000 7f0f48a57640 1 -- 172.21.15.86:0/4270776283 >> v1:172.21.15.86:6789/0 conn(0x7f0f4406d320 legacy=0x7f0f440c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:13.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.579+0000 7f0f48a57640 1 -- 172.21.15.86:0/4270776283 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f44070c50 con 0x7f0f440c8ca0 2024-09-19T06:37:13.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.579+0000 7f0f43fff640 1 --2- 172.21.15.86:0/4270776283 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f4406cf40 0x7f0f440ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:37:13.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.580+0000 7f0f48a57640 1 --2- 172.21.15.86:0/4270776283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f440c8ca0 0x7f0f44071730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009d90 tx=0x7f0f3c02a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d59a156697810eb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:13.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.580+0000 7f0f42ffd640 1 -- 172.21.15.86:0/4270776283 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f38001670 con 0x7f0f440c8ca0 2024-09-19T06:37:13.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.580+0000 7f0f42ffd640 1 -- 172.21.15.86:0/4270776283 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f3c007540 con 0x7f0f440c8ca0 2024-09-19T06:37:13.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.580+0000 7f0f42ffd640 1 -- 172.21.15.86:0/4270776283 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c0078f0 con 0x7f0f440c8ca0 2024-09-19T06:37:13.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.581+0000 7f0f4a4ba640 1 -- 172.21.15.86:0/4270776283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f440c8ca0 msgr2=0x7f0f44071730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:13.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.581+0000 7f0f4a4ba640 1 --2- 172.21.15.86:0/4270776283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f440c8ca0 0x7f0f44071730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009d90 tx=0x7f0f3c02a680 comp rx=0 tx=0).stop 2024-09-19T06:37:13.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.581+0000 7f0f4a4ba640 1 -- 172.21.15.86:0/4270776283 shutdown_connections 2024-09-19T06:37:13.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.581+0000 7f0f4a4ba640 1 --2- 172.21.15.86:0/4270776283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f440c8ca0 0x7f0f44071730 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:13.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.581+0000 7f0f4a4ba640 1 --2- 172.21.15.86:0/4270776283 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f4406cf40 0x7f0f440ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:13.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.581+0000 7f0f4a4ba640 1 -- 172.21.15.86:0/4270776283 >> 172.21.15.86:0/4270776283 conn(0x7f0f44067890 msgr2=0x7f0f44067c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:13.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.581+0000 7f0f4a4ba640 1 -- 172.21.15.86:0/4270776283 shutdown_connections 2024-09-19T06:37:13.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.581+0000 7f0f4a4ba640 1 -- 172.21.15.86:0/4270776283 wait complete. 2024-09-19T06:37:13.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.582+0000 7f0f4a4ba640 1 Processor -- start 2024-09-19T06:37:13.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.582+0000 7f0f4a4ba640 1 -- start start 2024-09-19T06:37:13.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.583+0000 7f0f4a4ba640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f4406cf40 0x7f0f440cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:13.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.583+0000 7f0f4a4ba640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f4406d320 0x7f0f44151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:13.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.583+0000 7f0f4a4ba640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f440c8ca0 0x7f0f4414c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:13.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.583+0000 7f0f4a4ba640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4415bc60 con 0x7f0f4406d320 2024-09-19T06:37:13.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.583+0000 7f0f4a4ba640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0f44071210 con 0x7f0f4406cf40 2024-09-19T06:37:13.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.583+0000 7f0f4a4ba640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0f4415bde0 con 0x7f0f440c8ca0 2024-09-19T06:37:13.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.583+0000 7f0f437fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f4406d320 0x7f0f44151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:13.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.583+0000 7f0f437fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f4406d320 0x7f0f44151ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40806/0 (socket says 172.21.15.86:40806) 2024-09-19T06:37:13.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.583+0000 7f0f437fe640 1 -- 172.21.15.86:0/1949515824 learned_addr learned my addr 172.21.15.86:0/1949515824 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:13.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.583+0000 7f0f43fff640 1 --2- 172.21.15.86:0/1949515824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f4406cf40 0x7f0f440cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:13.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.583+0000 7f0f48a57640 1 --2- 172.21.15.86:0/1949515824 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f440c8ca0 0x7f0f4414c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:13.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.583+0000 7f0f437fe640 1 -- 172.21.15.86:0/1949515824 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f440c8ca0 msgr2=0x7f0f4414c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:13.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.583+0000 7f0f437fe640 1 --2- 172.21.15.86:0/1949515824 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f440c8ca0 0x7f0f4414c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:13.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.583+0000 7f0f437fe640 1 -- 172.21.15.86:0/1949515824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f4406cf40 msgr2=0x7f0f440cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:13.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.583+0000 7f0f437fe640 1 --2- 172.21.15.86:0/1949515824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f4406cf40 0x7f0f440cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:13.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.583+0000 7f0f437fe640 1 -- 172.21.15.86:0/1949515824 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f441f4370 con 0x7f0f4406d320 2024-09-19T06:37:13.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.583+0000 7f0f43fff640 1 --2- 172.21.15.86:0/1949515824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f4406cf40 0x7f0f440cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:13.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.583+0000 7f0f437fe640 1 --2- 172.21.15.86:0/1949515824 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f4406d320 0x7f0f44151ff0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0f3800c750 tx=0x7f0f3800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:13.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.583+0000 7f0f40ff9640 1 -- 172.21.15.86:0/1949515824 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f38017070 con 0x7f0f4406d320 2024-09-19T06:37:13.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.584+0000 7f0f40ff9640 1 -- 172.21.15.86:0/1949515824 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f38005ad0 con 0x7f0f4406d320 2024-09-19T06:37:13.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.584+0000 7f0f4a4ba640 1 -- 172.21.15.86:0/1949515824 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f441f4650 con 0x7f0f4406d320 2024-09-19T06:37:13.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.584+0000 7f0f40ff9640 1 -- 172.21.15.86:0/1949515824 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f38007070 con 0x7f0f4406d320 2024-09-19T06:37:13.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.584+0000 7f0f4a4ba640 1 -- 172.21.15.86:0/1949515824 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f44159690 con 0x7f0f4406d320 2024-09-19T06:37:13.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.584+0000 7f0f4a4ba640 1 -- 172.21.15.86:0/1949515824 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f4415a350 con 0x7f0f4406d320 2024-09-19T06:37:13.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.585+0000 7f0f40ff9640 1 -- 172.21.15.86:0/1949515824 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0f3801a070 con 0x7f0f4406d320 2024-09-19T06:37:13.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.585+0000 7f0f40ff9640 1 --2- 172.21.15.86:0/1949515824 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f0f3006c2e0 0x7f0f3006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:13.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.586+0000 7f0f40ff9640 1 -- 172.21.15.86:0/1949515824 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7f0f3808aa90 con 0x7f0f4406d320 2024-09-19T06:37:13.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.586+0000 7f0f43fff640 1 --2- 172.21.15.86:0/1949515824 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f0f3006c2e0 0x7f0f3006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:13.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.586+0000 7f0f43fff640 1 --2- 172.21.15.86:0/1949515824 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f0f3006c2e0 0x7f0f3006e7a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0f34009ba0 tx=0x7f0f34008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:13.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.590+0000 7f0f40ff9640 1 -- 172.21.15.86:0/1949515824 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0f4415a350 con 0x7f0f4406d320 2024-09-19T06:37:13.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:13.794+0000 7f0f4a4ba640 1 -- 172.21.15.86:0/1949515824 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f0f440ca280 con 0x7f0f4406d320 2024-09-19T06:37:14.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.478+0000 7f0f40ff9640 1 -- 172.21.15.86:0/1949515824 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7f0f38058920 con 0x7f0f4406d320 2024-09-19T06:37:14.480 INFO:teuthology.orchestra.run.smithi086.stderr:added data pool 4 to fsmap 2024-09-19T06:37:14.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.481+0000 7f0f4a4ba640 1 -- 172.21.15.86:0/1949515824 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f0f3006c2e0 msgr2=0x7f0f3006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:14.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.481+0000 7f0f4a4ba640 1 --2- 172.21.15.86:0/1949515824 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f0f3006c2e0 0x7f0f3006e7a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0f34009ba0 tx=0x7f0f34008040 comp rx=0 tx=0).stop 2024-09-19T06:37:14.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.481+0000 7f0f4a4ba640 1 -- 172.21.15.86:0/1949515824 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f4406d320 msgr2=0x7f0f44151ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:14.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.481+0000 7f0f4a4ba640 1 --2- 172.21.15.86:0/1949515824 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f4406d320 0x7f0f44151ff0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0f3800c750 tx=0x7f0f3800cc10 comp rx=0 tx=0).stop 2024-09-19T06:37:14.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.481+0000 7f0f4a4ba640 1 -- 172.21.15.86:0/1949515824 shutdown_connections 2024-09-19T06:37:14.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.481+0000 7f0f4a4ba640 1 --2- 172.21.15.86:0/1949515824 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f0f3006c2e0 0x7f0f3006e7a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:14.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.481+0000 7f0f4a4ba640 1 --2- 172.21.15.86:0/1949515824 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f440c8ca0 0x7f0f4414c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:14.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.481+0000 7f0f4a4ba640 1 --2- 172.21.15.86:0/1949515824 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f4406d320 0x7f0f44151ff0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:14.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.481+0000 7f0f4a4ba640 1 --2- 172.21.15.86:0/1949515824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f4406cf40 0x7f0f440cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:14.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.481+0000 7f0f4a4ba640 1 -- 172.21.15.86:0/1949515824 >> 172.21.15.86:0/1949515824 conn(0x7f0f44067890 msgr2=0x7f0f440c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:14.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.481+0000 7f0f4a4ba640 1 -- 172.21.15.86:0/1949515824 shutdown_connections 2024-09-19T06:37:14.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.481+0000 7f0f4a4ba640 1 -- 172.21.15.86:0/1949515824 wait complete. 2024-09-19T06:37:14.495 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:37:14.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.594+0000 7f0c0e47b640 1 Processor -- start 2024-09-19T06:37:14.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.594+0000 7f0c0e47b640 1 -- start start 2024-09-19T06:37:14.598 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.594+0000 7f0c0e47b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0c08154ed0 0x7f0c080c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:14.598 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.594+0000 7f0c0e47b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c0806bbc0 0x7f0c0806d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:14.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.594+0000 7f0c0e47b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c08072da0 con 0x7f0c0815e560 2024-09-19T06:37:14.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.594+0000 7f0c0e47b640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f0c0806d210 con 0x7f0c08154ed0 2024-09-19T06:37:14.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.594+0000 7f0c0e47b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0c08072b40 con 0x7f0c0806bbc0 2024-09-19T06:37:14.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.595+0000 7f0c07fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0c08154ed0 0x7f0c080c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:14.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.595+0000 7f0c07fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0c08154ed0 0x7f0c080c9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40816/0 (socket says 172.21.15.86:40816) 2024-09-19T06:37:14.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.595+0000 7f0c07fff640 1 -- 172.21.15.86:0/667333995 learned_addr learned my addr 172.21.15.86:0/667333995 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:14.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.595+0000 7f0c077fe640 1 --2- 172.21.15.86:0/667333995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c0806bbc0 0x7f0c0806d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:14.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.595+0000 7f0c07fff640 1 -- 172.21.15.86:0/667333995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c0806bbc0 msgr2=0x7f0c0806d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:14.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.595+0000 7f0c07fff640 1 --2- 172.21.15.86:0/667333995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c0806bbc0 0x7f0c0806d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:14.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.595+0000 7f0c07fff640 1 -- 172.21.15.86:0/667333995 >> v1:172.21.15.169:6789/0 conn(0x7f0c0815e560 legacy=0x7f0c0815ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:14.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.595+0000 7f0c07fff640 1 -- 172.21.15.86:0/667333995 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c08073040 con 0x7f0c08154ed0 2024-09-19T06:37:14.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.596+0000 7f0c07fff640 1 --2- 172.21.15.86:0/667333995 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c08154ed0 0x7f0c080c9de0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009870 tx=0x7f0bf802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e3377837116ffc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:14.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.596+0000 7f0c06ffd640 1 -- 172.21.15.86:0/667333995 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8037070 con 0x7f0c08154ed0 2024-09-19T06:37:14.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.596+0000 7f0c06ffd640 1 -- 172.21.15.86:0/667333995 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf8032440 con 0x7f0c08154ed0 2024-09-19T06:37:14.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.596+0000 7f0c06ffd640 1 -- 172.21.15.86:0/667333995 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8032810 con 0x7f0c08154ed0 2024-09-19T06:37:14.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.596+0000 7f0c0e47b640 1 -- 172.21.15.86:0/667333995 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c08154ed0 msgr2=0x7f0c080c9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:14.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.596+0000 7f0c0e47b640 1 --2- 172.21.15.86:0/667333995 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c08154ed0 0x7f0c080c9de0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009870 tx=0x7f0bf802a180 comp rx=0 tx=0).stop 2024-09-19T06:37:14.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.596+0000 7f0c0e47b640 1 -- 172.21.15.86:0/667333995 shutdown_connections 2024-09-19T06:37:14.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.596+0000 7f0c0e47b640 1 --2- 172.21.15.86:0/667333995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c0806bbc0 0x7f0c0806d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:14.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.596+0000 7f0c0e47b640 1 --2- 172.21.15.86:0/667333995 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c08154ed0 0x7f0c080c9de0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:14.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.596+0000 7f0c0e47b640 1 -- 172.21.15.86:0/667333995 >> 172.21.15.86:0/667333995 conn(0x7f0c080ca320 msgr2=0x7f0c080ca730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:14.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.596+0000 7f0c0e47b640 1 -- 172.21.15.86:0/667333995 shutdown_connections 2024-09-19T06:37:14.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.596+0000 7f0c0e47b640 1 -- 172.21.15.86:0/667333995 wait complete. 2024-09-19T06:37:14.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.597+0000 7f0c0e47b640 1 Processor -- start 2024-09-19T06:37:14.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.598+0000 7f0c0e47b640 1 -- start start 2024-09-19T06:37:14.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.598+0000 7f0c0e47b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c0806bbc0 0x7f0c08158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:14.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.598+0000 7f0c0e47b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c08154ed0 0x7f0c081575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:14.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.598+0000 7f0c0e47b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c0815e560 0x7f0c08159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:14.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.598+0000 7f0c0e47b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0c081552b0 con 0x7f0c0806bbc0 2024-09-19T06:37:14.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.598+0000 7f0c0e47b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0c080c8220 con 0x7f0c0815e560 2024-09-19T06:37:14.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.598+0000 7f0c0e47b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0c0815f120 con 0x7f0c08154ed0 2024-09-19T06:37:14.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.598+0000 7f0c07fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c0806bbc0 0x7f0c08158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:14.606 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.598+0000 7f0c07fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c0806bbc0 0x7f0c08158de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40818/0 (socket says 172.21.15.86:40818) 2024-09-19T06:37:14.606 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.598+0000 7f0c07fff640 1 -- 172.21.15.86:0/2082186964 learned_addr learned my addr 172.21.15.86:0/2082186964 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:14.606 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.598+0000 7f0c077fe640 1 --2- 172.21.15.86:0/2082186964 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c08154ed0 0x7f0c081575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:14.606 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.598+0000 7f0c0ca18640 1 --2- 172.21.15.86:0/2082186964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c0815e560 0x7f0c08159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:14.606 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.599+0000 7f0c07fff640 1 -- 172.21.15.86:0/2082186964 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c08154ed0 msgr2=0x7f0c081575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:14.606 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.599+0000 7f0c07fff640 1 --2- 172.21.15.86:0/2082186964 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c08154ed0 0x7f0c081575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:14.606 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.599+0000 7f0c07fff640 1 -- 172.21.15.86:0/2082186964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c0815e560 msgr2=0x7f0c08159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:14.606 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.599+0000 7f0c07fff640 1 --2- 172.21.15.86:0/2082186964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c0815e560 0x7f0c08159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:14.606 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.599+0000 7f0c07fff640 1 -- 172.21.15.86:0/2082186964 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c081e55e0 con 0x7f0c0806bbc0 2024-09-19T06:37:14.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.599+0000 7f0c07fff640 1 --2- 172.21.15.86:0/2082186964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c0806bbc0 0x7f0c08158de0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009870 tx=0x7f0bf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:14.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.599+0000 7f0c04ff9640 1 -- 172.21.15.86:0/2082186964 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8041020 con 0x7f0c0806bbc0 2024-09-19T06:37:14.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.599+0000 7f0c04ff9640 1 -- 172.21.15.86:0/2082186964 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf8030970 con 0x7f0c0806bbc0 2024-09-19T06:37:14.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.599+0000 7f0c0e47b640 1 -- 172.21.15.86:0/2082186964 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c081e58c0 con 0x7f0c0806bbc0 2024-09-19T06:37:14.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.599+0000 7f0c04ff9640 1 -- 172.21.15.86:0/2082186964 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8037040 con 0x7f0c0806bbc0 2024-09-19T06:37:14.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.599+0000 7f0c0e47b640 1 -- 172.21.15.86:0/2082186964 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c081e5e80 con 0x7f0c0806bbc0 2024-09-19T06:37:14.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.600+0000 7f0c0e47b640 1 -- 172.21.15.86:0/2082186964 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c080caed0 con 0x7f0c0806bbc0 2024-09-19T06:37:14.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.600+0000 7f0c04ff9640 1 -- 172.21.15.86:0/2082186964 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0bf8044020 con 0x7f0c0806bbc0 2024-09-19T06:37:14.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.601+0000 7f0c04ff9640 1 --2- 172.21.15.86:0/2082186964 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f0bf406c2b0 0x7f0bf406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:14.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.601+0000 7f0c04ff9640 1 -- 172.21.15.86:0/2082186964 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0bf80ac0a0 con 0x7f0c0806bbc0 2024-09-19T06:37:14.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.601+0000 7f0c077fe640 1 --2- 172.21.15.86:0/2082186964 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f0bf406c2b0 0x7f0bf406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:14.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.601+0000 7f0c077fe640 1 --2- 172.21.15.86:0/2082186964 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f0bf406c2b0 0x7f0bf406e770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0c081e8610 tx=0x7f0bfc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:14.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.605+0000 7f0c04ff9640 1 -- 172.21.15.86:0/2082186964 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0bf804b030 con 0x7f0c0806bbc0 2024-09-19T06:37:14.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.806+0000 7f0c0e47b640 1 -- 172.21.15.86:0/2082186964 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c080ca0b0 con 0x7f0c0806bbc0 2024-09-19T06:37:14.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.806+0000 7f0c04ff9640 1 -- 172.21.15.86:0/2082186964 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+6865 (secure 0 0 0) 0x7f0bf807a560 con 0x7f0c0806bbc0 2024-09-19T06:37:14.808 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:14.808 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":5,"btime":"2024-09-19T06:37:14:474741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:37:13.796398+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.169:6837/201961024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":201961024},{"type":"v1","addr":"172.21.15.169:6837","nonce":201961024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:37:14.808 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 5 2024-09-19T06:37:14.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.808+0000 7f0c0e47b640 1 -- 172.21.15.86:0/2082186964 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f0bf406c2b0 msgr2=0x7f0bf406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:14.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.808+0000 7f0c0e47b640 1 --2- 172.21.15.86:0/2082186964 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f0bf406c2b0 0x7f0bf406e770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0c081e8610 tx=0x7f0bfc008040 comp rx=0 tx=0).stop 2024-09-19T06:37:14.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.808+0000 7f0c0e47b640 1 -- 172.21.15.86:0/2082186964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c0806bbc0 msgr2=0x7f0c08158de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:14.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.808+0000 7f0c0e47b640 1 --2- 172.21.15.86:0/2082186964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c0806bbc0 0x7f0c08158de0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009870 tx=0x7f0bf80046c0 comp rx=0 tx=0).stop 2024-09-19T06:37:14.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.808+0000 7f0c0e47b640 1 -- 172.21.15.86:0/2082186964 shutdown_connections 2024-09-19T06:37:14.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.808+0000 7f0c0e47b640 1 --2- 172.21.15.86:0/2082186964 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f0bf406c2b0 0x7f0bf406e770 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:14.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.808+0000 7f0c0e47b640 1 --2- 172.21.15.86:0/2082186964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c0815e560 0x7f0c08159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:14.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.808+0000 7f0c0e47b640 1 --2- 172.21.15.86:0/2082186964 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c08154ed0 0x7f0c081575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:14.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.808+0000 7f0c0e47b640 1 --2- 172.21.15.86:0/2082186964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c0806bbc0 0x7f0c08158de0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:14.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.808+0000 7f0c0e47b640 1 -- 172.21.15.86:0/2082186964 >> 172.21.15.86:0/2082186964 conn(0x7f0c080ca320 msgr2=0x7f0c080cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:14.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.808+0000 7f0c0e47b640 1 -- 172.21.15.86:0/2082186964 shutdown_connections 2024-09-19T06:37:14.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.808+0000 7f0c0e47b640 1 -- 172.21.15.86:0/2082186964 wait complete. 2024-09-19T06:37:14.821 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T06:37:14.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.917+0000 7f1edef31640 1 Processor -- start 2024-09-19T06:37:14.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.917+0000 7f1edef31640 1 -- start start 2024-09-19T06:37:14.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.918+0000 7f1edef31640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ed815e170 0x7f1ed80b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:14.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.918+0000 7f1edef31640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed815c9c0 con 0x7f1ed80d1120 2024-09-19T06:37:14.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.918+0000 7f1edef31640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed815cca0 con 0x7f1ed80d0d40 2024-09-19T06:37:14.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.918+0000 7f1edef31640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed815c770 con 0x7f1ed815e170 2024-09-19T06:37:14.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.918+0000 7f1ed7fff640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f1ed80d1120 0x7f1ed815da60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:52684/0 (socket says 172.21.15.86:52684) 2024-09-19T06:37:14.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.918+0000 7f1ed7fff640 1 -- 172.21.15.86:0/3957089171 learned_addr learned my addr 172.21.15.86:0/3957089171 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:14.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1edd4ce640 1 --2- 172.21.15.86:0/3957089171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ed815e170 0x7f1ed80b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:14.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1ed77fe640 1 -- 172.21.15.86:0/3957089171 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4052688428 0 0) 0x7f1ed815c9c0 con 0x7f1ed80d1120 2024-09-19T06:37:14.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1ed77fe640 1 -- 172.21.15.86:0/3957089171 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ec0003520 con 0x7f1ed80d1120 2024-09-19T06:37:14.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1ed77fe640 1 -- 172.21.15.86:0/3957089171 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3224791674 0 0) 0x7f1ed815cca0 con 0x7f1ed80d0d40 2024-09-19T06:37:14.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1ed77fe640 1 -- 172.21.15.86:0/3957089171 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ed815c9c0 con 0x7f1ed80d0d40 2024-09-19T06:37:14.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1ed77fe640 1 -- 172.21.15.86:0/3957089171 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3684496544 0 0) 0x7f1ec0003520 con 0x7f1ed80d1120 2024-09-19T06:37:14.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1ed77fe640 1 -- 172.21.15.86:0/3957089171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ed815e170 msgr2=0x7f1ed80b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:14.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1ed77fe640 1 --2- 172.21.15.86:0/3957089171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ed815e170 0x7f1ed80b4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:14.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1ed77fe640 1 -- 172.21.15.86:0/3957089171 >> v1:172.21.15.169:6789/0 conn(0x7f1ed80d0d40 legacy=0x7f1ed80ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:14.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1ed77fe640 1 -- 172.21.15.86:0/3957089171 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed815cf80 con 0x7f1ed80d1120 2024-09-19T06:37:14.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1ed77fe640 1 -- 172.21.15.86:0/3957089171 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f1ecc001670 con 0x7f1ed80d1120 2024-09-19T06:37:14.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1ed77fe640 1 -- 172.21.15.86:0/3957089171 >> v1:172.21.15.86:6789/0 conn(0x7f1ed80d1120 legacy=0x7f1ed815da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:14.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1ed77fe640 1 --2- 172.21.15.86:0/3957089171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec0003b70 0x7f1ec0003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:14.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1ed77fe640 1 --2- 172.21.15.86:0/3957089171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ec0004800 0x7f1ec0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:14.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1ed77fe640 1 --2- 172.21.15.86:0/3957089171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ec00051c0 0x7f1ec000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:14.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1ed77fe640 1 -- 172.21.15.86:0/3957089171 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed815c770 con 0x7f1ec0003b70 2024-09-19T06:37:14.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1ed77fe640 1 -- 172.21.15.86:0/3957089171 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec000bfe0 con 0x7f1ec0004800 2024-09-19T06:37:14.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1ed77fe640 1 -- 172.21.15.86:0/3957089171 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1ec000c1e0 con 0x7f1ec00051c0 2024-09-19T06:37:14.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1edd4ce640 1 --2- 172.21.15.86:0/3957089171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ed815e170 0x7f1ed80b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:37:14.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1edcccd640 1 --2- 172.21.15.86:0/3957089171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec0003b70 0x7f1ec0003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:14.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1ed7fff640 1 --2- 172.21.15.86:0/3957089171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ec0004800 0x7f1ec0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:14.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1edd4ce640 1 --2- 172.21.15.86:0/3957089171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ec00051c0 0x7f1ec000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:14.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1edcccd640 1 -- 172.21.15.86:0/3957089171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ec00051c0 msgr2=0x7f1ec000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:14.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1edcccd640 1 --2- 172.21.15.86:0/3957089171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ec00051c0 0x7f1ec000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:14.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1edcccd640 1 -- 172.21.15.86:0/3957089171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ec0004800 msgr2=0x7f1ec0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:14.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1edcccd640 1 --2- 172.21.15.86:0/3957089171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ec0004800 0x7f1ec0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:14.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1edcccd640 1 -- 172.21.15.86:0/3957089171 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec0003520 con 0x7f1ec0003b70 2024-09-19T06:37:14.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.919+0000 7f1edd4ce640 1 --2- 172.21.15.86:0/3957089171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ec00051c0 0x7f1ec000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:14.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.920+0000 7f1edcccd640 1 --2- 172.21.15.86:0/3957089171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec0003b70 0x7f1ec0003f90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1ec80018c0 tx=0x7f1ec0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e0a24395f784596 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:14.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.920+0000 7f1ed77fe640 1 -- 172.21.15.86:0/3957089171 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec80014e0 con 0x7f1ec0003b70 2024-09-19T06:37:14.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.920+0000 7f1ed77fe640 1 -- 172.21.15.86:0/3957089171 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ec80052f0 con 0x7f1ec0003b70 2024-09-19T06:37:14.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.920+0000 7f1ed77fe640 1 -- 172.21.15.86:0/3957089171 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec802ac90 con 0x7f1ec0003b70 2024-09-19T06:37:14.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.921+0000 7f1edef31640 1 -- 172.21.15.86:0/3957089171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec0003b70 msgr2=0x7f1ec0003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:14.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.921+0000 7f1edef31640 1 --2- 172.21.15.86:0/3957089171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec0003b70 0x7f1ec0003f90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1ec80018c0 tx=0x7f1ec0005830 comp rx=0 tx=0).stop 2024-09-19T06:37:14.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.921+0000 7f1edd4ce640 1 -- 172.21.15.86:0/3957089171 reap_dead start 2024-09-19T06:37:14.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.921+0000 7f1edef31640 1 -- 172.21.15.86:0/3957089171 shutdown_connections 2024-09-19T06:37:14.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.921+0000 7f1edef31640 1 -- 172.21.15.86:0/3957089171 >> 172.21.15.86:0/3957089171 conn(0x7f1ed806d910 msgr2=0x7f1ed806dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:14.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.921+0000 7f1edef31640 1 -- 172.21.15.86:0/3957089171 shutdown_connections 2024-09-19T06:37:14.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.921+0000 7f1edef31640 1 -- 172.21.15.86:0/3957089171 wait complete. 2024-09-19T06:37:14.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.922+0000 7f1edef31640 1 Processor -- start 2024-09-19T06:37:14.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.922+0000 7f1edef31640 1 -- start start 2024-09-19T06:37:14.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.923+0000 7f1edef31640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ec0003b70 0x7f1ed80ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:14.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.923+0000 7f1edef31640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ed80c7680 0x7f1ed814fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:14.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.923+0000 7f1edef31640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ed80c46a0 0x7f1ed81503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:14.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.923+0000 7f1edef31640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed80cadd0 con 0x7f1ed80c7680 2024-09-19T06:37:14.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.923+0000 7f1edef31640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed80b3f20 con 0x7f1ed80c46a0 2024-09-19T06:37:14.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.923+0000 7f1edef31640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed80caf50 con 0x7f1ec0003b70 2024-09-19T06:37:14.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.923+0000 7f1ed7fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ed80c7680 0x7f1ed814fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:14.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.923+0000 7f1ed7fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ed80c7680 0x7f1ed814fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40838/0 (socket says 172.21.15.86:40838) 2024-09-19T06:37:14.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.923+0000 7f1ed7fff640 1 -- 172.21.15.86:0/2116367999 learned_addr learned my addr 172.21.15.86:0/2116367999 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:14.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.923+0000 7f1edd4ce640 1 --2- 172.21.15.86:0/2116367999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ed80c46a0 0x7f1ed81503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:14.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.923+0000 7f1edcccd640 1 --2- 172.21.15.86:0/2116367999 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ec0003b70 0x7f1ed80ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:14.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.923+0000 7f1ed7fff640 1 -- 172.21.15.86:0/2116367999 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ec0003b70 msgr2=0x7f1ed80ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:14.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.923+0000 7f1ed7fff640 1 --2- 172.21.15.86:0/2116367999 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ec0003b70 0x7f1ed80ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:14.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.923+0000 7f1ed7fff640 1 -- 172.21.15.86:0/2116367999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ed80c46a0 msgr2=0x7f1ed81503d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:14.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.923+0000 7f1ed7fff640 1 --2- 172.21.15.86:0/2116367999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ed80c46a0 0x7f1ed81503d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:14.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.923+0000 7f1ed7fff640 1 -- 172.21.15.86:0/2116367999 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed81f1820 con 0x7f1ed80c7680 2024-09-19T06:37:14.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.923+0000 7f1ed7fff640 1 --2- 172.21.15.86:0/2116367999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ed80c7680 0x7f1ed814fe90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc004f00 tx=0x7f1ecc007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:14.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.923+0000 7f1ed57fa640 1 -- 172.21.15.86:0/2116367999 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc00f750 con 0x7f1ed80c7680 2024-09-19T06:37:14.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.923+0000 7f1ed57fa640 1 -- 172.21.15.86:0/2116367999 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ecc018070 con 0x7f1ed80c7680 2024-09-19T06:37:14.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.923+0000 7f1edef31640 1 -- 172.21.15.86:0/2116367999 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed81f1b00 con 0x7f1ed80c7680 2024-09-19T06:37:14.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.923+0000 7f1ed57fa640 1 -- 172.21.15.86:0/2116367999 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc00fb50 con 0x7f1ed80c7680 2024-09-19T06:37:14.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.923+0000 7f1edef31640 1 -- 172.21.15.86:0/2116367999 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ed81517c0 con 0x7f1ed80c7680 2024-09-19T06:37:14.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.924+0000 7f1edef31640 1 -- 172.21.15.86:0/2116367999 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ed8076950 con 0x7f1ed80c7680 2024-09-19T06:37:14.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.925+0000 7f1ed57fa640 1 -- 172.21.15.86:0/2116367999 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1ecc00fcf0 con 0x7f1ed80c7680 2024-09-19T06:37:14.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.925+0000 7f1ed57fa640 1 --2- 172.21.15.86:0/2116367999 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1ec406c2b0 0x7f1ec406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:14.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.925+0000 7f1edcccd640 1 --2- 172.21.15.86:0/2116367999 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1ec406c2b0 0x7f1ec406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:14.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.925+0000 7f1ed57fa640 1 -- 172.21.15.86:0/2116367999 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1ecc08b590 con 0x7f1ed80c7680 2024-09-19T06:37:14.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.926+0000 7f1edcccd640 1 --2- 172.21.15.86:0/2116367999 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1ec406c2b0 0x7f1ec406e770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8032000 tx=0x7f1ec802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:14.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:14.929+0000 7f1ed57fa640 1 -- 172.21.15.86:0/2116367999 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1ed8076950 con 0x7f1ed80c7680 2024-09-19T06:37:15.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.097+0000 7f1edef31640 1 -- 172.21.15.86:0/2116367999 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ed80cdc20 con 0x7f1ed80c7680 2024-09-19T06:37:15.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.098+0000 7f1ed57fa640 1 -- 172.21.15.86:0/2116367999 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18586 (secure 0 0 0) 0x7f1ed80cdc20 con 0x7f1ed80c7680 2024-09-19T06:37:15.238 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:15.239 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":26,"fsid":"1785f09f-0959-457d-8c4a-6cce2e655a37","created":"2024-09-19T06:36:45.671544+0000","modified":"2024-09-19T06:37:13.796252+0000","last_up_change":"2024-09-19T06:36:56.765680+0000","last_in_change":"2024-09-19T06:36:47.816681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:36:57.770634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:37:06.588120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:37:07.739726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T06:37:11.457476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bd3ce3f2-2a37-40ec-8dc3-69246437277c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6827","nonce":1588074611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6829","nonce":1588074611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6833","nonce":1588074611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6831","nonce":1588074611}]},"public_addr":"172.21.15.86:6827/1588074611","cluster_addr":"172.21.15.86:6829/1588074611","heartbeat_back_addr":"172.21.15.86:6833/1588074611","heartbeat_front_addr":"172.21.15.86:6831/1588074611","state":["exists","up"]},{"osd":1,"uuid":"871d7d23-ed03-4629-bca9-5b71ad0d926a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6819","nonce":1785682938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6821","nonce":1785682938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6825","nonce":1785682938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6823","nonce":1785682938}]},"public_addr":"172.21.15.86:6819/1785682938","cluster_addr":"172.21.15.86:6821/1785682938","heartbeat_back_addr":"172.21.15.86:6825/1785682938","heartbeat_front_addr":"172.21.15.86:6823/1785682938","state":["exists","up"]},{"osd":2,"uuid":"39d3562d-8c52-4af9-935a-2d90abb8b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6801","nonce":3306127846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6803","nonce":3306127846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6807","nonce":3306127846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6805","nonce":3306127846}]},"public_addr":"172.21.15.86:6801/3306127846","cluster_addr":"172.21.15.86:6803/3306127846","heartbeat_back_addr":"172.21.15.86:6807/3306127846","heartbeat_front_addr":"172.21.15.86:6805/3306127846","state":["exists","up"]},{"osd":3,"uuid":"7f88c5b1-042c-4a9f-a674-32456e0644a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6809","nonce":694275178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6811","nonce":694275178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6815","nonce":694275178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6813","nonce":694275178}]},"public_addr":"172.21.15.86:6809/694275178","cluster_addr":"172.21.15.86:6811/694275178","heartbeat_back_addr":"172.21.15.86:6815/694275178","heartbeat_front_addr":"172.21.15.86:6813/694275178","state":["exists","up"]},{"osd":4,"uuid":"18aa391b-0863-48bf-bff6-107e22ee9752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6811","nonce":1326795640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6815","nonce":1326795640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6823","nonce":1326795640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6819","nonce":1326795640}]},"public_addr":"172.21.15.169:6811/1326795640","cluster_addr":"172.21.15.169:6815/1326795640","heartbeat_back_addr":"172.21.15.169:6823/1326795640","heartbeat_front_addr":"172.21.15.169:6819/1326795640","state":["exists","up"]},{"osd":5,"uuid":"90fa5ca6-1815-4af1-a664-b45a9e19dd56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6825","nonce":3538913242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6827","nonce":3538913242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6831","nonce":3538913242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6829","nonce":3538913242}]},"public_addr":"172.21.15.169:6825/3538913242","cluster_addr":"172.21.15.169:6827/3538913242","heartbeat_back_addr":"172.21.15.169:6831/3538913242","heartbeat_front_addr":"172.21.15.169:6829/3538913242","state":["exists","up"]},{"osd":6,"uuid":"8b2019fc-6cc2-4394-9a7c-7951544f7cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6810","nonce":494424253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6814","nonce":494424253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6822","nonce":494424253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6818","nonce":494424253}]},"public_addr":"172.21.15.169:6810/494424253","cluster_addr":"172.21.15.169:6814/494424253","heartbeat_back_addr":"172.21.15.169:6822/494424253","heartbeat_front_addr":"172.21.15.169:6818/494424253","state":["exists","up"]},{"osd":7,"uuid":"622e3b2c-5302-4b0a-b7f2-f4050801401e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6801","nonce":797235989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6803","nonce":797235989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6807","nonce":797235989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6805","nonce":797235989}]},"public_addr":"172.21.15.169:6801/797235989","cluster_addr":"172.21.15.169:6803/797235989","heartbeat_back_addr":"172.21.15.169:6807/797235989","heartbeat_front_addr":"172.21.15.169:6805/797235989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.130643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.611572+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:53.419992+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.560112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.112065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.774642+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.341946+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.117884+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:37:15.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.100+0000 7f1edef31640 1 -- 172.21.15.86:0/2116367999 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1ec406c2b0 msgr2=0x7f1ec406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:15.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.100+0000 7f1edef31640 1 --2- 172.21.15.86:0/2116367999 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1ec406c2b0 0x7f1ec406e770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8032000 tx=0x7f1ec802e000 comp rx=0 tx=0).stop 2024-09-19T06:37:15.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.100+0000 7f1edef31640 1 -- 172.21.15.86:0/2116367999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ed80c7680 msgr2=0x7f1ed814fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:15.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.100+0000 7f1edef31640 1 --2- 172.21.15.86:0/2116367999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ed80c7680 0x7f1ed814fe90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc004f00 tx=0x7f1ecc007430 comp rx=0 tx=0).stop 2024-09-19T06:37:15.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.100+0000 7f1edef31640 1 -- 172.21.15.86:0/2116367999 shutdown_connections 2024-09-19T06:37:15.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.100+0000 7f1edef31640 1 --2- 172.21.15.86:0/2116367999 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1ec406c2b0 0x7f1ec406e770 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.100+0000 7f1edef31640 1 --2- 172.21.15.86:0/2116367999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ed80c46a0 0x7f1ed81503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.100+0000 7f1edef31640 1 --2- 172.21.15.86:0/2116367999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ed80c7680 0x7f1ed814fe90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.100+0000 7f1edef31640 1 --2- 172.21.15.86:0/2116367999 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ec0003b70 0x7f1ed80ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.100+0000 7f1edef31640 1 -- 172.21.15.86:0/2116367999 >> 172.21.15.86:0/2116367999 conn(0x7f1ed806d910 msgr2=0x7f1ed8154040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:15.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.100+0000 7f1edef31640 1 -- 172.21.15.86:0/2116367999 shutdown_connections 2024-09-19T06:37:15.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.100+0000 7f1edef31640 1 -- 172.21.15.86:0/2116367999 wait complete. 2024-09-19T06:37:15.242 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T06:37:15.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.339+0000 7f7e5059f640 1 Processor -- start 2024-09-19T06:37:15.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.339+0000 7f7e5059f640 1 -- start start 2024-09-19T06:37:15.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.340+0000 7f7e5059f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e4806bbc0 0x7f7e48158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:15.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.340+0000 7f7e5059f640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7e480c9cf0 0x7f7e48163640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:15.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.340+0000 7f7e5059f640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e481531a0 con 0x7f7e48152dc0 2024-09-19T06:37:15.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.340+0000 7f7e5059f640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f7e48159200 con 0x7f7e480c9cf0 2024-09-19T06:37:15.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.340+0000 7f7e5059f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7e480c5040 con 0x7f7e4806bbc0 2024-09-19T06:37:15.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.340+0000 7f7e4eb3c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7e480c9cf0 0x7f7e48163640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:15.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.340+0000 7f7e4eb3c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7e480c9cf0 0x7f7e48163640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40850/0 (socket says 172.21.15.86:40850) 2024-09-19T06:37:15.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.340+0000 7f7e4eb3c640 1 -- 172.21.15.86:0/1218950542 learned_addr learned my addr 172.21.15.86:0/1218950542 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:15.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.341+0000 7f7e4db3a640 1 --2- 172.21.15.86:0/1218950542 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e4806bbc0 0x7f7e48158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:15.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.341+0000 7f7e4eb3c640 1 -- 172.21.15.86:0/1218950542 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e4806bbc0 msgr2=0x7f7e48158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:15.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.341+0000 7f7e4eb3c640 1 --2- 172.21.15.86:0/1218950542 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e4806bbc0 0x7f7e48158cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.341+0000 7f7e4eb3c640 1 -- 172.21.15.86:0/1218950542 >> v1:172.21.15.169:6789/0 conn(0x7f7e48152dc0 legacy=0x7f7e480ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:15.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.341+0000 7f7e4eb3c640 1 -- 172.21.15.86:0/1218950542 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e480c5320 con 0x7f7e480c9cf0 2024-09-19T06:37:15.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.341+0000 7f7e4db3a640 1 --2- 172.21.15.86:0/1218950542 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e4806bbc0 0x7f7e48158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:15.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.341+0000 7f7e4eb3c640 1 --2- 172.21.15.86:0/1218950542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e480c9cf0 0x7f7e48163640 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7e40009870 tx=0x7f7e4002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd282f66dde2cbb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:15.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.342+0000 7f7e4d339640 1 -- 172.21.15.86:0/1218950542 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40037070 con 0x7f7e480c9cf0 2024-09-19T06:37:15.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.342+0000 7f7e4d339640 1 -- 172.21.15.86:0/1218950542 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e40032440 con 0x7f7e480c9cf0 2024-09-19T06:37:15.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.342+0000 7f7e4d339640 1 -- 172.21.15.86:0/1218950542 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40032810 con 0x7f7e480c9cf0 2024-09-19T06:37:15.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.342+0000 7f7e5059f640 1 -- 172.21.15.86:0/1218950542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e480c9cf0 msgr2=0x7f7e48163640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:15.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.342+0000 7f7e5059f640 1 --2- 172.21.15.86:0/1218950542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e480c9cf0 0x7f7e48163640 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7e40009870 tx=0x7f7e4002a2a0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.342+0000 7f7e5059f640 1 -- 172.21.15.86:0/1218950542 shutdown_connections 2024-09-19T06:37:15.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.342+0000 7f7e5059f640 1 --2- 172.21.15.86:0/1218950542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e480c9cf0 0x7f7e48163640 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.342+0000 7f7e5059f640 1 --2- 172.21.15.86:0/1218950542 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e4806bbc0 0x7f7e48158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.342+0000 7f7e5059f640 1 -- 172.21.15.86:0/1218950542 >> 172.21.15.86:0/1218950542 conn(0x7f7e4806fd60 msgr2=0x7f7e48070140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:15.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.342+0000 7f7e5059f640 1 -- 172.21.15.86:0/1218950542 shutdown_connections 2024-09-19T06:37:15.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.342+0000 7f7e5059f640 1 -- 172.21.15.86:0/1218950542 wait complete. 2024-09-19T06:37:15.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.343+0000 7f7e5059f640 1 Processor -- start 2024-09-19T06:37:15.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.343+0000 7f7e5059f640 1 -- start start 2024-09-19T06:37:15.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.344+0000 7f7e5059f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e4806bbc0 0x7f7e481f09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:15.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.344+0000 7f7e5059f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e480c9cf0 0x7f7e481554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:15.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.344+0000 7f7e5059f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e48152dc0 0x7f7e48155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:15.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.344+0000 7f7e5059f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7e480c7040 con 0x7f7e48152dc0 2024-09-19T06:37:15.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.344+0000 7f7e5059f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7e480c58e0 con 0x7f7e480c9cf0 2024-09-19T06:37:15.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.344+0000 7f7e5059f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7e480c7320 con 0x7f7e4806bbc0 2024-09-19T06:37:15.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.344+0000 7f7e4eb3c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e48152dc0 0x7f7e48155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:15.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.344+0000 7f7e4eb3c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e48152dc0 0x7f7e48155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40856/0 (socket says 172.21.15.86:40856) 2024-09-19T06:37:15.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.344+0000 7f7e4eb3c640 1 -- 172.21.15.86:0/3637065386 learned_addr learned my addr 172.21.15.86:0/3637065386 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:15.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.344+0000 7f7e4e33b640 1 --2- 172.21.15.86:0/3637065386 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e4806bbc0 0x7f7e481f09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:15.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.344+0000 7f7e4db3a640 1 --2- 172.21.15.86:0/3637065386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e480c9cf0 0x7f7e481554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:15.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.344+0000 7f7e4eb3c640 1 -- 172.21.15.86:0/3637065386 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e4806bbc0 msgr2=0x7f7e481f09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:15.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.344+0000 7f7e4eb3c640 1 --2- 172.21.15.86:0/3637065386 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e4806bbc0 0x7f7e481f09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.345+0000 7f7e4eb3c640 1 -- 172.21.15.86:0/3637065386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e480c9cf0 msgr2=0x7f7e481554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:15.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.345+0000 7f7e4eb3c640 1 --2- 172.21.15.86:0/3637065386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e480c9cf0 0x7f7e481554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.345+0000 7f7e4eb3c640 1 -- 172.21.15.86:0/3637065386 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e481564c0 con 0x7f7e48152dc0 2024-09-19T06:37:15.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.345+0000 7f7e4e33b640 1 --2- 172.21.15.86:0/3637065386 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e4806bbc0 0x7f7e481f09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:15.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.345+0000 7f7e4eb3c640 1 --2- 172.21.15.86:0/3637065386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e48152dc0 0x7f7e48155a30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7e40009870 tx=0x7f7e400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:15.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.345+0000 7f7e46ffd640 1 -- 172.21.15.86:0/3637065386 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40037040 con 0x7f7e48152dc0 2024-09-19T06:37:15.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.345+0000 7f7e46ffd640 1 -- 172.21.15.86:0/3637065386 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e40042070 con 0x7f7e48152dc0 2024-09-19T06:37:15.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.345+0000 7f7e5059f640 1 -- 172.21.15.86:0/3637065386 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e481f1360 con 0x7f7e48152dc0 2024-09-19T06:37:15.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.345+0000 7f7e46ffd640 1 -- 172.21.15.86:0/3637065386 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40030c90 con 0x7f7e48152dc0 2024-09-19T06:37:15.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.345+0000 7f7e5059f640 1 -- 172.21.15.86:0/3637065386 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e48158ac0 con 0x7f7e48152dc0 2024-09-19T06:37:15.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.346+0000 7f7e5059f640 1 -- 172.21.15.86:0/3637065386 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e480c46e0 con 0x7f7e48152dc0 2024-09-19T06:37:15.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.346+0000 7f7e46ffd640 1 -- 172.21.15.86:0/3637065386 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7e40047460 con 0x7f7e48152dc0 2024-09-19T06:37:15.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.347+0000 7f7e46ffd640 1 --2- 172.21.15.86:0/3637065386 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7e3406c2b0 0x7f7e3406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:15.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.347+0000 7f7e4e33b640 1 --2- 172.21.15.86:0/3637065386 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7e3406c2b0 0x7f7e3406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:15.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.347+0000 7f7e46ffd640 1 -- 172.21.15.86:0/3637065386 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7e400ac380 con 0x7f7e48152dc0 2024-09-19T06:37:15.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.347+0000 7f7e4e33b640 1 --2- 172.21.15.86:0/3637065386 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7e3406c2b0 0x7f7e3406e770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009fc0 tx=0x7f7e38009550 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:15.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.351+0000 7f7e46ffd640 1 -- 172.21.15.86:0/3637065386 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7e481531a0 con 0x7f7e48152dc0 2024-09-19T06:37:15.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.520+0000 7f7e5059f640 1 -- 172.21.15.86:0/3637065386 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7e48158590 con 0x7f7e48152dc0 2024-09-19T06:37:15.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.521+0000 7f7e46ffd640 1 -- 172.21.15.86:0/3637065386 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18586 (secure 0 0 0) 0x7f7e4007a1f0 con 0x7f7e48152dc0 2024-09-19T06:37:15.522 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:15.523 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":26,"fsid":"1785f09f-0959-457d-8c4a-6cce2e655a37","created":"2024-09-19T06:36:45.671544+0000","modified":"2024-09-19T06:37:13.796252+0000","last_up_change":"2024-09-19T06:36:56.765680+0000","last_in_change":"2024-09-19T06:36:47.816681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:36:57.770634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:37:06.588120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:37:07.739726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T06:37:11.457476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bd3ce3f2-2a37-40ec-8dc3-69246437277c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6827","nonce":1588074611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6829","nonce":1588074611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6833","nonce":1588074611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6831","nonce":1588074611}]},"public_addr":"172.21.15.86:6827/1588074611","cluster_addr":"172.21.15.86:6829/1588074611","heartbeat_back_addr":"172.21.15.86:6833/1588074611","heartbeat_front_addr":"172.21.15.86:6831/1588074611","state":["exists","up"]},{"osd":1,"uuid":"871d7d23-ed03-4629-bca9-5b71ad0d926a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6819","nonce":1785682938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6821","nonce":1785682938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6825","nonce":1785682938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6823","nonce":1785682938}]},"public_addr":"172.21.15.86:6819/1785682938","cluster_addr":"172.21.15.86:6821/1785682938","heartbeat_back_addr":"172.21.15.86:6825/1785682938","heartbeat_front_addr":"172.21.15.86:6823/1785682938","state":["exists","up"]},{"osd":2,"uuid":"39d3562d-8c52-4af9-935a-2d90abb8b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6801","nonce":3306127846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6803","nonce":3306127846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6807","nonce":3306127846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6805","nonce":3306127846}]},"public_addr":"172.21.15.86:6801/3306127846","cluster_addr":"172.21.15.86:6803/3306127846","heartbeat_back_addr":"172.21.15.86:6807/3306127846","heartbeat_front_addr":"172.21.15.86:6805/3306127846","state":["exists","up"]},{"osd":3,"uuid":"7f88c5b1-042c-4a9f-a674-32456e0644a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6809","nonce":694275178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6811","nonce":694275178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6815","nonce":694275178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6813","nonce":694275178}]},"public_addr":"172.21.15.86:6809/694275178","cluster_addr":"172.21.15.86:6811/694275178","heartbeat_back_addr":"172.21.15.86:6815/694275178","heartbeat_front_addr":"172.21.15.86:6813/694275178","state":["exists","up"]},{"osd":4,"uuid":"18aa391b-0863-48bf-bff6-107e22ee9752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6811","nonce":1326795640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6815","nonce":1326795640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6823","nonce":1326795640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6819","nonce":1326795640}]},"public_addr":"172.21.15.169:6811/1326795640","cluster_addr":"172.21.15.169:6815/1326795640","heartbeat_back_addr":"172.21.15.169:6823/1326795640","heartbeat_front_addr":"172.21.15.169:6819/1326795640","state":["exists","up"]},{"osd":5,"uuid":"90fa5ca6-1815-4af1-a664-b45a9e19dd56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6825","nonce":3538913242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6827","nonce":3538913242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6831","nonce":3538913242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6829","nonce":3538913242}]},"public_addr":"172.21.15.169:6825/3538913242","cluster_addr":"172.21.15.169:6827/3538913242","heartbeat_back_addr":"172.21.15.169:6831/3538913242","heartbeat_front_addr":"172.21.15.169:6829/3538913242","state":["exists","up"]},{"osd":6,"uuid":"8b2019fc-6cc2-4394-9a7c-7951544f7cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6810","nonce":494424253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6814","nonce":494424253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6822","nonce":494424253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6818","nonce":494424253}]},"public_addr":"172.21.15.169:6810/494424253","cluster_addr":"172.21.15.169:6814/494424253","heartbeat_back_addr":"172.21.15.169:6822/494424253","heartbeat_front_addr":"172.21.15.169:6818/494424253","state":["exists","up"]},{"osd":7,"uuid":"622e3b2c-5302-4b0a-b7f2-f4050801401e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6801","nonce":797235989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6803","nonce":797235989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6807","nonce":797235989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6805","nonce":797235989}]},"public_addr":"172.21.15.169:6801/797235989","cluster_addr":"172.21.15.169:6803/797235989","heartbeat_back_addr":"172.21.15.169:6807/797235989","heartbeat_front_addr":"172.21.15.169:6805/797235989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.130643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.611572+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:53.419992+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.560112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.112065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.774642+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.341946+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.117884+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:37:15.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.523+0000 7f7e5059f640 1 -- 172.21.15.86:0/3637065386 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7e3406c2b0 msgr2=0x7f7e3406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:15.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.523+0000 7f7e5059f640 1 --2- 172.21.15.86:0/3637065386 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7e3406c2b0 0x7f7e3406e770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009fc0 tx=0x7f7e38009550 comp rx=0 tx=0).stop 2024-09-19T06:37:15.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.523+0000 7f7e5059f640 1 -- 172.21.15.86:0/3637065386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e48152dc0 msgr2=0x7f7e48155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:15.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.523+0000 7f7e5059f640 1 --2- 172.21.15.86:0/3637065386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e48152dc0 0x7f7e48155a30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7e40009870 tx=0x7f7e400046c0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.523+0000 7f7e5059f640 1 -- 172.21.15.86:0/3637065386 shutdown_connections 2024-09-19T06:37:15.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.523+0000 7f7e5059f640 1 --2- 172.21.15.86:0/3637065386 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7e3406c2b0 0x7f7e3406e770 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.523+0000 7f7e5059f640 1 --2- 172.21.15.86:0/3637065386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e48152dc0 0x7f7e48155a30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.523+0000 7f7e5059f640 1 --2- 172.21.15.86:0/3637065386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e480c9cf0 0x7f7e481554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.523+0000 7f7e5059f640 1 --2- 172.21.15.86:0/3637065386 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e4806bbc0 0x7f7e481f09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.523+0000 7f7e5059f640 1 -- 172.21.15.86:0/3637065386 >> 172.21.15.86:0/3637065386 conn(0x7f7e4806fd60 msgr2=0x7f7e480ccdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:15.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.523+0000 7f7e5059f640 1 -- 172.21.15.86:0/3637065386 shutdown_connections 2024-09-19T06:37:15.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.523+0000 7f7e5059f640 1 -- 172.21.15.86:0/3637065386 wait complete. 2024-09-19T06:37:15.553 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:37:15.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.649+0000 7fab84dd6640 1 Processor -- start 2024-09-19T06:37:15.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.649+0000 7fab84dd6640 1 -- start start 2024-09-19T06:37:15.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.649+0000 7fab84dd6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab800d1120 0x7fab8015da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:15.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.649+0000 7fab84dd6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fab8015dfa0 0x7fab800b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:15.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.650+0000 7fab84dd6640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab8015c9c0 con 0x7fab800d0d40 2024-09-19T06:37:15.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.650+0000 7fab84dd6640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fab8015c770 con 0x7fab8015dfa0 2024-09-19T06:37:15.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.650+0000 7fab84dd6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fab8015e450 con 0x7fab800d1120 2024-09-19T06:37:15.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.650+0000 7fab7e59c640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fab800d0d40 0x7fab800ca6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:34558/0 (socket says 172.21.15.86:34558) 2024-09-19T06:37:15.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.650+0000 7fab7ed9d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fab8015dfa0 0x7fab800b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:15.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.650+0000 7fab7e59c640 1 -- 172.21.15.86:0/1471712269 learned_addr learned my addr 172.21.15.86:0/1471712269 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:15.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.650+0000 7fab75d9b640 1 --2- 172.21.15.86:0/1471712269 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab800d1120 0x7fab8015da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:15.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.650+0000 7fab7ed9d640 1 -- 172.21.15.86:0/1471712269 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab800d1120 msgr2=0x7fab8015da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:15.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.650+0000 7fab7ed9d640 1 --2- 172.21.15.86:0/1471712269 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab800d1120 0x7fab8015da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.650+0000 7fab7ed9d640 1 -- 172.21.15.86:0/1471712269 >> v1:172.21.15.169:6789/0 conn(0x7fab800d0d40 legacy=0x7fab800ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:15.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.650+0000 7fab7ed9d640 1 -- 172.21.15.86:0/1471712269 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab8015cca0 con 0x7fab8015dfa0 2024-09-19T06:37:15.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.650+0000 7fab75d9b640 1 --2- 172.21.15.86:0/1471712269 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab800d1120 0x7fab8015da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:37:15.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.651+0000 7fab7ed9d640 1 --2- 172.21.15.86:0/1471712269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab8015dfa0 0x7fab800b4b60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fab78009d90 tx=0x7fab7802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71336ef58aa76fd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:15.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.651+0000 7fab7dd9b640 1 -- 172.21.15.86:0/1471712269 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab78007740 con 0x7fab8015dfa0 2024-09-19T06:37:15.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.651+0000 7fab7dd9b640 1 -- 172.21.15.86:0/1471712269 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab780078e0 con 0x7fab8015dfa0 2024-09-19T06:37:15.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.651+0000 7fab7dd9b640 1 -- 172.21.15.86:0/1471712269 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab78007cb0 con 0x7fab8015dfa0 2024-09-19T06:37:15.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.651+0000 7fab84dd6640 1 -- 172.21.15.86:0/1471712269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab8015dfa0 msgr2=0x7fab800b4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:15.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.651+0000 7fab84dd6640 1 --2- 172.21.15.86:0/1471712269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab8015dfa0 0x7fab800b4b60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fab78009d90 tx=0x7fab7802a660 comp rx=0 tx=0).stop 2024-09-19T06:37:15.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.652+0000 7fab84dd6640 1 -- 172.21.15.86:0/1471712269 shutdown_connections 2024-09-19T06:37:15.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.652+0000 7fab84dd6640 1 --2- 172.21.15.86:0/1471712269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab8015dfa0 0x7fab800b4b60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.652+0000 7fab84dd6640 1 --2- 172.21.15.86:0/1471712269 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab800d1120 0x7fab8015da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.652+0000 7fab84dd6640 1 -- 172.21.15.86:0/1471712269 >> 172.21.15.86:0/1471712269 conn(0x7fab8006d910 msgr2=0x7fab8006dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:15.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.652+0000 7fab84dd6640 1 -- 172.21.15.86:0/1471712269 shutdown_connections 2024-09-19T06:37:15.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.652+0000 7fab84dd6640 1 -- 172.21.15.86:0/1471712269 wait complete. 2024-09-19T06:37:15.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.653+0000 7fab84dd6640 1 Processor -- start 2024-09-19T06:37:15.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.653+0000 7fab84dd6640 1 -- start start 2024-09-19T06:37:15.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.654+0000 7fab84dd6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab800d0d40 0x7fab8015bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:15.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.654+0000 7fab84dd6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab800d1120 0x7fab80156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:15.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.654+0000 7fab84dd6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab8015dfa0 0x7fab8015f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:15.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.654+0000 7fab84dd6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fab8015d260 con 0x7fab800d1120 2024-09-19T06:37:15.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.654+0000 7fab84dd6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fab800b3f20 con 0x7fab8015dfa0 2024-09-19T06:37:15.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.654+0000 7fab84dd6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fab800cadd0 con 0x7fab800d0d40 2024-09-19T06:37:15.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.654+0000 7fab75d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab800d1120 0x7fab80156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:15.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.654+0000 7fab75d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab800d1120 0x7fab80156680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40862/0 (socket says 172.21.15.86:40862) 2024-09-19T06:37:15.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.654+0000 7fab75d9b640 1 -- 172.21.15.86:0/3618333354 learned_addr learned my addr 172.21.15.86:0/3618333354 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:15.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.654+0000 7fab7e59c640 1 --2- 172.21.15.86:0/3618333354 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab800d0d40 0x7fab8015bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:15.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.654+0000 7fab7ed9d640 1 --2- 172.21.15.86:0/3618333354 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab8015dfa0 0x7fab8015f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:15.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.654+0000 7fab75d9b640 1 -- 172.21.15.86:0/3618333354 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab800d0d40 msgr2=0x7fab8015bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:15.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.654+0000 7fab75d9b640 1 --2- 172.21.15.86:0/3618333354 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab800d0d40 0x7fab8015bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.654+0000 7fab75d9b640 1 -- 172.21.15.86:0/3618333354 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab8015dfa0 msgr2=0x7fab8015f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:15.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.654+0000 7fab75d9b640 1 --2- 172.21.15.86:0/3618333354 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab8015dfa0 0x7fab8015f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.654+0000 7fab75d9b640 1 -- 172.21.15.86:0/3618333354 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab80158ab0 con 0x7fab800d1120 2024-09-19T06:37:15.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.654+0000 7fab75d9b640 1 --2- 172.21.15.86:0/3618333354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab800d1120 0x7fab80156680 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fab6800e980 tx=0x7fab6800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:15.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.654+0000 7fab777fe640 1 -- 172.21.15.86:0/3618333354 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab68017070 con 0x7fab800d1120 2024-09-19T06:37:15.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.654+0000 7fab777fe640 1 -- 172.21.15.86:0/3618333354 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab6800ca00 con 0x7fab800d1120 2024-09-19T06:37:15.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.654+0000 7fab84dd6640 1 -- 172.21.15.86:0/3618333354 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab801582d0 con 0x7fab800d1120 2024-09-19T06:37:15.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.654+0000 7fab777fe640 1 -- 172.21.15.86:0/3618333354 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6800cdb0 con 0x7fab800d1120 2024-09-19T06:37:15.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.655+0000 7fab84dd6640 1 -- 172.21.15.86:0/3618333354 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab80158e30 con 0x7fab800d1120 2024-09-19T06:37:15.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.655+0000 7fab84dd6640 1 -- 172.21.15.86:0/3618333354 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab8015da60 con 0x7fab800d1120 2024-09-19T06:37:15.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.656+0000 7fab777fe640 1 -- 172.21.15.86:0/3618333354 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fab6801a070 con 0x7fab800d1120 2024-09-19T06:37:15.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.656+0000 7fab777fe640 1 --2- 172.21.15.86:0/3618333354 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fab6006c2e0 0x7fab6006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:15.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.656+0000 7fab777fe640 1 -- 172.21.15.86:0/3618333354 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fab6808ba30 con 0x7fab800d1120 2024-09-19T06:37:15.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.656+0000 7fab7e59c640 1 --2- 172.21.15.86:0/3618333354 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fab6006c2e0 0x7fab6006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:15.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.657+0000 7fab7e59c640 1 --2- 172.21.15.86:0/3618333354 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fab6006c2e0 0x7fab6006e7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fab70005880 tx=0x7fab70009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:15.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.661+0000 7fab777fe640 1 -- 172.21.15.86:0/3618333354 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fab68059700 con 0x7fab800d1120 2024-09-19T06:37:15.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.862+0000 7fab84dd6640 1 -- 172.21.15.86:0/3618333354 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab8006e070 con 0x7fab800d1120 2024-09-19T06:37:15.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.863+0000 7fab777fe640 1 -- 172.21.15.86:0/3618333354 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6870 (secure 0 0 0) 0x7fab6805da00 con 0x7fab800d1120 2024-09-19T06:37:15.864 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:15.865 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":6,"btime":"2024-09-19T06:37:15:460861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:37:15.460857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6837/201961024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":201961024},{"type":"v1","addr":"172.21.15.169:6837","nonce":201961024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-09-19T06:37:15.865 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 6 2024-09-19T06:37:15.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.865+0000 7fab84dd6640 1 -- 172.21.15.86:0/3618333354 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fab6006c2e0 msgr2=0x7fab6006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:15.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.865+0000 7fab84dd6640 1 --2- 172.21.15.86:0/3618333354 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fab6006c2e0 0x7fab6006e7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fab70005880 tx=0x7fab70009040 comp rx=0 tx=0).stop 2024-09-19T06:37:15.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.865+0000 7fab84dd6640 1 -- 172.21.15.86:0/3618333354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab800d1120 msgr2=0x7fab80156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:15.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.865+0000 7fab84dd6640 1 --2- 172.21.15.86:0/3618333354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab800d1120 0x7fab80156680 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fab6800e980 tx=0x7fab6800ee40 comp rx=0 tx=0).stop 2024-09-19T06:37:15.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.865+0000 7fab84dd6640 1 -- 172.21.15.86:0/3618333354 shutdown_connections 2024-09-19T06:37:15.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.865+0000 7fab84dd6640 1 --2- 172.21.15.86:0/3618333354 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fab6006c2e0 0x7fab6006e7a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.865+0000 7fab84dd6640 1 --2- 172.21.15.86:0/3618333354 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab8015dfa0 0x7fab8015f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.865+0000 7fab84dd6640 1 --2- 172.21.15.86:0/3618333354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab800d1120 0x7fab80156680 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.865+0000 7fab84dd6640 1 --2- 172.21.15.86:0/3618333354 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab800d0d40 0x7fab8015bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.865+0000 7fab84dd6640 1 -- 172.21.15.86:0/3618333354 >> 172.21.15.86:0/3618333354 conn(0x7fab8006d910 msgr2=0x7fab800b5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:15.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.865+0000 7fab84dd6640 1 -- 172.21.15.86:0/3618333354 shutdown_connections 2024-09-19T06:37:15.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.865+0000 7fab84dd6640 1 -- 172.21.15.86:0/3618333354 wait complete. 2024-09-19T06:37:15.877 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T06:37:15.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.973+0000 7f5980ed0640 1 Processor -- start 2024-09-19T06:37:15.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.973+0000 7f5980ed0640 1 -- start start 2024-09-19T06:37:15.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.974+0000 7f5980ed0640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f597c155420 0x7f597c15f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:15.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.974+0000 7f5980ed0640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f597c15ba90 con 0x7f597c0c5e00 2024-09-19T06:37:15.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.974+0000 7f5980ed0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f597c15bd70 con 0x7f597c0c6350 2024-09-19T06:37:15.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.974+0000 7f5980ed0640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f597c15f750 con 0x7f597c155420 2024-09-19T06:37:15.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.974+0000 7f597a59c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f597c155420 0x7f597c15f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:15.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.974+0000 7f597ad9d640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f597c0c5e00 0x7f597c0d0ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:52700/0 (socket says 172.21.15.86:52700) 2024-09-19T06:37:15.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.974+0000 7f597a59c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f597c155420 0x7f597c15f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40866/0 (socket says 172.21.15.86:40866) 2024-09-19T06:37:15.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.974+0000 7f597ad9d640 1 -- 172.21.15.86:0/544366642 learned_addr learned my addr 172.21.15.86:0/544366642 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:15.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.974+0000 7f597a59c640 1 -- 172.21.15.86:0/544366642 >> v1:172.21.15.169:6789/0 conn(0x7f597c0c6350 legacy=0x7f597c15b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:15.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.975+0000 7f597a59c640 1 -- 172.21.15.86:0/544366642 >> v1:172.21.15.86:6789/0 conn(0x7f597c0c5e00 legacy=0x7f597c0d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:15.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.975+0000 7f597a59c640 1 -- 172.21.15.86:0/544366642 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f597c15c050 con 0x7f597c155420 2024-09-19T06:37:15.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.975+0000 7f597959a640 1 -- 172.21.15.86:0/544366642 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3379326265 0 0) 0x7f597c15ba90 con 0x7f597c0c5e00 2024-09-19T06:37:15.978 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.975+0000 7f597a59c640 1 --2- 172.21.15.86:0/544366642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f597c155420 0x7f597c15f210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f596c009d90 tx=0x7f596c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86481d53b819924 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:15.978 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.975+0000 7f597959a640 1 -- 172.21.15.86:0/544366642 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596c007740 con 0x7f597c155420 2024-09-19T06:37:15.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.975+0000 7f597959a640 1 -- 172.21.15.86:0/544366642 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f596c0078e0 con 0x7f597c155420 2024-09-19T06:37:15.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.975+0000 7f597959a640 1 -- 172.21.15.86:0/544366642 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596c007cb0 con 0x7f597c155420 2024-09-19T06:37:15.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.976+0000 7f5980ed0640 1 -- 172.21.15.86:0/544366642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f597c155420 msgr2=0x7f597c15f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:15.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.976+0000 7f5980ed0640 1 --2- 172.21.15.86:0/544366642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f597c155420 0x7f597c15f210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f596c009d90 tx=0x7f596c02a6f0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.976+0000 7f5980ed0640 1 -- 172.21.15.86:0/544366642 shutdown_connections 2024-09-19T06:37:15.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.976+0000 7f5980ed0640 1 --2- 172.21.15.86:0/544366642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f597c155420 0x7f597c15f210 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.976+0000 7f5980ed0640 1 -- 172.21.15.86:0/544366642 >> 172.21.15.86:0/544366642 conn(0x7f597c067890 msgr2=0x7f597c067c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:15.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.976+0000 7f5980ed0640 1 -- 172.21.15.86:0/544366642 shutdown_connections 2024-09-19T06:37:15.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.976+0000 7f5980ed0640 1 -- 172.21.15.86:0/544366642 wait complete. 2024-09-19T06:37:15.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.977+0000 7f5980ed0640 1 Processor -- start 2024-09-19T06:37:15.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.977+0000 7f5980ed0640 1 -- start start 2024-09-19T06:37:15.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.978+0000 7f5980ed0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f597c0c5e00 0x7f597c0b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:15.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.978+0000 7f5980ed0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f597c0c6350 0x7f597c1f40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:15.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.978+0000 7f5980ed0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f597c155420 0x7f597c1f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:15.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.978+0000 7f5980ed0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f597c15ed80 con 0x7f597c0c6350 2024-09-19T06:37:15.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.978+0000 7f5980ed0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f597c15e7c0 con 0x7f597c0c5e00 2024-09-19T06:37:15.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.978+0000 7f5980ed0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f597c0d11e0 con 0x7f597c155420 2024-09-19T06:37:15.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.978+0000 7f5979d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f597c0c6350 0x7f597c1f40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:15.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.978+0000 7f5979d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f597c0c6350 0x7f597c1f40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40868/0 (socket says 172.21.15.86:40868) 2024-09-19T06:37:15.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.978+0000 7f5979d9b640 1 -- 172.21.15.86:0/2582937923 learned_addr learned my addr 172.21.15.86:0/2582937923 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:15.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.978+0000 7f597a59c640 1 --2- 172.21.15.86:0/2582937923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f597c0c5e00 0x7f597c0b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:15.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.978+0000 7f597ad9d640 1 --2- 172.21.15.86:0/2582937923 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f597c155420 0x7f597c1f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:15.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.978+0000 7f5979d9b640 1 -- 172.21.15.86:0/2582937923 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f597c155420 msgr2=0x7f597c1f45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:15.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.978+0000 7f5979d9b640 1 --2- 172.21.15.86:0/2582937923 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f597c155420 0x7f597c1f45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.978+0000 7f5979d9b640 1 -- 172.21.15.86:0/2582937923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f597c0c5e00 msgr2=0x7f597c0b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:15.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.978+0000 7f5979d9b640 1 --2- 172.21.15.86:0/2582937923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f597c0c5e00 0x7f597c0b61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.978+0000 7f5979d9b640 1 -- 172.21.15.86:0/2582937923 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f597c0cf2b0 con 0x7f597c0c6350 2024-09-19T06:37:15.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.978+0000 7f5979d9b640 1 --2- 172.21.15.86:0/2582937923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f597c0c6350 0x7f597c1f40a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f597000c480 tx=0x7f597000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:15.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.979+0000 7f596affd640 1 -- 172.21.15.86:0/2582937923 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59700052d0 con 0x7f597c0c6350 2024-09-19T06:37:15.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.979+0000 7f596affd640 1 -- 172.21.15.86:0/2582937923 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5970005470 con 0x7f597c0c6350 2024-09-19T06:37:15.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.979+0000 7f5980ed0640 1 -- 172.21.15.86:0/2582937923 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f597c0d0760 con 0x7f597c0c6350 2024-09-19T06:37:15.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.979+0000 7f596affd640 1 -- 172.21.15.86:0/2582937923 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970012870 con 0x7f597c0c6350 2024-09-19T06:37:15.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.979+0000 7f5980ed0640 1 -- 172.21.15.86:0/2582937923 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f597c0cf550 con 0x7f597c0c6350 2024-09-19T06:37:15.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.980+0000 7f5980ed0640 1 -- 172.21.15.86:0/2582937923 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f597c0cfb60 con 0x7f597c0c6350 2024-09-19T06:37:15.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.980+0000 7f596affd640 1 -- 172.21.15.86:0/2582937923 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5970012a10 con 0x7f597c0c6350 2024-09-19T06:37:15.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.981+0000 7f596affd640 1 --2- 172.21.15.86:0/2582937923 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f595c06c2b0 0x7f595c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:15.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.981+0000 7f597a59c640 1 --2- 172.21.15.86:0/2582937923 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f595c06c2b0 0x7f595c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:15.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.981+0000 7f596affd640 1 -- 172.21.15.86:0/2582937923 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f597008b220 con 0x7f597c0c6350 2024-09-19T06:37:15.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.981+0000 7f597a59c640 1 --2- 172.21.15.86:0/2582937923 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f595c06c2b0 0x7f595c06e770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f596c034000 tx=0x7f596c02f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:15.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:15.985+0000 7f596affd640 1 -- 172.21.15.86:0/2582937923 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5970059090 con 0x7f597c0c6350 2024-09-19T06:37:16.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.149+0000 7f5980ed0640 1 -- 172.21.15.86:0/2582937923 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f597c155800 con 0x7f597c0c6350 2024-09-19T06:37:16.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.150+0000 7f596affd640 1 -- 172.21.15.86:0/2582937923 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18586 (secure 0 0 0) 0x7f597005d390 con 0x7f597c0c6350 2024-09-19T06:37:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:16.153 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":26,"fsid":"1785f09f-0959-457d-8c4a-6cce2e655a37","created":"2024-09-19T06:36:45.671544+0000","modified":"2024-09-19T06:37:13.796252+0000","last_up_change":"2024-09-19T06:36:56.765680+0000","last_in_change":"2024-09-19T06:36:47.816681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:36:57.770634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:37:06.588120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:37:07.739726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T06:37:11.457476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bd3ce3f2-2a37-40ec-8dc3-69246437277c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6827","nonce":1588074611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6829","nonce":1588074611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6833","nonce":1588074611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6831","nonce":1588074611}]},"public_addr":"172.21.15.86:6827/1588074611","cluster_addr":"172.21.15.86:6829/1588074611","heartbeat_back_addr":"172.21.15.86:6833/1588074611","heartbeat_front_addr":"172.21.15.86:6831/1588074611","state":["exists","up"]},{"osd":1,"uuid":"871d7d23-ed03-4629-bca9-5b71ad0d926a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6819","nonce":1785682938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6821","nonce":1785682938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6825","nonce":1785682938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6823","nonce":1785682938}]},"public_addr":"172.21.15.86:6819/1785682938","cluster_addr":"172.21.15.86:6821/1785682938","heartbeat_back_addr":"172.21.15.86:6825/1785682938","heartbeat_front_addr":"172.21.15.86:6823/1785682938","state":["exists","up"]},{"osd":2,"uuid":"39d3562d-8c52-4af9-935a-2d90abb8b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6801","nonce":3306127846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6803","nonce":3306127846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6807","nonce":3306127846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6805","nonce":3306127846}]},"public_addr":"172.21.15.86:6801/3306127846","cluster_addr":"172.21.15.86:6803/3306127846","heartbeat_back_addr":"172.21.15.86:6807/3306127846","heartbeat_front_addr":"172.21.15.86:6805/3306127846","state":["exists","up"]},{"osd":3,"uuid":"7f88c5b1-042c-4a9f-a674-32456e0644a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6809","nonce":694275178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6811","nonce":694275178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6815","nonce":694275178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6813","nonce":694275178}]},"public_addr":"172.21.15.86:6809/694275178","cluster_addr":"172.21.15.86:6811/694275178","heartbeat_back_addr":"172.21.15.86:6815/694275178","heartbeat_front_addr":"172.21.15.86:6813/694275178","state":["exists","up"]},{"osd":4,"uuid":"18aa391b-0863-48bf-bff6-107e22ee9752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6811","nonce":1326795640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6815","nonce":1326795640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6823","nonce":1326795640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6819","nonce":1326795640}]},"public_addr":"172.21.15.169:6811/1326795640","cluster_addr":"172.21.15.169:6815/1326795640","heartbeat_back_addr":"172.21.15.169:6823/1326795640","heartbeat_front_addr":"172.21.15.169:6819/1326795640","state":["exists","up"]},{"osd":5,"uuid":"90fa5ca6-1815-4af1-a664-b45a9e19dd56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6825","nonce":3538913242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6827","nonce":3538913242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6831","nonce":3538913242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6829","nonce":3538913242}]},"public_addr":"172.21.15.169:6825/3538913242","cluster_addr":"172.21.15.169:6827/3538913242","heartbeat_back_addr":"172.21.15.169:6831/3538913242","heartbeat_front_addr":"172.21.15.169:6829/3538913242","state":["exists","up"]},{"osd":6,"uuid":"8b2019fc-6cc2-4394-9a7c-7951544f7cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6810","nonce":494424253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6814","nonce":494424253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6822","nonce":494424253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6818","nonce":494424253}]},"public_addr":"172.21.15.169:6810/494424253","cluster_addr":"172.21.15.169:6814/494424253","heartbeat_back_addr":"172.21.15.169:6822/494424253","heartbeat_front_addr":"172.21.15.169:6818/494424253","state":["exists","up"]},{"osd":7,"uuid":"622e3b2c-5302-4b0a-b7f2-f4050801401e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6801","nonce":797235989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6803","nonce":797235989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6807","nonce":797235989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6805","nonce":797235989}]},"public_addr":"172.21.15.169:6801/797235989","cluster_addr":"172.21.15.169:6803/797235989","heartbeat_back_addr":"172.21.15.169:6807/797235989","heartbeat_front_addr":"172.21.15.169:6805/797235989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.130643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.611572+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:53.419992+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.560112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.112065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.774642+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.341946+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.117884+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:37:16.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.152+0000 7f5980ed0640 1 -- 172.21.15.86:0/2582937923 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f595c06c2b0 msgr2=0x7f595c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:16.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.152+0000 7f5980ed0640 1 --2- 172.21.15.86:0/2582937923 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f595c06c2b0 0x7f595c06e770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f596c034000 tx=0x7f596c02f000 comp rx=0 tx=0).stop 2024-09-19T06:37:16.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.152+0000 7f5980ed0640 1 -- 172.21.15.86:0/2582937923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f597c0c6350 msgr2=0x7f597c1f40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:16.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.152+0000 7f5980ed0640 1 --2- 172.21.15.86:0/2582937923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f597c0c6350 0x7f597c1f40a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f597000c480 tx=0x7f597000c940 comp rx=0 tx=0).stop 2024-09-19T06:37:16.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.152+0000 7f5980ed0640 1 -- 172.21.15.86:0/2582937923 shutdown_connections 2024-09-19T06:37:16.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.152+0000 7f5980ed0640 1 --2- 172.21.15.86:0/2582937923 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f595c06c2b0 0x7f595c06e770 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:16.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.152+0000 7f5980ed0640 1 --2- 172.21.15.86:0/2582937923 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f597c155420 0x7f597c1f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:16.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.152+0000 7f5980ed0640 1 --2- 172.21.15.86:0/2582937923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f597c0c6350 0x7f597c1f40a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:16.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.152+0000 7f5980ed0640 1 --2- 172.21.15.86:0/2582937923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f597c0c5e00 0x7f597c0b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:16.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.152+0000 7f5980ed0640 1 -- 172.21.15.86:0/2582937923 >> 172.21.15.86:0/2582937923 conn(0x7f597c067890 msgr2=0x7f597c0ccd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:16.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.152+0000 7f5980ed0640 1 -- 172.21.15.86:0/2582937923 shutdown_connections 2024-09-19T06:37:16.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.152+0000 7f5980ed0640 1 -- 172.21.15.86:0/2582937923 wait complete. 2024-09-19T06:37:16.770 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T06:37:08.763572+0000', 'modified': '2024-09-19T06:37:15.460857+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.169:6837/201961024', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6836', 'nonce': 201961024}, {'type': 'v1', 'addr': '172.21.15.169:6837', 'nonce': 201961024}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4285, 'qdb_cluster': [4285]} 2024-09-19T06:37:16.770 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T06:37:16.770 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-19T06:37:16.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.869+0000 7fd33279f640 1 Processor -- start 2024-09-19T06:37:16.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.869+0000 7fd33279f640 1 -- start start 2024-09-19T06:37:16.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.870+0000 7fd33279f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd32c0cb660 0x7fd32c0cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:16.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.870+0000 7fd33279f640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd32c0c6df0 0x7fd32c15e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:16.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.870+0000 7fd33279f640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd32c0cba40 0x7fd32c158360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:16.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.870+0000 7fd33279f640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fd32c0ccb90 con 0x7fd32c0c6df0 2024-09-19T06:37:16.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.870+0000 7fd33279f640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fd32c0cce20 con 0x7fd32c0cba40 2024-09-19T06:37:16.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.870+0000 7fd33279f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd32c0cd100 con 0x7fd32c0cb660 2024-09-19T06:37:16.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.870+0000 7fd32b7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd32c0c6df0 0x7fd32c15e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:16.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.870+0000 7fd32b7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd32c0c6df0 0x7fd32c15e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40880/0 (socket says 172.21.15.86:40880) 2024-09-19T06:37:16.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.870+0000 7fd32b7fe640 1 -- 172.21.15.86:0/933476308 learned_addr learned my addr 172.21.15.86:0/933476308 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:16.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.870+0000 7fd32bfff640 1 --2- 172.21.15.86:0/933476308 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd32c0cb660 0x7fd32c0cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:16.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.870+0000 7fd330d3c640 1 --2- 172.21.15.86:0/933476308 >> v2:172.21.15.169:3300/0 conn(0x7fd32c0cba40 0x7fd32c158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:16.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.870+0000 7fd32b7fe640 1 -- 172.21.15.86:0/933476308 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd32c0cb660 msgr2=0x7fd32c0cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:16.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.870+0000 7fd32b7fe640 1 --2- 172.21.15.86:0/933476308 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd32c0cb660 0x7fd32c0cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:16.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.870+0000 7fd32b7fe640 1 -- 172.21.15.86:0/933476308 >> v2:172.21.15.169:3300/0 conn(0x7fd32c0cba40 msgr2=0x7fd32c158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:16.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.870+0000 7fd32b7fe640 1 --2- 172.21.15.86:0/933476308 >> v2:172.21.15.169:3300/0 conn(0x7fd32c0cba40 0x7fd32c158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:16.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.870+0000 7fd32b7fe640 1 -- 172.21.15.86:0/933476308 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32c0c6310 con 0x7fd32c0c6df0 2024-09-19T06:37:16.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.871+0000 7fd32b7fe640 1 --2- 172.21.15.86:0/933476308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd32c0c6df0 0x7fd32c15e8c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0d1a30 tx=0x7fd32002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df0bd56187ac157 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:16.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.871+0000 7fd32affd640 1 -- 172.21.15.86:0/933476308 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd320037070 con 0x7fd32c0c6df0 2024-09-19T06:37:16.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.871+0000 7fd32affd640 1 -- 172.21.15.86:0/933476308 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd320032440 con 0x7fd32c0c6df0 2024-09-19T06:37:16.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.871+0000 7fd32affd640 1 -- 172.21.15.86:0/933476308 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd320032810 con 0x7fd32c0c6df0 2024-09-19T06:37:16.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.872+0000 7fd33279f640 1 -- 172.21.15.86:0/933476308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd32c0c6df0 msgr2=0x7fd32c15e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:16.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.872+0000 7fd33279f640 1 --2- 172.21.15.86:0/933476308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd32c0c6df0 0x7fd32c15e8c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0d1a30 tx=0x7fd32002a1e0 comp rx=0 tx=0).stop 2024-09-19T06:37:16.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.872+0000 7fd33279f640 1 -- 172.21.15.86:0/933476308 shutdown_connections 2024-09-19T06:37:16.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.872+0000 7fd33279f640 1 --2- 172.21.15.86:0/933476308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd32c0c6df0 0x7fd32c15e8c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:16.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.872+0000 7fd33279f640 1 --2- 172.21.15.86:0/933476308 >> v2:172.21.15.169:3300/0 conn(0x7fd32c0cba40 0x7fd32c158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:16.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.872+0000 7fd33279f640 1 --2- 172.21.15.86:0/933476308 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd32c0cb660 0x7fd32c0cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:16.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.872+0000 7fd33279f640 1 -- 172.21.15.86:0/933476308 >> 172.21.15.86:0/933476308 conn(0x7fd32c06bcc0 msgr2=0x7fd32c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:16.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.872+0000 7fd33279f640 1 -- 172.21.15.86:0/933476308 shutdown_connections 2024-09-19T06:37:16.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.872+0000 7fd33279f640 1 -- 172.21.15.86:0/933476308 wait complete. 2024-09-19T06:37:16.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.873+0000 7fd33279f640 1 Processor -- start 2024-09-19T06:37:16.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.873+0000 7fd33279f640 1 -- start start 2024-09-19T06:37:16.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.874+0000 7fd33279f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd32c0c6df0 0x7fd32c14b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:16.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.874+0000 7fd33279f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd32c0cb660 0x7fd32c158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:16.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.874+0000 7fd33279f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd32c0cba40 0x7fd32c158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:16.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.874+0000 7fd33279f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c0c7e70 con 0x7fd32c0c6df0 2024-09-19T06:37:16.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.874+0000 7fd33279f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c0c68d0 con 0x7fd32c0cba40 2024-09-19T06:37:16.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.874+0000 7fd33279f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd32c15ee00 con 0x7fd32c0cb660 2024-09-19T06:37:16.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.874+0000 7fd32bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd32c0c6df0 0x7fd32c14b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:16.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.874+0000 7fd32bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd32c0c6df0 0x7fd32c14b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40894/0 (socket says 172.21.15.86:40894) 2024-09-19T06:37:16.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.874+0000 7fd32bfff640 1 -- 172.21.15.86:0/1909747684 learned_addr learned my addr 172.21.15.86:0/1909747684 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:16.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.874+0000 7fd330d3c640 1 --2- 172.21.15.86:0/1909747684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd32c0cba40 0x7fd32c158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:16.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.874+0000 7fd32b7fe640 1 --2- 172.21.15.86:0/1909747684 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd32c0cb660 0x7fd32c158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:16.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.874+0000 7fd32bfff640 1 -- 172.21.15.86:0/1909747684 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd32c0cb660 msgr2=0x7fd32c158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:16.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.874+0000 7fd32bfff640 1 --2- 172.21.15.86:0/1909747684 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd32c0cb660 0x7fd32c158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:16.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.874+0000 7fd32bfff640 1 -- 172.21.15.86:0/1909747684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd32c0cba40 msgr2=0x7fd32c158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:16.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.874+0000 7fd32bfff640 1 --2- 172.21.15.86:0/1909747684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd32c0cba40 0x7fd32c158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:16.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.874+0000 7fd32bfff640 1 -- 172.21.15.86:0/1909747684 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32c159240 con 0x7fd32c0c6df0 2024-09-19T06:37:16.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.874+0000 7fd32b7fe640 1 --2- 172.21.15.86:0/1909747684 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd32c0cb660 0x7fd32c158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:16.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.874+0000 7fd32bfff640 1 --2- 172.21.15.86:0/1909747684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd32c0c6df0 0x7fd32c14b850 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00d830 tx=0x7fd31c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:16.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.874+0000 7fd328ff9640 1 -- 172.21.15.86:0/1909747684 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c018020 con 0x7fd32c0c6df0 2024-09-19T06:37:16.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.874+0000 7fd328ff9640 1 -- 172.21.15.86:0/1909747684 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd31c009640 con 0x7fd32c0c6df0 2024-09-19T06:37:16.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.874+0000 7fd33279f640 1 -- 172.21.15.86:0/1909747684 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd32c158f60 con 0x7fd32c0c6df0 2024-09-19T06:37:16.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.874+0000 7fd328ff9640 1 -- 172.21.15.86:0/1909747684 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c009a10 con 0x7fd32c0c6df0 2024-09-19T06:37:16.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.874+0000 7fd33279f640 1 -- 172.21.15.86:0/1909747684 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd32c15acb0 con 0x7fd32c0c6df0 2024-09-19T06:37:16.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.876+0000 7fd328ff9640 1 -- 172.21.15.86:0/1909747684 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd31c01b020 con 0x7fd32c0c6df0 2024-09-19T06:37:16.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.876+0000 7fd328ff9640 1 --2- 172.21.15.86:0/1909747684 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd31806c2b0 0x7fd31806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:16.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.876+0000 7fd32b7fe640 1 --2- 172.21.15.86:0/1909747684 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd31806c2b0 0x7fd31806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:16.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.876+0000 7fd328ff9640 1 -- 172.21.15.86:0/1909747684 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd31c08b890 con 0x7fd32c0c6df0 2024-09-19T06:37:16.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.877+0000 7fd32b7fe640 1 --2- 172.21.15.86:0/1909747684 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd31806c2b0 0x7fd31806e770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd320034000 tx=0x7fd32002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:16.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.877+0000 7fd335618740 1 Processor -- start 2024-09-19T06:37:16.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.877+0000 7fd335618740 1 -- start start 2024-09-19T06:37:16.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.878+0000 7fd335618740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d35bcb7750 0x55d35bcef9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:16.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.878+0000 7fd335618740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d35bcb4f80 0x55d35bceff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:16.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.878+0000 7fd335618740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb7b30 0x55d35bcb3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:16.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.878+0000 7fd335618740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d35bc18520 con 0x55d35bcb7b30 2024-09-19T06:37:16.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.878+0000 7fd335618740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d35bbc03e0 con 0x55d35bcb4f80 2024-09-19T06:37:16.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.878+0000 7fd335618740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55d35bc144e0 con 0x55d35bcb7750 2024-09-19T06:37:16.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.878+0000 7fd330d3c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb7b30 0x55d35bcb3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:16.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.878+0000 7fd330d3c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb7b30 0x55d35bcb3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40896/0 (socket says 172.21.15.86:40896) 2024-09-19T06:37:16.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.878+0000 7fd330d3c640 1 -- 172.21.15.86:0/3967143593 learned_addr learned my addr 172.21.15.86:0/3967143593 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:16.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.878+0000 7fd32b7fe640 1 --2- 172.21.15.86:0/3967143593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d35bcb4f80 0x55d35bceff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:16.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.878+0000 7fd32bfff640 1 --2- 172.21.15.86:0/3967143593 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d35bcb7750 0x55d35bcef9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:16.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.878+0000 7fd330d3c640 1 -- 172.21.15.86:0/3967143593 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d35bcb7750 msgr2=0x55d35bcef9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:16.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.878+0000 7fd330d3c640 1 --2- 172.21.15.86:0/3967143593 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d35bcb7750 0x55d35bcef9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:16.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.878+0000 7fd330d3c640 1 -- 172.21.15.86:0/3967143593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d35bcb4f80 msgr2=0x55d35bceff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:16.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.878+0000 7fd330d3c640 1 --2- 172.21.15.86:0/3967143593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d35bcb4f80 0x55d35bceff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:16.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.878+0000 7fd330d3c640 1 -- 172.21.15.86:0/3967143593 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d35bbdb2f0 con 0x55d35bcb7b30 2024-09-19T06:37:16.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.878+0000 7fd32bfff640 1 --2- 172.21.15.86:0/3967143593 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d35bcb7750 0x55d35bcef9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:16.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.878+0000 7fd330d3c640 1 --2- 172.21.15.86:0/3967143593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb7b30 0x55d35bcb3a60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd324009f70 tx=0x7fd324003e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d58597eb955ed815 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:16.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.879+0000 7fd311ffb640 1 -- 172.21.15.86:0/3967143593 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324015420 con 0x55d35bcb7b30 2024-09-19T06:37:16.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.879+0000 7fd311ffb640 1 -- 172.21.15.86:0/3967143593 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd32401a070 con 0x55d35bcb7b30 2024-09-19T06:37:16.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.879+0000 7fd311ffb640 1 -- 172.21.15.86:0/3967143593 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3240157e0 con 0x55d35bcb7b30 2024-09-19T06:37:16.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.879+0000 7fd335618740 1 -- 172.21.15.86:0/3967143593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb7b30 msgr2=0x55d35bcb3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:16.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.879+0000 7fd335618740 1 --2- 172.21.15.86:0/3967143593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb7b30 0x55d35bcb3a60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd324009f70 tx=0x7fd324003e20 comp rx=0 tx=0).stop 2024-09-19T06:37:16.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.879+0000 7fd335618740 1 -- 172.21.15.86:0/3967143593 shutdown_connections 2024-09-19T06:37:16.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.879+0000 7fd335618740 1 --2- 172.21.15.86:0/3967143593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb7b30 0x55d35bcb3a60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:16.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.879+0000 7fd335618740 1 --2- 172.21.15.86:0/3967143593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d35bcb4f80 0x55d35bceff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:16.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.879+0000 7fd335618740 1 --2- 172.21.15.86:0/3967143593 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d35bcb7750 0x55d35bcef9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:16.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.879+0000 7fd335618740 1 -- 172.21.15.86:0/3967143593 >> 172.21.15.86:0/3967143593 conn(0x55d35bcb5e70 msgr2=0x55d35bcb6270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:16.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.879+0000 7fd335618740 1 -- 172.21.15.86:0/3967143593 shutdown_connections 2024-09-19T06:37:16.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.879+0000 7fd335618740 1 -- 172.21.15.86:0/3967143593 wait complete. 2024-09-19T06:37:16.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.880+0000 7fd335618740 1 -- start start 2024-09-19T06:37:16.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.880+0000 7fd335618740 1 Processor -- start 2024-09-19T06:37:16.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.881+0000 7fd335618740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d35bcb4f80 0x55d35bcd51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:16.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.881+0000 7fd335618740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb7750 0x55d35bcd9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:16.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.881+0000 7fd335618740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d35bcb7b30 0x55d35bcdcc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:16.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.881+0000 7fd335618740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d35bcb6fe0 con 0x55d35bcb7750 2024-09-19T06:37:16.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.881+0000 7fd335618740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d35bba1450 con 0x55d35bcb4f80 2024-09-19T06:37:16.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.881+0000 7fd335618740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55d35bcef550 con 0x55d35bcb7b30 2024-09-19T06:37:16.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.881+0000 7fd335618740 10 client.0 _ll_register_callbacks cb 0x55d35b92aac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:37:16.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.881+0000 7fd32b7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb7750 0x55d35bcd9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:16.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.881+0000 7fd32b7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb7750 0x55d35bcd9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40900/0 (socket says 172.21.15.86:40900) 2024-09-19T06:37:16.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.881+0000 7fd32b7fe640 1 -- 172.21.15.86:0/963461957 learned_addr learned my addr 172.21.15.86:0/963461957 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:16.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.881+0000 7fd330d3c640 1 --2- 172.21.15.86:0/963461957 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d35bcb7b30 0x55d35bcdcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:16.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.881+0000 7fd32bfff640 1 --2- 172.21.15.86:0/963461957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d35bcb4f80 0x55d35bcd51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:16.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.881+0000 7fd32b7fe640 1 -- 172.21.15.86:0/963461957 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d35bcb7b30 msgr2=0x55d35bcdcc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:16.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.881+0000 7fd32b7fe640 1 --2- 172.21.15.86:0/963461957 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d35bcb7b30 0x55d35bcdcc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:16.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.881+0000 7fd32b7fe640 1 -- 172.21.15.86:0/963461957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d35bcb4f80 msgr2=0x55d35bcd51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:16.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.881+0000 7fd32b7fe640 1 --2- 172.21.15.86:0/963461957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d35bcb4f80 0x55d35bcd51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:16.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.881+0000 7fd32b7fe640 1 -- 172.21.15.86:0/963461957 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d35b92b2d0 con 0x55d35bcb7750 2024-09-19T06:37:16.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.881+0000 7fd32bfff640 1 --2- 172.21.15.86:0/963461957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d35bcb4f80 0x55d35bcd51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:16.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.881+0000 7fd32b7fe640 1 --2- 172.21.15.86:0/963461957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb7750 0x55d35bcd9c20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd3200090b0 tx=0x7fd32002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e68b7e6608d1bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:16.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.881+0000 7fd30affd640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T06:37:16.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.881+0000 7fd30affd640 1 -- 172.21.15.86:0/963461957 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd320050060 con 0x55d35bcb7750 2024-09-19T06:37:16.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.881+0000 7fd30affd640 1 -- 172.21.15.86:0/963461957 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd32003ed40 con 0x55d35bcb7750 2024-09-19T06:37:16.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.882+0000 7fd335618740 1 -- 172.21.15.86:0/963461957 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd32401a070 con 0x55d35bcb7750 2024-09-19T06:37:16.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.882+0000 7fd30affd640 1 -- 172.21.15.86:0/963461957 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fd320056050 con 0x55d35bcb7750 2024-09-19T06:37:16.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.882+0000 7fd335618740 10 client.4407 fetch_fsmap learned FSMap version 6 2024-09-19T06:37:16.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.882+0000 7fd335618740 1 -- 172.21.15.86:0/963461957 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55d35b9f56b0 con 0x55d35bcb7750 2024-09-19T06:37:16.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.882+0000 7fd30affd640 1 -- 172.21.15.86:0/963461957 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd32401a070 con 0x55d35bcb7750 2024-09-19T06:37:16.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.882+0000 7fd30affd640 1 -- 172.21.15.86:0/963461957 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 6) ==== 4720+0+0 (secure 0 0 0) 0x7fd320059020 con 0x55d35bcb7750 2024-09-19T06:37:16.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.882+0000 7fd335618740 10 client.4407 fetch_fsmap finished waiting for FSMap version 6 2024-09-19T06:37:16.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.882+0000 7fd335618740 10 client.4407 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-19T06:37:16.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.882+0000 7fd335618740 20 client.4407 populate_metadata read hostname 'smithi086' 2024-09-19T06:37:16.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.882+0000 7fd335618740 1 --2- 172.21.15.86:0/963461957 >> [v2:172.21.15.169:6836/201961024,v1:172.21.15.169:6837/201961024] conn(0x55d35bcde040 0x55d35bd15590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:16.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.882+0000 7fd335618740 4 client.4407 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:37:16.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.882+0000 7fd335618740 1 -- 172.21.15.86:0/963461957 --> [v2:172.21.15.169:6836/201961024,v1:172.21.15.169:6837/201961024] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d35bc25c50 con 0x55d35bcde040 2024-09-19T06:37:16.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.882+0000 7fd32bfff640 1 --2- 172.21.15.86:0/963461957 >> [v2:172.21.15.169:6836/201961024,v1:172.21.15.169:6837/201961024] conn(0x55d35bcde040 0x55d35bd15590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:16.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.883+0000 7fd30affd640 10 client.4407 ms_handle_connect on v2:172.21.15.169:6836/201961024 2024-09-19T06:37:16.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:16.883+0000 7fd32bfff640 1 --2- 172.21.15.86:0/963461957 >> [v2:172.21.15.169:6836/201961024,v1:172.21.15.169:6837/201961024] conn(0x55d35bcde040 0x55d35bd15590 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e230c6c457d8dd7 server_cookie=cbf98ddca9be38f4 in_seq=0 out_seq=0 2024-09-19T06:37:20.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.463+0000 7fd30affd640 1 -- 172.21.15.86:0/963461957 <== mds.0 v2:172.21.15.169:6836/201961024 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d35bc25c50 con 0x55d35bcde040 2024-09-19T06:37:20.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.463+0000 7fd30affd640 10 client.4407 handle_command_reply: tid=0 2024-09-19T06:37:20.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.463+0000 7fd335618740 1 client.4407 shutdown 2024-09-19T06:37:20.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.464+0000 7fd335618740 1 -- 172.21.15.86:0/963461957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb7750 msgr2=0x55d35bcd9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:20.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.464+0000 7fd335618740 1 --2- 172.21.15.86:0/963461957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb7750 0x55d35bcd9c20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd3200090b0 tx=0x7fd32002c000 comp rx=0 tx=0).stop 2024-09-19T06:37:20.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.464+0000 7fd335618740 1 -- 172.21.15.86:0/963461957 shutdown_connections 2024-09-19T06:37:20.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.464+0000 7fd335618740 1 --2- 172.21.15.86:0/963461957 >> [v2:172.21.15.169:6836/201961024,v1:172.21.15.169:6837/201961024] conn(0x55d35bcde040 0x55d35bd15590 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.464+0000 7fd335618740 1 --2- 172.21.15.86:0/963461957 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d35bcb7b30 0x55d35bcdcc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.464+0000 7fd335618740 1 --2- 172.21.15.86:0/963461957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb7750 0x55d35bcd9c20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.464+0000 7fd335618740 1 --2- 172.21.15.86:0/963461957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d35bcb4f80 0x55d35bcd51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.464+0000 7fd30affd640 0 client.4407 ms_handle_reset on v2:172.21.15.169:6836/201961024 2024-09-19T06:37:20.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.464+0000 7fd335618740 1 -- 172.21.15.86:0/963461957 >> 172.21.15.86:0/963461957 conn(0x55d35bcb5e70 msgr2=0x55d35bcf9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:20.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.464+0000 7fd335618740 1 -- 172.21.15.86:0/963461957 shutdown_connections 2024-09-19T06:37:20.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.464+0000 7fd335618740 1 -- 172.21.15.86:0/963461957 wait complete. 2024-09-19T06:37:20.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.464+0000 7fd335618740 20 client.4407 trim_cache size 0 max 16384 2024-09-19T06:37:20.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.483+0000 7fd335618740 1 Processor -- start 2024-09-19T06:37:20.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.483+0000 7fd335618740 1 -- start start 2024-09-19T06:37:20.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.484+0000 7fd335618740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb4f80 0x55d35bcb5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:20.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.484+0000 7fd335618740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d35bcb7750 0x55d35bcb58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:20.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.484+0000 7fd335618740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d35bcb7b30 0x55d35bcb6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:20.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.484+0000 7fd335618740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c1fda90 con 0x55d35bcb4f80 2024-09-19T06:37:20.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.484+0000 7fd335618740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d35bcdc430 con 0x55d35bcb7750 2024-09-19T06:37:20.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.484+0000 7fd335618740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55d35bcdd380 con 0x55d35bcb7b30 2024-09-19T06:37:20.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.484+0000 7fd32bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb4f80 0x55d35bcb5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:20.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.484+0000 7fd32bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb4f80 0x55d35bcb5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40912/0 (socket says 172.21.15.86:40912) 2024-09-19T06:37:20.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.484+0000 7fd32bfff640 1 -- 172.21.15.86:0/1901787958 learned_addr learned my addr 172.21.15.86:0/1901787958 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:20.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.484+0000 7fd330d3c640 1 --2- 172.21.15.86:0/1901787958 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d35bcb7b30 0x55d35bcb6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:20.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.484+0000 7fd32b7fe640 1 --2- 172.21.15.86:0/1901787958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d35bcb7750 0x55d35bcb58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:20.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.484+0000 7fd32bfff640 1 -- 172.21.15.86:0/1901787958 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d35bcb7b30 msgr2=0x55d35bcb6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:20.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.484+0000 7fd32bfff640 1 --2- 172.21.15.86:0/1901787958 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d35bcb7b30 0x55d35bcb6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.484+0000 7fd32bfff640 1 -- 172.21.15.86:0/1901787958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d35bcb7750 msgr2=0x55d35bcb58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:20.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.484+0000 7fd32bfff640 1 --2- 172.21.15.86:0/1901787958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d35bcb7750 0x55d35bcb58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.484+0000 7fd32bfff640 1 -- 172.21.15.86:0/1901787958 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d35bcb3580 con 0x55d35bcb4f80 2024-09-19T06:37:20.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.484+0000 7fd32b7fe640 1 --2- 172.21.15.86:0/1901787958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d35bcb7750 0x55d35bcb58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:20.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.485+0000 7fd32bfff640 1 --2- 172.21.15.86:0/1901787958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb4f80 0x55d35bcb5360 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd31c059350 tx=0x7fd31c0899e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49eaa59470c855e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:20.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.485+0000 7fd3117fa640 1 -- 172.21.15.86:0/1901787958 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c055cc0 con 0x55d35bcb4f80 2024-09-19T06:37:20.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.485+0000 7fd3117fa640 1 -- 172.21.15.86:0/1901787958 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd31c009bb0 con 0x55d35bcb4f80 2024-09-19T06:37:20.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.485+0000 7fd3117fa640 1 -- 172.21.15.86:0/1901787958 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c055e60 con 0x55d35bcb4f80 2024-09-19T06:37:20.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.486+0000 7fd335618740 1 -- 172.21.15.86:0/1901787958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb4f80 msgr2=0x55d35bcb5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:20.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.486+0000 7fd335618740 1 --2- 172.21.15.86:0/1901787958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb4f80 0x55d35bcb5360 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd31c059350 tx=0x7fd31c0899e0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.486+0000 7fd335618740 1 -- 172.21.15.86:0/1901787958 shutdown_connections 2024-09-19T06:37:20.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.486+0000 7fd335618740 1 --2- 172.21.15.86:0/1901787958 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d35bcb7b30 0x55d35bcb6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.486+0000 7fd335618740 1 --2- 172.21.15.86:0/1901787958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d35bcb7750 0x55d35bcb58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.486+0000 7fd335618740 1 --2- 172.21.15.86:0/1901787958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb4f80 0x55d35bcb5360 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.486+0000 7fd335618740 1 -- 172.21.15.86:0/1901787958 >> 172.21.15.86:0/1901787958 conn(0x55d35bcb5e70 msgr2=0x55d35bceb170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:20.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.486+0000 7fd335618740 1 -- 172.21.15.86:0/1901787958 shutdown_connections 2024-09-19T06:37:20.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.486+0000 7fd335618740 1 -- 172.21.15.86:0/1901787958 wait complete. 2024-09-19T06:37:20.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.486+0000 7fd335618740 1 -- start start 2024-09-19T06:37:20.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.487+0000 7fd335618740 1 Processor -- start 2024-09-19T06:37:20.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.488+0000 7fd335618740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d35bcb4f80 0x55d35bd78480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:20.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.488+0000 7fd335618740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb7750 0x55d35bd09200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:20.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.488+0000 7fd335618740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d35bcb7b30 0x55d35bcb6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:20.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.488+0000 7fd335618740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d35bcda9c0 con 0x55d35bcb7750 2024-09-19T06:37:20.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.488+0000 7fd335618740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d35bce1900 con 0x55d35bcb4f80 2024-09-19T06:37:20.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.488+0000 7fd335618740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55d35bd0a130 con 0x55d35bcb7b30 2024-09-19T06:37:20.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.488+0000 7fd335618740 10 client.0 _ll_register_callbacks cb 0x7fd3200096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:37:20.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.488+0000 7fd32b7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb7750 0x55d35bd09200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:20.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.488+0000 7fd32b7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb7750 0x55d35bd09200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40922/0 (socket says 172.21.15.86:40922) 2024-09-19T06:37:20.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.488+0000 7fd32bfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d35bcb4f80 0x55d35bd78480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:20.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.488+0000 7fd32b7fe640 1 -- 172.21.15.86:0/1854468786 learned_addr learned my addr 172.21.15.86:0/1854468786 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:20.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.488+0000 7fd330d3c640 1 --2- 172.21.15.86:0/1854468786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d35bcb7b30 0x55d35bcb6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:20.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.488+0000 7fd32b7fe640 1 -- 172.21.15.86:0/1854468786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d35bcb7b30 msgr2=0x55d35bcb6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:20.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.488+0000 7fd32b7fe640 1 --2- 172.21.15.86:0/1854468786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d35bcb7b30 0x55d35bcb6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.488+0000 7fd32b7fe640 1 -- 172.21.15.86:0/1854468786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d35bcb4f80 msgr2=0x55d35bd78480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:20.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.488+0000 7fd32b7fe640 1 --2- 172.21.15.86:0/1854468786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d35bcb4f80 0x55d35bd78480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.488+0000 7fd32b7fe640 1 -- 172.21.15.86:0/1854468786 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d35bcb49a0 con 0x55d35bcb7750 2024-09-19T06:37:20.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.488+0000 7fd32b7fe640 1 --2- 172.21.15.86:0/1854468786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb7750 0x55d35bd09200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd320035040 tx=0x7fd32002c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ed145595f1f101 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:20.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.488+0000 7fd30affd640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T06:37:20.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.488+0000 7fd30affd640 1 -- 172.21.15.86:0/1854468786 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd320050070 con 0x55d35bcb7750 2024-09-19T06:37:20.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.488+0000 7fd30affd640 1 -- 172.21.15.86:0/1854468786 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd320051820 con 0x55d35bcb7750 2024-09-19T06:37:20.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.488+0000 7fd335618740 1 -- 172.21.15.86:0/1854468786 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd31c009bb0 con 0x55d35bcb7750 2024-09-19T06:37:20.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.489+0000 7fd30affd640 1 -- 172.21.15.86:0/1854468786 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fd320067050 con 0x55d35bcb7750 2024-09-19T06:37:20.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.489+0000 7fd335618740 10 client.4413 fetch_fsmap learned FSMap version 6 2024-09-19T06:37:20.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.489+0000 7fd335618740 1 -- 172.21.15.86:0/1854468786 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55d35bcb6de0 con 0x55d35bcb7750 2024-09-19T06:37:20.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.489+0000 7fd30affd640 1 -- 172.21.15.86:0/1854468786 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd31c009bb0 con 0x55d35bcb7750 2024-09-19T06:37:20.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.489+0000 7fd30affd640 1 -- 172.21.15.86:0/1854468786 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 6) ==== 4720+0+0 (secure 0 0 0) 0x7fd32006a020 con 0x55d35bcb7750 2024-09-19T06:37:20.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.489+0000 7fd335618740 10 client.4413 fetch_fsmap finished waiting for FSMap version 6 2024-09-19T06:37:20.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.489+0000 7fd335618740 10 client.4413 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-19T06:37:20.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.489+0000 7fd335618740 20 client.4413 populate_metadata read hostname 'smithi086' 2024-09-19T06:37:20.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.489+0000 7fd335618740 1 --2- 172.21.15.86:0/1854468786 >> [v2:172.21.15.169:6836/201961024,v1:172.21.15.169:6837/201961024] conn(0x55d35bd6e920 0x55d35bd6ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:20.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.489+0000 7fd335618740 4 client.4413 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:37:20.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.489+0000 7fd335618740 1 -- 172.21.15.86:0/1854468786 --> [v2:172.21.15.169:6836/201961024,v1:172.21.15.169:6837/201961024] -- command(tid 0: {"prefix": "status"}) -- 0x55d35bc1ffa0 con 0x55d35bd6e920 2024-09-19T06:37:20.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.489+0000 7fd32bfff640 1 --2- 172.21.15.86:0/1854468786 >> [v2:172.21.15.169:6836/201961024,v1:172.21.15.169:6837/201961024] conn(0x55d35bd6e920 0x55d35bd6ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:20.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.489+0000 7fd32bfff640 1 -- 172.21.15.86:0/1854468786 >> [v2:172.21.15.169:6836/201961024,v1:172.21.15.169:6837/201961024] conn(0x55d35bd6e920 msgr2=0x55d35bd6ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-09-19T06:37:20.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.489+0000 7fd32bfff640 1 -- 172.21.15.86:0/1854468786 >> [v2:172.21.15.169:6836/201961024,v1:172.21.15.169:6837/201961024] conn(0x55d35bd6e920 msgr2=0x55d35bd6ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T06:37:20.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.489+0000 7fd32bfff640 1 --2- 172.21.15.86:0/1854468786 >> [v2:172.21.15.169:6836/201961024,v1:172.21.15.169:6837/201961024] conn(0x55d35bd6e920 0x55d35bd6ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T06:37:20.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.489+0000 7fd32bfff640 1 --2- 172.21.15.86:0/1854468786 >> [v2:172.21.15.169:6836/201961024,v1:172.21.15.169:6837/201961024] conn(0x55d35bd6e920 0x55d35bd6ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:37:20.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.690+0000 7fd32bfff640 1 --2- 172.21.15.86:0/1854468786 >> [v2:172.21.15.169:6836/201961024,v1:172.21.15.169:6837/201961024] conn(0x55d35bd6e920 0x55d35bd6ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:20.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.690+0000 7fd32bfff640 1 --2- 172.21.15.86:0/1854468786 >> [v2:172.21.15.169:6836/201961024,v1:172.21.15.169:6837/201961024] conn(0x55d35bd6e920 0x55d35bd6ed00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=261d2dc972de0324 server_cookie=a82f22c4bc6d5401 in_seq=0 out_seq=0 2024-09-19T06:37:20.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.690+0000 7fd30affd640 10 client.4413 ms_handle_connect on v2:172.21.15.169:6836/201961024 2024-09-19T06:37:20.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.691+0000 7fd30affd640 1 -- 172.21.15.86:0/1854468786 <== mds.0 v2:172.21.15.169:6836/201961024 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55d35bc1ffa0 con 0x55d35bd6e920 2024-09-19T06:37:20.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.691+0000 7fd30affd640 10 client.4413 handle_command_reply: tid=0 2024-09-19T06:37:20.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.691+0000 7fd335618740 1 client.4413 shutdown 2024-09-19T06:37:20.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.691+0000 7fd335618740 1 -- 172.21.15.86:0/1854468786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb7750 msgr2=0x55d35bd09200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:20.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.691+0000 7fd335618740 1 --2- 172.21.15.86:0/1854468786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb7750 0x55d35bd09200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd320035040 tx=0x7fd32002c070 comp rx=0 tx=0).stop 2024-09-19T06:37:20.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.691+0000 7fd335618740 1 -- 172.21.15.86:0/1854468786 shutdown_connections 2024-09-19T06:37:20.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.691+0000 7fd335618740 1 --2- 172.21.15.86:0/1854468786 >> [v2:172.21.15.169:6836/201961024,v1:172.21.15.169:6837/201961024] conn(0x55d35bd6e920 0x55d35bd6ed00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.691+0000 7fd335618740 1 --2- 172.21.15.86:0/1854468786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d35bcb7b30 0x55d35bcb6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.691+0000 7fd335618740 1 --2- 172.21.15.86:0/1854468786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d35bcb7750 0x55d35bd09200 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.691+0000 7fd335618740 1 --2- 172.21.15.86:0/1854468786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d35bcb4f80 0x55d35bd78480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.691+0000 7fd30affd640 0 client.4413 ms_handle_reset on v2:172.21.15.169:6836/201961024 2024-09-19T06:37:20.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.691+0000 7fd335618740 1 -- 172.21.15.86:0/1854468786 >> 172.21.15.86:0/1854468786 conn(0x55d35bcb5e70 msgr2=0x55d35bcb5360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:20.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.691+0000 7fd335618740 1 -- 172.21.15.86:0/1854468786 shutdown_connections 2024-09-19T06:37:20.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.691+0000 7fd335618740 1 -- 172.21.15.86:0/1854468786 wait complete. 2024-09-19T06:37:20.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.692+0000 7fd335618740 20 client.4413 trim_cache size 0 max 16384 2024-09-19T06:37:20.695 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-19T06:37:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "1785f09f-0959-457d-8c4a-6cce2e655a37", 2024-09-19T06:37:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2024-09-19T06:37:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 4285, 2024-09-19T06:37:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-09-19T06:37:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-09-19T06:37:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-09-19T06:37:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 11.269303891, 2024-09-19T06:37:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 6, 2024-09-19T06:37:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 26, 2024-09-19T06:37:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 26, 2024-09-19T06:37:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 17.281449301999999 2024-09-19T06:37:20.696 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-19T06:37:20.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.692+0000 7fd33279f640 1 -- 172.21.15.86:0/1909747684 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd31806c2b0 msgr2=0x7fd31806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:20.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.692+0000 7fd33279f640 1 --2- 172.21.15.86:0/1909747684 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd31806c2b0 0x7fd31806e770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd320034000 tx=0x7fd32002e000 comp rx=0 tx=0).stop 2024-09-19T06:37:20.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.692+0000 7fd33279f640 1 -- 172.21.15.86:0/1909747684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd32c0c6df0 msgr2=0x7fd32c14b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:20.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.692+0000 7fd33279f640 1 --2- 172.21.15.86:0/1909747684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd32c0c6df0 0x7fd32c14b850 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00d830 tx=0x7fd31c00dcf0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.692+0000 7fd33279f640 1 -- 172.21.15.86:0/1909747684 shutdown_connections 2024-09-19T06:37:20.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.692+0000 7fd33279f640 1 --2- 172.21.15.86:0/1909747684 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd31806c2b0 0x7fd31806e770 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.692+0000 7fd33279f640 1 --2- 172.21.15.86:0/1909747684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd32c0cba40 0x7fd32c158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.692+0000 7fd33279f640 1 --2- 172.21.15.86:0/1909747684 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd32c0cb660 0x7fd32c158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.692+0000 7fd33279f640 1 --2- 172.21.15.86:0/1909747684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd32c0c6df0 0x7fd32c14b850 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.692+0000 7fd33279f640 1 -- 172.21.15.86:0/1909747684 >> 172.21.15.86:0/1909747684 conn(0x7fd32c06bcc0 msgr2=0x7fd32c15d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:20.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.693+0000 7fd33279f640 1 -- 172.21.15.86:0/1909747684 shutdown_connections 2024-09-19T06:37:20.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.693+0000 7fd33279f640 1 -- 172.21.15.86:0/1909747684 wait complete. 2024-09-19T06:37:20.708 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T06:37:20.709 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-19T06:37:20.709 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T06:37:20.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.815+0000 7fbd1b5f8640 1 Processor -- start 2024-09-19T06:37:20.817 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.815+0000 7fbd1b5f8640 1 -- start start 2024-09-19T06:37:20.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.816+0000 7fbd1b5f8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd14153050 0x7fbd140cb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:20.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.816+0000 7fbd1b5f8640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbd140c8b20 0x7fbd1415ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:20.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.816+0000 7fbd1b5f8640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd140c5da0 con 0x7fbd1415cf60 2024-09-19T06:37:20.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.816+0000 7fbd1b5f8640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fbd14153430 con 0x7fbd140c8b20 2024-09-19T06:37:20.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.816+0000 7fbd1b5f8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbd140c6040 con 0x7fbd14153050 2024-09-19T06:37:20.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.816+0000 7fbd18b93640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbd140c8b20 0x7fbd1415ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:20.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.816+0000 7fbd19b95640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fbd1415cf60 0x7fbd14073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:52702/0 (socket says 172.21.15.86:52702) 2024-09-19T06:37:20.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.816+0000 7fbd19b95640 1 -- 172.21.15.86:0/3423337159 learned_addr learned my addr 172.21.15.86:0/3423337159 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:20.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.816+0000 7fbd18b93640 1 --2- 172.21.15.86:0/3423337159 >> v2:172.21.15.86:3300/0 conn(0x7fbd140c8b20 0x7fbd1415ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40932/0 (socket says 172.21.15.86:40932) 2024-09-19T06:37:20.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.816+0000 7fbd19394640 1 --2- 172.21.15.86:0/3423337159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd14153050 0x7fbd140cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:20.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.816+0000 7fbd18b93640 1 -- 172.21.15.86:0/3423337159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd14153050 msgr2=0x7fbd140cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:20.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.816+0000 7fbd18b93640 1 --2- 172.21.15.86:0/3423337159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd14153050 0x7fbd140cb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.816+0000 7fbd18b93640 1 -- 172.21.15.86:0/3423337159 >> v1:172.21.15.86:6789/0 conn(0x7fbd1415cf60 legacy=0x7fbd14073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:20.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.816+0000 7fbd0bfff640 1 -- 172.21.15.86:0/3423337159 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1956585154 0 0) 0x7fbd140c5da0 con 0x7fbd1415cf60 2024-09-19T06:37:20.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.816+0000 7fbd18b93640 1 -- 172.21.15.86:0/3423337159 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd140c6320 con 0x7fbd140c8b20 2024-09-19T06:37:20.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.816+0000 7fbd19394640 1 --2- 172.21.15.86:0/3423337159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd14153050 0x7fbd140cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:20.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.817+0000 7fbd18b93640 1 --2- 172.21.15.86:0/3423337159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd140c8b20 0x7fbd1415ca20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbd040097a0 tx=0x7fbd0402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2c41f17e8b5d90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:20.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.817+0000 7fbd0bfff640 1 -- 172.21.15.86:0/3423337159 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd04037070 con 0x7fbd140c8b20 2024-09-19T06:37:20.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.817+0000 7fbd0bfff640 1 -- 172.21.15.86:0/3423337159 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd04032440 con 0x7fbd140c8b20 2024-09-19T06:37:20.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.817+0000 7fbd0bfff640 1 -- 172.21.15.86:0/3423337159 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd04032810 con 0x7fbd140c8b20 2024-09-19T06:37:20.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.818+0000 7fbd1b5f8640 1 -- 172.21.15.86:0/3423337159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd140c8b20 msgr2=0x7fbd1415ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:20.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.818+0000 7fbd1b5f8640 1 --2- 172.21.15.86:0/3423337159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd140c8b20 0x7fbd1415ca20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbd040097a0 tx=0x7fbd0402a180 comp rx=0 tx=0).stop 2024-09-19T06:37:20.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.818+0000 7fbd1b5f8640 1 -- 172.21.15.86:0/3423337159 shutdown_connections 2024-09-19T06:37:20.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.818+0000 7fbd1b5f8640 1 --2- 172.21.15.86:0/3423337159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd140c8b20 0x7fbd1415ca20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.818+0000 7fbd1b5f8640 1 --2- 172.21.15.86:0/3423337159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd14153050 0x7fbd140cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.818+0000 7fbd1b5f8640 1 -- 172.21.15.86:0/3423337159 >> 172.21.15.86:0/3423337159 conn(0x7fbd14070d10 msgr2=0x7fbd140710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:20.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.818+0000 7fbd1b5f8640 1 -- 172.21.15.86:0/3423337159 shutdown_connections 2024-09-19T06:37:20.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.818+0000 7fbd1b5f8640 1 -- 172.21.15.86:0/3423337159 wait complete. 2024-09-19T06:37:20.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.819+0000 7fbd1b5f8640 1 Processor -- start 2024-09-19T06:37:20.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.819+0000 7fbd1b5f8640 1 -- start start 2024-09-19T06:37:20.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.820+0000 7fbd1b5f8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd140c8b20 0x7fbd141e3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:20.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.820+0000 7fbd1b5f8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd14153050 0x7fbd141f4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:20.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.820+0000 7fbd1b5f8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd1415cf60 0x7fbd141f4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:20.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.820+0000 7fbd1b5f8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1415c500 con 0x7fbd14153050 2024-09-19T06:37:20.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.820+0000 7fbd1b5f8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbd140c68e0 con 0x7fbd140c8b20 2024-09-19T06:37:20.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.820+0000 7fbd1b5f8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbd14073830 con 0x7fbd1415cf60 2024-09-19T06:37:20.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.820+0000 7fbd18b93640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd14153050 0x7fbd141f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:20.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.820+0000 7fbd18b93640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd14153050 0x7fbd141f4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40940/0 (socket says 172.21.15.86:40940) 2024-09-19T06:37:20.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.820+0000 7fbd18b93640 1 -- 172.21.15.86:0/923310984 learned_addr learned my addr 172.21.15.86:0/923310984 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:20.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.820+0000 7fbd18b93640 1 -- 172.21.15.86:0/923310984 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd1415cf60 msgr2=0x7fbd141f4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:20.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.820+0000 7fbd19b95640 1 --2- 172.21.15.86:0/923310984 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd1415cf60 0x7fbd141f4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:20.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.820+0000 7fbd18b93640 1 --2- 172.21.15.86:0/923310984 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd1415cf60 0x7fbd141f4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.820+0000 7fbd19394640 1 --2- 172.21.15.86:0/923310984 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd140c8b20 0x7fbd141e3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:20.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.820+0000 7fbd18b93640 1 -- 172.21.15.86:0/923310984 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd140c8b20 msgr2=0x7fbd141e3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:20.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.820+0000 7fbd18b93640 1 --2- 172.21.15.86:0/923310984 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd140c8b20 0x7fbd141e3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.820+0000 7fbd18b93640 1 -- 172.21.15.86:0/923310984 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd1415aa50 con 0x7fbd14153050 2024-09-19T06:37:20.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.820+0000 7fbd18b93640 1 --2- 172.21.15.86:0/923310984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd14153050 0x7fbd141f4580 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbd04035040 tx=0x7fbd040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:20.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.821+0000 7fbd09ffb640 1 -- 172.21.15.86:0/923310984 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd04037050 con 0x7fbd14153050 2024-09-19T06:37:20.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.821+0000 7fbd09ffb640 1 -- 172.21.15.86:0/923310984 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd04038040 con 0x7fbd14153050 2024-09-19T06:37:20.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.821+0000 7fbd1b5f8640 1 -- 172.21.15.86:0/923310984 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd1406e790 con 0x7fbd14153050 2024-09-19T06:37:20.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.821+0000 7fbd09ffb640 1 -- 172.21.15.86:0/923310984 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd04004490 con 0x7fbd14153050 2024-09-19T06:37:20.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.821+0000 7fbd1b5f8640 1 -- 172.21.15.86:0/923310984 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd1406ea50 con 0x7fbd14153050 2024-09-19T06:37:20.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.822+0000 7fbd1b5f8640 1 -- 172.21.15.86:0/923310984 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd1415ca20 con 0x7fbd14153050 2024-09-19T06:37:20.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.822+0000 7fbd09ffb640 1 -- 172.21.15.86:0/923310984 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbd04030980 con 0x7fbd14153050 2024-09-19T06:37:20.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.823+0000 7fbd09ffb640 1 --2- 172.21.15.86:0/923310984 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fbcf806c2b0 0x7fbcf806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:20.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.823+0000 7fbd09ffb640 1 -- 172.21.15.86:0/923310984 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbd040ac340 con 0x7fbd14153050 2024-09-19T06:37:20.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.823+0000 7fbd19394640 1 --2- 172.21.15.86:0/923310984 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fbcf806c2b0 0x7fbcf806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:20.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.823+0000 7fbd19394640 1 --2- 172.21.15.86:0/923310984 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fbcf806c2b0 0x7fbcf806e770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbd10008850 tx=0x7fbd10008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:20.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:20.827+0000 7fbd09ffb640 1 -- 172.21.15.86:0/923310984 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbd0407a920 con 0x7fbd14153050 2024-09-19T06:37:21.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:21.026+0000 7fbd1b5f8640 1 -- 172.21.15.86:0/923310984 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbd140c5a80 con 0x7fbd14153050 2024-09-19T06:37:21.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:21.027+0000 7fbd09ffb640 1 -- 172.21.15.86:0/923310984 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7fbd0407a220 con 0x7fbd14153050 2024-09-19T06:37:21.028 INFO:teuthology.orchestra.run.smithi086.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-19T06:37:21.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:21.029+0000 7fbd1b5f8640 1 -- 172.21.15.86:0/923310984 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fbcf806c2b0 msgr2=0x7fbcf806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:21.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:21.029+0000 7fbd1b5f8640 1 --2- 172.21.15.86:0/923310984 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fbcf806c2b0 0x7fbcf806e770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbd10008850 tx=0x7fbd10008040 comp rx=0 tx=0).stop 2024-09-19T06:37:21.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:21.029+0000 7fbd1b5f8640 1 -- 172.21.15.86:0/923310984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd14153050 msgr2=0x7fbd141f4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:21.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:21.029+0000 7fbd1b5f8640 1 --2- 172.21.15.86:0/923310984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd14153050 0x7fbd141f4580 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbd04035040 tx=0x7fbd040046c0 comp rx=0 tx=0).stop 2024-09-19T06:37:21.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:21.029+0000 7fbd1b5f8640 1 -- 172.21.15.86:0/923310984 shutdown_connections 2024-09-19T06:37:21.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:21.029+0000 7fbd1b5f8640 1 --2- 172.21.15.86:0/923310984 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fbcf806c2b0 0x7fbcf806e770 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:21.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:21.029+0000 7fbd1b5f8640 1 --2- 172.21.15.86:0/923310984 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd1415cf60 0x7fbd141f4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:21.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:21.029+0000 7fbd1b5f8640 1 --2- 172.21.15.86:0/923310984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd14153050 0x7fbd141f4580 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:21.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:21.029+0000 7fbd1b5f8640 1 --2- 172.21.15.86:0/923310984 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd140c8b20 0x7fbd141e3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:21.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:21.029+0000 7fbd1b5f8640 1 -- 172.21.15.86:0/923310984 >> 172.21.15.86:0/923310984 conn(0x7fbd14070d10 msgr2=0x7fbd140cb680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:21.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:21.029+0000 7fbd1b5f8640 1 -- 172.21.15.86:0/923310984 shutdown_connections 2024-09-19T06:37:21.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:21.029+0000 7fbd1b5f8640 1 -- 172.21.15.86:0/923310984 wait complete. 2024-09-19T06:37:21.041 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T06:37:21.041 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T06:37:21.041 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2024-09-19T06:37:21.041 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-19T06:37:21.041 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-19T06:37:21.041 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T06:37:21.041 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T06:37:21.042 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T06:37:21.042 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-19T06:37:21.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:37:21.042 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2024-09-19T06:37:21.057 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T06:37:21.058 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T06:37:21.058 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T06:37:21.058 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:37:21.058 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2024-09-19T06:37:21.058 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:37:21.058 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:37:21.058 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:37:21.058 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f0 2024-09-19T06:37:21.058 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:37:21.058 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:37:21.059 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f1 2024-09-19T06:37:21.059 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:37:21.059 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:37:21.059 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T06:37:21.059 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:37:21.059 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T06:37:21.059 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42768sec preferred_lft 42768sec 2024-09-19T06:37:21.059 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link noprefixroute 2024-09-19T06:37:21.059 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:37:21.060 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T06:37:21.060 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:37:21.060 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-19T06:37:21.060 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add name ceph-brx type bridge 2024-09-19T06:37:21.060 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip addr flush dev ceph-brx 2024-09-19T06:37:21.060 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set ceph-brx up 2024-09-19T06:37:21.060 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T06:37:21.061 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-19T06:37:21.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:37:21.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:37:21.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:37:21.269 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T06:37:21.294 INFO:teuthology.orchestra.run.smithi086.stdout:1 2024-09-19T06:37:21.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:37:21.295 DEBUG:teuthology.orchestra.run.smithi086:> route 2024-09-19T06:37:21.367 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2024-09-19T06:37:21.367 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T06:37:21.367 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T06:37:21.367 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T06:37:21.367 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T06:37:21.368 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:37:21.368 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-19T06:37:21.368 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T06:37:21.368 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T06:37:21.368 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T06:37:21.368 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-19T06:37:21.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:37:21.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:37:21.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:37:21.633 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2024-09-19T06:37:21.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:37:21.649 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list-id 2024-09-19T06:37:21.704 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:37:21.704 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-19T06:37:21.704 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T06:37:21.705 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-19T06:37:21.705 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-19T06:37:21.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:37:21.817 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:37:21.823 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-19T06:37:21.823 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:37:21.823 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-19T06:37:21.824 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-19T06:37:21.824 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T06:37:21.824 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-19T06:37:21.824 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-19T06:37:21.824 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-19T06:37:21.824 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-19T06:37:21.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:37:21.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:37:21.947 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:37:21.947 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-19T06:37:21.947 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2024-09-19T06:37:21.947 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T06:37:21.948 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-19T06:37:21.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:37:22.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:37:22.025 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-19T06:37:22.025 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T06:37:22.025 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-19T06:37:22.040 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-19T06:37:22.040 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T06:37:22.040 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-19T06:37:22.096 DEBUG:teuthology.orchestra.run.smithi086:> sudo modprobe fuse 2024-09-19T06:37:22.160 DEBUG:teuthology.orchestra.run.smithi086:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T06:37:22.216 INFO:teuthology.orchestra.run.smithi086.stdout:/proc 2024-09-19T06:37:22.216 INFO:teuthology.orchestra.run.smithi086.stdout:/sys 2024-09-19T06:37:22.216 INFO:teuthology.orchestra.run.smithi086.stdout:/dev 2024-09-19T06:37:22.216 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/security 2024-09-19T06:37:22.216 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/shm 2024-09-19T06:37:22.216 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/pts 2024-09-19T06:37:22.216 INFO:teuthology.orchestra.run.smithi086.stdout:/run 2024-09-19T06:37:22.216 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/cgroup 2024-09-19T06:37:22.216 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/pstore 2024-09-19T06:37:22.216 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/bpf 2024-09-19T06:37:22.217 INFO:teuthology.orchestra.run.smithi086.stdout:/ 2024-09-19T06:37:22.217 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/selinux 2024-09-19T06:37:22.217 INFO:teuthology.orchestra.run.smithi086.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T06:37:22.217 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/debug 2024-09-19T06:37:22.217 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/mqueue 2024-09-19T06:37:22.217 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/hugepages 2024-09-19T06:37:22.217 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/tracing 2024-09-19T06:37:22.217 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/fuse/connections 2024-09-19T06:37:22.217 INFO:teuthology.orchestra.run.smithi086.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T06:37:22.217 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/config 2024-09-19T06:37:22.217 INFO:teuthology.orchestra.run.smithi086.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T06:37:22.217 INFO:teuthology.orchestra.run.smithi086.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T06:37:22.218 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T06:37:22.218 INFO:teuthology.orchestra.run.smithi086.stdout:/run/user/1000 2024-09-19T06:37:22.218 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph 2024-09-19T06:37:22.218 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T06:37:22.218 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T06:37:22.218 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T06:37:22.218 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T06:37:22.218 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns 2024-09-19T06:37:22.218 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T06:37:22.218 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T06:37:22.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:37:22.219 DEBUG:teuthology.orchestra.run.smithi086:> ls /sys/fs/fuse/connections 2024-09-19T06:37:22.271 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T06:37:22.271 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-19T06:37:22.313 DEBUG:teuthology.orchestra.run.smithi086:> sudo modprobe fuse 2024-09-19T06:37:22.338 DEBUG:teuthology.orchestra.run.smithi086:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T06:37:22.393 INFO:teuthology.orchestra.run.smithi086.stdout:/proc 2024-09-19T06:37:22.393 INFO:teuthology.orchestra.run.smithi086.stdout:/sys 2024-09-19T06:37:22.393 INFO:teuthology.orchestra.run.smithi086.stdout:/dev 2024-09-19T06:37:22.393 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/security 2024-09-19T06:37:22.393 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/shm 2024-09-19T06:37:22.393 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/pts 2024-09-19T06:37:22.393 INFO:teuthology.orchestra.run.smithi086.stdout:/run 2024-09-19T06:37:22.394 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/cgroup 2024-09-19T06:37:22.394 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/pstore 2024-09-19T06:37:22.394 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/bpf 2024-09-19T06:37:22.394 INFO:teuthology.orchestra.run.smithi086.stdout:/ 2024-09-19T06:37:22.394 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/selinux 2024-09-19T06:37:22.394 INFO:teuthology.orchestra.run.smithi086.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T06:37:22.394 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/debug 2024-09-19T06:37:22.394 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/mqueue 2024-09-19T06:37:22.394 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/hugepages 2024-09-19T06:37:22.394 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/tracing 2024-09-19T06:37:22.394 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/fuse/connections 2024-09-19T06:37:22.394 INFO:teuthology.orchestra.run.smithi086.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T06:37:22.394 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/config 2024-09-19T06:37:22.394 INFO:teuthology.orchestra.run.smithi086.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T06:37:22.395 INFO:teuthology.orchestra.run.smithi086.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T06:37:22.395 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T06:37:22.395 INFO:teuthology.orchestra.run.smithi086.stdout:/run/user/1000 2024-09-19T06:37:22.395 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph 2024-09-19T06:37:22.395 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T06:37:22.395 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T06:37:22.395 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T06:37:22.395 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T06:37:22.395 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns 2024-09-19T06:37:22.395 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T06:37:22.395 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T06:37:22.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:37:22.396 DEBUG:teuthology.orchestra.run.smithi086:> ls /sys/fs/fuse/connections 2024-09-19T06:37:22.772 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi086.stderr:2024-09-19T06:37:22.770+0000 7fbf830ff480 -1 init, newargv = 0x555776988f40 newargc=15 2024-09-19T06:37:22.772 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi086.stderr:ceph-fuse[41722]: starting ceph client 2024-09-19T06:37:22.777 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi086.stderr:ceph-fuse[41722]: starting fuse 2024-09-19T06:37:23.552 DEBUG:teuthology.orchestra.run.smithi086:> sudo modprobe fuse 2024-09-19T06:37:23.585 DEBUG:teuthology.orchestra.run.smithi086:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T06:37:23.645 INFO:teuthology.orchestra.run.smithi086.stdout:/proc 2024-09-19T06:37:23.645 INFO:teuthology.orchestra.run.smithi086.stdout:/sys 2024-09-19T06:37:23.645 INFO:teuthology.orchestra.run.smithi086.stdout:/dev 2024-09-19T06:37:23.645 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/security 2024-09-19T06:37:23.645 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/shm 2024-09-19T06:37:23.645 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/pts 2024-09-19T06:37:23.645 INFO:teuthology.orchestra.run.smithi086.stdout:/run 2024-09-19T06:37:23.645 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/cgroup 2024-09-19T06:37:23.645 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/pstore 2024-09-19T06:37:23.646 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/bpf 2024-09-19T06:37:23.646 INFO:teuthology.orchestra.run.smithi086.stdout:/ 2024-09-19T06:37:23.646 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/selinux 2024-09-19T06:37:23.646 INFO:teuthology.orchestra.run.smithi086.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T06:37:23.646 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/debug 2024-09-19T06:37:23.646 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/mqueue 2024-09-19T06:37:23.646 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/hugepages 2024-09-19T06:37:23.646 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/tracing 2024-09-19T06:37:23.646 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/fuse/connections 2024-09-19T06:37:23.646 INFO:teuthology.orchestra.run.smithi086.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T06:37:23.646 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/config 2024-09-19T06:37:23.646 INFO:teuthology.orchestra.run.smithi086.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T06:37:23.646 INFO:teuthology.orchestra.run.smithi086.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T06:37:23.647 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T06:37:23.647 INFO:teuthology.orchestra.run.smithi086.stdout:/run/user/1000 2024-09-19T06:37:23.647 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph 2024-09-19T06:37:23.647 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T06:37:23.647 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T06:37:23.647 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T06:37:23.647 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T06:37:23.647 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns 2024-09-19T06:37:23.647 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T06:37:23.647 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T06:37:23.647 INFO:teuthology.orchestra.run.smithi086.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-19T06:37:23.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:37:23.648 DEBUG:teuthology.orchestra.run.smithi086:> ls /sys/fs/fuse/connections 2024-09-19T06:37:23.703 INFO:teuthology.orchestra.run.smithi086.stdout:41 2024-09-19T06:37:23.704 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-19T06:37:23.704 DEBUG:teuthology.orchestra.run.smithi086:> sudo stdin-killer -- python3 -c ' 2024-09-19T06:37:23.704 DEBUG:teuthology.orchestra.run.smithi086:> import glob 2024-09-19T06:37:23.704 DEBUG:teuthology.orchestra.run.smithi086:> import re 2024-09-19T06:37:23.704 DEBUG:teuthology.orchestra.run.smithi086:> import os 2024-09-19T06:37:23.704 DEBUG:teuthology.orchestra.run.smithi086:> import subprocess 2024-09-19T06:37:23.704 DEBUG:teuthology.orchestra.run.smithi086:> 2024-09-19T06:37:23.705 DEBUG:teuthology.orchestra.run.smithi086:> def _find_admin_socket(client_name): 2024-09-19T06:37:23.705 DEBUG:teuthology.orchestra.run.smithi086:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-19T06:37:23.705 DEBUG:teuthology.orchestra.run.smithi086:> files = glob.glob(asok_path) 2024-09-19T06:37:23.705 DEBUG:teuthology.orchestra.run.smithi086:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-19T06:37:23.705 DEBUG:teuthology.orchestra.run.smithi086:> 2024-09-19T06:37:23.705 DEBUG:teuthology.orchestra.run.smithi086:> # Given a non-glob path, it better be there 2024-09-19T06:37:23.705 DEBUG:teuthology.orchestra.run.smithi086:> if "*" not in asok_path: 2024-09-19T06:37:23.705 DEBUG:teuthology.orchestra.run.smithi086:> assert(len(files) == 1) 2024-09-19T06:37:23.705 DEBUG:teuthology.orchestra.run.smithi086:> return files[0] 2024-09-19T06:37:23.705 DEBUG:teuthology.orchestra.run.smithi086:> 2024-09-19T06:37:23.705 DEBUG:teuthology.orchestra.run.smithi086:> for f in files: 2024-09-19T06:37:23.705 DEBUG:teuthology.orchestra.run.smithi086:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T06:37:23.705 DEBUG:teuthology.orchestra.run.smithi086:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T06:37:23.706 DEBUG:teuthology.orchestra.run.smithi086:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T06:37:23.706 DEBUG:teuthology.orchestra.run.smithi086:> contents = proc_f.read() 2024-09-19T06:37:23.706 DEBUG:teuthology.orchestra.run.smithi086:> if mountpoint in contents: 2024-09-19T06:37:23.706 DEBUG:teuthology.orchestra.run.smithi086:> return f 2024-09-19T06:37:23.706 DEBUG:teuthology.orchestra.run.smithi086:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T06:37:23.706 DEBUG:teuthology.orchestra.run.smithi086:> 2024-09-19T06:37:23.706 DEBUG:teuthology.orchestra.run.smithi086:> print(_find_admin_socket("client.admin")) 2024-09-19T06:37:23.706 DEBUG:teuthology.orchestra.run.smithi086:> ' 2024-09-19T06:37:23.828 INFO:teuthology.orchestra.run.smithi086.stdout:/var/run/ceph/ceph-client.admin.41722.asok 2024-09-19T06:37:23.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:37:23.839 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.41722.asok 2024-09-19T06:37:23.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:37:23.839 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.41722.asok status 2024-09-19T06:37:23.973 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-19T06:37:23.973 INFO:teuthology.orchestra.run.smithi086.stdout: "metadata": { 2024-09-19T06:37:23.973 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T06:37:23.973 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T06:37:23.973 INFO:teuthology.orchestra.run.smithi086.stdout: "entity_id": "admin", 2024-09-19T06:37:23.973 INFO:teuthology.orchestra.run.smithi086.stdout: "hostname": "smithi086", 2024-09-19T06:37:23.973 INFO:teuthology.orchestra.run.smithi086.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-19T06:37:23.973 INFO:teuthology.orchestra.run.smithi086.stdout: "pid": "41722", 2024-09-19T06:37:23.973 INFO:teuthology.orchestra.run.smithi086.stdout: "root": "/" 2024-09-19T06:37:23.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T06:37:23.974 INFO:teuthology.orchestra.run.smithi086.stdout: "dentry_count": 0, 2024-09-19T06:37:23.974 INFO:teuthology.orchestra.run.smithi086.stdout: "dentry_pinned_count": 0, 2024-09-19T06:37:23.974 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 4428, 2024-09-19T06:37:23.974 INFO:teuthology.orchestra.run.smithi086.stdout: "inst": { 2024-09-19T06:37:23.974 INFO:teuthology.orchestra.run.smithi086.stdout: "name": { 2024-09-19T06:37:23.974 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "client", 2024-09-19T06:37:23.974 INFO:teuthology.orchestra.run.smithi086.stdout: "num": 4428 2024-09-19T06:37:23.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T06:37:23.974 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": { 2024-09-19T06:37:23.974 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v1", 2024-09-19T06:37:23.974 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "192.168.0.1:0", 2024-09-19T06:37:23.974 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 1453758012 2024-09-19T06:37:23.975 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T06:37:23.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T06:37:23.975 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": { 2024-09-19T06:37:23.975 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v1", 2024-09-19T06:37:23.975 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "192.168.0.1:0", 2024-09-19T06:37:23.975 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 1453758012 2024-09-19T06:37:23.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T06:37:23.975 INFO:teuthology.orchestra.run.smithi086.stdout: "inst_str": "client.4428 192.168.0.1:0/1453758012", 2024-09-19T06:37:23.975 INFO:teuthology.orchestra.run.smithi086.stdout: "addr_str": "192.168.0.1:0/1453758012", 2024-09-19T06:37:23.975 INFO:teuthology.orchestra.run.smithi086.stdout: "inode_count": 1, 2024-09-19T06:37:23.975 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_epoch": 6, 2024-09-19T06:37:23.975 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_epoch": 26, 2024-09-19T06:37:23.975 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_epoch_barrier": 0, 2024-09-19T06:37:23.976 INFO:teuthology.orchestra.run.smithi086.stdout: "blocklisted": false, 2024-09-19T06:37:23.976 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs" 2024-09-19T06:37:23.976 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-19T06:37:23.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:37:23.981 DEBUG:teuthology.orchestra.run.smithi086:> stat --file-system '--printf=%T 2024-09-19T06:37:23.981 DEBUG:teuthology.orchestra.run.smithi086:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-19T06:37:23.997 INFO:teuthology.orchestra.run.smithi086.stdout:fuseblk 2024-09-19T06:37:23.997 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-19T06:37:23.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:37:23.998 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-19T06:37:24.062 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-19T06:37:24.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T06:37:24.172 INFO:teuthology.orchestra.run.smithi086.stdout:# file: . 2024-09-19T06:37:24.172 INFO:teuthology.orchestra.run.smithi086.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-19T06:37:24.172 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:24.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:37:24.177 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:37:24.178 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T06:37:24.194 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T06:37:24.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.332+0000 7f674c4dd640 1 Processor -- start 2024-09-19T06:37:24.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.332+0000 7f674c4dd640 1 -- start start 2024-09-19T06:37:24.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.333+0000 7f674c4dd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6744152c20 0x7f6744153000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:24.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.333+0000 7f674c4dd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f67440c68e0 0x7f67440730e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:24.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.333+0000 7f674c4dd640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6744158d70 con 0x7f67440c64a0 2024-09-19T06:37:24.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.333+0000 7f674c4dd640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f67440c3d20 con 0x7f67440c68e0 2024-09-19T06:37:24.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.333+0000 7f674c4dd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f67440c4000 con 0x7f6744152c20 2024-09-19T06:37:24.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.333+0000 7f674aa7a640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f67440c68e0 0x7f67440730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:24.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.333+0000 7f674aa7a640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f67440c68e0 0x7f67440730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39196/0 (socket says 172.21.15.86:39196) 2024-09-19T06:37:24.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.333+0000 7f674aa7a640 1 -- 172.21.15.86:0/4014445826 learned_addr learned my addr 172.21.15.86:0/4014445826 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:24.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.333+0000 7f674a279640 1 --2- 172.21.15.86:0/4014445826 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6744152c20 0x7f6744153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:24.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.333+0000 7f674aa7a640 1 -- 172.21.15.86:0/4014445826 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6744152c20 msgr2=0x7f6744153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:24.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.334+0000 7f674aa7a640 1 --2- 172.21.15.86:0/4014445826 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6744152c20 0x7f6744153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.334+0000 7f674aa7a640 1 -- 172.21.15.86:0/4014445826 >> v1:172.21.15.169:6789/0 conn(0x7f67440c64a0 legacy=0x7f67440c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:24.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.334+0000 7f674aa7a640 1 -- 172.21.15.86:0/4014445826 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67440c42e0 con 0x7f67440c68e0 2024-09-19T06:37:24.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.334+0000 7f674a279640 1 --2- 172.21.15.86:0/4014445826 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6744152c20 0x7f6744153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:24.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.334+0000 7f674aa7a640 1 --2- 172.21.15.86:0/4014445826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67440c68e0 0x7f67440730e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f673c009870 tx=0x7f673c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e55cf6d2dfacec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:24.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.334+0000 7f6749277640 1 -- 172.21.15.86:0/4014445826 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c037070 con 0x7f67440c68e0 2024-09-19T06:37:24.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.334+0000 7f6749277640 1 -- 172.21.15.86:0/4014445826 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f673c032440 con 0x7f67440c68e0 2024-09-19T06:37:24.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.334+0000 7f6749277640 1 -- 172.21.15.86:0/4014445826 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c032810 con 0x7f67440c68e0 2024-09-19T06:37:24.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.335+0000 7f674c4dd640 1 -- 172.21.15.86:0/4014445826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67440c68e0 msgr2=0x7f67440730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:24.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.335+0000 7f674c4dd640 1 --2- 172.21.15.86:0/4014445826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67440c68e0 0x7f67440730e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f673c009870 tx=0x7f673c02a2a0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.335+0000 7f674c4dd640 1 -- 172.21.15.86:0/4014445826 shutdown_connections 2024-09-19T06:37:24.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.335+0000 7f674c4dd640 1 --2- 172.21.15.86:0/4014445826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67440c68e0 0x7f67440730e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.335+0000 7f674c4dd640 1 --2- 172.21.15.86:0/4014445826 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6744152c20 0x7f6744153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.335+0000 7f674c4dd640 1 -- 172.21.15.86:0/4014445826 >> 172.21.15.86:0/4014445826 conn(0x7f67440c9280 msgr2=0x7f67440c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:24.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.335+0000 7f674c4dd640 1 -- 172.21.15.86:0/4014445826 shutdown_connections 2024-09-19T06:37:24.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.335+0000 7f674c4dd640 1 -- 172.21.15.86:0/4014445826 wait complete. 2024-09-19T06:37:24.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.336+0000 7f674c4dd640 1 Processor -- start 2024-09-19T06:37:24.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.336+0000 7f674c4dd640 1 -- start start 2024-09-19T06:37:24.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.337+0000 7f674c4dd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67440c64a0 0x7f67441f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:24.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.337+0000 7f674c4dd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67440c68e0 0x7f67441ef7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:24.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.337+0000 7f674c4dd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6744152c20 0x7f674414bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:24.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.337+0000 7f674c4dd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f67440c48a0 con 0x7f67440c68e0 2024-09-19T06:37:24.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.337+0000 7f674c4dd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f674406d900 con 0x7f6744152c20 2024-09-19T06:37:24.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.337+0000 7f674c4dd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f67440c4a20 con 0x7f67440c64a0 2024-09-19T06:37:24.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.337+0000 7f6749a78640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67440c68e0 0x7f67441ef7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:24.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.337+0000 7f6749a78640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67440c68e0 0x7f67441ef7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39206/0 (socket says 172.21.15.86:39206) 2024-09-19T06:37:24.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.337+0000 7f6749a78640 1 -- 172.21.15.86:0/1550423998 learned_addr learned my addr 172.21.15.86:0/1550423998 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:24.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.337+0000 7f674a279640 1 --2- 172.21.15.86:0/1550423998 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67440c64a0 0x7f67441f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:24.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.337+0000 7f674aa7a640 1 --2- 172.21.15.86:0/1550423998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6744152c20 0x7f674414bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:24.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.337+0000 7f6749a78640 1 -- 172.21.15.86:0/1550423998 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67440c64a0 msgr2=0x7f67441f21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:24.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.337+0000 7f6749a78640 1 --2- 172.21.15.86:0/1550423998 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67440c64a0 0x7f67441f21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.337+0000 7f6749a78640 1 -- 172.21.15.86:0/1550423998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6744152c20 msgr2=0x7f674414bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:24.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.337+0000 7f6749a78640 1 --2- 172.21.15.86:0/1550423998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6744152c20 0x7f674414bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.337+0000 7f6749a78640 1 -- 172.21.15.86:0/1550423998 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6744153760 con 0x7f67440c68e0 2024-09-19T06:37:24.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.337+0000 7f6749a78640 1 --2- 172.21.15.86:0/1550423998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67440c68e0 0x7f67441ef7d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f673800c400 tx=0x7f673800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:24.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.338+0000 7f6742ffd640 1 -- 172.21.15.86:0/1550423998 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6738011790 con 0x7f67440c68e0 2024-09-19T06:37:24.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.338+0000 7f6742ffd640 1 -- 172.21.15.86:0/1550423998 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6738017070 con 0x7f67440c68e0 2024-09-19T06:37:24.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.338+0000 7f6742ffd640 1 -- 172.21.15.86:0/1550423998 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6738011bb0 con 0x7f67440c68e0 2024-09-19T06:37:24.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.338+0000 7f674c4dd640 1 -- 172.21.15.86:0/1550423998 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67441e3e70 con 0x7f67440c68e0 2024-09-19T06:37:24.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.338+0000 7f674c4dd640 1 -- 172.21.15.86:0/1550423998 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67441eefd0 con 0x7f67440c68e0 2024-09-19T06:37:24.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.339+0000 7f674c4dd640 1 -- 172.21.15.86:0/1550423998 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6744153000 con 0x7f67440c68e0 2024-09-19T06:37:24.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.339+0000 7f6742ffd640 1 -- 172.21.15.86:0/1550423998 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f673801c460 con 0x7f67440c68e0 2024-09-19T06:37:24.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.339+0000 7f6742ffd640 1 --2- 172.21.15.86:0/1550423998 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f673006c2b0 0x7f673006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:24.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.340+0000 7f6742ffd640 1 -- 172.21.15.86:0/1550423998 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f673808b3e0 con 0x7f67440c68e0 2024-09-19T06:37:24.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.340+0000 7f674a279640 1 --2- 172.21.15.86:0/1550423998 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f673006c2b0 0x7f673006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:24.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.340+0000 7f674a279640 1 --2- 172.21.15.86:0/1550423998 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f673006c2b0 0x7f673006e770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f673400f500 tx=0x7f6734007770 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:24.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.344+0000 7f6742ffd640 1 -- 172.21.15.86:0/1550423998 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6744153760 con 0x7f67440c68e0 2024-09-19T06:37:24.404 INFO:tasks.ceph.mds.d.smithi169.stderr:2024-09-19T06:37:24.403+0000 7f7209074640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T06:37:24.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.525+0000 7f674c4dd640 1 -- 172.21.15.86:0/1550423998 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6744156690 con 0x7f67440c68e0 2024-09-19T06:37:24.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.525+0000 7f6742ffd640 1 -- 172.21.15.86:0/1550423998 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f6738059250 con 0x7f67440c68e0 2024-09-19T06:37:24.527 INFO:teuthology.orchestra.run.smithi086.stderr:listed 0 entries 2024-09-19T06:37:24.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.527+0000 7f674c4dd640 1 -- 172.21.15.86:0/1550423998 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f673006c2b0 msgr2=0x7f673006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:24.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.527+0000 7f674c4dd640 1 --2- 172.21.15.86:0/1550423998 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f673006c2b0 0x7f673006e770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f673400f500 tx=0x7f6734007770 comp rx=0 tx=0).stop 2024-09-19T06:37:24.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.527+0000 7f674c4dd640 1 -- 172.21.15.86:0/1550423998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67440c68e0 msgr2=0x7f67441ef7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:24.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.527+0000 7f674c4dd640 1 --2- 172.21.15.86:0/1550423998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67440c68e0 0x7f67441ef7d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f673800c400 tx=0x7f673800c8c0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.527+0000 7f674c4dd640 1 -- 172.21.15.86:0/1550423998 shutdown_connections 2024-09-19T06:37:24.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.527+0000 7f674c4dd640 1 --2- 172.21.15.86:0/1550423998 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f673006c2b0 0x7f673006e770 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.527+0000 7f674c4dd640 1 --2- 172.21.15.86:0/1550423998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6744152c20 0x7f674414bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.527+0000 7f674c4dd640 1 --2- 172.21.15.86:0/1550423998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67440c68e0 0x7f67441ef7d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.527+0000 7f674c4dd640 1 --2- 172.21.15.86:0/1550423998 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67440c64a0 0x7f67441f21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.527+0000 7f674c4dd640 1 -- 172.21.15.86:0/1550423998 >> 172.21.15.86:0/1550423998 conn(0x7f67440c9280 msgr2=0x7f67440c7570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:24.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.528+0000 7f674c4dd640 1 -- 172.21.15.86:0/1550423998 shutdown_connections 2024-09-19T06:37:24.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.528+0000 7f674c4dd640 1 -- 172.21.15.86:0/1550423998 wait complete. 2024-09-19T06:37:24.539 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:37:24.540 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T06:37:24.556 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T06:37:24.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.693+0000 7f6058637640 1 Processor -- start 2024-09-19T06:37:24.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.693+0000 7f6058637640 1 -- start start 2024-09-19T06:37:24.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.694+0000 7f6058637640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6050155000 0x7f605015b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:24.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.694+0000 7f6058637640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f605015bb00 0x7f605006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:24.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.694+0000 7f6058637640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f605015f1f0 con 0x7f6050071800 2024-09-19T06:37:24.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.694+0000 7f6058637640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f605015b130 con 0x7f6050155000 2024-09-19T06:37:24.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.694+0000 7f6058637640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f60500c9950 con 0x7f605015bb00 2024-09-19T06:37:24.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.695+0000 7f60563d3640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6050155000 0x7f605015b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:24.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.695+0000 7f6056bd4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f605015bb00 0x7f605006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:24.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.695+0000 7f6056bd4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f605015bb00 0x7f605006d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:40390/0 (socket says 172.21.15.86:40390) 2024-09-19T06:37:24.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.695+0000 7f60563d3640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6050155000 0x7f605015b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:55444/0 (socket says 172.21.15.86:55444) 2024-09-19T06:37:24.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.695+0000 7f6056bd4640 1 -- 172.21.15.86:0/1692626193 learned_addr learned my addr 172.21.15.86:0/1692626193 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:24.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.695+0000 7f6055bd2640 1 --1- 172.21.15.86:0/1692626193 >> v1:172.21.15.169:6789/0 conn(0x7f6050071800 0x7f605006ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:52566/0 (socket says 172.21.15.86:52566) 2024-09-19T06:37:24.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.695+0000 7f6056bd4640 1 -- 172.21.15.86:0/1692626193 >> v2:172.21.15.169:3300/0 conn(0x7f6050155000 msgr2=0x7f605015b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:24.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.695+0000 7f6056bd4640 1 --2- 172.21.15.86:0/1692626193 >> v2:172.21.15.169:3300/0 conn(0x7f6050155000 0x7f605015b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.695+0000 7f6056bd4640 1 -- 172.21.15.86:0/1692626193 >> v1:172.21.15.169:6789/0 conn(0x7f6050071800 legacy=0x7f605006ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:24.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.695+0000 7f6056bd4640 1 -- 172.21.15.86:0/1692626193 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60500c9c30 con 0x7f605015bb00 2024-09-19T06:37:24.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.695+0000 7f60563d3640 1 --2- 172.21.15.86:0/1692626193 >> v2:172.21.15.169:3300/0 conn(0x7f6050155000 0x7f605015b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:37:24.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.696+0000 7f6056bd4640 1 --2- 172.21.15.86:0/1692626193 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f605015bb00 0x7f605006d3e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6048009e50 tx=0x7f604802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4afdcbf70cbdadeb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:24.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.696+0000 7f60553d1640 1 -- 172.21.15.86:0/1692626193 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6048036070 con 0x7f605015bb00 2024-09-19T06:37:24.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.696+0000 7f60553d1640 1 -- 172.21.15.86:0/1692626193 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6048031600 con 0x7f605015bb00 2024-09-19T06:37:24.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.696+0000 7f60553d1640 1 -- 172.21.15.86:0/1692626193 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60480319d0 con 0x7f605015bb00 2024-09-19T06:37:24.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.697+0000 7f6058637640 1 -- 172.21.15.86:0/1692626193 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f605015bb00 msgr2=0x7f605006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:24.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.697+0000 7f6058637640 1 --2- 172.21.15.86:0/1692626193 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f605015bb00 0x7f605006d3e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6048009e50 tx=0x7f604802a710 comp rx=0 tx=0).stop 2024-09-19T06:37:24.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.697+0000 7f6058637640 1 -- 172.21.15.86:0/1692626193 shutdown_connections 2024-09-19T06:37:24.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.697+0000 7f6058637640 1 --2- 172.21.15.86:0/1692626193 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f605015bb00 0x7f605006d3e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.697+0000 7f6058637640 1 --2- 172.21.15.86:0/1692626193 >> v2:172.21.15.169:3300/0 conn(0x7f6050155000 0x7f605015b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.697+0000 7f6058637640 1 -- 172.21.15.86:0/1692626193 >> 172.21.15.86:0/1692626193 conn(0x7f6050070c30 msgr2=0x7f6050071040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:24.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.697+0000 7f6058637640 1 -- 172.21.15.86:0/1692626193 shutdown_connections 2024-09-19T06:37:24.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.697+0000 7f6058637640 1 -- 172.21.15.86:0/1692626193 wait complete. 2024-09-19T06:37:24.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.698+0000 7f6058637640 1 Processor -- start 2024-09-19T06:37:24.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.698+0000 7f6058637640 1 -- start start 2024-09-19T06:37:24.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.699+0000 7f6058637640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6050071800 0x7f605014b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:24.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.699+0000 7f6058637640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6050155000 0x7f605014a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:24.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.699+0000 7f6058637640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f605015bb00 0x7f60501f1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:24.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.699+0000 7f6058637640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6050155560 con 0x7f605015bb00 2024-09-19T06:37:24.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.699+0000 7f6058637640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f60501553e0 con 0x7f6050071800 2024-09-19T06:37:24.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.699+0000 7f6058637640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f60500c5bc0 con 0x7f6050155000 2024-09-19T06:37:24.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.699+0000 7f6056bd4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f605015bb00 0x7f60501f1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:24.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.699+0000 7f60563d3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6050071800 0x7f605014b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:24.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.699+0000 7f6056bd4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f605015bb00 0x7f60501f1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39208/0 (socket says 172.21.15.86:39208) 2024-09-19T06:37:24.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.699+0000 7f6056bd4640 1 -- 172.21.15.86:0/2923722265 learned_addr learned my addr 172.21.15.86:0/2923722265 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:24.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.699+0000 7f6055bd2640 1 --2- 172.21.15.86:0/2923722265 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6050155000 0x7f605014a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:24.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.699+0000 7f6056bd4640 1 -- 172.21.15.86:0/2923722265 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6050155000 msgr2=0x7f605014a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:24.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.699+0000 7f6056bd4640 1 --2- 172.21.15.86:0/2923722265 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6050155000 0x7f605014a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.699+0000 7f6056bd4640 1 -- 172.21.15.86:0/2923722265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6050071800 msgr2=0x7f605014b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:24.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.699+0000 7f6056bd4640 1 --2- 172.21.15.86:0/2923722265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6050071800 0x7f605014b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.699+0000 7f6056bd4640 1 -- 172.21.15.86:0/2923722265 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605014be80 con 0x7f605015bb00 2024-09-19T06:37:24.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.699+0000 7f6056bd4640 1 --2- 172.21.15.86:0/2923722265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f605015bb00 0x7f60501f1650 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6048034040 tx=0x7f6048004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:24.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.699+0000 7f604effd640 1 -- 172.21.15.86:0/2923722265 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6048041020 con 0x7f605015bb00 2024-09-19T06:37:24.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.700+0000 7f604effd640 1 -- 172.21.15.86:0/2923722265 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6048007820 con 0x7f605015bb00 2024-09-19T06:37:24.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.700+0000 7f604effd640 1 -- 172.21.15.86:0/2923722265 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6048036040 con 0x7f605015bb00 2024-09-19T06:37:24.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.700+0000 7f6058637640 1 -- 172.21.15.86:0/2923722265 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6050154820 con 0x7f605015bb00 2024-09-19T06:37:24.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.700+0000 7f6058637640 1 -- 172.21.15.86:0/2923722265 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60500c9f80 con 0x7f605015bb00 2024-09-19T06:37:24.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.700+0000 7f6058637640 1 -- 172.21.15.86:0/2923722265 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f605015b5c0 con 0x7f605015bb00 2024-09-19T06:37:24.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.701+0000 7f604effd640 1 -- 172.21.15.86:0/2923722265 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6048044020 con 0x7f605015bb00 2024-09-19T06:37:24.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.701+0000 7f604effd640 1 --2- 172.21.15.86:0/2923722265 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f603c06c2b0 0x7f603c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:24.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.701+0000 7f604effd640 1 -- 172.21.15.86:0/2923722265 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f60480ac200 con 0x7f605015bb00 2024-09-19T06:37:24.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.702+0000 7f60563d3640 1 --2- 172.21.15.86:0/2923722265 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f603c06c2b0 0x7f603c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:24.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.702+0000 7f60563d3640 1 --2- 172.21.15.86:0/2923722265 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f603c06c2b0 0x7f603c06e770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6040009560 tx=0x7f6040009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:24.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.706+0000 7f604effd640 1 -- 172.21.15.86:0/2923722265 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f604804b030 con 0x7f605015bb00 2024-09-19T06:37:24.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.881+0000 7f6058637640 1 -- 172.21.15.86:0/2923722265 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6050153200 con 0x7f605015bb00 2024-09-19T06:37:24.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.881+0000 7f604effd640 1 -- 172.21.15.86:0/2923722265 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f605014be80 con 0x7f605015bb00 2024-09-19T06:37:24.883 INFO:teuthology.orchestra.run.smithi086.stderr:listed 0 entries 2024-09-19T06:37:24.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.883+0000 7f6058637640 1 -- 172.21.15.86:0/2923722265 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f603c06c2b0 msgr2=0x7f603c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:24.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.883+0000 7f6058637640 1 --2- 172.21.15.86:0/2923722265 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f603c06c2b0 0x7f603c06e770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6040009560 tx=0x7f6040009190 comp rx=0 tx=0).stop 2024-09-19T06:37:24.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.883+0000 7f6058637640 1 -- 172.21.15.86:0/2923722265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f605015bb00 msgr2=0x7f60501f1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:24.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.883+0000 7f6058637640 1 --2- 172.21.15.86:0/2923722265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f605015bb00 0x7f60501f1650 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6048034040 tx=0x7f6048004a40 comp rx=0 tx=0).stop 2024-09-19T06:37:24.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.883+0000 7f6058637640 1 -- 172.21.15.86:0/2923722265 shutdown_connections 2024-09-19T06:37:24.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.883+0000 7f6058637640 1 --2- 172.21.15.86:0/2923722265 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f603c06c2b0 0x7f603c06e770 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.883+0000 7f6058637640 1 --2- 172.21.15.86:0/2923722265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f605015bb00 0x7f60501f1650 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.883+0000 7f6058637640 1 --2- 172.21.15.86:0/2923722265 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6050155000 0x7f605014a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.883+0000 7f6058637640 1 --2- 172.21.15.86:0/2923722265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6050071800 0x7f605014b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.883+0000 7f6058637640 1 -- 172.21.15.86:0/2923722265 >> 172.21.15.86:0/2923722265 conn(0x7f6050070c30 msgr2=0x7f605015c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:24.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.883+0000 7f6058637640 1 -- 172.21.15.86:0/2923722265 shutdown_connections 2024-09-19T06:37:24.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:24.883+0000 7f6058637640 1 -- 172.21.15.86:0/2923722265 wait complete. 2024-09-19T06:37:24.895 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi086.front.sepia.ceph.com... 2024-09-19T06:37:24.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:37:24.896 DEBUG:teuthology.orchestra.run.smithi086:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-19T06:37:24.918 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi086.stderr:ceph-fuse[41722]: fuse finished with error 0 and tester_r 0 2024-09-19T06:37:24.920 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:37:24.960 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi086.front.sepia.ceph.com 2024-09-19T06:37:24.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:37:24.961 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-19T06:37:25.027 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T06:37:25.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.164+0000 7f1e2f53b640 1 Processor -- start 2024-09-19T06:37:25.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.164+0000 7f1e2f53b640 1 -- start start 2024-09-19T06:37:25.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.165+0000 7f1e2f53b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1e280c5f60 0x7f1e280c7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:25.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.165+0000 7f1e2f53b640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e2815ee60 con 0x7f1e280c76d0 2024-09-19T06:37:25.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.165+0000 7f1e2f53b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e2815f140 con 0x7f1e281555d0 2024-09-19T06:37:25.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.165+0000 7f1e2f53b640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f1e280c6740 con 0x7f1e280c5f60 2024-09-19T06:37:25.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.165+0000 7f1e2cad6640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1e280c5f60 0x7f1e280c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:25.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.165+0000 7f1e2cad6640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1e280c5f60 0x7f1e280c7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39216/0 (socket says 172.21.15.86:39216) 2024-09-19T06:37:25.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.165+0000 7f1e2dad8640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f1e280c76d0 0x7f1e280cba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39552/0 (socket says 172.21.15.86:39552) 2024-09-19T06:37:25.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.165+0000 7f1e2cad6640 1 -- 172.21.15.86:0/449025386 learned_addr learned my addr 172.21.15.86:0/449025386 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:25.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.165+0000 7f1e2cad6640 1 -- 172.21.15.86:0/449025386 >> v1:172.21.15.169:6789/0 conn(0x7f1e281555d0 legacy=0x7f1e2815e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:25.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.165+0000 7f1e2cad6640 1 -- 172.21.15.86:0/449025386 >> v1:172.21.15.86:6789/0 conn(0x7f1e280c76d0 legacy=0x7f1e280cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:25.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.165+0000 7f1e2cad6640 1 -- 172.21.15.86:0/449025386 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e2815f420 con 0x7f1e280c5f60 2024-09-19T06:37:25.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.165+0000 7f1e1ffff640 1 -- 172.21.15.86:0/449025386 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1997623769 0 0) 0x7f1e2815ee60 con 0x7f1e280c76d0 2024-09-19T06:37:25.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.166+0000 7f1e2cad6640 1 --2- 172.21.15.86:0/449025386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e280c5f60 0x7f1e280c7190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1e180098a0 tx=0x7f1e1802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965daaf6e592362e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:25.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.166+0000 7f1e1ffff640 1 -- 172.21.15.86:0/449025386 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18037070 con 0x7f1e280c5f60 2024-09-19T06:37:25.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.166+0000 7f1e1ffff640 1 -- 172.21.15.86:0/449025386 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e18032440 con 0x7f1e280c5f60 2024-09-19T06:37:25.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.166+0000 7f1e1ffff640 1 -- 172.21.15.86:0/449025386 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18032810 con 0x7f1e280c5f60 2024-09-19T06:37:25.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.167+0000 7f1e2f53b640 1 -- 172.21.15.86:0/449025386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e280c5f60 msgr2=0x7f1e280c7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:25.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.167+0000 7f1e2f53b640 1 --2- 172.21.15.86:0/449025386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e280c5f60 0x7f1e280c7190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1e180098a0 tx=0x7f1e1802a250 comp rx=0 tx=0).stop 2024-09-19T06:37:25.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.167+0000 7f1e2f53b640 1 -- 172.21.15.86:0/449025386 shutdown_connections 2024-09-19T06:37:25.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.167+0000 7f1e2f53b640 1 --2- 172.21.15.86:0/449025386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e280c5f60 0x7f1e280c7190 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.167+0000 7f1e2f53b640 1 -- 172.21.15.86:0/449025386 >> 172.21.15.86:0/449025386 conn(0x7f1e2806d980 msgr2=0x7f1e2806dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:25.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.167+0000 7f1e2f53b640 1 -- 172.21.15.86:0/449025386 shutdown_connections 2024-09-19T06:37:25.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.167+0000 7f1e2f53b640 1 -- 172.21.15.86:0/449025386 wait complete. 2024-09-19T06:37:25.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.168+0000 7f1e2f53b640 1 Processor -- start 2024-09-19T06:37:25.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.168+0000 7f1e2f53b640 1 -- start start 2024-09-19T06:37:25.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.169+0000 7f1e2f53b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e280c5f60 0x7f1e281e7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:25.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.169+0000 7f1e2f53b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e280c76d0 0x7f1e281f0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:25.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.169+0000 7f1e2f53b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e281555d0 0x7f1e281f1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:25.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.169+0000 7f1e2f53b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1e280c5c80 con 0x7f1e281555d0 2024-09-19T06:37:25.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.169+0000 7f1e2f53b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1e280c6d00 con 0x7f1e280c76d0 2024-09-19T06:37:25.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.169+0000 7f1e2f53b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1e280c6340 con 0x7f1e280c5f60 2024-09-19T06:37:25.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.169+0000 7f1e2dad8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e281555d0 0x7f1e281f1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:25.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.169+0000 7f1e2dad8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e281555d0 0x7f1e281f1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39218/0 (socket says 172.21.15.86:39218) 2024-09-19T06:37:25.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.169+0000 7f1e2dad8640 1 -- 172.21.15.86:0/1141451867 learned_addr learned my addr 172.21.15.86:0/1141451867 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:25.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.169+0000 7f1e2d2d7640 1 --2- 172.21.15.86:0/1141451867 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e280c5f60 0x7f1e281e7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:25.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.169+0000 7f1e2cad6640 1 --2- 172.21.15.86:0/1141451867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e280c76d0 0x7f1e281f0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:25.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.169+0000 7f1e2dad8640 1 -- 172.21.15.86:0/1141451867 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e280c5f60 msgr2=0x7f1e281e7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:25.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.169+0000 7f1e2dad8640 1 --2- 172.21.15.86:0/1141451867 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e280c5f60 0x7f1e281e7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.169+0000 7f1e2dad8640 1 -- 172.21.15.86:0/1141451867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e280c76d0 msgr2=0x7f1e281f0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:25.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.169+0000 7f1e2dad8640 1 --2- 172.21.15.86:0/1141451867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e280c76d0 0x7f1e281f0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.169+0000 7f1e2dad8640 1 -- 172.21.15.86:0/1141451867 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e2814be60 con 0x7f1e281555d0 2024-09-19T06:37:25.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.169+0000 7f1e2dad8640 1 --2- 172.21.15.86:0/1141451867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e281555d0 0x7f1e281f1460 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1e2400c770 tx=0x7f1e2400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:25.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.169+0000 7f1e1dffb640 1 -- 172.21.15.86:0/1141451867 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e24018070 con 0x7f1e281555d0 2024-09-19T06:37:25.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.169+0000 7f1e1dffb640 1 -- 172.21.15.86:0/1141451867 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e2400a640 con 0x7f1e281555d0 2024-09-19T06:37:25.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.169+0000 7f1e2f53b640 1 -- 172.21.15.86:0/1141451867 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e2814f280 con 0x7f1e281555d0 2024-09-19T06:37:25.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.169+0000 7f1e1dffb640 1 -- 172.21.15.86:0/1141451867 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2400aa30 con 0x7f1e281555d0 2024-09-19T06:37:25.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.170+0000 7f1e2f53b640 1 -- 172.21.15.86:0/1141451867 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e28150bd0 con 0x7f1e281555d0 2024-09-19T06:37:25.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.171+0000 7f1e2f53b640 1 -- 172.21.15.86:0/1141451867 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e280ccd90 con 0x7f1e281555d0 2024-09-19T06:37:25.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.171+0000 7f1e1dffb640 1 -- 172.21.15.86:0/1141451867 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1e2401b070 con 0x7f1e281555d0 2024-09-19T06:37:25.175 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.171+0000 7f1e1dffb640 1 --2- 172.21.15.86:0/1141451867 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1e0c06c2b0 0x7f1e0c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:25.175 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.171+0000 7f1e1dffb640 1 -- 172.21.15.86:0/1141451867 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1e2408ac90 con 0x7f1e281555d0 2024-09-19T06:37:25.175 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.171+0000 7f1e2d2d7640 1 --2- 172.21.15.86:0/1141451867 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1e0c06c2b0 0x7f1e0c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:25.175 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.172+0000 7f1e2d2d7640 1 --2- 172.21.15.86:0/1141451867 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1e0c06c2b0 0x7f1e0c06e770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1e20004f60 tx=0x7f1e20007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:25.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.176+0000 7f1e1dffb640 1 -- 172.21.15.86:0/1141451867 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1e24058a70 con 0x7f1e281555d0 2024-09-19T06:37:25.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.343+0000 7f1e2f53b640 1 -- 172.21.15.86:0/1141451867 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1e281f0bf0 con 0x7f1e281555d0 2024-09-19T06:37:25.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.344+0000 7f1e1dffb640 1 -- 172.21.15.86:0/1141451867 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18586 (secure 0 0 0) 0x7f1e2405cd70 con 0x7f1e281555d0 2024-09-19T06:37:25.346 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:25.346 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":26,"fsid":"1785f09f-0959-457d-8c4a-6cce2e655a37","created":"2024-09-19T06:36:45.671544+0000","modified":"2024-09-19T06:37:13.796252+0000","last_up_change":"2024-09-19T06:36:56.765680+0000","last_in_change":"2024-09-19T06:36:47.816681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:36:57.770634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:37:06.588120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:37:07.739726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T06:37:11.457476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bd3ce3f2-2a37-40ec-8dc3-69246437277c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6827","nonce":1588074611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6829","nonce":1588074611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6833","nonce":1588074611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6831","nonce":1588074611}]},"public_addr":"172.21.15.86:6827/1588074611","cluster_addr":"172.21.15.86:6829/1588074611","heartbeat_back_addr":"172.21.15.86:6833/1588074611","heartbeat_front_addr":"172.21.15.86:6831/1588074611","state":["exists","up"]},{"osd":1,"uuid":"871d7d23-ed03-4629-bca9-5b71ad0d926a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6819","nonce":1785682938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6821","nonce":1785682938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6825","nonce":1785682938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6823","nonce":1785682938}]},"public_addr":"172.21.15.86:6819/1785682938","cluster_addr":"172.21.15.86:6821/1785682938","heartbeat_back_addr":"172.21.15.86:6825/1785682938","heartbeat_front_addr":"172.21.15.86:6823/1785682938","state":["exists","up"]},{"osd":2,"uuid":"39d3562d-8c52-4af9-935a-2d90abb8b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6801","nonce":3306127846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6803","nonce":3306127846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6807","nonce":3306127846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6805","nonce":3306127846}]},"public_addr":"172.21.15.86:6801/3306127846","cluster_addr":"172.21.15.86:6803/3306127846","heartbeat_back_addr":"172.21.15.86:6807/3306127846","heartbeat_front_addr":"172.21.15.86:6805/3306127846","state":["exists","up"]},{"osd":3,"uuid":"7f88c5b1-042c-4a9f-a674-32456e0644a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6809","nonce":694275178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6811","nonce":694275178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6815","nonce":694275178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6813","nonce":694275178}]},"public_addr":"172.21.15.86:6809/694275178","cluster_addr":"172.21.15.86:6811/694275178","heartbeat_back_addr":"172.21.15.86:6815/694275178","heartbeat_front_addr":"172.21.15.86:6813/694275178","state":["exists","up"]},{"osd":4,"uuid":"18aa391b-0863-48bf-bff6-107e22ee9752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6811","nonce":1326795640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6815","nonce":1326795640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6823","nonce":1326795640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6819","nonce":1326795640}]},"public_addr":"172.21.15.169:6811/1326795640","cluster_addr":"172.21.15.169:6815/1326795640","heartbeat_back_addr":"172.21.15.169:6823/1326795640","heartbeat_front_addr":"172.21.15.169:6819/1326795640","state":["exists","up"]},{"osd":5,"uuid":"90fa5ca6-1815-4af1-a664-b45a9e19dd56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6825","nonce":3538913242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6827","nonce":3538913242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6831","nonce":3538913242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6829","nonce":3538913242}]},"public_addr":"172.21.15.169:6825/3538913242","cluster_addr":"172.21.15.169:6827/3538913242","heartbeat_back_addr":"172.21.15.169:6831/3538913242","heartbeat_front_addr":"172.21.15.169:6829/3538913242","state":["exists","up"]},{"osd":6,"uuid":"8b2019fc-6cc2-4394-9a7c-7951544f7cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6810","nonce":494424253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6814","nonce":494424253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6822","nonce":494424253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6818","nonce":494424253}]},"public_addr":"172.21.15.169:6810/494424253","cluster_addr":"172.21.15.169:6814/494424253","heartbeat_back_addr":"172.21.15.169:6822/494424253","heartbeat_front_addr":"172.21.15.169:6818/494424253","state":["exists","up"]},{"osd":7,"uuid":"622e3b2c-5302-4b0a-b7f2-f4050801401e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6801","nonce":797235989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6803","nonce":797235989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6807","nonce":797235989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6805","nonce":797235989}]},"public_addr":"172.21.15.169:6801/797235989","cluster_addr":"172.21.15.169:6803/797235989","heartbeat_back_addr":"172.21.15.169:6807/797235989","heartbeat_front_addr":"172.21.15.169:6805/797235989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.130643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.611572+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:53.419992+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.560112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.112065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.774642+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.341946+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.117884+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:37:25.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.346+0000 7f1e2f53b640 1 -- 172.21.15.86:0/1141451867 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1e0c06c2b0 msgr2=0x7f1e0c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:25.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.346+0000 7f1e2f53b640 1 --2- 172.21.15.86:0/1141451867 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1e0c06c2b0 0x7f1e0c06e770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1e20004f60 tx=0x7f1e20007e30 comp rx=0 tx=0).stop 2024-09-19T06:37:25.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.346+0000 7f1e2f53b640 1 -- 172.21.15.86:0/1141451867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e281555d0 msgr2=0x7f1e281f1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:25.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.346+0000 7f1e2f53b640 1 --2- 172.21.15.86:0/1141451867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e281555d0 0x7f1e281f1460 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1e2400c770 tx=0x7f1e2400cc30 comp rx=0 tx=0).stop 2024-09-19T06:37:25.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.346+0000 7f1e2f53b640 1 -- 172.21.15.86:0/1141451867 shutdown_connections 2024-09-19T06:37:25.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.346+0000 7f1e2f53b640 1 --2- 172.21.15.86:0/1141451867 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1e0c06c2b0 0x7f1e0c06e770 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.346+0000 7f1e2f53b640 1 --2- 172.21.15.86:0/1141451867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e281555d0 0x7f1e281f1460 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.346+0000 7f1e2f53b640 1 --2- 172.21.15.86:0/1141451867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e280c76d0 0x7f1e281f0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.346+0000 7f1e2f53b640 1 --2- 172.21.15.86:0/1141451867 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e280c5f60 0x7f1e281e7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.346+0000 7f1e2f53b640 1 -- 172.21.15.86:0/1141451867 >> 172.21.15.86:0/1141451867 conn(0x7f1e2806d980 msgr2=0x7f1e281e4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:25.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.346+0000 7f1e2f53b640 1 -- 172.21.15.86:0/1141451867 shutdown_connections 2024-09-19T06:37:25.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.346+0000 7f1e2f53b640 1 -- 172.21.15.86:0/1141451867 wait complete. 2024-09-19T06:37:25.359 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T06:37:25.460 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.458+0000 7f2bb5711640 1 Processor -- start 2024-09-19T06:37:25.460 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.458+0000 7f2bb5711640 1 -- start start 2024-09-19T06:37:25.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.459+0000 7f2bb5711640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2bb0152ff0 0x7f2bb00c8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:25.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.459+0000 7f2bb5711640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bb00c2c20 con 0x7f2bb00cd6c0 2024-09-19T06:37:25.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.459+0000 7f2bb5711640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bb0158f20 con 0x7f2bb01533d0 2024-09-19T06:37:25.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.459+0000 7f2bb5711640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f2bb00b3090 con 0x7f2bb0152ff0 2024-09-19T06:37:25.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.459+0000 7f2baf7fe640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f2bb00cd6c0 0x7f2bb0073c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39558/0 (socket says 172.21.15.86:39558) 2024-09-19T06:37:25.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.459+0000 7f2baf7fe640 1 -- 172.21.15.86:0/198122683 learned_addr learned my addr 172.21.15.86:0/198122683 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:25.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.459+0000 7f2baeffd640 1 --2- 172.21.15.86:0/198122683 >> v2:172.21.15.169:3300/0 conn(0x7f2bb0152ff0 0x7f2bb00c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:25.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.459+0000 7f2badffb640 1 -- 172.21.15.86:0/198122683 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 744350638 0 0) 0x7f2bb00c2c20 con 0x7f2bb00cd6c0 2024-09-19T06:37:25.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.459+0000 7f2badffb640 1 -- 172.21.15.86:0/198122683 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b98003520 con 0x7f2bb00cd6c0 2024-09-19T06:37:25.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.460+0000 7f2badffb640 1 -- 172.21.15.86:0/198122683 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3228324306 0 0) 0x7f2b98003520 con 0x7f2bb00cd6c0 2024-09-19T06:37:25.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.460+0000 7f2badffb640 1 -- 172.21.15.86:0/198122683 >> v2:172.21.15.169:3300/0 conn(0x7f2bb0152ff0 msgr2=0x7f2bb00c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:25.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.460+0000 7f2badffb640 1 --2- 172.21.15.86:0/198122683 >> v2:172.21.15.169:3300/0 conn(0x7f2bb0152ff0 0x7f2bb00c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.460+0000 7f2badffb640 1 -- 172.21.15.86:0/198122683 >> v1:172.21.15.169:6789/0 conn(0x7f2bb01533d0 legacy=0x7f2bb0073530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:25.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.460+0000 7f2badffb640 1 -- 172.21.15.86:0/198122683 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb00c7930 con 0x7f2bb00cd6c0 2024-09-19T06:37:25.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.460+0000 7f2badffb640 1 -- 172.21.15.86:0/198122683 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f2ba8001670 con 0x7f2bb00cd6c0 2024-09-19T06:37:25.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.460+0000 7f2baeffd640 1 --2- 172.21.15.86:0/198122683 >> v2:172.21.15.169:3300/0 conn(0x7f2bb0152ff0 0x7f2bb00c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:37:25.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.460+0000 7f2badffb640 1 -- 172.21.15.86:0/198122683 >> v1:172.21.15.86:6789/0 conn(0x7f2bb00cd6c0 legacy=0x7f2bb0073c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:25.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.460+0000 7f2badffb640 1 --2- 172.21.15.86:0/198122683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b980039b0 0x7f2b98003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:25.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.460+0000 7f2badffb640 1 --2- 172.21.15.86:0/198122683 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b98004800 0x7f2b98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:25.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.460+0000 7f2badffb640 1 --2- 172.21.15.86:0/198122683 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b980051c0 0x7f2b9800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:25.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.460+0000 7f2badffb640 1 -- 172.21.15.86:0/198122683 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb00b3090 con 0x7f2b980039b0 2024-09-19T06:37:25.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.460+0000 7f2badffb640 1 -- 172.21.15.86:0/198122683 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9800c060 con 0x7f2b980051c0 2024-09-19T06:37:25.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.460+0000 7f2badffb640 1 -- 172.21.15.86:0/198122683 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2b9800c260 con 0x7f2b98004800 2024-09-19T06:37:25.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.460+0000 7f2baeffd640 1 --2- 172.21.15.86:0/198122683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b980039b0 0x7f2b98003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:25.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.460+0000 7f2bae7fc640 1 --2- 172.21.15.86:0/198122683 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b98004800 0x7f2b98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:25.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.460+0000 7f2baf7fe640 1 --2- 172.21.15.86:0/198122683 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b980051c0 0x7f2b9800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:25.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.460+0000 7f2baeffd640 1 -- 172.21.15.86:0/198122683 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b98004800 msgr2=0x7f2b98004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:25.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.460+0000 7f2baeffd640 1 --2- 172.21.15.86:0/198122683 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b98004800 0x7f2b98004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.460+0000 7f2baeffd640 1 -- 172.21.15.86:0/198122683 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b980051c0 msgr2=0x7f2b9800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:25.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.460+0000 7f2baeffd640 1 --2- 172.21.15.86:0/198122683 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b980051c0 0x7f2b9800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.460+0000 7f2baf7fe640 1 -- 172.21.15.86:0/198122683 reap_dead start 2024-09-19T06:37:25.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.460+0000 7f2baeffd640 1 -- 172.21.15.86:0/198122683 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b98003520 con 0x7f2b980039b0 2024-09-19T06:37:25.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.461+0000 7f2baeffd640 1 --2- 172.21.15.86:0/198122683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b980039b0 0x7f2b98003dd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000e350 tx=0x7f2b98005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ab9bdf565ed252 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:25.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.461+0000 7f2badffb640 1 -- 172.21.15.86:0/198122683 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0033070 con 0x7f2b980039b0 2024-09-19T06:37:25.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.461+0000 7f2badffb640 1 -- 172.21.15.86:0/198122683 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba002f660 con 0x7f2b980039b0 2024-09-19T06:37:25.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.461+0000 7f2badffb640 1 -- 172.21.15.86:0/198122683 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0009de0 con 0x7f2b980039b0 2024-09-19T06:37:25.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.462+0000 7f2bb5711640 1 -- 172.21.15.86:0/198122683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b980039b0 msgr2=0x7f2b98003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:25.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.462+0000 7f2bb5711640 1 --2- 172.21.15.86:0/198122683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b980039b0 0x7f2b98003dd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000e350 tx=0x7f2b98005830 comp rx=0 tx=0).stop 2024-09-19T06:37:25.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.462+0000 7f2bb5711640 1 -- 172.21.15.86:0/198122683 shutdown_connections 2024-09-19T06:37:25.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.462+0000 7f2bb5711640 1 --2- 172.21.15.86:0/198122683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b980039b0 0x7f2b98003dd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.462+0000 7f2bb5711640 1 -- 172.21.15.86:0/198122683 >> 172.21.15.86:0/198122683 conn(0x7f2bb00ccba0 msgr2=0x7f2bb00ccfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:25.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.462+0000 7f2bb5711640 1 -- 172.21.15.86:0/198122683 shutdown_connections 2024-09-19T06:37:25.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.462+0000 7f2bb5711640 1 -- 172.21.15.86:0/198122683 wait complete. 2024-09-19T06:37:25.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.463+0000 7f2bb5711640 1 Processor -- start 2024-09-19T06:37:25.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.463+0000 7f2bb5711640 1 -- start start 2024-09-19T06:37:25.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.464+0000 7f2bb5711640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b980039b0 0x7f2bb014d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:25.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.464+0000 7f2bb5711640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2bb00c42f0 0x7f2bb0071780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:25.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.464+0000 7f2bb5711640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2bb00c4770 0x7f2bb0071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:25.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.464+0000 7f2bb5711640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb01591e0 con 0x7f2bb00c42f0 2024-09-19T06:37:25.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.464+0000 7f2bb5711640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb00c7ef0 con 0x7f2bb00c4770 2024-09-19T06:37:25.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.464+0000 7f2bb5711640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2bb01594c0 con 0x7f2b980039b0 2024-09-19T06:37:25.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.464+0000 7f2bae7fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2bb00c42f0 0x7f2bb0071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:25.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.464+0000 7f2bae7fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2bb00c42f0 0x7f2bb0071780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39234/0 (socket says 172.21.15.86:39234) 2024-09-19T06:37:25.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.464+0000 7f2bae7fc640 1 -- 172.21.15.86:0/357139874 learned_addr learned my addr 172.21.15.86:0/357139874 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:25.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.464+0000 7f2bae7fc640 1 -- 172.21.15.86:0/357139874 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b980039b0 msgr2=0x7f2bb014d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:25.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.464+0000 7f2bae7fc640 1 --2- 172.21.15.86:0/357139874 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b980039b0 0x7f2bb014d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.464+0000 7f2bae7fc640 1 -- 172.21.15.86:0/357139874 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2bb00c4770 msgr2=0x7f2bb0071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:25.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.464+0000 7f2baf7fe640 1 --2- 172.21.15.86:0/357139874 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2bb00c4770 0x7f2bb0071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:25.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.464+0000 7f2bae7fc640 1 --2- 172.21.15.86:0/357139874 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2bb00c4770 0x7f2bb0071cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.464+0000 7f2bae7fc640 1 -- 172.21.15.86:0/357139874 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb01e3340 con 0x7f2bb00c42f0 2024-09-19T06:37:25.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.464+0000 7f2bae7fc640 1 --2- 172.21.15.86:0/357139874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2bb00c42f0 0x7f2bb0071780 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400f5f0 tx=0x7f2ba400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:25.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.464+0000 7f2b977fe640 1 -- 172.21.15.86:0/357139874 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba40052e0 con 0x7f2bb00c42f0 2024-09-19T06:37:25.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.464+0000 7f2b977fe640 1 -- 172.21.15.86:0/357139874 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba4018070 con 0x7f2bb00c42f0 2024-09-19T06:37:25.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.464+0000 7f2b977fe640 1 -- 172.21.15.86:0/357139874 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4003830 con 0x7f2bb00c42f0 2024-09-19T06:37:25.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.464+0000 7f2bb5711640 1 -- 172.21.15.86:0/357139874 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb01e35e0 con 0x7f2bb00c42f0 2024-09-19T06:37:25.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.465+0000 7f2bb5711640 1 -- 172.21.15.86:0/357139874 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bb00c52c0 con 0x7f2bb00c42f0 2024-09-19T06:37:25.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.466+0000 7f2bb5711640 1 -- 172.21.15.86:0/357139874 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bb00c2930 con 0x7f2bb00c42f0 2024-09-19T06:37:25.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.466+0000 7f2b977fe640 1 -- 172.21.15.86:0/357139874 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2ba40039d0 con 0x7f2bb00c42f0 2024-09-19T06:37:25.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.466+0000 7f2b977fe640 1 --2- 172.21.15.86:0/357139874 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2b9c06c2b0 0x7f2b9c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:25.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.466+0000 7f2b977fe640 1 -- 172.21.15.86:0/357139874 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2ba408b560 con 0x7f2bb00c42f0 2024-09-19T06:37:25.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.466+0000 7f2baeffd640 1 --2- 172.21.15.86:0/357139874 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2b9c06c2b0 0x7f2b9c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:25.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.467+0000 7f2baeffd640 1 --2- 172.21.15.86:0/357139874 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2b9c06c2b0 0x7f2b9c06e770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0035000 tx=0x7f2ba002d000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:25.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.471+0000 7f2b977fe640 1 -- 172.21.15.86:0/357139874 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2ba4059990 con 0x7f2bb00c42f0 2024-09-19T06:37:25.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.639+0000 7f2bb5711640 1 -- 172.21.15.86:0/357139874 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2bb00b2e20 con 0x7f2bb00c42f0 2024-09-19T06:37:25.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.640+0000 7f2b977fe640 1 -- 172.21.15.86:0/357139874 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18586 (secure 0 0 0) 0x7f2ba4059290 con 0x7f2bb00c42f0 2024-09-19T06:37:25.642 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:25.642 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":26,"fsid":"1785f09f-0959-457d-8c4a-6cce2e655a37","created":"2024-09-19T06:36:45.671544+0000","modified":"2024-09-19T06:37:13.796252+0000","last_up_change":"2024-09-19T06:36:56.765680+0000","last_in_change":"2024-09-19T06:36:47.816681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:36:57.770634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:37:06.588120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:37:07.739726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T06:37:11.457476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bd3ce3f2-2a37-40ec-8dc3-69246437277c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6827","nonce":1588074611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6829","nonce":1588074611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6833","nonce":1588074611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6831","nonce":1588074611}]},"public_addr":"172.21.15.86:6827/1588074611","cluster_addr":"172.21.15.86:6829/1588074611","heartbeat_back_addr":"172.21.15.86:6833/1588074611","heartbeat_front_addr":"172.21.15.86:6831/1588074611","state":["exists","up"]},{"osd":1,"uuid":"871d7d23-ed03-4629-bca9-5b71ad0d926a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6819","nonce":1785682938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6821","nonce":1785682938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6825","nonce":1785682938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6823","nonce":1785682938}]},"public_addr":"172.21.15.86:6819/1785682938","cluster_addr":"172.21.15.86:6821/1785682938","heartbeat_back_addr":"172.21.15.86:6825/1785682938","heartbeat_front_addr":"172.21.15.86:6823/1785682938","state":["exists","up"]},{"osd":2,"uuid":"39d3562d-8c52-4af9-935a-2d90abb8b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6801","nonce":3306127846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6803","nonce":3306127846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6807","nonce":3306127846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6805","nonce":3306127846}]},"public_addr":"172.21.15.86:6801/3306127846","cluster_addr":"172.21.15.86:6803/3306127846","heartbeat_back_addr":"172.21.15.86:6807/3306127846","heartbeat_front_addr":"172.21.15.86:6805/3306127846","state":["exists","up"]},{"osd":3,"uuid":"7f88c5b1-042c-4a9f-a674-32456e0644a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6809","nonce":694275178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6811","nonce":694275178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6815","nonce":694275178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6813","nonce":694275178}]},"public_addr":"172.21.15.86:6809/694275178","cluster_addr":"172.21.15.86:6811/694275178","heartbeat_back_addr":"172.21.15.86:6815/694275178","heartbeat_front_addr":"172.21.15.86:6813/694275178","state":["exists","up"]},{"osd":4,"uuid":"18aa391b-0863-48bf-bff6-107e22ee9752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6811","nonce":1326795640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6815","nonce":1326795640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6823","nonce":1326795640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6819","nonce":1326795640}]},"public_addr":"172.21.15.169:6811/1326795640","cluster_addr":"172.21.15.169:6815/1326795640","heartbeat_back_addr":"172.21.15.169:6823/1326795640","heartbeat_front_addr":"172.21.15.169:6819/1326795640","state":["exists","up"]},{"osd":5,"uuid":"90fa5ca6-1815-4af1-a664-b45a9e19dd56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6825","nonce":3538913242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6827","nonce":3538913242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6831","nonce":3538913242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6829","nonce":3538913242}]},"public_addr":"172.21.15.169:6825/3538913242","cluster_addr":"172.21.15.169:6827/3538913242","heartbeat_back_addr":"172.21.15.169:6831/3538913242","heartbeat_front_addr":"172.21.15.169:6829/3538913242","state":["exists","up"]},{"osd":6,"uuid":"8b2019fc-6cc2-4394-9a7c-7951544f7cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6810","nonce":494424253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6814","nonce":494424253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6822","nonce":494424253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6818","nonce":494424253}]},"public_addr":"172.21.15.169:6810/494424253","cluster_addr":"172.21.15.169:6814/494424253","heartbeat_back_addr":"172.21.15.169:6822/494424253","heartbeat_front_addr":"172.21.15.169:6818/494424253","state":["exists","up"]},{"osd":7,"uuid":"622e3b2c-5302-4b0a-b7f2-f4050801401e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6801","nonce":797235989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6803","nonce":797235989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6807","nonce":797235989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6805","nonce":797235989}]},"public_addr":"172.21.15.169:6801/797235989","cluster_addr":"172.21.15.169:6803/797235989","heartbeat_back_addr":"172.21.15.169:6807/797235989","heartbeat_front_addr":"172.21.15.169:6805/797235989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.130643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.611572+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:53.419992+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.560112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.112065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.774642+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.341946+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.117884+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:37:25.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.642+0000 7f2bb5711640 1 -- 172.21.15.86:0/357139874 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2b9c06c2b0 msgr2=0x7f2b9c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:25.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.642+0000 7f2bb5711640 1 --2- 172.21.15.86:0/357139874 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2b9c06c2b0 0x7f2b9c06e770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0035000 tx=0x7f2ba002d000 comp rx=0 tx=0).stop 2024-09-19T06:37:25.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.642+0000 7f2bb5711640 1 -- 172.21.15.86:0/357139874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2bb00c42f0 msgr2=0x7f2bb0071780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:25.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.642+0000 7f2bb5711640 1 --2- 172.21.15.86:0/357139874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2bb00c42f0 0x7f2bb0071780 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400f5f0 tx=0x7f2ba400fab0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.642+0000 7f2bb5711640 1 -- 172.21.15.86:0/357139874 shutdown_connections 2024-09-19T06:37:25.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.642+0000 7f2bb5711640 1 --2- 172.21.15.86:0/357139874 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2b9c06c2b0 0x7f2b9c06e770 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.642+0000 7f2bb5711640 1 --2- 172.21.15.86:0/357139874 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2bb00c4770 0x7f2bb0071cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.642+0000 7f2bb5711640 1 --2- 172.21.15.86:0/357139874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2bb00c42f0 0x7f2bb0071780 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.642+0000 7f2bb5711640 1 --2- 172.21.15.86:0/357139874 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b980039b0 0x7f2bb014d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.642+0000 7f2bb5711640 1 -- 172.21.15.86:0/357139874 >> 172.21.15.86:0/357139874 conn(0x7f2bb00ccba0 msgr2=0x7f2bb0156d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:25.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.642+0000 7f2bb5711640 1 -- 172.21.15.86:0/357139874 shutdown_connections 2024-09-19T06:37:25.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.642+0000 7f2bb5711640 1 -- 172.21.15.86:0/357139874 wait complete. 2024-09-19T06:37:25.655 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T06:37:25.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.754+0000 7fdaf60ba640 1 Processor -- start 2024-09-19T06:37:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.754+0000 7fdaf60ba640 1 -- start start 2024-09-19T06:37:25.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.754+0000 7fdaf60ba640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdaf00c7290 0x7fdaf0152150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:25.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.754+0000 7fdaf60ba640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fdaf015be60 0x7fdaf0071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:25.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.754+0000 7fdaf60ba640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaf006ea00 con 0x7fdaf0151d70 2024-09-19T06:37:25.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.754+0000 7fdaf60ba640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fdaf015c2b0 con 0x7fdaf015be60 2024-09-19T06:37:25.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.754+0000 7fdaf60ba640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fdaf006eca0 con 0x7fdaf00c7290 2024-09-19T06:37:25.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.755+0000 7fdaef7fe640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fdaf0151d70 0x7fdaf0071240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39562/0 (socket says 172.21.15.86:39562) 2024-09-19T06:37:25.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.755+0000 7fdaef7fe640 1 -- 172.21.15.86:0/2191620034 learned_addr learned my addr 172.21.15.86:0/2191620034 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:25.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.755+0000 7fdaeffff640 1 --2- 172.21.15.86:0/2191620034 >> v2:172.21.15.169:3300/0 conn(0x7fdaf015be60 0x7fdaf0071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:25.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.755+0000 7fdaeeffd640 1 --2- 172.21.15.86:0/2191620034 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdaf00c7290 0x7fdaf0152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:25.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.755+0000 7fdaee7fc640 1 -- 172.21.15.86:0/2191620034 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4144069584 0 0) 0x7fdaf006ea00 con 0x7fdaf0151d70 2024-09-19T06:37:25.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.755+0000 7fdaee7fc640 1 -- 172.21.15.86:0/2191620034 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdad8003520 con 0x7fdaf0151d70 2024-09-19T06:37:25.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.755+0000 7fdaee7fc640 1 -- 172.21.15.86:0/2191620034 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 688980270 0 0) 0x7fdad8003520 con 0x7fdaf0151d70 2024-09-19T06:37:25.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.755+0000 7fdaee7fc640 1 -- 172.21.15.86:0/2191620034 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdaf00c7290 msgr2=0x7fdaf0152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:25.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.755+0000 7fdaee7fc640 1 --2- 172.21.15.86:0/2191620034 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdaf00c7290 0x7fdaf0152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.755+0000 7fdaee7fc640 1 -- 172.21.15.86:0/2191620034 >> v2:172.21.15.169:3300/0 conn(0x7fdaf015be60 msgr2=0x7fdaf0071ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:25.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.755+0000 7fdaee7fc640 1 --2- 172.21.15.86:0/2191620034 >> v2:172.21.15.169:3300/0 conn(0x7fdaf015be60 0x7fdaf0071ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.755+0000 7fdaee7fc640 1 -- 172.21.15.86:0/2191620034 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf006ef60 con 0x7fdaf0151d70 2024-09-19T06:37:25.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.755+0000 7fdaee7fc640 1 -- 172.21.15.86:0/2191620034 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7fdae0001670 con 0x7fdaf0151d70 2024-09-19T06:37:25.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.755+0000 7fdaee7fc640 1 -- 172.21.15.86:0/2191620034 >> v1:172.21.15.86:6789/0 conn(0x7fdaf0151d70 legacy=0x7fdaf0071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:25.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.755+0000 7fdaee7fc640 1 --2- 172.21.15.86:0/2191620034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdad80039b0 0x7fdad8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:25.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.755+0000 7fdaee7fc640 1 --2- 172.21.15.86:0/2191620034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdad8004800 0x7fdad8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:25.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.755+0000 7fdaee7fc640 1 --2- 172.21.15.86:0/2191620034 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdaf00c7290 0x7fdad80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:25.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.755+0000 7fdaee7fc640 1 -- 172.21.15.86:0/2191620034 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf015c2b0 con 0x7fdad8004800 2024-09-19T06:37:25.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.755+0000 7fdaee7fc640 1 -- 172.21.15.86:0/2191620034 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf006eca0 con 0x7fdad80039b0 2024-09-19T06:37:25.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.755+0000 7fdaee7fc640 1 -- 172.21.15.86:0/2191620034 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fdad800dc00 con 0x7fdaf00c7290 2024-09-19T06:37:25.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.755+0000 7fdaeeffd640 1 --2- 172.21.15.86:0/2191620034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdad8004800 0x7fdad8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:25.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.755+0000 7fdaef7fe640 1 --2- 172.21.15.86:0/2191620034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdad80039b0 0x7fdad8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:25.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.755+0000 7fdaeffff640 1 --2- 172.21.15.86:0/2191620034 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdaf00c7290 0x7fdad80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:25.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.756+0000 7fdaeeffd640 1 -- 172.21.15.86:0/2191620034 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdaf00c7290 msgr2=0x7fdad80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:25.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.756+0000 7fdaeeffd640 1 --2- 172.21.15.86:0/2191620034 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdaf00c7290 0x7fdad80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.756+0000 7fdaeeffd640 1 -- 172.21.15.86:0/2191620034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdad80039b0 msgr2=0x7fdad8003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:25.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.756+0000 7fdaeeffd640 1 --2- 172.21.15.86:0/2191620034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdad80039b0 0x7fdad8003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.756+0000 7fdaeeffd640 1 -- 172.21.15.86:0/2191620034 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdad8003520 con 0x7fdad8004800 2024-09-19T06:37:25.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.756+0000 7fdaeeffd640 1 --2- 172.21.15.86:0/2191620034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdad8004800 0x7fdad8004c80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdae4009ac0 tx=0x7fdad8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3020ec66c2aefc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:25.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.756+0000 7fdaee7fc640 1 -- 172.21.15.86:0/2191620034 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae4036070 con 0x7fdad8004800 2024-09-19T06:37:25.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.756+0000 7fdaee7fc640 1 -- 172.21.15.86:0/2191620034 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdae4031400 con 0x7fdad8004800 2024-09-19T06:37:25.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.756+0000 7fdaee7fc640 1 -- 172.21.15.86:0/2191620034 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae4009690 con 0x7fdad8004800 2024-09-19T06:37:25.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.757+0000 7fdaf60ba640 1 -- 172.21.15.86:0/2191620034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdad8004800 msgr2=0x7fdad8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:25.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.757+0000 7fdaf60ba640 1 --2- 172.21.15.86:0/2191620034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdad8004800 0x7fdad8004c80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdae4009ac0 tx=0x7fdad8005830 comp rx=0 tx=0).stop 2024-09-19T06:37:25.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.757+0000 7fdaeffff640 1 -- 172.21.15.86:0/2191620034 reap_dead start 2024-09-19T06:37:25.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.757+0000 7fdaf60ba640 1 -- 172.21.15.86:0/2191620034 shutdown_connections 2024-09-19T06:37:25.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.757+0000 7fdaf60ba640 1 -- 172.21.15.86:0/2191620034 >> 172.21.15.86:0/2191620034 conn(0x7fdaf00c9390 msgr2=0x7fdaf00c9770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:25.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.757+0000 7fdaf60ba640 1 -- 172.21.15.86:0/2191620034 shutdown_connections 2024-09-19T06:37:25.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.757+0000 7fdaf60ba640 1 -- 172.21.15.86:0/2191620034 wait complete. 2024-09-19T06:37:25.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.758+0000 7fdaf60ba640 1 Processor -- start 2024-09-19T06:37:25.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.758+0000 7fdaf60ba640 1 -- start start 2024-09-19T06:37:25.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.759+0000 7fdaf60ba640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdad8004800 0x7fdaf00ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:25.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.759+0000 7fdaf60ba640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdaf01ed6a0 0x7fdaf00ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:25.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.759+0000 7fdaf60ba640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdaf014af70 0x7fdaf0149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:25.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.759+0000 7fdaf60ba640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf015b660 con 0x7fdaf01ed6a0 2024-09-19T06:37:25.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.759+0000 7fdaf60ba640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf015b380 con 0x7fdaf014af70 2024-09-19T06:37:25.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.759+0000 7fdaf60ba640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fdaf015b940 con 0x7fdad8004800 2024-09-19T06:37:25.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.759+0000 7fdaeeffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdaf01ed6a0 0x7fdaf00ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:25.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.759+0000 7fdaeeffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdaf01ed6a0 0x7fdaf00ccef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39240/0 (socket says 172.21.15.86:39240) 2024-09-19T06:37:25.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.759+0000 7fdaeeffd640 1 -- 172.21.15.86:0/732689576 learned_addr learned my addr 172.21.15.86:0/732689576 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:25.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.759+0000 7fdaeffff640 1 --2- 172.21.15.86:0/732689576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdaf014af70 0x7fdaf0149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:25.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.759+0000 7fdaeeffd640 1 -- 172.21.15.86:0/732689576 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdad8004800 msgr2=0x7fdaf00ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:25.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.759+0000 7fdaeeffd640 1 --2- 172.21.15.86:0/732689576 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdad8004800 0x7fdaf00ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.759+0000 7fdaeeffd640 1 -- 172.21.15.86:0/732689576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdaf014af70 msgr2=0x7fdaf0149920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:25.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.759+0000 7fdaeeffd640 1 --2- 172.21.15.86:0/732689576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdaf014af70 0x7fdaf0149920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.759+0000 7fdaeeffd640 1 -- 172.21.15.86:0/732689576 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf00cc460 con 0x7fdaf01ed6a0 2024-09-19T06:37:25.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.760+0000 7fdaeeffd640 1 --2- 172.21.15.86:0/732689576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdaf01ed6a0 0x7fdaf00ccef0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdae4034040 tx=0x7fdae4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:25.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.760+0000 7fdad7fff640 1 -- 172.21.15.86:0/732689576 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae4040020 con 0x7fdaf01ed6a0 2024-09-19T06:37:25.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.760+0000 7fdad7fff640 1 -- 172.21.15.86:0/732689576 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdae4003b40 con 0x7fdaf01ed6a0 2024-09-19T06:37:25.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.760+0000 7fdad7fff640 1 -- 172.21.15.86:0/732689576 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae4036040 con 0x7fdaf01ed6a0 2024-09-19T06:37:25.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.760+0000 7fdaf60ba640 1 -- 172.21.15.86:0/732689576 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaf00cc740 con 0x7fdaf01ed6a0 2024-09-19T06:37:25.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.760+0000 7fdaf60ba640 1 -- 172.21.15.86:0/732689576 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaf01ecea0 con 0x7fdaf01ed6a0 2024-09-19T06:37:25.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.761+0000 7fdaf60ba640 1 -- 172.21.15.86:0/732689576 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaf01ec9b0 con 0x7fdaf01ed6a0 2024-09-19T06:37:25.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.761+0000 7fdad7fff640 1 -- 172.21.15.86:0/732689576 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdae4043020 con 0x7fdaf01ed6a0 2024-09-19T06:37:25.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.762+0000 7fdad7fff640 1 --2- 172.21.15.86:0/732689576 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fdadc06c2e0 0x7fdadc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:25.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.762+0000 7fdad7fff640 1 -- 172.21.15.86:0/732689576 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fdae40ab920 con 0x7fdaf01ed6a0 2024-09-19T06:37:25.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.762+0000 7fdaef7fe640 1 --2- 172.21.15.86:0/732689576 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fdadc06c2e0 0x7fdadc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:25.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.762+0000 7fdaef7fe640 1 --2- 172.21.15.86:0/732689576 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fdadc06c2e0 0x7fdadc06e7a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdae0001470 tx=0x7fdae0000f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:25.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.766+0000 7fdad7fff640 1 -- 172.21.15.86:0/732689576 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fdae404a070 con 0x7fdaf01ed6a0 2024-09-19T06:37:25.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:25.968+0000 7fdaf60ba640 1 -- 172.21.15.86:0/732689576 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fdaf00c3940 con 0x7fdaf01ed6a0 2024-09-19T06:37:26.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.497+0000 7fdad7fff640 1 -- 172.21.15.86:0/732689576 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fdae40044e0 con 0x7fdaf01ed6a0 2024-09-19T06:37:26.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.499+0000 7fdaf60ba640 1 -- 172.21.15.86:0/732689576 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fdadc06c2e0 msgr2=0x7fdadc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:26.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.499+0000 7fdaf60ba640 1 --2- 172.21.15.86:0/732689576 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fdadc06c2e0 0x7fdadc06e7a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdae0001470 tx=0x7fdae0000f90 comp rx=0 tx=0).stop 2024-09-19T06:37:26.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.499+0000 7fdaf60ba640 1 -- 172.21.15.86:0/732689576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdaf01ed6a0 msgr2=0x7fdaf00ccef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:26.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.499+0000 7fdaf60ba640 1 --2- 172.21.15.86:0/732689576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdaf01ed6a0 0x7fdaf00ccef0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdae4034040 tx=0x7fdae4004730 comp rx=0 tx=0).stop 2024-09-19T06:37:26.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.499+0000 7fdaf60ba640 1 -- 172.21.15.86:0/732689576 shutdown_connections 2024-09-19T06:37:26.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.499+0000 7fdaf60ba640 1 --2- 172.21.15.86:0/732689576 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fdadc06c2e0 0x7fdadc06e7a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:26.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.499+0000 7fdaf60ba640 1 --2- 172.21.15.86:0/732689576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdaf014af70 0x7fdaf0149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:26.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.499+0000 7fdaf60ba640 1 --2- 172.21.15.86:0/732689576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdaf01ed6a0 0x7fdaf00ccef0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:26.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.499+0000 7fdaf60ba640 1 --2- 172.21.15.86:0/732689576 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdad8004800 0x7fdaf00ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:26.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.499+0000 7fdaf60ba640 1 -- 172.21.15.86:0/732689576 >> 172.21.15.86:0/732689576 conn(0x7fdaf00c9390 msgr2=0x7fdaf0159990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:26.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.499+0000 7fdaf60ba640 1 -- 172.21.15.86:0/732689576 shutdown_connections 2024-09-19T06:37:26.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.499+0000 7fdaf60ba640 1 -- 172.21.15.86:0/732689576 wait complete. 2024-09-19T06:37:26.514 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300} 2024-09-19T06:37:26.515 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T06:37:26.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.621+0000 7f85115e4640 1 Processor -- start 2024-09-19T06:37:26.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.621+0000 7f85115e4640 1 -- start start 2024-09-19T06:37:26.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.622+0000 7f85115e4640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f850c15b0f0 0x7f850c0c7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:26.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.622+0000 7f85115e4640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f850c15b520 0x7f850c0cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:26.624 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.622+0000 7f85115e4640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f850c0c66e0 con 0x7f850c155330 2024-09-19T06:37:26.624 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.622+0000 7f85115e4640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f850c15ba10 con 0x7f850c15b520 2024-09-19T06:37:26.624 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.622+0000 7f85115e4640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f850c15bcf0 con 0x7f850c15b0f0 2024-09-19T06:37:26.624 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.622+0000 7f850b7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f850c15b520 0x7f850c0cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:26.624 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.622+0000 7f850b7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f850c15b520 0x7f850c0cba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39254/0 (socket says 172.21.15.86:39254) 2024-09-19T06:37:26.624 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.622+0000 7f850b7fe640 1 -- 172.21.15.86:0/3613720309 learned_addr learned my addr 172.21.15.86:0/3613720309 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:26.624 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.622+0000 7f850affd640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f850c155330 0x7f850c0c5de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39564/0 (socket says 172.21.15.86:39564) 2024-09-19T06:37:26.624 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.622+0000 7f850b7fe640 1 -- 172.21.15.86:0/3613720309 >> v2:172.21.15.169:3300/0 conn(0x7f850c15b0f0 msgr2=0x7f850c0c7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:26.624 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.622+0000 7f850b7fe640 1 --2- 172.21.15.86:0/3613720309 >> v2:172.21.15.169:3300/0 conn(0x7f850c15b0f0 0x7f850c0c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:26.624 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.622+0000 7f850b7fe640 1 -- 172.21.15.86:0/3613720309 >> v1:172.21.15.86:6789/0 conn(0x7f850c155330 legacy=0x7f850c0c5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:26.624 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.622+0000 7f850b7fe640 1 -- 172.21.15.86:0/3613720309 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850c0c6980 con 0x7f850c15b520 2024-09-19T06:37:26.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.623+0000 7f850b7fe640 1 --2- 172.21.15.86:0/3613720309 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f850c15b520 0x7f850c0cba30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f850c0d1c00 tx=0x7f850402a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1f5d5e37d91ad0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:26.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.623+0000 7f850a7fc640 1 -- 172.21.15.86:0/3613720309 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8504036070 con 0x7f850c15b520 2024-09-19T06:37:26.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.623+0000 7f850a7fc640 1 -- 172.21.15.86:0/3613720309 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8504031600 con 0x7f850c15b520 2024-09-19T06:37:26.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.623+0000 7f850a7fc640 1 -- 172.21.15.86:0/3613720309 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85040319f0 con 0x7f850c15b520 2024-09-19T06:37:26.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.623+0000 7f85115e4640 1 -- 172.21.15.86:0/3613720309 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f850c15b520 msgr2=0x7f850c0cba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:26.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.623+0000 7f85115e4640 1 --2- 172.21.15.86:0/3613720309 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f850c15b520 0x7f850c0cba30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f850c0d1c00 tx=0x7f850402a7c0 comp rx=0 tx=0).stop 2024-09-19T06:37:26.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.623+0000 7f85115e4640 1 -- 172.21.15.86:0/3613720309 shutdown_connections 2024-09-19T06:37:26.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.623+0000 7f85115e4640 1 --2- 172.21.15.86:0/3613720309 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f850c15b520 0x7f850c0cba30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:26.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.623+0000 7f85115e4640 1 --2- 172.21.15.86:0/3613720309 >> v2:172.21.15.169:3300/0 conn(0x7f850c15b0f0 0x7f850c0c7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:26.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.623+0000 7f85115e4640 1 -- 172.21.15.86:0/3613720309 >> 172.21.15.86:0/3613720309 conn(0x7f850c067890 msgr2=0x7f850c067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:26.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.623+0000 7f85115e4640 1 -- 172.21.15.86:0/3613720309 shutdown_connections 2024-09-19T06:37:26.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.624+0000 7f85115e4640 1 -- 172.21.15.86:0/3613720309 wait complete. 2024-09-19T06:37:26.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.625+0000 7f85115e4640 1 Processor -- start 2024-09-19T06:37:26.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.625+0000 7f85115e4640 1 -- start start 2024-09-19T06:37:26.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.625+0000 7f85115e4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f850c155330 0x7f850c1f43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:26.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.625+0000 7f85115e4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f850c15b0f0 0x7f850c0b6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:26.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.625+0000 7f85115e4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f850c15b520 0x7f850c153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:26.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.625+0000 7f85115e4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f850c0ccce0 con 0x7f850c155330 2024-09-19T06:37:26.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.625+0000 7f85115e4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f850c15bfd0 con 0x7f850c15b0f0 2024-09-19T06:37:26.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.625+0000 7f85115e4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f850c155710 con 0x7f850c15b520 2024-09-19T06:37:26.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.626+0000 7f850affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f850c155330 0x7f850c1f43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:26.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.626+0000 7f850affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f850c155330 0x7f850c1f43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39264/0 (socket says 172.21.15.86:39264) 2024-09-19T06:37:26.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.626+0000 7f850affd640 1 -- 172.21.15.86:0/820894401 learned_addr learned my addr 172.21.15.86:0/820894401 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:26.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.626+0000 7f85027fc640 1 --2- 172.21.15.86:0/820894401 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f850c15b0f0 0x7f850c0b6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:26.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.626+0000 7f850b7fe640 1 --2- 172.21.15.86:0/820894401 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f850c15b520 0x7f850c153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:26.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.626+0000 7f850affd640 1 -- 172.21.15.86:0/820894401 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f850c15b520 msgr2=0x7f850c153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:26.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.626+0000 7f850affd640 1 --2- 172.21.15.86:0/820894401 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f850c15b520 0x7f850c153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:26.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.626+0000 7f850affd640 1 -- 172.21.15.86:0/820894401 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f850c15b0f0 msgr2=0x7f850c0b6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:26.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.626+0000 7f850affd640 1 --2- 172.21.15.86:0/820894401 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f850c15b0f0 0x7f850c0b6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:26.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.626+0000 7f850affd640 1 -- 172.21.15.86:0/820894401 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850c1e1210 con 0x7f850c155330 2024-09-19T06:37:26.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.626+0000 7f850affd640 1 --2- 172.21.15.86:0/820894401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f850c155330 0x7f850c1f43b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f84fc00c430 tx=0x7f84fc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:26.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.626+0000 7f8503fff640 1 -- 172.21.15.86:0/820894401 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84fc0074e0 con 0x7f850c155330 2024-09-19T06:37:26.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.626+0000 7f8503fff640 1 -- 172.21.15.86:0/820894401 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84fc007680 con 0x7f850c155330 2024-09-19T06:37:26.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.626+0000 7f85115e4640 1 -- 172.21.15.86:0/820894401 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f850c1e14f0 con 0x7f850c155330 2024-09-19T06:37:26.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.626+0000 7f8503fff640 1 -- 172.21.15.86:0/820894401 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84fc004a00 con 0x7f850c155330 2024-09-19T06:37:26.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.626+0000 7f85115e4640 1 -- 172.21.15.86:0/820894401 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f850c0cff20 con 0x7f850c155330 2024-09-19T06:37:26.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.627+0000 7f85115e4640 1 -- 172.21.15.86:0/820894401 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f850c0c5de0 con 0x7f850c155330 2024-09-19T06:37:26.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.628+0000 7f8503fff640 1 -- 172.21.15.86:0/820894401 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f84fc01a020 con 0x7f850c155330 2024-09-19T06:37:26.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.628+0000 7f8503fff640 1 --2- 172.21.15.86:0/820894401 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f84ec06c2b0 0x7f84ec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:26.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.628+0000 7f8503fff640 1 -- 172.21.15.86:0/820894401 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f84fc08ae10 con 0x7f850c155330 2024-09-19T06:37:26.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.628+0000 7f85027fc640 1 --2- 172.21.15.86:0/820894401 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f84ec06c2b0 0x7f84ec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:26.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.629+0000 7f85027fc640 1 --2- 172.21.15.86:0/820894401 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f84ec06c2b0 0x7f84ec06e770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f850c067fc0 tx=0x7f84f4009110 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:26.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.633+0000 7f8503fff640 1 -- 172.21.15.86:0/820894401 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f84fc059240 con 0x7f850c155330 2024-09-19T06:37:26.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:26.835+0000 7f85115e4640 1 -- 172.21.15.86:0/820894401 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f850c0cc570 con 0x7f850c155330 2024-09-19T06:37:27.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.504+0000 7f8503fff640 1 -- 172.21.15.86:0/820894401 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f84fc058b40 con 0x7f850c155330 2024-09-19T06:37:27.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.506+0000 7f85115e4640 1 -- 172.21.15.86:0/820894401 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f84ec06c2b0 msgr2=0x7f84ec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:27.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.506+0000 7f85115e4640 1 --2- 172.21.15.86:0/820894401 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f84ec06c2b0 0x7f84ec06e770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f850c067fc0 tx=0x7f84f4009110 comp rx=0 tx=0).stop 2024-09-19T06:37:27.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.506+0000 7f85115e4640 1 -- 172.21.15.86:0/820894401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f850c155330 msgr2=0x7f850c1f43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:27.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.506+0000 7f85115e4640 1 --2- 172.21.15.86:0/820894401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f850c155330 0x7f850c1f43b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f84fc00c430 tx=0x7f84fc00c830 comp rx=0 tx=0).stop 2024-09-19T06:37:27.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.506+0000 7f85115e4640 1 -- 172.21.15.86:0/820894401 shutdown_connections 2024-09-19T06:37:27.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.506+0000 7f85115e4640 1 --2- 172.21.15.86:0/820894401 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f84ec06c2b0 0x7f84ec06e770 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:27.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.506+0000 7f85115e4640 1 --2- 172.21.15.86:0/820894401 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f850c15b520 0x7f850c153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:27.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.506+0000 7f85115e4640 1 --2- 172.21.15.86:0/820894401 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f850c15b0f0 0x7f850c0b6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:27.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.506+0000 7f85115e4640 1 --2- 172.21.15.86:0/820894401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f850c155330 0x7f850c1f43b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:27.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.506+0000 7f85115e4640 1 -- 172.21.15.86:0/820894401 >> 172.21.15.86:0/820894401 conn(0x7f850c067890 msgr2=0x7f850c06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:27.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.507+0000 7f85115e4640 1 -- 172.21.15.86:0/820894401 shutdown_connections 2024-09-19T06:37:27.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.507+0000 7f85115e4640 1 -- 172.21.15.86:0/820894401 wait complete. 2024-09-19T06:37:27.521 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-09-19T06:37:27.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.628+0000 7fc8abffd640 1 Processor -- start 2024-09-19T06:37:27.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.629+0000 7fc8abffd640 1 -- start start 2024-09-19T06:37:27.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.629+0000 7fc8abffd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc8a40ca4d0 0x7fc8a40c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:27.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.629+0000 7fc8abffd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc8a415be10 0x7fc8a40c7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:27.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.629+0000 7fc8abffd640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8a415b220 con 0x7fc8a40ca8b0 2024-09-19T06:37:27.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.629+0000 7fc8abffd640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fc8a406bee0 con 0x7fc8a40ca4d0 2024-09-19T06:37:27.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.629+0000 7fc8abffd640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fc8a406c1c0 con 0x7fc8a415be10 2024-09-19T06:37:27.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.630+0000 7fc8a9d99640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc8a40ca4d0 0x7fc8a40c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:27.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.630+0000 7fc8a9d99640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc8a40ca4d0 0x7fc8a40c99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39272/0 (socket says 172.21.15.86:39272) 2024-09-19T06:37:27.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.630+0000 7fc8a9598640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc8a40ca8b0 0x7fc8a415b700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39580/0 (socket says 172.21.15.86:39580) 2024-09-19T06:37:27.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.630+0000 7fc8a9d99640 1 -- 172.21.15.86:0/2934630812 learned_addr learned my addr 172.21.15.86:0/2934630812 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:27.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.630+0000 7fc8aa59a640 1 --2- 172.21.15.86:0/2934630812 >> v2:172.21.15.169:3300/0 conn(0x7fc8a415be10 0x7fc8a40c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:27.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.630+0000 7fc8a9d99640 1 -- 172.21.15.86:0/2934630812 >> v2:172.21.15.169:3300/0 conn(0x7fc8a415be10 msgr2=0x7fc8a40c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:27.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.630+0000 7fc8a9d99640 1 --2- 172.21.15.86:0/2934630812 >> v2:172.21.15.169:3300/0 conn(0x7fc8a415be10 0x7fc8a40c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:27.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.630+0000 7fc8a9d99640 1 -- 172.21.15.86:0/2934630812 >> v1:172.21.15.86:6789/0 conn(0x7fc8a40ca8b0 legacy=0x7fc8a415b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:27.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.630+0000 7fc8a9d99640 1 -- 172.21.15.86:0/2934630812 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a406c4a0 con 0x7fc8a40ca4d0 2024-09-19T06:37:27.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.630+0000 7fc8a8d97640 1 -- 172.21.15.86:0/2934630812 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1722819031 0 0) 0x7fc8a415b220 con 0x7fc8a40ca8b0 2024-09-19T06:37:27.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.631+0000 7fc8a9d99640 1 --2- 172.21.15.86:0/2934630812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8a40ca4d0 0x7fc8a40c99c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4144ac0 tx=0x7fc8a002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1dcda214d78a3c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:27.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.631+0000 7fc8a8d97640 1 -- 172.21.15.86:0/2934630812 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0037070 con 0x7fc8a40ca4d0 2024-09-19T06:37:27.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.631+0000 7fc8a8d97640 1 -- 172.21.15.86:0/2934630812 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a002ae50 con 0x7fc8a40ca4d0 2024-09-19T06:37:27.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.631+0000 7fc8a8d97640 1 -- 172.21.15.86:0/2934630812 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0032860 con 0x7fc8a40ca4d0 2024-09-19T06:37:27.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.631+0000 7fc8abffd640 1 -- 172.21.15.86:0/2934630812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8a40ca4d0 msgr2=0x7fc8a40c99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:27.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.631+0000 7fc8abffd640 1 --2- 172.21.15.86:0/2934630812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8a40ca4d0 0x7fc8a40c99c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4144ac0 tx=0x7fc8a002a300 comp rx=0 tx=0).stop 2024-09-19T06:37:27.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.631+0000 7fc8abffd640 1 -- 172.21.15.86:0/2934630812 shutdown_connections 2024-09-19T06:37:27.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.631+0000 7fc8abffd640 1 --2- 172.21.15.86:0/2934630812 >> v2:172.21.15.169:3300/0 conn(0x7fc8a415be10 0x7fc8a40c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:27.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.631+0000 7fc8abffd640 1 --2- 172.21.15.86:0/2934630812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8a40ca4d0 0x7fc8a40c99c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:27.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.631+0000 7fc8abffd640 1 -- 172.21.15.86:0/2934630812 >> 172.21.15.86:0/2934630812 conn(0x7fc8a406fb80 msgr2=0x7fc8a406ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:27.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.631+0000 7fc8abffd640 1 -- 172.21.15.86:0/2934630812 shutdown_connections 2024-09-19T06:37:27.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.631+0000 7fc8abffd640 1 -- 172.21.15.86:0/2934630812 wait complete. 2024-09-19T06:37:27.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.633+0000 7fc8abffd640 1 Processor -- start 2024-09-19T06:37:27.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.633+0000 7fc8abffd640 1 -- start start 2024-09-19T06:37:27.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.633+0000 7fc8abffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8a40ca4d0 0x7fc8a41e4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:27.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.633+0000 7fc8abffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8a40ca8b0 0x7fc8a41e5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:27.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.634+0000 7fc8abffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8a415be10 0x7fc8a41e1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:27.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.634+0000 7fc8abffd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a406ca60 con 0x7fc8a415be10 2024-09-19T06:37:27.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.634+0000 7fc8abffd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a406bbc0 con 0x7fc8a40ca8b0 2024-09-19T06:37:27.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.634+0000 7fc8abffd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc8a406cbe0 con 0x7fc8a40ca4d0 2024-09-19T06:37:27.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.634+0000 7fc8aa59a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8a415be10 0x7fc8a41e1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:27.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.634+0000 7fc8aa59a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8a415be10 0x7fc8a41e1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39284/0 (socket says 172.21.15.86:39284) 2024-09-19T06:37:27.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.634+0000 7fc8aa59a640 1 -- 172.21.15.86:0/1532275407 learned_addr learned my addr 172.21.15.86:0/1532275407 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:27.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.634+0000 7fc8a9598640 1 --2- 172.21.15.86:0/1532275407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8a40ca8b0 0x7fc8a41e5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:27.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.634+0000 7fc8a9d99640 1 --2- 172.21.15.86:0/1532275407 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8a40ca4d0 0x7fc8a41e4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:27.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.634+0000 7fc8aa59a640 1 -- 172.21.15.86:0/1532275407 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8a40ca4d0 msgr2=0x7fc8a41e4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:27.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.634+0000 7fc8aa59a640 1 --2- 172.21.15.86:0/1532275407 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8a40ca4d0 0x7fc8a41e4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:27.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.634+0000 7fc8aa59a640 1 -- 172.21.15.86:0/1532275407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8a40ca8b0 msgr2=0x7fc8a41e5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:27.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.634+0000 7fc8aa59a640 1 --2- 172.21.15.86:0/1532275407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8a40ca8b0 0x7fc8a41e5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:27.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.634+0000 7fc8aa59a640 1 -- 172.21.15.86:0/1532275407 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a41f1610 con 0x7fc8a415be10 2024-09-19T06:37:27.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.634+0000 7fc8aa59a640 1 --2- 172.21.15.86:0/1532275407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8a415be10 0x7fc8a41e1660 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc89c007ca0 tx=0x7fc89c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:27.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.634+0000 7fc8967fc640 1 -- 172.21.15.86:0/1532275407 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c014420 con 0x7fc8a415be10 2024-09-19T06:37:27.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.634+0000 7fc8967fc640 1 -- 172.21.15.86:0/1532275407 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc89c019070 con 0x7fc8a415be10 2024-09-19T06:37:27.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.634+0000 7fc8abffd640 1 -- 172.21.15.86:0/1532275407 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8a41e23e0 con 0x7fc8a415be10 2024-09-19T06:37:27.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.634+0000 7fc8967fc640 1 -- 172.21.15.86:0/1532275407 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c014800 con 0x7fc8a415be10 2024-09-19T06:37:27.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.634+0000 7fc8abffd640 1 -- 172.21.15.86:0/1532275407 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8a41e2960 con 0x7fc8a415be10 2024-09-19T06:37:27.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.635+0000 7fc8abffd640 1 -- 172.21.15.86:0/1532275407 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8a41e6eb0 con 0x7fc8a415be10 2024-09-19T06:37:27.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.636+0000 7fc8967fc640 1 -- 172.21.15.86:0/1532275407 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc89c0149a0 con 0x7fc8a415be10 2024-09-19T06:37:27.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.636+0000 7fc8967fc640 1 --2- 172.21.15.86:0/1532275407 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc88806c2b0 0x7fc88806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:27.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.636+0000 7fc8a9d99640 1 --2- 172.21.15.86:0/1532275407 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc88806c2b0 0x7fc88806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:27.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.636+0000 7fc8967fc640 1 -- 172.21.15.86:0/1532275407 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc89c08bd50 con 0x7fc8a415be10 2024-09-19T06:37:27.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.637+0000 7fc8a9d99640 1 --2- 172.21.15.86:0/1532275407 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc88806c2b0 0x7fc88806e770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0034000 tx=0x7fc8a002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:27.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.640+0000 7fc8967fc640 1 -- 172.21.15.86:0/1532275407 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc89c08f030 con 0x7fc8a415be10 2024-09-19T06:37:27.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:27.841+0000 7fc8abffd640 1 -- 172.21.15.86:0/1532275407 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fc8a41f18b0 con 0x7fc8a415be10 2024-09-19T06:37:28.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.509+0000 7fc8967fc640 1 -- 172.21.15.86:0/1532275407 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v9) ==== 115+0+0 (secure 0 0 0) 0x7fc89c059b30 con 0x7fc8a415be10 2024-09-19T06:37:28.513 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.511+0000 7fc8abffd640 1 -- 172.21.15.86:0/1532275407 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc88806c2b0 msgr2=0x7fc88806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:28.513 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.511+0000 7fc8abffd640 1 --2- 172.21.15.86:0/1532275407 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc88806c2b0 0x7fc88806e770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0034000 tx=0x7fc8a002e000 comp rx=0 tx=0).stop 2024-09-19T06:37:28.513 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.511+0000 7fc8abffd640 1 -- 172.21.15.86:0/1532275407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8a415be10 msgr2=0x7fc8a41e1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:28.514 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.511+0000 7fc8abffd640 1 --2- 172.21.15.86:0/1532275407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8a415be10 0x7fc8a41e1660 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc89c007ca0 tx=0x7fc89c00e4b0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.514 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.512+0000 7fc8abffd640 1 -- 172.21.15.86:0/1532275407 shutdown_connections 2024-09-19T06:37:28.514 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.512+0000 7fc8abffd640 1 --2- 172.21.15.86:0/1532275407 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc88806c2b0 0x7fc88806e770 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.514 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.512+0000 7fc8abffd640 1 --2- 172.21.15.86:0/1532275407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8a415be10 0x7fc8a41e1660 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.514 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.512+0000 7fc8abffd640 1 --2- 172.21.15.86:0/1532275407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8a40ca8b0 0x7fc8a41e5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.514 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.512+0000 7fc8abffd640 1 --2- 172.21.15.86:0/1532275407 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8a40ca4d0 0x7fc8a41e4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.514 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.512+0000 7fc8abffd640 1 -- 172.21.15.86:0/1532275407 >> 172.21.15.86:0/1532275407 conn(0x7fc8a406fb80 msgr2=0x7fc8a40c80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:28.514 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.512+0000 7fc8abffd640 1 -- 172.21.15.86:0/1532275407 shutdown_connections 2024-09-19T06:37:28.514 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.512+0000 7fc8abffd640 1 -- 172.21.15.86:0/1532275407 wait complete. 2024-09-19T06:37:28.524 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T06:37:28.525 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:37:28.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.622+0000 7f32f3a8d640 1 Processor -- start 2024-09-19T06:37:28.624 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.622+0000 7f32f3a8d640 1 -- start start 2024-09-19T06:37:28.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.623+0000 7f32f3a8d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f32ec155170 0x7f32ec0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:28.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.623+0000 7f32f3a8d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32ec06d160 0x7f32ec06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:28.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.623+0000 7f32f3a8d640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32ec15b0b0 con 0x7f32ec073240 2024-09-19T06:37:28.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.623+0000 7f32f3a8d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f32ec06ccd0 con 0x7f32ec155170 2024-09-19T06:37:28.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.623+0000 7f32f3a8d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f32ec06daf0 con 0x7f32ec06d160 2024-09-19T06:37:28.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.623+0000 7f32f202a640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f32ec073240 0x7f32ec073650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39586/0 (socket says 172.21.15.86:39586) 2024-09-19T06:37:28.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.623+0000 7f32f202a640 1 -- 172.21.15.86:0/1047760853 learned_addr learned my addr 172.21.15.86:0/1047760853 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:28.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.623+0000 7f32f1829640 1 --2- 172.21.15.86:0/1047760853 >> v2:172.21.15.169:3300/0 conn(0x7f32ec155170 0x7f32ec0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:28.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.623+0000 7f32f0827640 1 -- 172.21.15.86:0/1047760853 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4006906521 0 0) 0x7f32ec15b0b0 con 0x7f32ec073240 2024-09-19T06:37:28.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.623+0000 7f32f0827640 1 -- 172.21.15.86:0/1047760853 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32d4003520 con 0x7f32ec073240 2024-09-19T06:37:28.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.623+0000 7f32f1028640 1 --2- 172.21.15.86:0/1047760853 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32ec06d160 0x7f32ec06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:28.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.624+0000 7f32f0827640 1 -- 172.21.15.86:0/1047760853 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1468565023 0 0) 0x7f32d4003520 con 0x7f32ec073240 2024-09-19T06:37:28.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.624+0000 7f32f0827640 1 -- 172.21.15.86:0/1047760853 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32ec06d160 msgr2=0x7f32ec06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:28.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.624+0000 7f32f0827640 1 --2- 172.21.15.86:0/1047760853 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32ec06d160 0x7f32ec06d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.624+0000 7f32f0827640 1 -- 172.21.15.86:0/1047760853 >> v2:172.21.15.169:3300/0 conn(0x7f32ec155170 msgr2=0x7f32ec0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:28.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.624+0000 7f32f0827640 1 --2- 172.21.15.86:0/1047760853 >> v2:172.21.15.169:3300/0 conn(0x7f32ec155170 0x7f32ec0cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.624+0000 7f32f0827640 1 -- 172.21.15.86:0/1047760853 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ec155550 con 0x7f32ec073240 2024-09-19T06:37:28.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.624+0000 7f32f0827640 1 -- 172.21.15.86:0/1047760853 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f32e4001670 con 0x7f32ec073240 2024-09-19T06:37:28.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.624+0000 7f32f0827640 1 -- 172.21.15.86:0/1047760853 >> v1:172.21.15.86:6789/0 conn(0x7f32ec073240 legacy=0x7f32ec073650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:28.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.624+0000 7f32f0827640 1 --2- 172.21.15.86:0/1047760853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32d40039b0 0x7f32d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:28.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.624+0000 7f32f0827640 1 --2- 172.21.15.86:0/1047760853 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32ec06d160 0x7f32d4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:28.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.624+0000 7f32f0827640 1 --2- 172.21.15.86:0/1047760853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32d4004d40 0x7f32d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:28.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.624+0000 7f32f0827640 1 -- 172.21.15.86:0/1047760853 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec06ccd0 con 0x7f32d4004d40 2024-09-19T06:37:28.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.624+0000 7f32f0827640 1 -- 172.21.15.86:0/1047760853 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec06daf0 con 0x7f32d40039b0 2024-09-19T06:37:28.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.624+0000 7f32f0827640 1 -- 172.21.15.86:0/1047760853 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f32d400b9c0 con 0x7f32ec06d160 2024-09-19T06:37:28.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.624+0000 7f32f1829640 1 --2- 172.21.15.86:0/1047760853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32d40039b0 0x7f32d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:28.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.624+0000 7f32f202a640 1 --2- 172.21.15.86:0/1047760853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32d4004d40 0x7f32d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:28.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.624+0000 7f32f1028640 1 --2- 172.21.15.86:0/1047760853 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32ec06d160 0x7f32d4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:28.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.624+0000 7f32f202a640 1 -- 172.21.15.86:0/1047760853 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32ec06d160 msgr2=0x7f32d4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:28.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.624+0000 7f32f202a640 1 --2- 172.21.15.86:0/1047760853 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32ec06d160 0x7f32d4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.624+0000 7f32f202a640 1 -- 172.21.15.86:0/1047760853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32d40039b0 msgr2=0x7f32d4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:28.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.624+0000 7f32f202a640 1 --2- 172.21.15.86:0/1047760853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32d40039b0 0x7f32d4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.624+0000 7f32f202a640 1 -- 172.21.15.86:0/1047760853 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d4003520 con 0x7f32d4004d40 2024-09-19T06:37:28.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.625+0000 7f32f202a640 1 --2- 172.21.15.86:0/1047760853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32d4004d40 0x7f32d40051c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f32e4001050 tx=0x7f32d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b908e016073ed359 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:28.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.625+0000 7f32f0827640 1 -- 172.21.15.86:0/1047760853 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e402e070 con 0x7f32d4004d40 2024-09-19T06:37:28.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.625+0000 7f32f0827640 1 -- 172.21.15.86:0/1047760853 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e4005af0 con 0x7f32d4004d40 2024-09-19T06:37:28.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.625+0000 7f32f0827640 1 -- 172.21.15.86:0/1047760853 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e4007d70 con 0x7f32d4004d40 2024-09-19T06:37:28.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.625+0000 7f32f3a8d640 1 -- 172.21.15.86:0/1047760853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32d4004d40 msgr2=0x7f32d40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:28.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.626+0000 7f32f3a8d640 1 --2- 172.21.15.86:0/1047760853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32d4004d40 0x7f32d40051c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f32e4001050 tx=0x7f32d4005830 comp rx=0 tx=0).stop 2024-09-19T06:37:28.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.626+0000 7f32f202a640 1 -- 172.21.15.86:0/1047760853 reap_dead start 2024-09-19T06:37:28.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.626+0000 7f32f3a8d640 1 -- 172.21.15.86:0/1047760853 shutdown_connections 2024-09-19T06:37:28.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.626+0000 7f32f3a8d640 1 -- 172.21.15.86:0/1047760853 >> 172.21.15.86:0/1047760853 conn(0x7f32ec0cebf0 msgr2=0x7f32ec0cf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:28.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.626+0000 7f32f3a8d640 1 -- 172.21.15.86:0/1047760853 shutdown_connections 2024-09-19T06:37:28.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.626+0000 7f32f3a8d640 1 -- 172.21.15.86:0/1047760853 wait complete. 2024-09-19T06:37:28.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.627+0000 7f32f3a8d640 1 Processor -- start 2024-09-19T06:37:28.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.627+0000 7f32f3a8d640 1 -- start start 2024-09-19T06:37:28.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.627+0000 7f32f3a8d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32d4004d40 0x7f32ec0c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:28.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.627+0000 7f32f3a8d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32ec0c6b30 0x7f32ec159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:28.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.627+0000 7f32f3a8d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32ec159e70 0x7f32ec0cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:28.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.628+0000 7f32f3a8d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec15b8f0 con 0x7f32d4004d40 2024-09-19T06:37:28.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.628+0000 7f32f3a8d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec15b610 con 0x7f32ec0c6b30 2024-09-19T06:37:28.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.628+0000 7f32f3a8d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f32ec15bbd0 con 0x7f32ec159e70 2024-09-19T06:37:28.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.628+0000 7f32f1829640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32d4004d40 0x7f32ec0c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:28.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.628+0000 7f32f1829640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32d4004d40 0x7f32ec0c65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39300/0 (socket says 172.21.15.86:39300) 2024-09-19T06:37:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.628+0000 7f32f1829640 1 -- 172.21.15.86:0/817710054 learned_addr learned my addr 172.21.15.86:0/817710054 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.628+0000 7f32f202a640 1 --2- 172.21.15.86:0/817710054 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32ec159e70 0x7f32ec0cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.628+0000 7f32f1028640 1 --2- 172.21.15.86:0/817710054 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32ec0c6b30 0x7f32ec159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.628+0000 7f32f1829640 1 -- 172.21.15.86:0/817710054 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32ec159e70 msgr2=0x7f32ec0cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.628+0000 7f32f1829640 1 --2- 172.21.15.86:0/817710054 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32ec159e70 0x7f32ec0cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.628+0000 7f32f1829640 1 -- 172.21.15.86:0/817710054 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32ec0c6b30 msgr2=0x7f32ec159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.628+0000 7f32f1829640 1 --2- 172.21.15.86:0/817710054 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32ec0c6b30 0x7f32ec159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.628+0000 7f32f1829640 1 -- 172.21.15.86:0/817710054 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ec0c80d0 con 0x7f32d4004d40 2024-09-19T06:37:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.628+0000 7f32f1829640 1 --2- 172.21.15.86:0/817710054 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32d4004d40 0x7f32ec0c65f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009f90 tx=0x7f32dc00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.628+0000 7f32ea7fc640 1 -- 172.21.15.86:0/817710054 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc00fea0 con 0x7f32d4004d40 2024-09-19T06:37:28.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.628+0000 7f32ea7fc640 1 -- 172.21.15.86:0/817710054 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32dc015630 con 0x7f32d4004d40 2024-09-19T06:37:28.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.628+0000 7f32f3a8d640 1 -- 172.21.15.86:0/817710054 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32ec14d4a0 con 0x7f32d4004d40 2024-09-19T06:37:28.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.628+0000 7f32ea7fc640 1 -- 172.21.15.86:0/817710054 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc015a20 con 0x7f32d4004d40 2024-09-19T06:37:28.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.628+0000 7f32f3a8d640 1 -- 172.21.15.86:0/817710054 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32ec1593f0 con 0x7f32d4004d40 2024-09-19T06:37:28.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.629+0000 7f32f3a8d640 1 -- 172.21.15.86:0/817710054 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32ec15beb0 con 0x7f32d4004d40 2024-09-19T06:37:28.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.630+0000 7f32ea7fc640 1 -- 172.21.15.86:0/817710054 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f32dc015bc0 con 0x7f32d4004d40 2024-09-19T06:37:28.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.630+0000 7f32ea7fc640 1 --2- 172.21.15.86:0/817710054 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f32d806c2e0 0x7f32d806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:28.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.630+0000 7f32ea7fc640 1 -- 172.21.15.86:0/817710054 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f32dc08c910 con 0x7f32d4004d40 2024-09-19T06:37:28.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.630+0000 7f32f1028640 1 --2- 172.21.15.86:0/817710054 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f32d806c2e0 0x7f32d806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:28.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.630+0000 7f32f1028640 1 --2- 172.21.15.86:0/817710054 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f32d806c2e0 0x7f32d806e7a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f32ec150260 tx=0x7f32e0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:28.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.634+0000 7f32ea7fc640 1 -- 172.21.15.86:0/817710054 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f32dc019030 con 0x7f32d4004d40 2024-09-19T06:37:28.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.835+0000 7f32f3a8d640 1 -- 172.21.15.86:0/817710054 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32ec159710 con 0x7f32d4004d40 2024-09-19T06:37:28.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.836+0000 7f32ea7fc640 1 -- 172.21.15.86:0/817710054 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6871 (secure 0 0 0) 0x7f32dc010040 con 0x7f32d4004d40 2024-09-19T06:37:28.838 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:28.838 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":9,"btime":"2024-09-19T06:37:28:505383+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:37:27.843067+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6837/201961024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":201961024},{"type":"v1","addr":"172.21.15.169:6837","nonce":201961024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-09-19T06:37:28.838 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 9 2024-09-19T06:37:28.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.838+0000 7f32f3a8d640 1 -- 172.21.15.86:0/817710054 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f32d806c2e0 msgr2=0x7f32d806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:28.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.838+0000 7f32f3a8d640 1 --2- 172.21.15.86:0/817710054 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f32d806c2e0 0x7f32d806e7a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f32ec150260 tx=0x7f32e0009190 comp rx=0 tx=0).stop 2024-09-19T06:37:28.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.838+0000 7f32f3a8d640 1 -- 172.21.15.86:0/817710054 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32d4004d40 msgr2=0x7f32ec0c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:28.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.838+0000 7f32f3a8d640 1 --2- 172.21.15.86:0/817710054 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32d4004d40 0x7f32ec0c65f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009f90 tx=0x7f32dc00f580 comp rx=0 tx=0).stop 2024-09-19T06:37:28.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.838+0000 7f32f3a8d640 1 -- 172.21.15.86:0/817710054 shutdown_connections 2024-09-19T06:37:28.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.838+0000 7f32f3a8d640 1 --2- 172.21.15.86:0/817710054 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f32d806c2e0 0x7f32d806e7a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.838+0000 7f32f3a8d640 1 --2- 172.21.15.86:0/817710054 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32ec159e70 0x7f32ec0cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.838+0000 7f32f3a8d640 1 --2- 172.21.15.86:0/817710054 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32ec0c6b30 0x7f32ec159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.838+0000 7f32f3a8d640 1 --2- 172.21.15.86:0/817710054 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32d4004d40 0x7f32ec0c65f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.838+0000 7f32f3a8d640 1 -- 172.21.15.86:0/817710054 >> 172.21.15.86:0/817710054 conn(0x7f32ec0cebf0 msgr2=0x7f32ec0cf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:28.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.838+0000 7f32f3a8d640 1 -- 172.21.15.86:0/817710054 shutdown_connections 2024-09-19T06:37:28.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.838+0000 7f32f3a8d640 1 -- 172.21.15.86:0/817710054 wait complete. 2024-09-19T06:37:28.851 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T06:37:28.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.949+0000 7ff492c8b640 1 Processor -- start 2024-09-19T06:37:28.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.949+0000 7ff492c8b640 1 -- start start 2024-09-19T06:37:28.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.950+0000 7ff492c8b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff48c0cb660 0x7ff48c0cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:28.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.950+0000 7ff492c8b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff48c0c6df0 0x7ff48c15e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:28.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.950+0000 7ff492c8b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff48c0ccb90 con 0x7ff48c0cba40 2024-09-19T06:37:28.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.950+0000 7ff492c8b640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7ff48c0cce20 con 0x7ff48c0cb660 2024-09-19T06:37:28.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.950+0000 7ff492c8b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff48c0cd100 con 0x7ff48c0c6df0 2024-09-19T06:37:28.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.950+0000 7ff490a27640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff48c0cb660 0x7ff48c0cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:28.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.950+0000 7ff490a27640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff48c0cb660 0x7ff48c0cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39312/0 (socket says 172.21.15.86:39312) 2024-09-19T06:37:28.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.950+0000 7ff490a27640 1 -- 172.21.15.86:0/3225768248 learned_addr learned my addr 172.21.15.86:0/3225768248 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:28.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.950+0000 7ff483fff640 1 --2- 172.21.15.86:0/3225768248 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff48c0c6df0 0x7ff48c15e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:28.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.950+0000 7ff490a27640 1 -- 172.21.15.86:0/3225768248 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff48c0c6df0 msgr2=0x7ff48c15e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:28.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.950+0000 7ff490a27640 1 --2- 172.21.15.86:0/3225768248 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff48c0c6df0 0x7ff48c15e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.950+0000 7ff490a27640 1 -- 172.21.15.86:0/3225768248 >> v1:172.21.15.169:6789/0 conn(0x7ff48c0cba40 legacy=0x7ff48c158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:28.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.950+0000 7ff490a27640 1 -- 172.21.15.86:0/3225768248 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48c0c6310 con 0x7ff48c0cb660 2024-09-19T06:37:28.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.951+0000 7ff490a27640 1 --2- 172.21.15.86:0/3225768248 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff48c0cb660 0x7ff48c0cc650 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff488009e50 tx=0x7ff48802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b800ae3b8c958b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:28.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.951+0000 7ff4837fe640 1 -- 172.21.15.86:0/3225768248 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff488036070 con 0x7ff48c0cb660 2024-09-19T06:37:28.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.951+0000 7ff4837fe640 1 -- 172.21.15.86:0/3225768248 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff488031600 con 0x7ff48c0cb660 2024-09-19T06:37:28.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.951+0000 7ff4837fe640 1 -- 172.21.15.86:0/3225768248 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4880319d0 con 0x7ff48c0cb660 2024-09-19T06:37:28.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.951+0000 7ff492c8b640 1 -- 172.21.15.86:0/3225768248 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff48c0cb660 msgr2=0x7ff48c0cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:28.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.951+0000 7ff492c8b640 1 --2- 172.21.15.86:0/3225768248 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff48c0cb660 0x7ff48c0cc650 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff488009e50 tx=0x7ff48802a6c0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.951+0000 7ff492c8b640 1 -- 172.21.15.86:0/3225768248 shutdown_connections 2024-09-19T06:37:28.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.951+0000 7ff492c8b640 1 --2- 172.21.15.86:0/3225768248 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff48c0c6df0 0x7ff48c15e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.951+0000 7ff492c8b640 1 --2- 172.21.15.86:0/3225768248 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff48c0cb660 0x7ff48c0cc650 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.951+0000 7ff492c8b640 1 -- 172.21.15.86:0/3225768248 >> 172.21.15.86:0/3225768248 conn(0x7ff48c06bcc0 msgr2=0x7ff48c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:28.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.951+0000 7ff492c8b640 1 -- 172.21.15.86:0/3225768248 shutdown_connections 2024-09-19T06:37:28.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.951+0000 7ff492c8b640 1 -- 172.21.15.86:0/3225768248 wait complete. 2024-09-19T06:37:28.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.953+0000 7ff492c8b640 1 Processor -- start 2024-09-19T06:37:28.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.953+0000 7ff492c8b640 1 -- start start 2024-09-19T06:37:28.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.953+0000 7ff492c8b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff48c0c6df0 0x7ff48c14ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:28.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.953+0000 7ff492c8b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff48c0cb660 0x7ff48c1f1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:28.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.953+0000 7ff492c8b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff48c0cba40 0x7ff48c15b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:28.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.953+0000 7ff492c8b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c0c7e70 con 0x7ff48c0cb660 2024-09-19T06:37:28.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.953+0000 7ff492c8b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c0c68d0 con 0x7ff48c0cba40 2024-09-19T06:37:28.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.953+0000 7ff492c8b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff48c15ee00 con 0x7ff48c0c6df0 2024-09-19T06:37:28.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.954+0000 7ff483fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff48c0cb660 0x7ff48c1f1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:28.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.954+0000 7ff483fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff48c0cb660 0x7ff48c1f1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39320/0 (socket says 172.21.15.86:39320) 2024-09-19T06:37:28.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.954+0000 7ff483fff640 1 -- 172.21.15.86:0/340190516 learned_addr learned my addr 172.21.15.86:0/340190516 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:28.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.954+0000 7ff490a27640 1 --2- 172.21.15.86:0/340190516 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff48c0c6df0 0x7ff48c14ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:28.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.954+0000 7ff491228640 1 --2- 172.21.15.86:0/340190516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff48c0cba40 0x7ff48c15b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:28.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.954+0000 7ff483fff640 1 -- 172.21.15.86:0/340190516 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff48c0c6df0 msgr2=0x7ff48c14ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:28.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.954+0000 7ff483fff640 1 --2- 172.21.15.86:0/340190516 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff48c0c6df0 0x7ff48c14ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.954+0000 7ff483fff640 1 -- 172.21.15.86:0/340190516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff48c0cba40 msgr2=0x7ff48c15b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:28.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.954+0000 7ff483fff640 1 --2- 172.21.15.86:0/340190516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff48c0cba40 0x7ff48c15b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.954+0000 7ff483fff640 1 -- 172.21.15.86:0/340190516 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48c0cc2c0 con 0x7ff48c0cb660 2024-09-19T06:37:28.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.954+0000 7ff483fff640 1 --2- 172.21.15.86:0/340190516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff48c0cb660 0x7ff48c1f1520 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00d620 tx=0x7ff47c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:28.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.954+0000 7ff4817fa640 1 -- 172.21.15.86:0/340190516 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff47c00b620 con 0x7ff48c0cb660 2024-09-19T06:37:28.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.954+0000 7ff4817fa640 1 -- 172.21.15.86:0/340190516 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff47c019070 con 0x7ff48c0cb660 2024-09-19T06:37:28.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.954+0000 7ff492c8b640 1 -- 172.21.15.86:0/340190516 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff48c0cc5a0 con 0x7ff48c0cb660 2024-09-19T06:37:28.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.954+0000 7ff4817fa640 1 -- 172.21.15.86:0/340190516 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff47c00ba00 con 0x7ff48c0cb660 2024-09-19T06:37:28.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.954+0000 7ff492c8b640 1 -- 172.21.15.86:0/340190516 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff48c15a4f0 con 0x7ff48c0cb660 2024-09-19T06:37:28.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.955+0000 7ff492c8b640 1 -- 172.21.15.86:0/340190516 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff48c15a000 con 0x7ff48c0cb660 2024-09-19T06:37:28.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.956+0000 7ff4817fa640 1 -- 172.21.15.86:0/340190516 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff47c00bba0 con 0x7ff48c0cb660 2024-09-19T06:37:28.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.956+0000 7ff4817fa640 1 --2- 172.21.15.86:0/340190516 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff47806c2b0 0x7ff47806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:28.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.956+0000 7ff4817fa640 1 -- 172.21.15.86:0/340190516 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff47c08bb10 con 0x7ff48c0cb660 2024-09-19T06:37:28.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.956+0000 7ff490a27640 1 --2- 172.21.15.86:0/340190516 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff47806c2b0 0x7ff47806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:28.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.957+0000 7ff490a27640 1 --2- 172.21.15.86:0/340190516 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff47806c2b0 0x7ff47806e770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff488033000 tx=0x7ff488009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:28.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:28.960+0000 7ff4817fa640 1 -- 172.21.15.86:0/340190516 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff47c0597e0 con 0x7ff48c0cb660 2024-09-19T06:37:29.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.126+0000 7ff492c8b640 1 -- 172.21.15.86:0/340190516 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff48c0c58f0 con 0x7ff48c0cb660 2024-09-19T06:37:29.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.127+0000 7ff4817fa640 1 -- 172.21.15.86:0/340190516 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18586 (secure 0 0 0) 0x7ff47c05dae0 con 0x7ff48c0cb660 2024-09-19T06:37:29.128 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:29.129 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":26,"fsid":"1785f09f-0959-457d-8c4a-6cce2e655a37","created":"2024-09-19T06:36:45.671544+0000","modified":"2024-09-19T06:37:13.796252+0000","last_up_change":"2024-09-19T06:36:56.765680+0000","last_in_change":"2024-09-19T06:36:47.816681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:36:57.770634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:37:06.588120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:37:07.739726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T06:37:11.457476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bd3ce3f2-2a37-40ec-8dc3-69246437277c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6827","nonce":1588074611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6829","nonce":1588074611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6833","nonce":1588074611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6831","nonce":1588074611}]},"public_addr":"172.21.15.86:6827/1588074611","cluster_addr":"172.21.15.86:6829/1588074611","heartbeat_back_addr":"172.21.15.86:6833/1588074611","heartbeat_front_addr":"172.21.15.86:6831/1588074611","state":["exists","up"]},{"osd":1,"uuid":"871d7d23-ed03-4629-bca9-5b71ad0d926a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6819","nonce":1785682938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6821","nonce":1785682938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6825","nonce":1785682938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6823","nonce":1785682938}]},"public_addr":"172.21.15.86:6819/1785682938","cluster_addr":"172.21.15.86:6821/1785682938","heartbeat_back_addr":"172.21.15.86:6825/1785682938","heartbeat_front_addr":"172.21.15.86:6823/1785682938","state":["exists","up"]},{"osd":2,"uuid":"39d3562d-8c52-4af9-935a-2d90abb8b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6801","nonce":3306127846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6803","nonce":3306127846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6807","nonce":3306127846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6805","nonce":3306127846}]},"public_addr":"172.21.15.86:6801/3306127846","cluster_addr":"172.21.15.86:6803/3306127846","heartbeat_back_addr":"172.21.15.86:6807/3306127846","heartbeat_front_addr":"172.21.15.86:6805/3306127846","state":["exists","up"]},{"osd":3,"uuid":"7f88c5b1-042c-4a9f-a674-32456e0644a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6809","nonce":694275178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6811","nonce":694275178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6815","nonce":694275178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6813","nonce":694275178}]},"public_addr":"172.21.15.86:6809/694275178","cluster_addr":"172.21.15.86:6811/694275178","heartbeat_back_addr":"172.21.15.86:6815/694275178","heartbeat_front_addr":"172.21.15.86:6813/694275178","state":["exists","up"]},{"osd":4,"uuid":"18aa391b-0863-48bf-bff6-107e22ee9752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6811","nonce":1326795640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6815","nonce":1326795640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6823","nonce":1326795640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6819","nonce":1326795640}]},"public_addr":"172.21.15.169:6811/1326795640","cluster_addr":"172.21.15.169:6815/1326795640","heartbeat_back_addr":"172.21.15.169:6823/1326795640","heartbeat_front_addr":"172.21.15.169:6819/1326795640","state":["exists","up"]},{"osd":5,"uuid":"90fa5ca6-1815-4af1-a664-b45a9e19dd56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6825","nonce":3538913242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6827","nonce":3538913242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6831","nonce":3538913242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6829","nonce":3538913242}]},"public_addr":"172.21.15.169:6825/3538913242","cluster_addr":"172.21.15.169:6827/3538913242","heartbeat_back_addr":"172.21.15.169:6831/3538913242","heartbeat_front_addr":"172.21.15.169:6829/3538913242","state":["exists","up"]},{"osd":6,"uuid":"8b2019fc-6cc2-4394-9a7c-7951544f7cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6810","nonce":494424253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6814","nonce":494424253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6822","nonce":494424253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6818","nonce":494424253}]},"public_addr":"172.21.15.169:6810/494424253","cluster_addr":"172.21.15.169:6814/494424253","heartbeat_back_addr":"172.21.15.169:6822/494424253","heartbeat_front_addr":"172.21.15.169:6818/494424253","state":["exists","up"]},{"osd":7,"uuid":"622e3b2c-5302-4b0a-b7f2-f4050801401e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6801","nonce":797235989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6803","nonce":797235989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6807","nonce":797235989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6805","nonce":797235989}]},"public_addr":"172.21.15.169:6801/797235989","cluster_addr":"172.21.15.169:6803/797235989","heartbeat_back_addr":"172.21.15.169:6807/797235989","heartbeat_front_addr":"172.21.15.169:6805/797235989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.130643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.611572+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:53.419992+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.560112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.112065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.774642+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.341946+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.117884+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:37:29.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.129+0000 7ff492c8b640 1 -- 172.21.15.86:0/340190516 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff47806c2b0 msgr2=0x7ff47806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:29.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.129+0000 7ff492c8b640 1 --2- 172.21.15.86:0/340190516 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff47806c2b0 0x7ff47806e770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff488033000 tx=0x7ff488009000 comp rx=0 tx=0).stop 2024-09-19T06:37:29.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.129+0000 7ff492c8b640 1 -- 172.21.15.86:0/340190516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff48c0cb660 msgr2=0x7ff48c1f1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:29.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.129+0000 7ff492c8b640 1 --2- 172.21.15.86:0/340190516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff48c0cb660 0x7ff48c1f1520 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00d620 tx=0x7ff47c00dae0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.129+0000 7ff492c8b640 1 -- 172.21.15.86:0/340190516 shutdown_connections 2024-09-19T06:37:29.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.129+0000 7ff492c8b640 1 --2- 172.21.15.86:0/340190516 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff47806c2b0 0x7ff47806e770 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.129+0000 7ff492c8b640 1 --2- 172.21.15.86:0/340190516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff48c0cba40 0x7ff48c15b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.129+0000 7ff492c8b640 1 --2- 172.21.15.86:0/340190516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff48c0cb660 0x7ff48c1f1520 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.129+0000 7ff492c8b640 1 --2- 172.21.15.86:0/340190516 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff48c0c6df0 0x7ff48c14ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.129+0000 7ff492c8b640 1 -- 172.21.15.86:0/340190516 >> 172.21.15.86:0/340190516 conn(0x7ff48c06bcc0 msgr2=0x7ff48c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:29.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.129+0000 7ff492c8b640 1 -- 172.21.15.86:0/340190516 shutdown_connections 2024-09-19T06:37:29.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.129+0000 7ff492c8b640 1 -- 172.21.15.86:0/340190516 wait complete. 2024-09-19T06:37:29.141 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T06:37:29.142 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:37:29.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.238+0000 7f9948d11640 1 Processor -- start 2024-09-19T06:37:29.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.238+0000 7f9948d11640 1 -- start start 2024-09-19T06:37:29.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.239+0000 7f9948d11640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9944153050 0x7f99440cb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:29.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.239+0000 7f9948d11640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99440c8b20 0x7f994415ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:29.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.239+0000 7f9948d11640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99440c5da0 con 0x7f994415cf60 2024-09-19T06:37:29.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.239+0000 7f9948d11640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f9944153430 con 0x7f9944153050 2024-09-19T06:37:29.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.239+0000 7f9948d11640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f99440c6040 con 0x7f99440c8b20 2024-09-19T06:37:29.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.239+0000 7f9942d9d640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f994415cf60 0x7f9944073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39592/0 (socket says 172.21.15.86:39592) 2024-09-19T06:37:29.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.239+0000 7f9942d9d640 1 -- 172.21.15.86:0/4089311786 learned_addr learned my addr 172.21.15.86:0/4089311786 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:29.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.239+0000 7f994259c640 1 --2- 172.21.15.86:0/4089311786 >> v2:172.21.15.169:3300/0 conn(0x7f9944153050 0x7f99440cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:29.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.239+0000 7f994159a640 1 -- 172.21.15.86:0/4089311786 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1892408872 0 0) 0x7f99440c5da0 con 0x7f994415cf60 2024-09-19T06:37:29.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.239+0000 7f9941d9b640 1 --2- 172.21.15.86:0/4089311786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99440c8b20 0x7f994415ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:29.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.239+0000 7f994159a640 1 -- 172.21.15.86:0/4089311786 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f992c003520 con 0x7f994415cf60 2024-09-19T06:37:29.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.239+0000 7f994159a640 1 -- 172.21.15.86:0/4089311786 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3675880902 0 0) 0x7f992c003520 con 0x7f994415cf60 2024-09-19T06:37:29.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.239+0000 7f994159a640 1 -- 172.21.15.86:0/4089311786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99440c8b20 msgr2=0x7f994415ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:29.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.239+0000 7f994159a640 1 --2- 172.21.15.86:0/4089311786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99440c8b20 0x7f994415ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.239+0000 7f994159a640 1 -- 172.21.15.86:0/4089311786 >> v2:172.21.15.169:3300/0 conn(0x7f9944153050 msgr2=0x7f99440cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:29.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.239+0000 7f994159a640 1 --2- 172.21.15.86:0/4089311786 >> v2:172.21.15.169:3300/0 conn(0x7f9944153050 0x7f99440cb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.239+0000 7f994159a640 1 -- 172.21.15.86:0/4089311786 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99440c6320 con 0x7f994415cf60 2024-09-19T06:37:29.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.239+0000 7f994159a640 1 -- 172.21.15.86:0/4089311786 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f993c0019f0 con 0x7f994415cf60 2024-09-19T06:37:29.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.239+0000 7f994159a640 1 -- 172.21.15.86:0/4089311786 >> v1:172.21.15.86:6789/0 conn(0x7f994415cf60 legacy=0x7f9944073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:29.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.239+0000 7f994159a640 1 --2- 172.21.15.86:0/4089311786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f992c0039b0 0x7f992c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:29.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.239+0000 7f994159a640 1 --2- 172.21.15.86:0/4089311786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f992c004800 0x7f992c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:29.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.239+0000 7f994159a640 1 --2- 172.21.15.86:0/4089311786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99440c8b20 0x7f992c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:29.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.239+0000 7f994159a640 1 -- 172.21.15.86:0/4089311786 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9944153430 con 0x7f992c0039b0 2024-09-19T06:37:29.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.239+0000 7f994159a640 1 -- 172.21.15.86:0/4089311786 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f99440c6040 con 0x7f992c004800 2024-09-19T06:37:29.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.239+0000 7f994159a640 1 -- 172.21.15.86:0/4089311786 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f992c00b9c0 con 0x7f99440c8b20 2024-09-19T06:37:29.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.240+0000 7f994259c640 1 --2- 172.21.15.86:0/4089311786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f992c0039b0 0x7f992c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:29.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.240+0000 7f9941d9b640 1 --2- 172.21.15.86:0/4089311786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f992c004800 0x7f992c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:29.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.240+0000 7f9942d9d640 1 --2- 172.21.15.86:0/4089311786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99440c8b20 0x7f992c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:29.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.240+0000 7f994259c640 1 -- 172.21.15.86:0/4089311786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99440c8b20 msgr2=0x7f992c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:29.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.240+0000 7f994259c640 1 --2- 172.21.15.86:0/4089311786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99440c8b20 0x7f992c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.240+0000 7f994259c640 1 -- 172.21.15.86:0/4089311786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f992c004800 msgr2=0x7f992c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:29.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.240+0000 7f994259c640 1 --2- 172.21.15.86:0/4089311786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f992c004800 0x7f992c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.240+0000 7f994259c640 1 -- 172.21.15.86:0/4089311786 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f992c003520 con 0x7f992c0039b0 2024-09-19T06:37:29.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.240+0000 7f994259c640 1 --2- 172.21.15.86:0/4089311786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f992c0039b0 0x7f992c003dd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9934009ac0 tx=0x7f992c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229c44e1786bf47c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:29.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.241+0000 7f994159a640 1 -- 172.21.15.86:0/4089311786 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9934036070 con 0x7f992c0039b0 2024-09-19T06:37:29.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.241+0000 7f994159a640 1 -- 172.21.15.86:0/4089311786 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9934031400 con 0x7f992c0039b0 2024-09-19T06:37:29.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.241+0000 7f994159a640 1 -- 172.21.15.86:0/4089311786 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9934009690 con 0x7f992c0039b0 2024-09-19T06:37:29.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.241+0000 7f9948d11640 1 -- 172.21.15.86:0/4089311786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f992c0039b0 msgr2=0x7f992c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:29.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.241+0000 7f9948d11640 1 --2- 172.21.15.86:0/4089311786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f992c0039b0 0x7f992c003dd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9934009ac0 tx=0x7f992c005830 comp rx=0 tx=0).stop 2024-09-19T06:37:29.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.241+0000 7f9942d9d640 1 -- 172.21.15.86:0/4089311786 reap_dead start 2024-09-19T06:37:29.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.241+0000 7f9948d11640 1 -- 172.21.15.86:0/4089311786 shutdown_connections 2024-09-19T06:37:29.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.241+0000 7f9948d11640 1 -- 172.21.15.86:0/4089311786 >> 172.21.15.86:0/4089311786 conn(0x7f9944070d10 msgr2=0x7f99440710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:29.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.241+0000 7f9948d11640 1 -- 172.21.15.86:0/4089311786 shutdown_connections 2024-09-19T06:37:29.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.241+0000 7f9948d11640 1 -- 172.21.15.86:0/4089311786 wait complete. 2024-09-19T06:37:29.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.242+0000 7f9948d11640 1 Processor -- start 2024-09-19T06:37:29.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.243+0000 7f9948d11640 1 -- start start 2024-09-19T06:37:29.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.243+0000 7f9948d11640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f992c0039b0 0x7f994414bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:29.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.243+0000 7f9948d11640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99441490f0 0x7f9944149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:29.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.243+0000 7f9948d11640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99441e3210 0x7f99441e3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:29.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.243+0000 7f9948d11640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f994415c500 con 0x7f992c0039b0 2024-09-19T06:37:29.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.243+0000 7f9948d11640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f99440c68e0 con 0x7f99441e3210 2024-09-19T06:37:29.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.243+0000 7f9948d11640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9944073830 con 0x7f99441490f0 2024-09-19T06:37:29.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.243+0000 7f994259c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f992c0039b0 0x7f994414bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:29.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.243+0000 7f994259c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f992c0039b0 0x7f994414bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39326/0 (socket says 172.21.15.86:39326) 2024-09-19T06:37:29.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.243+0000 7f994259c640 1 -- 172.21.15.86:0/606442799 learned_addr learned my addr 172.21.15.86:0/606442799 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:29.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.243+0000 7f9942d9d640 1 --2- 172.21.15.86:0/606442799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99441e3210 0x7f99441e3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:29.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.243+0000 7f9941d9b640 1 --2- 172.21.15.86:0/606442799 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99441490f0 0x7f9944149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:29.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.244+0000 7f994259c640 1 -- 172.21.15.86:0/606442799 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99441490f0 msgr2=0x7f9944149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:29.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.244+0000 7f994259c640 1 --2- 172.21.15.86:0/606442799 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99441490f0 0x7f9944149530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.244+0000 7f994259c640 1 -- 172.21.15.86:0/606442799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99441e3210 msgr2=0x7f99441e3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:29.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.244+0000 7f994259c640 1 --2- 172.21.15.86:0/606442799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99441e3210 0x7f99441e3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.244+0000 7f994259c640 1 -- 172.21.15.86:0/606442799 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9944149a70 con 0x7f992c0039b0 2024-09-19T06:37:29.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.244+0000 7f9941d9b640 1 --2- 172.21.15.86:0/606442799 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99441490f0 0x7f9944149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:29.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.244+0000 7f994259c640 1 --2- 172.21.15.86:0/606442799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f992c0039b0 0x7f994414bfb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f993402abe0 tx=0x7f9934004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:29.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.244+0000 7f9932ffd640 1 -- 172.21.15.86:0/606442799 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9934040020 con 0x7f992c0039b0 2024-09-19T06:37:29.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.244+0000 7f9932ffd640 1 -- 172.21.15.86:0/606442799 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9934003890 con 0x7f992c0039b0 2024-09-19T06:37:29.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.244+0000 7f9948d11640 1 -- 172.21.15.86:0/606442799 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99441e3bd0 con 0x7f992c0039b0 2024-09-19T06:37:29.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.244+0000 7f9932ffd640 1 -- 172.21.15.86:0/606442799 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9934036040 con 0x7f992c0039b0 2024-09-19T06:37:29.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.244+0000 7f9948d11640 1 -- 172.21.15.86:0/606442799 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99441e4870 con 0x7f992c0039b0 2024-09-19T06:37:29.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.245+0000 7f9948d11640 1 -- 172.21.15.86:0/606442799 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99440ce860 con 0x7f992c0039b0 2024-09-19T06:37:29.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.245+0000 7f9932ffd640 1 -- 172.21.15.86:0/606442799 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9934043020 con 0x7f992c0039b0 2024-09-19T06:37:29.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.246+0000 7f9932ffd640 1 --2- 172.21.15.86:0/606442799 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f992406c2b0 0x7f992406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:29.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.246+0000 7f9941d9b640 1 --2- 172.21.15.86:0/606442799 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f992406c2b0 0x7f992406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:29.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.246+0000 7f9932ffd640 1 -- 172.21.15.86:0/606442799 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f99340ab730 con 0x7f992c0039b0 2024-09-19T06:37:29.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.246+0000 7f9941d9b640 1 --2- 172.21.15.86:0/606442799 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f992406c2b0 0x7f992406e770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f994406d890 tx=0x7f9938008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:29.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.250+0000 7f9932ffd640 1 -- 172.21.15.86:0/606442799 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f99440ce860 con 0x7f992c0039b0 2024-09-19T06:37:29.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.414+0000 7f9948d11640 1 -- 172.21.15.86:0/606442799 --> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f994415ca20 con 0x7f992406c2b0 2024-09-19T06:37:29.423 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.422+0000 7f9932ffd640 1 -- 172.21.15.86:0/606442799 <== mgr.4105 v2:172.21.15.86:6816/4165134248 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332617 (secure 0 0 0) 0x7f994415ca20 con 0x7f992406c2b0 2024-09-19T06:37:29.427 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:29.429 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-09-19T06:37:29.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.425+0000 7f9948d11640 1 -- 172.21.15.86:0/606442799 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f992406c2b0 msgr2=0x7f992406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:29.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.425+0000 7f9948d11640 1 --2- 172.21.15.86:0/606442799 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f992406c2b0 0x7f992406e770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f994406d890 tx=0x7f9938008040 comp rx=0 tx=0).stop 2024-09-19T06:37:29.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.425+0000 7f9948d11640 1 -- 172.21.15.86:0/606442799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f992c0039b0 msgr2=0x7f994414bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:29.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.425+0000 7f9948d11640 1 --2- 172.21.15.86:0/606442799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f992c0039b0 0x7f994414bfb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f993402abe0 tx=0x7f9934004730 comp rx=0 tx=0).stop 2024-09-19T06:37:29.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.425+0000 7f9948d11640 1 -- 172.21.15.86:0/606442799 shutdown_connections 2024-09-19T06:37:29.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.425+0000 7f9948d11640 1 --2- 172.21.15.86:0/606442799 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f992406c2b0 0x7f992406e770 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.425+0000 7f9948d11640 1 --2- 172.21.15.86:0/606442799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99441e3210 0x7f99441e3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.425+0000 7f9948d11640 1 --2- 172.21.15.86:0/606442799 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99441490f0 0x7f9944149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.425+0000 7f9948d11640 1 --2- 172.21.15.86:0/606442799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f992c0039b0 0x7f994414bfb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.425+0000 7f9948d11640 1 -- 172.21.15.86:0/606442799 >> 172.21.15.86:0/606442799 conn(0x7f9944070d10 msgr2=0x7f994414b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:29.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.425+0000 7f9948d11640 1 -- 172.21.15.86:0/606442799 shutdown_connections 2024-09-19T06:37:29.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.425+0000 7f9948d11640 1 -- 172.21.15.86:0/606442799 wait complete. 2024-09-19T06:37:29.437 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-09-19T06:37:27.745095+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218536,"kb_used_data":2304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756184,"statfs":{"total":773094113280,"available":772870332416,"internally_reserved":0,"allocated":2359296,"data_stored":2051860,"data_compressed":65040,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002755"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030305+0000","last_change":"2024-09-19T06:37:08.446272+0000","last_active":"2024-09-19T06:37:15.030305+0000","last_peered":"2024-09-19T06:37:15.030305+0000","last_clean":"2024-09-19T06:37:15.030305+0000","last_became_active":"2024-09-19T06:37:08.446044+0000","last_became_peered":"2024-09-19T06:37:08.446044+0000","last_unstale":"2024-09-19T06:37:15.030305+0000","last_undegraded":"2024-09-19T06:37:15.030305+0000","last_fullsized":"2024-09-19T06:37:15.030305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:37.623543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477629+0000","last_change":"2024-09-19T06:37:09.441539+0000","last_active":"2024-09-19T06:37:14.477629+0000","last_peered":"2024-09-19T06:37:14.477629+0000","last_clean":"2024-09-19T06:37:14.477629+0000","last_became_active":"2024-09-19T06:37:09.440839+0000","last_became_peered":"2024-09-19T06:37:09.440839+0000","last_unstale":"2024-09-19T06:37:14.477629+0000","last_undegraded":"2024-09-19T06:37:14.477629+0000","last_fullsized":"2024-09-19T06:37:14.477629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:49.222252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477205+0000","last_change":"2024-09-19T06:37:13.461355+0000","last_active":"2024-09-19T06:37:14.477205+0000","last_peered":"2024-09-19T06:37:14.477205+0000","last_clean":"2024-09-19T06:37:14.477205+0000","last_became_active":"2024-09-19T06:37:13.460936+0000","last_became_peered":"2024-09-19T06:37:13.460936+0000","last_unstale":"2024-09-19T06:37:14.477205+0000","last_undegraded":"2024-09-19T06:37:14.477205+0000","last_fullsized":"2024-09-19T06:37:14.477205+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:59.860583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477847+0000","last_change":"2024-09-19T06:37:08.438583+0000","last_active":"2024-09-19T06:37:14.477847+0000","last_peered":"2024-09-19T06:37:14.477847+0000","last_clean":"2024-09-19T06:37:14.477847+0000","last_became_active":"2024-09-19T06:37:08.437921+0000","last_became_peered":"2024-09-19T06:37:08.437921+0000","last_unstale":"2024-09-19T06:37:14.477847+0000","last_undegraded":"2024-09-19T06:37:14.477847+0000","last_fullsized":"2024-09-19T06:37:14.477847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:58:23.269120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030018+0000","last_change":"2024-09-19T06:37:09.450731+0000","last_active":"2024-09-19T06:37:15.030018+0000","last_peered":"2024-09-19T06:37:15.030018+0000","last_clean":"2024-09-19T06:37:15.030018+0000","last_became_active":"2024-09-19T06:37:09.450430+0000","last_became_peered":"2024-09-19T06:37:09.450430+0000","last_unstale":"2024-09-19T06:37:15.030018+0000","last_undegraded":"2024-09-19T06:37:15.030018+0000","last_fullsized":"2024-09-19T06:37:15.030018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:21.701872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029552+0000","last_change":"2024-09-19T06:37:13.459445+0000","last_active":"2024-09-19T06:37:15.029552+0000","last_peered":"2024-09-19T06:37:15.029552+0000","last_clean":"2024-09-19T06:37:15.029552+0000","last_became_active":"2024-09-19T06:37:13.459040+0000","last_became_peered":"2024-09-19T06:37:13.459040+0000","last_unstale":"2024-09-19T06:37:15.029552+0000","last_undegraded":"2024-09-19T06:37:15.029552+0000","last_fullsized":"2024-09-19T06:37:15.029552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:37.676097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479475+0000","last_change":"2024-09-19T06:37:08.448303+0000","last_active":"2024-09-19T06:37:14.479475+0000","last_peered":"2024-09-19T06:37:14.479475+0000","last_clean":"2024-09-19T06:37:14.479475+0000","last_became_active":"2024-09-19T06:37:08.447559+0000","last_became_peered":"2024-09-19T06:37:08.447559+0000","last_unstale":"2024-09-19T06:37:14.479475+0000","last_undegraded":"2024-09-19T06:37:14.479475+0000","last_fullsized":"2024-09-19T06:37:14.479475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:43.093216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030079+0000","last_change":"2024-09-19T06:37:09.445971+0000","last_active":"2024-09-19T06:37:15.030079+0000","last_peered":"2024-09-19T06:37:15.030079+0000","last_clean":"2024-09-19T06:37:15.030079+0000","last_became_active":"2024-09-19T06:37:09.444806+0000","last_became_peered":"2024-09-19T06:37:09.444806+0000","last_unstale":"2024-09-19T06:37:15.030079+0000","last_undegraded":"2024-09-19T06:37:15.030079+0000","last_fullsized":"2024-09-19T06:37:15.030079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:15.765835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030528+0000","last_change":"2024-09-19T06:37:13.459035+0000","last_active":"2024-09-19T06:37:15.030528+0000","last_peered":"2024-09-19T06:37:15.030528+0000","last_clean":"2024-09-19T06:37:15.030528+0000","last_became_active":"2024-09-19T06:37:13.458588+0000","last_became_peered":"2024-09-19T06:37:13.458588+0000","last_unstale":"2024-09-19T06:37:15.030528+0000","last_undegraded":"2024-09-19T06:37:15.030528+0000","last_fullsized":"2024-09-19T06:37:15.030528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:27.900054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479040+0000","last_change":"2024-09-19T06:37:08.446363+0000","last_active":"2024-09-19T06:37:14.479040+0000","last_peered":"2024-09-19T06:37:14.479040+0000","last_clean":"2024-09-19T06:37:14.479040+0000","last_became_active":"2024-09-19T06:37:08.446053+0000","last_became_peered":"2024-09-19T06:37:08.446053+0000","last_unstale":"2024-09-19T06:37:14.479040+0000","last_undegraded":"2024-09-19T06:37:14.479040+0000","last_fullsized":"2024-09-19T06:37:14.479040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:22.488347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030495+0000","last_change":"2024-09-19T06:37:09.445124+0000","last_active":"2024-09-19T06:37:15.030495+0000","last_peered":"2024-09-19T06:37:15.030495+0000","last_clean":"2024-09-19T06:37:15.030495+0000","last_became_active":"2024-09-19T06:37:09.444824+0000","last_became_peered":"2024-09-19T06:37:09.444824+0000","last_unstale":"2024-09-19T06:37:15.030495+0000","last_undegraded":"2024-09-19T06:37:15.030495+0000","last_fullsized":"2024-09-19T06:37:15.030495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:40:05.642055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030082+0000","last_change":"2024-09-19T06:37:13.459720+0000","last_active":"2024-09-19T06:37:15.030082+0000","last_peered":"2024-09-19T06:37:15.030082+0000","last_clean":"2024-09-19T06:37:15.030082+0000","last_became_active":"2024-09-19T06:37:13.459350+0000","last_became_peered":"2024-09-19T06:37:13.459350+0000","last_unstale":"2024-09-19T06:37:15.030082+0000","last_undegraded":"2024-09-19T06:37:15.030082+0000","last_fullsized":"2024-09-19T06:37:15.030082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:29.546976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478406+0000","last_change":"2024-09-19T06:37:09.447795+0000","last_active":"2024-09-19T06:37:14.478406+0000","last_peered":"2024-09-19T06:37:14.478406+0000","last_clean":"2024-09-19T06:37:14.478406+0000","last_became_active":"2024-09-19T06:37:09.447502+0000","last_became_peered":"2024-09-19T06:37:09.447502+0000","last_unstale":"2024-09-19T06:37:14.478406+0000","last_undegraded":"2024-09-19T06:37:14.478406+0000","last_fullsized":"2024-09-19T06:37:14.478406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:51.384743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479493+0000","last_change":"2024-09-19T06:37:08.446179+0000","last_active":"2024-09-19T06:37:14.479493+0000","last_peered":"2024-09-19T06:37:14.479493+0000","last_clean":"2024-09-19T06:37:14.479493+0000","last_became_active":"2024-09-19T06:37:08.445834+0000","last_became_peered":"2024-09-19T06:37:08.445834+0000","last_unstale":"2024-09-19T06:37:14.479493+0000","last_undegraded":"2024-09-19T06:37:14.479493+0000","last_fullsized":"2024-09-19T06:37:14.479493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:03.783414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030572+0000","last_change":"2024-09-19T06:37:13.460344+0000","last_active":"2024-09-19T06:37:15.030572+0000","last_peered":"2024-09-19T06:37:15.030572+0000","last_clean":"2024-09-19T06:37:15.030572+0000","last_became_active":"2024-09-19T06:37:13.459967+0000","last_became_peered":"2024-09-19T06:37:13.459967+0000","last_unstale":"2024-09-19T06:37:15.030572+0000","last_undegraded":"2024-09-19T06:37:15.030572+0000","last_fullsized":"2024-09-19T06:37:15.030572+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:59.096218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477943+0000","last_change":"2024-09-19T06:37:09.449884+0000","last_active":"2024-09-19T06:37:14.477943+0000","last_peered":"2024-09-19T06:37:14.477943+0000","last_clean":"2024-09-19T06:37:14.477943+0000","last_became_active":"2024-09-19T06:37:09.449645+0000","last_became_peered":"2024-09-19T06:37:09.449645+0000","last_unstale":"2024-09-19T06:37:14.477943+0000","last_undegraded":"2024-09-19T06:37:14.477943+0000","last_fullsized":"2024-09-19T06:37:14.477943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:07.353098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030475+0000","last_change":"2024-09-19T06:37:08.437022+0000","last_active":"2024-09-19T06:37:15.030475+0000","last_peered":"2024-09-19T06:37:15.030475+0000","last_clean":"2024-09-19T06:37:15.030475+0000","last_became_active":"2024-09-19T06:37:08.436761+0000","last_became_peered":"2024-09-19T06:37:08.436761+0000","last_unstale":"2024-09-19T06:37:15.030475+0000","last_undegraded":"2024-09-19T06:37:15.030475+0000","last_fullsized":"2024-09-19T06:37:15.030475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:04.985581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030395+0000","last_change":"2024-09-19T06:37:13.460470+0000","last_active":"2024-09-19T06:37:15.030395+0000","last_peered":"2024-09-19T06:37:15.030395+0000","last_clean":"2024-09-19T06:37:15.030395+0000","last_became_active":"2024-09-19T06:37:13.460072+0000","last_became_peered":"2024-09-19T06:37:13.460072+0000","last_unstale":"2024-09-19T06:37:15.030395+0000","last_undegraded":"2024-09-19T06:37:15.030395+0000","last_fullsized":"2024-09-19T06:37:15.030395+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:50.835286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477295+0000","last_change":"2024-09-19T06:37:09.433042+0000","last_active":"2024-09-19T06:37:14.477295+0000","last_peered":"2024-09-19T06:37:14.477295+0000","last_clean":"2024-09-19T06:37:14.477295+0000","last_became_active":"2024-09-19T06:37:09.432589+0000","last_became_peered":"2024-09-19T06:37:09.432589+0000","last_unstale":"2024-09-19T06:37:14.477295+0000","last_undegraded":"2024-09-19T06:37:14.477295+0000","last_fullsized":"2024-09-19T06:37:14.477295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:18.661071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029869+0000","last_change":"2024-09-19T06:37:08.444408+0000","last_active":"2024-09-19T06:37:15.029869+0000","last_peered":"2024-09-19T06:37:15.029869+0000","last_clean":"2024-09-19T06:37:15.029869+0000","last_became_active":"2024-09-19T06:37:08.444160+0000","last_became_peered":"2024-09-19T06:37:08.444160+0000","last_unstale":"2024-09-19T06:37:15.029869+0000","last_undegraded":"2024-09-19T06:37:15.029869+0000","last_fullsized":"2024-09-19T06:37:15.029869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:54.304153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030788+0000","last_change":"2024-09-19T06:37:13.466175+0000","last_active":"2024-09-19T06:37:15.030788+0000","last_peered":"2024-09-19T06:37:15.030788+0000","last_clean":"2024-09-19T06:37:15.030788+0000","last_became_active":"2024-09-19T06:37:13.465731+0000","last_became_peered":"2024-09-19T06:37:13.465731+0000","last_unstale":"2024-09-19T06:37:15.030788+0000","last_undegraded":"2024-09-19T06:37:15.030788+0000","last_fullsized":"2024-09-19T06:37:15.030788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:01.100164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029947+0000","last_change":"2024-09-19T06:37:09.437254+0000","last_active":"2024-09-19T06:37:15.029947+0000","last_peered":"2024-09-19T06:37:15.029947+0000","last_clean":"2024-09-19T06:37:15.029947+0000","last_became_active":"2024-09-19T06:37:09.436512+0000","last_became_peered":"2024-09-19T06:37:09.436512+0000","last_unstale":"2024-09-19T06:37:15.029947+0000","last_undegraded":"2024-09-19T06:37:15.029947+0000","last_fullsized":"2024-09-19T06:37:15.029947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:21.893793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478028+0000","last_change":"2024-09-19T06:37:08.446216+0000","last_active":"2024-09-19T06:37:14.478028+0000","last_peered":"2024-09-19T06:37:14.478028+0000","last_clean":"2024-09-19T06:37:14.478028+0000","last_became_active":"2024-09-19T06:37:08.445845+0000","last_became_peered":"2024-09-19T06:37:08.445845+0000","last_unstale":"2024-09-19T06:37:14.478028+0000","last_undegraded":"2024-09-19T06:37:14.478028+0000","last_fullsized":"2024-09-19T06:37:14.478028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:04.033283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030215+0000","last_change":"2024-09-19T06:37:13.462192+0000","last_active":"2024-09-19T06:37:15.030215+0000","last_peered":"2024-09-19T06:37:15.030215+0000","last_clean":"2024-09-19T06:37:15.030215+0000","last_became_active":"2024-09-19T06:37:13.460955+0000","last_became_peered":"2024-09-19T06:37:13.460955+0000","last_unstale":"2024-09-19T06:37:15.030215+0000","last_undegraded":"2024-09-19T06:37:15.030215+0000","last_fullsized":"2024-09-19T06:37:15.030215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:53.583488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030554+0000","last_change":"2024-09-19T06:37:09.445989+0000","last_active":"2024-09-19T06:37:15.030554+0000","last_peered":"2024-09-19T06:37:15.030554+0000","last_clean":"2024-09-19T06:37:15.030554+0000","last_became_active":"2024-09-19T06:37:09.445705+0000","last_became_peered":"2024-09-19T06:37:09.445705+0000","last_unstale":"2024-09-19T06:37:15.030554+0000","last_undegraded":"2024-09-19T06:37:15.030554+0000","last_fullsized":"2024-09-19T06:37:15.030554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:24.592460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478969+0000","last_change":"2024-09-19T06:37:08.446226+0000","last_active":"2024-09-19T06:37:14.478969+0000","last_peered":"2024-09-19T06:37:14.478969+0000","last_clean":"2024-09-19T06:37:14.478969+0000","last_became_active":"2024-09-19T06:37:08.445929+0000","last_became_peered":"2024-09-19T06:37:08.445929+0000","last_unstale":"2024-09-19T06:37:14.478969+0000","last_undegraded":"2024-09-19T06:37:14.478969+0000","last_fullsized":"2024-09-19T06:37:14.478969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:32.233033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029648+0000","last_change":"2024-09-19T06:37:13.462598+0000","last_active":"2024-09-19T06:37:15.029648+0000","last_peered":"2024-09-19T06:37:15.029648+0000","last_clean":"2024-09-19T06:37:15.029648+0000","last_became_active":"2024-09-19T06:37:13.462217+0000","last_became_peered":"2024-09-19T06:37:13.462217+0000","last_unstale":"2024-09-19T06:37:15.029648+0000","last_undegraded":"2024-09-19T06:37:15.029648+0000","last_fullsized":"2024-09-19T06:37:15.029648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:04.109419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477866+0000","last_change":"2024-09-19T06:37:09.434309+0000","last_active":"2024-09-19T06:37:14.477866+0000","last_peered":"2024-09-19T06:37:14.477866+0000","last_clean":"2024-09-19T06:37:14.477866+0000","last_became_active":"2024-09-19T06:37:09.433897+0000","last_became_peered":"2024-09-19T06:37:09.433897+0000","last_unstale":"2024-09-19T06:37:14.477866+0000","last_undegraded":"2024-09-19T06:37:14.477866+0000","last_fullsized":"2024-09-19T06:37:14.477866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:59.054484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030307+0000","last_change":"2024-09-19T06:37:08.441525+0000","last_active":"2024-09-19T06:37:15.030307+0000","last_peered":"2024-09-19T06:37:15.030307+0000","last_clean":"2024-09-19T06:37:15.030307+0000","last_became_active":"2024-09-19T06:37:08.441245+0000","last_became_peered":"2024-09-19T06:37:08.441245+0000","last_unstale":"2024-09-19T06:37:15.030307+0000","last_undegraded":"2024-09-19T06:37:15.030307+0000","last_fullsized":"2024-09-19T06:37:15.030307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:19.820705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477133+0000","last_change":"2024-09-19T06:37:13.468486+0000","last_active":"2024-09-19T06:37:14.477133+0000","last_peered":"2024-09-19T06:37:14.477133+0000","last_clean":"2024-09-19T06:37:14.477133+0000","last_became_active":"2024-09-19T06:37:13.468074+0000","last_became_peered":"2024-09-19T06:37:13.468074+0000","last_unstale":"2024-09-19T06:37:14.477133+0000","last_undegraded":"2024-09-19T06:37:14.477133+0000","last_fullsized":"2024-09-19T06:37:14.477133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:36.783781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030772+0000","last_change":"2024-09-19T06:37:09.435864+0000","last_active":"2024-09-19T06:37:15.030772+0000","last_peered":"2024-09-19T06:37:15.030772+0000","last_clean":"2024-09-19T06:37:15.030772+0000","last_became_active":"2024-09-19T06:37:09.435597+0000","last_became_peered":"2024-09-19T06:37:09.435597+0000","last_unstale":"2024-09-19T06:37:15.030772+0000","last_undegraded":"2024-09-19T06:37:15.030772+0000","last_fullsized":"2024-09-19T06:37:15.030772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:20.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479615+0000","last_change":"2024-09-19T06:37:08.447931+0000","last_active":"2024-09-19T06:37:14.479615+0000","last_peered":"2024-09-19T06:37:14.479615+0000","last_clean":"2024-09-19T06:37:14.479615+0000","last_became_active":"2024-09-19T06:37:08.447630+0000","last_became_peered":"2024-09-19T06:37:08.447630+0000","last_unstale":"2024-09-19T06:37:14.479615+0000","last_undegraded":"2024-09-19T06:37:14.479615+0000","last_fullsized":"2024-09-19T06:37:14.479615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:17.375740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030552+0000","last_change":"2024-09-19T06:37:13.468360+0000","last_active":"2024-09-19T06:37:15.030552+0000","last_peered":"2024-09-19T06:37:15.030552+0000","last_clean":"2024-09-19T06:37:15.030552+0000","last_became_active":"2024-09-19T06:37:13.467926+0000","last_became_peered":"2024-09-19T06:37:13.467926+0000","last_unstale":"2024-09-19T06:37:15.030552+0000","last_undegraded":"2024-09-19T06:37:15.030552+0000","last_fullsized":"2024-09-19T06:37:15.030552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:55.089630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030606+0000","last_change":"2024-09-19T06:37:09.441678+0000","last_active":"2024-09-19T06:37:15.030606+0000","last_peered":"2024-09-19T06:37:15.030606+0000","last_clean":"2024-09-19T06:37:15.030606+0000","last_became_active":"2024-09-19T06:37:09.441406+0000","last_became_peered":"2024-09-19T06:37:09.441406+0000","last_unstale":"2024-09-19T06:37:15.030606+0000","last_undegraded":"2024-09-19T06:37:15.030606+0000","last_fullsized":"2024-09-19T06:37:15.030606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:14.638004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030831+0000","last_change":"2024-09-19T06:37:08.438805+0000","last_active":"2024-09-19T06:37:15.030831+0000","last_peered":"2024-09-19T06:37:15.030831+0000","last_clean":"2024-09-19T06:37:15.030831+0000","last_became_active":"2024-09-19T06:37:08.438528+0000","last_became_peered":"2024-09-19T06:37:08.438528+0000","last_unstale":"2024-09-19T06:37:15.030831+0000","last_undegraded":"2024-09-19T06:37:15.030831+0000","last_fullsized":"2024-09-19T06:37:15.030831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:55.500347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030303+0000","last_change":"2024-09-19T06:37:13.459697+0000","last_active":"2024-09-19T06:37:15.030303+0000","last_peered":"2024-09-19T06:37:15.030303+0000","last_clean":"2024-09-19T06:37:15.030303+0000","last_became_active":"2024-09-19T06:37:13.459303+0000","last_became_peered":"2024-09-19T06:37:13.459303+0000","last_unstale":"2024-09-19T06:37:15.030303+0000","last_undegraded":"2024-09-19T06:37:15.030303+0000","last_fullsized":"2024-09-19T06:37:15.030303+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:01.695905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.031009+0000","last_change":"2024-09-19T06:37:09.449701+0000","last_active":"2024-09-19T06:37:15.031009+0000","last_peered":"2024-09-19T06:37:15.031009+0000","last_clean":"2024-09-19T06:37:15.031009+0000","last_became_active":"2024-09-19T06:37:09.448899+0000","last_became_peered":"2024-09-19T06:37:09.448899+0000","last_unstale":"2024-09-19T06:37:15.031009+0000","last_undegraded":"2024-09-19T06:37:15.031009+0000","last_fullsized":"2024-09-19T06:37:15.031009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:17.448251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030609+0000","last_change":"2024-09-19T06:37:08.434263+0000","last_active":"2024-09-19T06:37:15.030609+0000","last_peered":"2024-09-19T06:37:15.030609+0000","last_clean":"2024-09-19T06:37:15.030609+0000","last_became_active":"2024-09-19T06:37:08.433984+0000","last_became_peered":"2024-09-19T06:37:08.433984+0000","last_unstale":"2024-09-19T06:37:15.030609+0000","last_undegraded":"2024-09-19T06:37:15.030609+0000","last_fullsized":"2024-09-19T06:37:15.030609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:05.599054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030728+0000","last_change":"2024-09-19T06:37:13.464527+0000","last_active":"2024-09-19T06:37:15.030728+0000","last_peered":"2024-09-19T06:37:15.030728+0000","last_clean":"2024-09-19T06:37:15.030728+0000","last_became_active":"2024-09-19T06:37:13.461685+0000","last_became_peered":"2024-09-19T06:37:13.461685+0000","last_unstale":"2024-09-19T06:37:15.030728+0000","last_undegraded":"2024-09-19T06:37:15.030728+0000","last_fullsized":"2024-09-19T06:37:15.030728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:57.229892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030028+0000","last_change":"2024-09-19T06:37:09.434421+0000","last_active":"2024-09-19T06:37:15.030028+0000","last_peered":"2024-09-19T06:37:15.030028+0000","last_clean":"2024-09-19T06:37:15.030028+0000","last_became_active":"2024-09-19T06:37:09.434119+0000","last_became_peered":"2024-09-19T06:37:09.434119+0000","last_unstale":"2024-09-19T06:37:15.030028+0000","last_undegraded":"2024-09-19T06:37:15.030028+0000","last_fullsized":"2024-09-19T06:37:15.030028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:56.984336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.814975+0000","last_change":"2024-09-19T06:37:08.436856+0000","last_active":"2024-09-19T06:37:14.814975+0000","last_peered":"2024-09-19T06:37:14.814975+0000","last_clean":"2024-09-19T06:37:14.814975+0000","last_became_active":"2024-09-19T06:37:08.435718+0000","last_became_peered":"2024-09-19T06:37:08.435718+0000","last_unstale":"2024-09-19T06:37:14.814975+0000","last_undegraded":"2024-09-19T06:37:14.814975+0000","last_fullsized":"2024-09-19T06:37:14.814975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:58.650430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030892+0000","last_change":"2024-09-19T06:37:13.466081+0000","last_active":"2024-09-19T06:37:15.030892+0000","last_peered":"2024-09-19T06:37:15.030892+0000","last_clean":"2024-09-19T06:37:15.030892+0000","last_became_active":"2024-09-19T06:37:13.465348+0000","last_became_peered":"2024-09-19T06:37:13.465348+0000","last_unstale":"2024-09-19T06:37:15.030892+0000","last_undegraded":"2024-09-19T06:37:15.030892+0000","last_fullsized":"2024-09-19T06:37:15.030892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:11.592737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029583+0000","last_change":"2024-09-19T06:37:09.444888+0000","last_active":"2024-09-19T06:37:15.029583+0000","last_peered":"2024-09-19T06:37:15.029583+0000","last_clean":"2024-09-19T06:37:15.029583+0000","last_became_active":"2024-09-19T06:37:09.444605+0000","last_became_peered":"2024-09-19T06:37:09.444605+0000","last_unstale":"2024-09-19T06:37:15.029583+0000","last_undegraded":"2024-09-19T06:37:15.029583+0000","last_fullsized":"2024-09-19T06:37:15.029583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:53.868356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478136+0000","last_change":"2024-09-19T06:37:08.446760+0000","last_active":"2024-09-19T06:37:14.478136+0000","last_peered":"2024-09-19T06:37:14.478136+0000","last_clean":"2024-09-19T06:37:14.478136+0000","last_became_active":"2024-09-19T06:37:08.446474+0000","last_became_peered":"2024-09-19T06:37:08.446474+0000","last_unstale":"2024-09-19T06:37:14.478136+0000","last_undegraded":"2024-09-19T06:37:14.478136+0000","last_fullsized":"2024-09-19T06:37:14.478136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:12.597952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030429+0000","last_change":"2024-09-19T06:37:13.471220+0000","last_active":"2024-09-19T06:37:15.030429+0000","last_peered":"2024-09-19T06:37:15.030429+0000","last_clean":"2024-09-19T06:37:15.030429+0000","last_became_active":"2024-09-19T06:37:13.470860+0000","last_became_peered":"2024-09-19T06:37:13.470860+0000","last_unstale":"2024-09-19T06:37:15.030429+0000","last_undegraded":"2024-09-19T06:37:15.030429+0000","last_fullsized":"2024-09-19T06:37:15.030429+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:07.659583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477346+0000","last_change":"2024-09-19T06:37:09.440366+0000","last_active":"2024-09-19T06:37:14.477346+0000","last_peered":"2024-09-19T06:37:14.477346+0000","last_clean":"2024-09-19T06:37:14.477346+0000","last_became_active":"2024-09-19T06:37:09.439478+0000","last_became_peered":"2024-09-19T06:37:09.439478+0000","last_unstale":"2024-09-19T06:37:14.477346+0000","last_undegraded":"2024-09-19T06:37:14.477346+0000","last_fullsized":"2024-09-19T06:37:14.477346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:21.837351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029827+0000","last_change":"2024-09-19T06:37:08.435473+0000","last_active":"2024-09-19T06:37:15.029827+0000","last_peered":"2024-09-19T06:37:15.029827+0000","last_clean":"2024-09-19T06:37:15.029827+0000","last_became_active":"2024-09-19T06:37:08.435183+0000","last_became_peered":"2024-09-19T06:37:08.435183+0000","last_unstale":"2024-09-19T06:37:15.029827+0000","last_undegraded":"2024-09-19T06:37:15.029827+0000","last_fullsized":"2024-09-19T06:37:15.029827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:53.115010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478240+0000","last_change":"2024-09-19T06:36:58.829099+0000","last_active":"2024-09-19T06:37:14.478240+0000","last_peered":"2024-09-19T06:37:14.478240+0000","last_clean":"2024-09-19T06:37:14.478240+0000","last_became_active":"2024-09-19T06:36:58.828079+0000","last_became_peered":"2024-09-19T06:36:58.828079+0000","last_unstale":"2024-09-19T06:37:14.478240+0000","last_undegraded":"2024-09-19T06:37:14.478240+0000","last_fullsized":"2024-09-19T06:37:14.478240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:36:57.771085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:36:57.771085+0000","last_clean_scrub_stamp":"2024-09-19T06:36:57.771085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:14.663925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477944+0000","last_change":"2024-09-19T06:37:13.464435+0000","last_active":"2024-09-19T06:37:14.477944+0000","last_peered":"2024-09-19T06:37:14.477944+0000","last_clean":"2024-09-19T06:37:14.477944+0000","last_became_active":"2024-09-19T06:37:13.464101+0000","last_became_peered":"2024-09-19T06:37:13.464101+0000","last_unstale":"2024-09-19T06:37:14.477944+0000","last_undegraded":"2024-09-19T06:37:14.477944+0000","last_fullsized":"2024-09-19T06:37:14.477944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:30.073937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479308+0000","last_change":"2024-09-19T06:37:09.442774+0000","last_active":"2024-09-19T06:37:14.479308+0000","last_peered":"2024-09-19T06:37:14.479308+0000","last_clean":"2024-09-19T06:37:14.479308+0000","last_became_active":"2024-09-19T06:37:09.442515+0000","last_became_peered":"2024-09-19T06:37:09.442515+0000","last_unstale":"2024-09-19T06:37:14.479308+0000","last_undegraded":"2024-09-19T06:37:14.479308+0000","last_fullsized":"2024-09-19T06:37:14.479308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:57.376059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815252+0000","last_change":"2024-09-19T06:37:08.438038+0000","last_active":"2024-09-19T06:37:14.815252+0000","last_peered":"2024-09-19T06:37:14.815252+0000","last_clean":"2024-09-19T06:37:14.815252+0000","last_became_active":"2024-09-19T06:37:08.437771+0000","last_became_peered":"2024-09-19T06:37:08.437771+0000","last_unstale":"2024-09-19T06:37:14.815252+0000","last_undegraded":"2024-09-19T06:37:14.815252+0000","last_fullsized":"2024-09-19T06:37:14.815252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:07.210382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477772+0000","last_change":"2024-09-19T06:37:13.470916+0000","last_active":"2024-09-19T06:37:14.477772+0000","last_peered":"2024-09-19T06:37:14.477772+0000","last_clean":"2024-09-19T06:37:14.477772+0000","last_became_active":"2024-09-19T06:37:13.470488+0000","last_became_peered":"2024-09-19T06:37:13.470488+0000","last_unstale":"2024-09-19T06:37:14.477772+0000","last_undegraded":"2024-09-19T06:37:14.477772+0000","last_fullsized":"2024-09-19T06:37:14.477772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:27.884932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030150+0000","last_change":"2024-09-19T06:37:09.442213+0000","last_active":"2024-09-19T06:37:15.030150+0000","last_peered":"2024-09-19T06:37:15.030150+0000","last_clean":"2024-09-19T06:37:15.030150+0000","last_became_active":"2024-09-19T06:37:09.441850+0000","last_became_peered":"2024-09-19T06:37:09.441850+0000","last_unstale":"2024-09-19T06:37:15.030150+0000","last_undegraded":"2024-09-19T06:37:15.030150+0000","last_fullsized":"2024-09-19T06:37:15.030150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:43.728914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030863+0000","last_change":"2024-09-19T06:37:08.431703+0000","last_active":"2024-09-19T06:37:15.030863+0000","last_peered":"2024-09-19T06:37:15.030863+0000","last_clean":"2024-09-19T06:37:15.030863+0000","last_became_active":"2024-09-19T06:37:08.431443+0000","last_became_peered":"2024-09-19T06:37:08.431443+0000","last_unstale":"2024-09-19T06:37:15.030863+0000","last_undegraded":"2024-09-19T06:37:15.030863+0000","last_fullsized":"2024-09-19T06:37:15.030863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:02.007521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030768+0000","last_change":"2024-09-19T06:37:13.469295+0000","last_active":"2024-09-19T06:37:15.030768+0000","last_peered":"2024-09-19T06:37:15.030768+0000","last_clean":"2024-09-19T06:37:15.030768+0000","last_became_active":"2024-09-19T06:37:13.468879+0000","last_became_peered":"2024-09-19T06:37:13.468879+0000","last_unstale":"2024-09-19T06:37:15.030768+0000","last_undegraded":"2024-09-19T06:37:15.030768+0000","last_fullsized":"2024-09-19T06:37:15.030768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:34.380034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479747+0000","last_change":"2024-09-19T06:37:09.439264+0000","last_active":"2024-09-19T06:37:14.479747+0000","last_peered":"2024-09-19T06:37:14.479747+0000","last_clean":"2024-09-19T06:37:14.479747+0000","last_became_active":"2024-09-19T06:37:09.438954+0000","last_became_peered":"2024-09-19T06:37:09.438954+0000","last_unstale":"2024-09-19T06:37:14.479747+0000","last_undegraded":"2024-09-19T06:37:14.479747+0000","last_fullsized":"2024-09-19T06:37:14.479747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:55.094093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815232+0000","last_change":"2024-09-19T06:37:08.437406+0000","last_active":"2024-09-19T06:37:14.815232+0000","last_peered":"2024-09-19T06:37:14.815232+0000","last_clean":"2024-09-19T06:37:14.815232+0000","last_became_active":"2024-09-19T06:37:08.437093+0000","last_became_peered":"2024-09-19T06:37:08.437093+0000","last_unstale":"2024-09-19T06:37:14.815232+0000","last_undegraded":"2024-09-19T06:37:14.815232+0000","last_fullsized":"2024-09-19T06:37:14.815232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:25.158027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029476+0000","last_change":"2024-09-19T06:37:13.460116+0000","last_active":"2024-09-19T06:37:15.029476+0000","last_peered":"2024-09-19T06:37:15.029476+0000","last_clean":"2024-09-19T06:37:15.029476+0000","last_became_active":"2024-09-19T06:37:13.459707+0000","last_became_peered":"2024-09-19T06:37:13.459707+0000","last_unstale":"2024-09-19T06:37:15.029476+0000","last_undegraded":"2024-09-19T06:37:15.029476+0000","last_fullsized":"2024-09-19T06:37:15.029476+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:02.657115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479032+0000","last_change":"2024-09-19T06:37:09.442670+0000","last_active":"2024-09-19T06:37:14.479032+0000","last_peered":"2024-09-19T06:37:14.479032+0000","last_clean":"2024-09-19T06:37:14.479032+0000","last_became_active":"2024-09-19T06:37:09.442390+0000","last_became_peered":"2024-09-19T06:37:09.442390+0000","last_unstale":"2024-09-19T06:37:14.479032+0000","last_undegraded":"2024-09-19T06:37:14.479032+0000","last_fullsized":"2024-09-19T06:37:14.479032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:02:26.726663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030129+0000","last_change":"2024-09-19T06:37:08.437263+0000","last_active":"2024-09-19T06:37:15.030129+0000","last_peered":"2024-09-19T06:37:15.030129+0000","last_clean":"2024-09-19T06:37:15.030129+0000","last_became_active":"2024-09-19T06:37:08.436982+0000","last_became_peered":"2024-09-19T06:37:08.436982+0000","last_unstale":"2024-09-19T06:37:15.030129+0000","last_undegraded":"2024-09-19T06:37:15.030129+0000","last_fullsized":"2024-09-19T06:37:15.030129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:14.895925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029466+0000","last_change":"2024-09-19T06:37:13.459433+0000","last_active":"2024-09-19T06:37:15.029466+0000","last_peered":"2024-09-19T06:37:15.029466+0000","last_clean":"2024-09-19T06:37:15.029466+0000","last_became_active":"2024-09-19T06:37:13.459031+0000","last_became_peered":"2024-09-19T06:37:13.459031+0000","last_unstale":"2024-09-19T06:37:15.029466+0000","last_undegraded":"2024-09-19T06:37:15.029466+0000","last_fullsized":"2024-09-19T06:37:15.029466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:07.294413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478514+0000","last_change":"2024-09-19T06:37:09.439142+0000","last_active":"2024-09-19T06:37:14.478514+0000","last_peered":"2024-09-19T06:37:14.478514+0000","last_clean":"2024-09-19T06:37:14.478514+0000","last_became_active":"2024-09-19T06:37:09.437717+0000","last_became_peered":"2024-09-19T06:37:09.437717+0000","last_unstale":"2024-09-19T06:37:14.478514+0000","last_undegraded":"2024-09-19T06:37:14.478514+0000","last_fullsized":"2024-09-19T06:37:14.478514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:32.934290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.814858+0000","last_change":"2024-09-19T06:37:08.430649+0000","last_active":"2024-09-19T06:37:14.814858+0000","last_peered":"2024-09-19T06:37:14.814858+0000","last_clean":"2024-09-19T06:37:14.814858+0000","last_became_active":"2024-09-19T06:37:08.430324+0000","last_became_peered":"2024-09-19T06:37:08.430324+0000","last_unstale":"2024-09-19T06:37:14.814858+0000","last_undegraded":"2024-09-19T06:37:14.814858+0000","last_fullsized":"2024-09-19T06:37:14.814858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:56.656357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030152+0000","last_change":"2024-09-19T06:37:13.463695+0000","last_active":"2024-09-19T06:37:15.030152+0000","last_peered":"2024-09-19T06:37:15.030152+0000","last_clean":"2024-09-19T06:37:15.030152+0000","last_became_active":"2024-09-19T06:37:13.463334+0000","last_became_peered":"2024-09-19T06:37:13.463334+0000","last_unstale":"2024-09-19T06:37:15.030152+0000","last_undegraded":"2024-09-19T06:37:15.030152+0000","last_fullsized":"2024-09-19T06:37:15.030152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:46.991800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477668+0000","last_change":"2024-09-19T06:37:09.450168+0000","last_active":"2024-09-19T06:37:14.477668+0000","last_peered":"2024-09-19T06:37:14.477668+0000","last_clean":"2024-09-19T06:37:14.477668+0000","last_became_active":"2024-09-19T06:37:09.449872+0000","last_became_peered":"2024-09-19T06:37:09.449872+0000","last_unstale":"2024-09-19T06:37:14.477668+0000","last_undegraded":"2024-09-19T06:37:14.477668+0000","last_fullsized":"2024-09-19T06:37:14.477668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:02:28.282840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478710+0000","last_change":"2024-09-19T06:37:08.442428+0000","last_active":"2024-09-19T06:37:14.478710+0000","last_peered":"2024-09-19T06:37:14.478710+0000","last_clean":"2024-09-19T06:37:14.478710+0000","last_became_active":"2024-09-19T06:37:08.442120+0000","last_became_peered":"2024-09-19T06:37:08.442120+0000","last_unstale":"2024-09-19T06:37:14.478710+0000","last_undegraded":"2024-09-19T06:37:14.478710+0000","last_fullsized":"2024-09-19T06:37:14.478710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:48.816822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477870+0000","last_change":"2024-09-19T06:37:13.471319+0000","last_active":"2024-09-19T06:37:14.477870+0000","last_peered":"2024-09-19T06:37:14.477870+0000","last_clean":"2024-09-19T06:37:14.477870+0000","last_became_active":"2024-09-19T06:37:13.470887+0000","last_became_peered":"2024-09-19T06:37:13.470887+0000","last_unstale":"2024-09-19T06:37:14.477870+0000","last_undegraded":"2024-09-19T06:37:14.477870+0000","last_fullsized":"2024-09-19T06:37:14.477870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:21.884985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479407+0000","last_change":"2024-09-19T06:37:09.439142+0000","last_active":"2024-09-19T06:37:14.479407+0000","last_peered":"2024-09-19T06:37:14.479407+0000","last_clean":"2024-09-19T06:37:14.479407+0000","last_became_active":"2024-09-19T06:37:09.437635+0000","last_became_peered":"2024-09-19T06:37:09.437635+0000","last_unstale":"2024-09-19T06:37:14.479407+0000","last_undegraded":"2024-09-19T06:37:14.479407+0000","last_fullsized":"2024-09-19T06:37:14.479407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:46.773889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030517+0000","last_change":"2024-09-19T06:37:08.438932+0000","last_active":"2024-09-19T06:37:15.030517+0000","last_peered":"2024-09-19T06:37:15.030517+0000","last_clean":"2024-09-19T06:37:15.030517+0000","last_became_active":"2024-09-19T06:37:08.438405+0000","last_became_peered":"2024-09-19T06:37:08.438405+0000","last_unstale":"2024-09-19T06:37:15.030517+0000","last_undegraded":"2024-09-19T06:37:15.030517+0000","last_fullsized":"2024-09-19T06:37:15.030517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:59.606628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477677+0000","last_change":"2024-09-19T06:37:13.459370+0000","last_active":"2024-09-19T06:37:14.477677+0000","last_peered":"2024-09-19T06:37:14.477677+0000","last_clean":"2024-09-19T06:37:14.477677+0000","last_became_active":"2024-09-19T06:37:13.458928+0000","last_became_peered":"2024-09-19T06:37:13.458928+0000","last_unstale":"2024-09-19T06:37:14.477677+0000","last_undegraded":"2024-09-19T06:37:14.477677+0000","last_fullsized":"2024-09-19T06:37:14.477677+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:00.179404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029933+0000","last_change":"2024-09-19T06:37:09.448958+0000","last_active":"2024-09-19T06:37:15.029933+0000","last_peered":"2024-09-19T06:37:15.029933+0000","last_clean":"2024-09-19T06:37:15.029933+0000","last_became_active":"2024-09-19T06:37:09.448697+0000","last_became_peered":"2024-09-19T06:37:09.448697+0000","last_unstale":"2024-09-19T06:37:15.029933+0000","last_undegraded":"2024-09-19T06:37:15.029933+0000","last_fullsized":"2024-09-19T06:37:15.029933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:16.306915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030900+0000","last_change":"2024-09-19T06:37:08.442685+0000","last_active":"2024-09-19T06:37:15.030900+0000","last_peered":"2024-09-19T06:37:15.030900+0000","last_clean":"2024-09-19T06:37:15.030900+0000","last_became_active":"2024-09-19T06:37:08.442436+0000","last_became_peered":"2024-09-19T06:37:08.442436+0000","last_unstale":"2024-09-19T06:37:15.030900+0000","last_undegraded":"2024-09-19T06:37:15.030900+0000","last_fullsized":"2024-09-19T06:37:15.030900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:09.952733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030332+0000","last_change":"2024-09-19T06:37:13.457651+0000","last_active":"2024-09-19T06:37:15.030332+0000","last_peered":"2024-09-19T06:37:15.030332+0000","last_clean":"2024-09-19T06:37:15.030332+0000","last_became_active":"2024-09-19T06:37:13.457246+0000","last_became_peered":"2024-09-19T06:37:13.457246+0000","last_unstale":"2024-09-19T06:37:15.030332+0000","last_undegraded":"2024-09-19T06:37:15.030332+0000","last_fullsized":"2024-09-19T06:37:15.030332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:18.553158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479228+0000","last_change":"2024-09-19T06:37:09.441212+0000","last_active":"2024-09-19T06:37:14.479228+0000","last_peered":"2024-09-19T06:37:14.479228+0000","last_clean":"2024-09-19T06:37:14.479228+0000","last_became_active":"2024-09-19T06:37:09.440209+0000","last_became_peered":"2024-09-19T06:37:09.440209+0000","last_unstale":"2024-09-19T06:37:14.479228+0000","last_undegraded":"2024-09-19T06:37:14.479228+0000","last_fullsized":"2024-09-19T06:37:14.479228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:52.173784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:24.168847+0000","last_change":"2024-09-19T06:37:08.442615+0000","last_active":"2024-09-19T06:37:24.168847+0000","last_peered":"2024-09-19T06:37:24.168847+0000","last_clean":"2024-09-19T06:37:24.168847+0000","last_became_active":"2024-09-19T06:37:08.442242+0000","last_became_peered":"2024-09-19T06:37:08.442242+0000","last_unstale":"2024-09-19T06:37:24.168847+0000","last_undegraded":"2024-09-19T06:37:24.168847+0000","last_fullsized":"2024-09-19T06:37:24.168847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:23.813400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030495+0000","last_change":"2024-09-19T06:37:13.464688+0000","last_active":"2024-09-19T06:37:15.030495+0000","last_peered":"2024-09-19T06:37:15.030495+0000","last_clean":"2024-09-19T06:37:15.030495+0000","last_became_active":"2024-09-19T06:37:13.461620+0000","last_became_peered":"2024-09-19T06:37:13.461620+0000","last_unstale":"2024-09-19T06:37:15.030495+0000","last_undegraded":"2024-09-19T06:37:15.030495+0000","last_fullsized":"2024-09-19T06:37:15.030495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:02.928332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030727+0000","last_change":"2024-09-19T06:37:09.440021+0000","last_active":"2024-09-19T06:37:15.030727+0000","last_peered":"2024-09-19T06:37:15.030727+0000","last_clean":"2024-09-19T06:37:15.030727+0000","last_became_active":"2024-09-19T06:37:09.437800+0000","last_became_peered":"2024-09-19T06:37:09.437800+0000","last_unstale":"2024-09-19T06:37:15.030727+0000","last_undegraded":"2024-09-19T06:37:15.030727+0000","last_fullsized":"2024-09-19T06:37:15.030727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:51.963097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030761+0000","last_change":"2024-09-19T06:37:08.434422+0000","last_active":"2024-09-19T06:37:15.030761+0000","last_peered":"2024-09-19T06:37:15.030761+0000","last_clean":"2024-09-19T06:37:15.030761+0000","last_became_active":"2024-09-19T06:37:08.434151+0000","last_became_peered":"2024-09-19T06:37:08.434151+0000","last_unstale":"2024-09-19T06:37:15.030761+0000","last_undegraded":"2024-09-19T06:37:15.030761+0000","last_fullsized":"2024-09-19T06:37:15.030761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:49.540748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030746+0000","last_change":"2024-09-19T06:37:13.459321+0000","last_active":"2024-09-19T06:37:15.030746+0000","last_peered":"2024-09-19T06:37:15.030746+0000","last_clean":"2024-09-19T06:37:15.030746+0000","last_became_active":"2024-09-19T06:37:13.458924+0000","last_became_peered":"2024-09-19T06:37:13.458924+0000","last_unstale":"2024-09-19T06:37:15.030746+0000","last_undegraded":"2024-09-19T06:37:15.030746+0000","last_fullsized":"2024-09-19T06:37:15.030746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:11.428574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030167+0000","last_change":"2024-09-19T06:37:09.448450+0000","last_active":"2024-09-19T06:37:15.030167+0000","last_peered":"2024-09-19T06:37:15.030167+0000","last_clean":"2024-09-19T06:37:15.030167+0000","last_became_active":"2024-09-19T06:37:09.448173+0000","last_became_peered":"2024-09-19T06:37:09.448173+0000","last_unstale":"2024-09-19T06:37:15.030167+0000","last_undegraded":"2024-09-19T06:37:15.030167+0000","last_fullsized":"2024-09-19T06:37:15.030167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:22.442374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030854+0000","last_change":"2024-09-19T06:37:08.442796+0000","last_active":"2024-09-19T06:37:15.030854+0000","last_peered":"2024-09-19T06:37:15.030854+0000","last_clean":"2024-09-19T06:37:15.030854+0000","last_became_active":"2024-09-19T06:37:08.442126+0000","last_became_peered":"2024-09-19T06:37:08.442126+0000","last_unstale":"2024-09-19T06:37:15.030854+0000","last_undegraded":"2024-09-19T06:37:15.030854+0000","last_fullsized":"2024-09-19T06:37:15.030854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:27.716141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477293+0000","last_change":"2024-09-19T06:37:13.464100+0000","last_active":"2024-09-19T06:37:14.477293+0000","last_peered":"2024-09-19T06:37:14.477293+0000","last_clean":"2024-09-19T06:37:14.477293+0000","last_became_active":"2024-09-19T06:37:13.462750+0000","last_became_peered":"2024-09-19T06:37:13.462750+0000","last_unstale":"2024-09-19T06:37:14.477293+0000","last_undegraded":"2024-09-19T06:37:14.477293+0000","last_fullsized":"2024-09-19T06:37:14.477293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:49.139841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030752+0000","last_change":"2024-09-19T06:37:09.448328+0000","last_active":"2024-09-19T06:37:15.030752+0000","last_peered":"2024-09-19T06:37:15.030752+0000","last_clean":"2024-09-19T06:37:15.030752+0000","last_became_active":"2024-09-19T06:37:09.448056+0000","last_became_peered":"2024-09-19T06:37:09.448056+0000","last_unstale":"2024-09-19T06:37:15.030752+0000","last_undegraded":"2024-09-19T06:37:15.030752+0000","last_fullsized":"2024-09-19T06:37:15.030752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:53.451104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478778+0000","last_change":"2024-09-19T06:37:08.439543+0000","last_active":"2024-09-19T06:37:14.478778+0000","last_peered":"2024-09-19T06:37:14.478778+0000","last_clean":"2024-09-19T06:37:14.478778+0000","last_became_active":"2024-09-19T06:37:08.438785+0000","last_became_peered":"2024-09-19T06:37:08.438785+0000","last_unstale":"2024-09-19T06:37:14.478778+0000","last_undegraded":"2024-09-19T06:37:14.478778+0000","last_fullsized":"2024-09-19T06:37:14.478778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:51.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477286+0000","last_change":"2024-09-19T06:37:13.462327+0000","last_active":"2024-09-19T06:37:14.477286+0000","last_peered":"2024-09-19T06:37:14.477286+0000","last_clean":"2024-09-19T06:37:14.477286+0000","last_became_active":"2024-09-19T06:37:13.461762+0000","last_became_peered":"2024-09-19T06:37:13.461762+0000","last_unstale":"2024-09-19T06:37:14.477286+0000","last_undegraded":"2024-09-19T06:37:14.477286+0000","last_fullsized":"2024-09-19T06:37:14.477286+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:26.931537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029982+0000","last_change":"2024-09-19T06:37:13.471309+0000","last_active":"2024-09-19T06:37:15.029982+0000","last_peered":"2024-09-19T06:37:15.029982+0000","last_clean":"2024-09-19T06:37:15.029982+0000","last_became_active":"2024-09-19T06:37:13.470969+0000","last_became_peered":"2024-09-19T06:37:13.470969+0000","last_unstale":"2024-09-19T06:37:15.029982+0000","last_undegraded":"2024-09-19T06:37:15.029982+0000","last_fullsized":"2024-09-19T06:37:15.029982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:30.990159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029769+0000","last_change":"2024-09-19T06:37:09.443308+0000","last_active":"2024-09-19T06:37:15.029769+0000","last_peered":"2024-09-19T06:37:15.029769+0000","last_clean":"2024-09-19T06:37:15.029769+0000","last_became_active":"2024-09-19T06:37:09.443069+0000","last_became_peered":"2024-09-19T06:37:09.443069+0000","last_unstale":"2024-09-19T06:37:15.029769+0000","last_undegraded":"2024-09-19T06:37:15.029769+0000","last_fullsized":"2024-09-19T06:37:15.029769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:31:33.708578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029646+0000","last_change":"2024-09-19T06:37:08.441967+0000","last_active":"2024-09-19T06:37:15.029646+0000","last_peered":"2024-09-19T06:37:15.029646+0000","last_clean":"2024-09-19T06:37:15.029646+0000","last_became_active":"2024-09-19T06:37:08.441698+0000","last_became_peered":"2024-09-19T06:37:08.441698+0000","last_unstale":"2024-09-19T06:37:15.029646+0000","last_undegraded":"2024-09-19T06:37:15.029646+0000","last_fullsized":"2024-09-19T06:37:15.029646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:56.933775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478180+0000","last_change":"2024-09-19T06:37:13.470903+0000","last_active":"2024-09-19T06:37:14.478180+0000","last_peered":"2024-09-19T06:37:14.478180+0000","last_clean":"2024-09-19T06:37:14.478180+0000","last_became_active":"2024-09-19T06:37:13.470528+0000","last_became_peered":"2024-09-19T06:37:13.470528+0000","last_unstale":"2024-09-19T06:37:14.478180+0000","last_undegraded":"2024-09-19T06:37:14.478180+0000","last_fullsized":"2024-09-19T06:37:14.478180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:45.999436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477209+0000","last_change":"2024-09-19T06:37:09.448953+0000","last_active":"2024-09-19T06:37:14.477209+0000","last_peered":"2024-09-19T06:37:14.477209+0000","last_clean":"2024-09-19T06:37:14.477209+0000","last_became_active":"2024-09-19T06:37:09.448658+0000","last_became_peered":"2024-09-19T06:37:09.448658+0000","last_unstale":"2024-09-19T06:37:14.477209+0000","last_undegraded":"2024-09-19T06:37:14.477209+0000","last_fullsized":"2024-09-19T06:37:14.477209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:07.333392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477562+0000","last_change":"2024-09-19T06:37:08.440800+0000","last_active":"2024-09-19T06:37:14.477562+0000","last_peered":"2024-09-19T06:37:14.477562+0000","last_clean":"2024-09-19T06:37:14.477562+0000","last_became_active":"2024-09-19T06:37:08.440591+0000","last_became_peered":"2024-09-19T06:37:08.440591+0000","last_unstale":"2024-09-19T06:37:14.477562+0000","last_undegraded":"2024-09-19T06:37:14.477562+0000","last_fullsized":"2024-09-19T06:37:14.477562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:05.540261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478578+0000","last_change":"2024-09-19T06:37:08.441268+0000","last_active":"2024-09-19T06:37:14.478578+0000","last_peered":"2024-09-19T06:37:14.478578+0000","last_clean":"2024-09-19T06:37:14.478578+0000","last_became_active":"2024-09-19T06:37:08.440969+0000","last_became_peered":"2024-09-19T06:37:08.440969+0000","last_unstale":"2024-09-19T06:37:14.478578+0000","last_undegraded":"2024-09-19T06:37:14.478578+0000","last_fullsized":"2024-09-19T06:37:14.478578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:59.426336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030814+0000","last_change":"2024-09-19T06:37:09.444857+0000","last_active":"2024-09-19T06:37:15.030814+0000","last_peered":"2024-09-19T06:37:15.030814+0000","last_clean":"2024-09-19T06:37:15.030814+0000","last_became_active":"2024-09-19T06:37:09.444562+0000","last_became_peered":"2024-09-19T06:37:09.444562+0000","last_unstale":"2024-09-19T06:37:15.030814+0000","last_undegraded":"2024-09-19T06:37:15.030814+0000","last_fullsized":"2024-09-19T06:37:15.030814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:02.470787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815254+0000","last_change":"2024-09-19T06:37:13.467183+0000","last_active":"2024-09-19T06:37:14.815254+0000","last_peered":"2024-09-19T06:37:14.815254+0000","last_clean":"2024-09-19T06:37:14.815254+0000","last_became_active":"2024-09-19T06:37:13.466765+0000","last_became_peered":"2024-09-19T06:37:13.466765+0000","last_unstale":"2024-09-19T06:37:14.815254+0000","last_undegraded":"2024-09-19T06:37:14.815254+0000","last_fullsized":"2024-09-19T06:37:14.815254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:35.184815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477901+0000","last_change":"2024-09-19T06:37:08.443993+0000","last_active":"2024-09-19T06:37:14.477901+0000","last_peered":"2024-09-19T06:37:14.477901+0000","last_clean":"2024-09-19T06:37:14.477901+0000","last_became_active":"2024-09-19T06:37:08.443774+0000","last_became_peered":"2024-09-19T06:37:08.443774+0000","last_unstale":"2024-09-19T06:37:14.477901+0000","last_undegraded":"2024-09-19T06:37:14.477901+0000","last_fullsized":"2024-09-19T06:37:14.477901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:16.005073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029942+0000","last_change":"2024-09-19T06:37:09.440258+0000","last_active":"2024-09-19T06:37:15.029942+0000","last_peered":"2024-09-19T06:37:15.029942+0000","last_clean":"2024-09-19T06:37:15.029942+0000","last_became_active":"2024-09-19T06:37:09.438457+0000","last_became_peered":"2024-09-19T06:37:09.438457+0000","last_unstale":"2024-09-19T06:37:15.029942+0000","last_undegraded":"2024-09-19T06:37:15.029942+0000","last_fullsized":"2024-09-19T06:37:15.029942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:24.636340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477624+0000","last_change":"2024-09-19T06:37:13.462800+0000","last_active":"2024-09-19T06:37:14.477624+0000","last_peered":"2024-09-19T06:37:14.477624+0000","last_clean":"2024-09-19T06:37:14.477624+0000","last_became_active":"2024-09-19T06:37:13.462393+0000","last_became_peered":"2024-09-19T06:37:13.462393+0000","last_unstale":"2024-09-19T06:37:14.477624+0000","last_undegraded":"2024-09-19T06:37:14.477624+0000","last_fullsized":"2024-09-19T06:37:14.477624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:35.901637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477580+0000","last_change":"2024-09-19T06:37:09.450421+0000","last_active":"2024-09-19T06:37:14.477580+0000","last_peered":"2024-09-19T06:37:14.477580+0000","last_clean":"2024-09-19T06:37:14.477580+0000","last_became_active":"2024-09-19T06:37:09.450147+0000","last_became_peered":"2024-09-19T06:37:09.450147+0000","last_unstale":"2024-09-19T06:37:14.477580+0000","last_undegraded":"2024-09-19T06:37:14.477580+0000","last_fullsized":"2024-09-19T06:37:14.477580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:42.949759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.814967+0000","last_change":"2024-09-19T06:37:09.435131+0000","last_active":"2024-09-19T06:37:14.814967+0000","last_peered":"2024-09-19T06:37:14.814967+0000","last_clean":"2024-09-19T06:37:14.814967+0000","last_became_active":"2024-09-19T06:37:09.434840+0000","last_became_peered":"2024-09-19T06:37:09.434840+0000","last_unstale":"2024-09-19T06:37:14.814967+0000","last_undegraded":"2024-09-19T06:37:14.814967+0000","last_fullsized":"2024-09-19T06:37:14.814967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:20.484554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030415+0000","last_change":"2024-09-19T06:37:09.445196+0000","last_active":"2024-09-19T06:37:15.030415+0000","last_peered":"2024-09-19T06:37:15.030415+0000","last_clean":"2024-09-19T06:37:15.030415+0000","last_became_active":"2024-09-19T06:37:09.444907+0000","last_became_peered":"2024-09-19T06:37:09.444907+0000","last_unstale":"2024-09-19T06:37:15.030415+0000","last_undegraded":"2024-09-19T06:37:15.030415+0000","last_fullsized":"2024-09-19T06:37:15.030415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:17.605675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030729+0000","last_change":"2024-09-19T06:37:09.447966+0000","last_active":"2024-09-19T06:37:15.030729+0000","last_peered":"2024-09-19T06:37:15.030729+0000","last_clean":"2024-09-19T06:37:15.030729+0000","last_became_active":"2024-09-19T06:37:09.447692+0000","last_became_peered":"2024-09-19T06:37:09.447692+0000","last_unstale":"2024-09-19T06:37:15.030729+0000","last_undegraded":"2024-09-19T06:37:15.030729+0000","last_fullsized":"2024-09-19T06:37:15.030729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:01.517824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477900+0000","last_change":"2024-09-19T06:37:09.442651+0000","last_active":"2024-09-19T06:37:14.477900+0000","last_peered":"2024-09-19T06:37:14.477900+0000","last_clean":"2024-09-19T06:37:14.477900+0000","last_became_active":"2024-09-19T06:37:09.442195+0000","last_became_peered":"2024-09-19T06:37:09.442195+0000","last_unstale":"2024-09-19T06:37:14.477900+0000","last_undegraded":"2024-09-19T06:37:14.477900+0000","last_fullsized":"2024-09-19T06:37:14.477900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:15.658285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030600+0000","last_change":"2024-09-19T06:37:09.441782+0000","last_active":"2024-09-19T06:37:15.030600+0000","last_peered":"2024-09-19T06:37:15.030600+0000","last_clean":"2024-09-19T06:37:15.030600+0000","last_became_active":"2024-09-19T06:37:09.441456+0000","last_became_peered":"2024-09-19T06:37:09.441456+0000","last_unstale":"2024-09-19T06:37:15.030600+0000","last_undegraded":"2024-09-19T06:37:15.030600+0000","last_fullsized":"2024-09-19T06:37:15.030600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:04:28.458974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479237+0000","last_change":"2024-09-19T06:37:09.449856+0000","last_active":"2024-09-19T06:37:14.479237+0000","last_peered":"2024-09-19T06:37:14.479237+0000","last_clean":"2024-09-19T06:37:14.479237+0000","last_became_active":"2024-09-19T06:37:09.449562+0000","last_became_peered":"2024-09-19T06:37:09.449562+0000","last_unstale":"2024-09-19T06:37:14.479237+0000","last_undegraded":"2024-09-19T06:37:14.479237+0000","last_fullsized":"2024-09-19T06:37:14.479237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:49.182126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477764+0000","last_change":"2024-09-19T06:37:09.438551+0000","last_active":"2024-09-19T06:37:14.477764+0000","last_peered":"2024-09-19T06:37:14.477764+0000","last_clean":"2024-09-19T06:37:14.477764+0000","last_became_active":"2024-09-19T06:37:09.437624+0000","last_became_peered":"2024-09-19T06:37:09.437624+0000","last_unstale":"2024-09-19T06:37:14.477764+0000","last_undegraded":"2024-09-19T06:37:14.477764+0000","last_fullsized":"2024-09-19T06:37:14.477764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:46.565780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029601+0000","last_change":"2024-09-19T06:37:09.438737+0000","last_active":"2024-09-19T06:37:15.029601+0000","last_peered":"2024-09-19T06:37:15.029601+0000","last_clean":"2024-09-19T06:37:15.029601+0000","last_became_active":"2024-09-19T06:37:09.438453+0000","last_became_peered":"2024-09-19T06:37:09.438453+0000","last_unstale":"2024-09-19T06:37:15.029601+0000","last_undegraded":"2024-09-19T06:37:15.029601+0000","last_fullsized":"2024-09-19T06:37:15.029601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.982275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477390+0000","last_change":"2024-09-19T06:37:09.442093+0000","last_active":"2024-09-19T06:37:14.477390+0000","last_peered":"2024-09-19T06:37:14.477390+0000","last_clean":"2024-09-19T06:37:14.477390+0000","last_became_active":"2024-09-19T06:37:09.439710+0000","last_became_peered":"2024-09-19T06:37:09.439710+0000","last_unstale":"2024-09-19T06:37:14.477390+0000","last_undegraded":"2024-09-19T06:37:14.477390+0000","last_fullsized":"2024-09-19T06:37:14.477390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:02.626854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030310+0000","last_change":"2024-09-19T06:37:09.438271+0000","last_active":"2024-09-19T06:37:15.030310+0000","last_peered":"2024-09-19T06:37:15.030310+0000","last_clean":"2024-09-19T06:37:15.030310+0000","last_became_active":"2024-09-19T06:37:09.438009+0000","last_became_peered":"2024-09-19T06:37:09.438009+0000","last_unstale":"2024-09-19T06:37:15.030310+0000","last_undegraded":"2024-09-19T06:37:15.030310+0000","last_fullsized":"2024-09-19T06:37:15.030310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:26.395210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030632+0000","last_change":"2024-09-19T06:37:09.449633+0000","last_active":"2024-09-19T06:37:15.030632+0000","last_peered":"2024-09-19T06:37:15.030632+0000","last_clean":"2024-09-19T06:37:15.030632+0000","last_became_active":"2024-09-19T06:37:09.449379+0000","last_became_peered":"2024-09-19T06:37:09.449379+0000","last_unstale":"2024-09-19T06:37:15.030632+0000","last_undegraded":"2024-09-19T06:37:15.030632+0000","last_fullsized":"2024-09-19T06:37:15.030632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:29.565038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478253+0000","last_change":"2024-09-19T06:37:09.447808+0000","last_active":"2024-09-19T06:37:14.478253+0000","last_peered":"2024-09-19T06:37:14.478253+0000","last_clean":"2024-09-19T06:37:14.478253+0000","last_became_active":"2024-09-19T06:37:09.447514+0000","last_became_peered":"2024-09-19T06:37:09.447514+0000","last_unstale":"2024-09-19T06:37:14.478253+0000","last_undegraded":"2024-09-19T06:37:14.478253+0000","last_fullsized":"2024-09-19T06:37:14.478253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:04.653997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479576+0000","last_change":"2024-09-19T06:37:09.439605+0000","last_active":"2024-09-19T06:37:14.479576+0000","last_peered":"2024-09-19T06:37:14.479576+0000","last_clean":"2024-09-19T06:37:14.479576+0000","last_became_active":"2024-09-19T06:37:09.432601+0000","last_became_peered":"2024-09-19T06:37:09.432601+0000","last_unstale":"2024-09-19T06:37:14.479576+0000","last_undegraded":"2024-09-19T06:37:14.479576+0000","last_fullsized":"2024-09-19T06:37:14.479576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:50.640062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815206+0000","last_change":"2024-09-19T06:37:09.440268+0000","last_active":"2024-09-19T06:37:14.815206+0000","last_peered":"2024-09-19T06:37:14.815206+0000","last_clean":"2024-09-19T06:37:14.815206+0000","last_became_active":"2024-09-19T06:37:09.439937+0000","last_became_peered":"2024-09-19T06:37:09.439937+0000","last_unstale":"2024-09-19T06:37:14.815206+0000","last_undegraded":"2024-09-19T06:37:14.815206+0000","last_fullsized":"2024-09-19T06:37:14.815206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:32:46.182979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030922+0000","last_change":"2024-09-19T06:37:09.437080+0000","last_active":"2024-09-19T06:37:15.030922+0000","last_peered":"2024-09-19T06:37:15.030922+0000","last_clean":"2024-09-19T06:37:15.030922+0000","last_became_active":"2024-09-19T06:37:09.436752+0000","last_became_peered":"2024-09-19T06:37:09.436752+0000","last_unstale":"2024-09-19T06:37:15.030922+0000","last_undegraded":"2024-09-19T06:37:15.030922+0000","last_fullsized":"2024-09-19T06:37:15.030922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:31.423640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029549+0000","last_change":"2024-09-19T06:37:09.448942+0000","last_active":"2024-09-19T06:37:15.029549+0000","last_peered":"2024-09-19T06:37:15.029549+0000","last_clean":"2024-09-19T06:37:15.029549+0000","last_became_active":"2024-09-19T06:37:09.448647+0000","last_became_peered":"2024-09-19T06:37:09.448647+0000","last_unstale":"2024-09-19T06:37:15.029549+0000","last_undegraded":"2024-09-19T06:37:15.029549+0000","last_fullsized":"2024-09-19T06:37:15.029549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:49.027909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029809+0000","last_change":"2024-09-19T06:37:09.445015+0000","last_active":"2024-09-19T06:37:15.029809+0000","last_peered":"2024-09-19T06:37:15.029809+0000","last_clean":"2024-09-19T06:37:15.029809+0000","last_became_active":"2024-09-19T06:37:09.444737+0000","last_became_peered":"2024-09-19T06:37:09.444737+0000","last_unstale":"2024-09-19T06:37:15.029809+0000","last_undegraded":"2024-09-19T06:37:15.029809+0000","last_fullsized":"2024-09-19T06:37:15.029809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:16.194580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029853+0000","last_change":"2024-09-19T06:37:09.446025+0000","last_active":"2024-09-19T06:37:15.029853+0000","last_peered":"2024-09-19T06:37:15.029853+0000","last_clean":"2024-09-19T06:37:15.029853+0000","last_became_active":"2024-09-19T06:37:09.445503+0000","last_became_peered":"2024-09-19T06:37:09.445503+0000","last_unstale":"2024-09-19T06:37:15.029853+0000","last_undegraded":"2024-09-19T06:37:15.029853+0000","last_fullsized":"2024-09-19T06:37:15.029853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:30.469995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477784+0000","last_change":"2024-09-19T06:37:09.441302+0000","last_active":"2024-09-19T06:37:14.477784+0000","last_peered":"2024-09-19T06:37:14.477784+0000","last_clean":"2024-09-19T06:37:14.477784+0000","last_became_active":"2024-09-19T06:37:09.439767+0000","last_became_peered":"2024-09-19T06:37:09.439767+0000","last_unstale":"2024-09-19T06:37:14.477784+0000","last_undegraded":"2024-09-19T06:37:14.477784+0000","last_fullsized":"2024-09-19T06:37:14.477784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:01.038823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030560+0000","last_change":"2024-09-19T06:37:09.440976+0000","last_active":"2024-09-19T06:37:15.030560+0000","last_peered":"2024-09-19T06:37:15.030560+0000","last_clean":"2024-09-19T06:37:15.030560+0000","last_became_active":"2024-09-19T06:37:09.440702+0000","last_became_peered":"2024-09-19T06:37:09.440702+0000","last_unstale":"2024-09-19T06:37:15.030560+0000","last_undegraded":"2024-09-19T06:37:15.030560+0000","last_fullsized":"2024-09-19T06:37:15.030560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:21.281400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477942+0000","last_change":"2024-09-19T06:37:09.442301+0000","last_active":"2024-09-19T06:37:14.477942+0000","last_peered":"2024-09-19T06:37:14.477942+0000","last_clean":"2024-09-19T06:37:14.477942+0000","last_became_active":"2024-09-19T06:37:09.442053+0000","last_became_peered":"2024-09-19T06:37:09.442053+0000","last_unstale":"2024-09-19T06:37:14.477942+0000","last_undegraded":"2024-09-19T06:37:14.477942+0000","last_fullsized":"2024-09-19T06:37:14.477942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:26.189384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479335+0000","last_change":"2024-09-19T06:37:09.441525+0000","last_active":"2024-09-19T06:37:14.479335+0000","last_peered":"2024-09-19T06:37:14.479335+0000","last_clean":"2024-09-19T06:37:14.479335+0000","last_became_active":"2024-09-19T06:37:09.441179+0000","last_became_peered":"2024-09-19T06:37:09.441179+0000","last_unstale":"2024-09-19T06:37:14.479335+0000","last_undegraded":"2024-09-19T06:37:14.479335+0000","last_fullsized":"2024-09-19T06:37:14.479335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:47.235113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479743+0000","last_change":"2024-09-19T06:37:09.437163+0000","last_active":"2024-09-19T06:37:14.479743+0000","last_peered":"2024-09-19T06:37:14.479743+0000","last_clean":"2024-09-19T06:37:14.479743+0000","last_became_active":"2024-09-19T06:37:09.436892+0000","last_became_peered":"2024-09-19T06:37:09.436892+0000","last_unstale":"2024-09-19T06:37:14.479743+0000","last_undegraded":"2024-09-19T06:37:14.479743+0000","last_fullsized":"2024-09-19T06:37:14.479743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:47:58.347385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477114+0000","last_change":"2024-09-19T06:37:09.437524+0000","last_active":"2024-09-19T06:37:14.477114+0000","last_peered":"2024-09-19T06:37:14.477114+0000","last_clean":"2024-09-19T06:37:14.477114+0000","last_became_active":"2024-09-19T06:37:09.437023+0000","last_became_peered":"2024-09-19T06:37:09.437023+0000","last_unstale":"2024-09-19T06:37:14.477114+0000","last_undegraded":"2024-09-19T06:37:14.477114+0000","last_fullsized":"2024-09-19T06:37:14.477114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:31.398914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478456+0000","last_change":"2024-09-19T06:37:09.448814+0000","last_active":"2024-09-19T06:37:14.478456+0000","last_peered":"2024-09-19T06:37:14.478456+0000","last_clean":"2024-09-19T06:37:14.478456+0000","last_became_active":"2024-09-19T06:37:09.448547+0000","last_became_peered":"2024-09-19T06:37:09.448547+0000","last_unstale":"2024-09-19T06:37:14.478456+0000","last_undegraded":"2024-09-19T06:37:14.478456+0000","last_fullsized":"2024-09-19T06:37:14.478456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:13.526300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030114+0000","last_change":"2024-09-19T06:37:09.446910+0000","last_active":"2024-09-19T06:37:15.030114+0000","last_peered":"2024-09-19T06:37:15.030114+0000","last_clean":"2024-09-19T06:37:15.030114+0000","last_became_active":"2024-09-19T06:37:09.446603+0000","last_became_peered":"2024-09-19T06:37:09.446603+0000","last_unstale":"2024-09-19T06:37:15.030114+0000","last_undegraded":"2024-09-19T06:37:15.030114+0000","last_fullsized":"2024-09-19T06:37:15.030114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:47.006354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479198+0000","last_change":"2024-09-19T06:37:09.430160+0000","last_active":"2024-09-19T06:37:14.479198+0000","last_peered":"2024-09-19T06:37:14.479198+0000","last_clean":"2024-09-19T06:37:14.479198+0000","last_became_active":"2024-09-19T06:37:09.429813+0000","last_became_peered":"2024-09-19T06:37:09.429813+0000","last_unstale":"2024-09-19T06:37:14.479198+0000","last_undegraded":"2024-09-19T06:37:14.479198+0000","last_fullsized":"2024-09-19T06:37:14.479198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:10.353834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030011+0000","last_change":"2024-09-19T06:37:09.446622+0000","last_active":"2024-09-19T06:37:15.030011+0000","last_peered":"2024-09-19T06:37:15.030011+0000","last_clean":"2024-09-19T06:37:15.030011+0000","last_became_active":"2024-09-19T06:37:09.446349+0000","last_became_peered":"2024-09-19T06:37:09.446349+0000","last_unstale":"2024-09-19T06:37:15.030011+0000","last_undegraded":"2024-09-19T06:37:15.030011+0000","last_fullsized":"2024-09-19T06:37:15.030011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:01.702039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030152+0000","last_change":"2024-09-19T06:37:09.446789+0000","last_active":"2024-09-19T06:37:15.030152+0000","last_peered":"2024-09-19T06:37:15.030152+0000","last_clean":"2024-09-19T06:37:15.030152+0000","last_became_active":"2024-09-19T06:37:09.446557+0000","last_became_peered":"2024-09-19T06:37:09.446557+0000","last_unstale":"2024-09-19T06:37:15.030152+0000","last_undegraded":"2024-09-19T06:37:15.030152+0000","last_fullsized":"2024-09-19T06:37:15.030152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:18.119474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030246+0000","last_change":"2024-09-19T06:37:09.448093+0000","last_active":"2024-09-19T06:37:15.030246+0000","last_peered":"2024-09-19T06:37:15.030246+0000","last_clean":"2024-09-19T06:37:15.030246+0000","last_became_active":"2024-09-19T06:37:09.447753+0000","last_became_peered":"2024-09-19T06:37:09.447753+0000","last_unstale":"2024-09-19T06:37:15.030246+0000","last_undegraded":"2024-09-19T06:37:15.030246+0000","last_fullsized":"2024-09-19T06:37:15.030246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:11.944092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479640+0000","last_change":"2024-09-19T06:37:09.442798+0000","last_active":"2024-09-19T06:37:14.479640+0000","last_peered":"2024-09-19T06:37:14.479640+0000","last_clean":"2024-09-19T06:37:14.479640+0000","last_became_active":"2024-09-19T06:37:09.442047+0000","last_became_peered":"2024-09-19T06:37:09.442047+0000","last_unstale":"2024-09-19T06:37:14.479640+0000","last_undegraded":"2024-09-19T06:37:14.479640+0000","last_fullsized":"2024-09-19T06:37:14.479640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:33.193185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65040,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":348160,"data_stored":698736,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":698680,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":107730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:37:29.443 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:37:29.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.575+0000 7f42581e4640 1 Processor -- start 2024-09-19T06:37:29.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.575+0000 7f42581e4640 1 -- start start 2024-09-19T06:37:29.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.576+0000 7f42581e4640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f42500cb660 0x7f42500cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:29.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.576+0000 7f42581e4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42500c6df0 0x7f425015e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:29.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.576+0000 7f42581e4640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42500ccb90 con 0x7f42500cba40 2024-09-19T06:37:29.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.576+0000 7f42581e4640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f42500cce20 con 0x7f42500cb660 2024-09-19T06:37:29.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.576+0000 7f42581e4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f42500cd100 con 0x7f42500c6df0 2024-09-19T06:37:29.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.576+0000 7f4255f80640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f42500cb660 0x7f42500cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:29.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.576+0000 7f4255f80640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f42500cb660 0x7f42500cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39342/0 (socket says 172.21.15.86:39342) 2024-09-19T06:37:29.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.576+0000 7f4255f80640 1 -- 172.21.15.86:0/2016638463 learned_addr learned my addr 172.21.15.86:0/2016638463 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:29.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.577+0000 7f4255f80640 1 -- 172.21.15.86:0/2016638463 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42500c6df0 msgr2=0x7f425015e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:29.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.577+0000 7f425577f640 1 --2- 172.21.15.86:0/2016638463 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42500c6df0 0x7f425015e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:29.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.577+0000 7f4255f80640 1 --2- 172.21.15.86:0/2016638463 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42500c6df0 0x7f425015e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.577+0000 7f4255f80640 1 -- 172.21.15.86:0/2016638463 >> v1:172.21.15.86:6789/0 conn(0x7f42500cba40 legacy=0x7f4250158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:29.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.577+0000 7f4254f7e640 1 -- 172.21.15.86:0/2016638463 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2636175681 0 0) 0x7f42500ccb90 con 0x7f42500cba40 2024-09-19T06:37:29.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.577+0000 7f4255f80640 1 -- 172.21.15.86:0/2016638463 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42500c6310 con 0x7f42500cb660 2024-09-19T06:37:29.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.577+0000 7f4255f80640 1 --2- 172.21.15.86:0/2016638463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42500cb660 0x7f42500cc650 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f424c009870 tx=0x7f424c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55458b30bc55ad3b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:29.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.577+0000 7f4254f7e640 1 -- 172.21.15.86:0/2016638463 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c037070 con 0x7f42500cb660 2024-09-19T06:37:29.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.577+0000 7f4254f7e640 1 -- 172.21.15.86:0/2016638463 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f424c032440 con 0x7f42500cb660 2024-09-19T06:37:29.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.577+0000 7f4254f7e640 1 -- 172.21.15.86:0/2016638463 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c032810 con 0x7f42500cb660 2024-09-19T06:37:29.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.578+0000 7f42581e4640 1 -- 172.21.15.86:0/2016638463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42500cb660 msgr2=0x7f42500cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:29.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.578+0000 7f42581e4640 1 --2- 172.21.15.86:0/2016638463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42500cb660 0x7f42500cc650 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f424c009870 tx=0x7f424c02a270 comp rx=0 tx=0).stop 2024-09-19T06:37:29.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.578+0000 7f42581e4640 1 -- 172.21.15.86:0/2016638463 shutdown_connections 2024-09-19T06:37:29.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.578+0000 7f42581e4640 1 --2- 172.21.15.86:0/2016638463 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42500c6df0 0x7f425015e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.578+0000 7f42581e4640 1 --2- 172.21.15.86:0/2016638463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42500cb660 0x7f42500cc650 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.578+0000 7f42581e4640 1 -- 172.21.15.86:0/2016638463 >> 172.21.15.86:0/2016638463 conn(0x7f425006bcc0 msgr2=0x7f425006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:29.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.578+0000 7f42581e4640 1 -- 172.21.15.86:0/2016638463 shutdown_connections 2024-09-19T06:37:29.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.578+0000 7f42581e4640 1 -- 172.21.15.86:0/2016638463 wait complete. 2024-09-19T06:37:29.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.579+0000 7f42581e4640 1 Processor -- start 2024-09-19T06:37:29.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.579+0000 7f42581e4640 1 -- start start 2024-09-19T06:37:29.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.580+0000 7f42581e4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42500c6df0 0x7f42500d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:29.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.580+0000 7f42581e4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42500cb660 0x7f4250150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:29.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.580+0000 7f42581e4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42500cba40 0x7f42501f4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:29.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.580+0000 7f42581e4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f42500c7e70 con 0x7f42500cb660 2024-09-19T06:37:29.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.580+0000 7f42581e4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f42500c68d0 con 0x7f42500c6df0 2024-09-19T06:37:29.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.580+0000 7f42581e4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f425015ee00 con 0x7f42500cba40 2024-09-19T06:37:29.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.580+0000 7f425577f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42500cb660 0x7f4250150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:29.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.580+0000 7f425577f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42500cb660 0x7f4250150910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39344/0 (socket says 172.21.15.86:39344) 2024-09-19T06:37:29.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.580+0000 7f425577f640 1 -- 172.21.15.86:0/2688502997 learned_addr learned my addr 172.21.15.86:0/2688502997 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:29.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.580+0000 7f4255f80640 1 --2- 172.21.15.86:0/2688502997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42500c6df0 0x7f42500d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:29.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.580+0000 7f4256781640 1 --2- 172.21.15.86:0/2688502997 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42500cba40 0x7f42501f4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:29.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.580+0000 7f425577f640 1 -- 172.21.15.86:0/2688502997 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42500cba40 msgr2=0x7f42501f4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:29.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.580+0000 7f425577f640 1 --2- 172.21.15.86:0/2688502997 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42500cba40 0x7f42501f4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.580+0000 7f425577f640 1 -- 172.21.15.86:0/2688502997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42500c6df0 msgr2=0x7f42500d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:29.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.580+0000 7f425577f640 1 --2- 172.21.15.86:0/2688502997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42500c6df0 0x7f42500d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.580+0000 7f425577f640 1 -- 172.21.15.86:0/2688502997 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42500d1290 con 0x7f42500cb660 2024-09-19T06:37:29.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.580+0000 7f425577f640 1 --2- 172.21.15.86:0/2688502997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42500cb660 0x7f4250150910 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f424000c820 tx=0x7f424000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:29.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.581+0000 7f42467fc640 1 -- 172.21.15.86:0/2688502997 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4240015070 con 0x7f42500cb660 2024-09-19T06:37:29.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.581+0000 7f42467fc640 1 -- 172.21.15.86:0/2688502997 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4240004220 con 0x7f42500cb660 2024-09-19T06:37:29.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.581+0000 7f42581e4640 1 -- 172.21.15.86:0/2688502997 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42500d1540 con 0x7f42500cb660 2024-09-19T06:37:29.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.581+0000 7f42467fc640 1 -- 172.21.15.86:0/2688502997 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424000ce10 con 0x7f42500cb660 2024-09-19T06:37:29.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.581+0000 7f42581e4640 1 -- 172.21.15.86:0/2688502997 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42501e59c0 con 0x7f42500cb660 2024-09-19T06:37:29.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.582+0000 7f42581e4640 1 -- 172.21.15.86:0/2688502997 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42500c58f0 con 0x7f42500cb660 2024-09-19T06:37:29.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.582+0000 7f42467fc640 1 -- 172.21.15.86:0/2688502997 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4240007830 con 0x7f42500cb660 2024-09-19T06:37:29.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.583+0000 7f42467fc640 1 --2- 172.21.15.86:0/2688502997 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f423406c2b0 0x7f423406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:29.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.583+0000 7f42467fc640 1 -- 172.21.15.86:0/2688502997 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f424008b6f0 con 0x7f42500cb660 2024-09-19T06:37:29.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.583+0000 7f4255f80640 1 --2- 172.21.15.86:0/2688502997 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f423406c2b0 0x7f423406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:29.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.583+0000 7f4255f80640 1 --2- 172.21.15.86:0/2688502997 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f423406c2b0 0x7f423406e770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f424c034000 tx=0x7f424c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:29.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.587+0000 7f42467fc640 1 -- 172.21.15.86:0/2688502997 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4240059a90 con 0x7f42500cb660 2024-09-19T06:37:29.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.749+0000 7f42581e4640 1 -- 172.21.15.86:0/2688502997 --> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4250068290 con 0x7f423406c2b0 2024-09-19T06:37:29.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.757+0000 7f42467fc640 1 -- 172.21.15.86:0/2688502997 <== mgr.4105 v2:172.21.15.86:6816/4165134248 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332614 (secure 0 0 0) 0x7f4250068290 con 0x7f423406c2b0 2024-09-19T06:37:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:29.763 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-09-19T06:37:29.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.760+0000 7f42581e4640 1 -- 172.21.15.86:0/2688502997 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f423406c2b0 msgr2=0x7f423406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:29.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.760+0000 7f42581e4640 1 --2- 172.21.15.86:0/2688502997 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f423406c2b0 0x7f423406e770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f424c034000 tx=0x7f424c02e000 comp rx=0 tx=0).stop 2024-09-19T06:37:29.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.760+0000 7f42581e4640 1 -- 172.21.15.86:0/2688502997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42500cb660 msgr2=0x7f4250150910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:29.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.760+0000 7f42581e4640 1 --2- 172.21.15.86:0/2688502997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42500cb660 0x7f4250150910 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f424000c820 tx=0x7f424000cce0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.760+0000 7f42581e4640 1 -- 172.21.15.86:0/2688502997 shutdown_connections 2024-09-19T06:37:29.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.760+0000 7f42581e4640 1 --2- 172.21.15.86:0/2688502997 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f423406c2b0 0x7f423406e770 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.760+0000 7f42581e4640 1 --2- 172.21.15.86:0/2688502997 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42500cba40 0x7f42501f4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.760+0000 7f42581e4640 1 --2- 172.21.15.86:0/2688502997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42500cb660 0x7f4250150910 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.760+0000 7f42581e4640 1 --2- 172.21.15.86:0/2688502997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42500c6df0 0x7f42500d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.760+0000 7f42581e4640 1 -- 172.21.15.86:0/2688502997 >> 172.21.15.86:0/2688502997 conn(0x7f425006bcc0 msgr2=0x7f425015d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:29.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.760+0000 7f42581e4640 1 -- 172.21.15.86:0/2688502997 shutdown_connections 2024-09-19T06:37:29.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.760+0000 7f42581e4640 1 -- 172.21.15.86:0/2688502997 wait complete. 2024-09-19T06:37:29.772 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-19T06:37:29.745565+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218536,"kb_used_data":2304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756184,"statfs":{"total":773094113280,"available":772870332416,"internally_reserved":0,"allocated":2359296,"data_stored":2051860,"data_compressed":65040,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2870,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002792"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030305+0000","last_change":"2024-09-19T06:37:08.446272+0000","last_active":"2024-09-19T06:37:15.030305+0000","last_peered":"2024-09-19T06:37:15.030305+0000","last_clean":"2024-09-19T06:37:15.030305+0000","last_became_active":"2024-09-19T06:37:08.446044+0000","last_became_peered":"2024-09-19T06:37:08.446044+0000","last_unstale":"2024-09-19T06:37:15.030305+0000","last_undegraded":"2024-09-19T06:37:15.030305+0000","last_fullsized":"2024-09-19T06:37:15.030305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:37.623543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477629+0000","last_change":"2024-09-19T06:37:09.441539+0000","last_active":"2024-09-19T06:37:14.477629+0000","last_peered":"2024-09-19T06:37:14.477629+0000","last_clean":"2024-09-19T06:37:14.477629+0000","last_became_active":"2024-09-19T06:37:09.440839+0000","last_became_peered":"2024-09-19T06:37:09.440839+0000","last_unstale":"2024-09-19T06:37:14.477629+0000","last_undegraded":"2024-09-19T06:37:14.477629+0000","last_fullsized":"2024-09-19T06:37:14.477629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:49.222252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477205+0000","last_change":"2024-09-19T06:37:13.461355+0000","last_active":"2024-09-19T06:37:14.477205+0000","last_peered":"2024-09-19T06:37:14.477205+0000","last_clean":"2024-09-19T06:37:14.477205+0000","last_became_active":"2024-09-19T06:37:13.460936+0000","last_became_peered":"2024-09-19T06:37:13.460936+0000","last_unstale":"2024-09-19T06:37:14.477205+0000","last_undegraded":"2024-09-19T06:37:14.477205+0000","last_fullsized":"2024-09-19T06:37:14.477205+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:59.860583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477847+0000","last_change":"2024-09-19T06:37:08.438583+0000","last_active":"2024-09-19T06:37:14.477847+0000","last_peered":"2024-09-19T06:37:14.477847+0000","last_clean":"2024-09-19T06:37:14.477847+0000","last_became_active":"2024-09-19T06:37:08.437921+0000","last_became_peered":"2024-09-19T06:37:08.437921+0000","last_unstale":"2024-09-19T06:37:14.477847+0000","last_undegraded":"2024-09-19T06:37:14.477847+0000","last_fullsized":"2024-09-19T06:37:14.477847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:58:23.269120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030018+0000","last_change":"2024-09-19T06:37:09.450731+0000","last_active":"2024-09-19T06:37:15.030018+0000","last_peered":"2024-09-19T06:37:15.030018+0000","last_clean":"2024-09-19T06:37:15.030018+0000","last_became_active":"2024-09-19T06:37:09.450430+0000","last_became_peered":"2024-09-19T06:37:09.450430+0000","last_unstale":"2024-09-19T06:37:15.030018+0000","last_undegraded":"2024-09-19T06:37:15.030018+0000","last_fullsized":"2024-09-19T06:37:15.030018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:21.701872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029552+0000","last_change":"2024-09-19T06:37:13.459445+0000","last_active":"2024-09-19T06:37:15.029552+0000","last_peered":"2024-09-19T06:37:15.029552+0000","last_clean":"2024-09-19T06:37:15.029552+0000","last_became_active":"2024-09-19T06:37:13.459040+0000","last_became_peered":"2024-09-19T06:37:13.459040+0000","last_unstale":"2024-09-19T06:37:15.029552+0000","last_undegraded":"2024-09-19T06:37:15.029552+0000","last_fullsized":"2024-09-19T06:37:15.029552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:37.676097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479475+0000","last_change":"2024-09-19T06:37:08.448303+0000","last_active":"2024-09-19T06:37:14.479475+0000","last_peered":"2024-09-19T06:37:14.479475+0000","last_clean":"2024-09-19T06:37:14.479475+0000","last_became_active":"2024-09-19T06:37:08.447559+0000","last_became_peered":"2024-09-19T06:37:08.447559+0000","last_unstale":"2024-09-19T06:37:14.479475+0000","last_undegraded":"2024-09-19T06:37:14.479475+0000","last_fullsized":"2024-09-19T06:37:14.479475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:43.093216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030079+0000","last_change":"2024-09-19T06:37:09.445971+0000","last_active":"2024-09-19T06:37:15.030079+0000","last_peered":"2024-09-19T06:37:15.030079+0000","last_clean":"2024-09-19T06:37:15.030079+0000","last_became_active":"2024-09-19T06:37:09.444806+0000","last_became_peered":"2024-09-19T06:37:09.444806+0000","last_unstale":"2024-09-19T06:37:15.030079+0000","last_undegraded":"2024-09-19T06:37:15.030079+0000","last_fullsized":"2024-09-19T06:37:15.030079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:15.765835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030528+0000","last_change":"2024-09-19T06:37:13.459035+0000","last_active":"2024-09-19T06:37:15.030528+0000","last_peered":"2024-09-19T06:37:15.030528+0000","last_clean":"2024-09-19T06:37:15.030528+0000","last_became_active":"2024-09-19T06:37:13.458588+0000","last_became_peered":"2024-09-19T06:37:13.458588+0000","last_unstale":"2024-09-19T06:37:15.030528+0000","last_undegraded":"2024-09-19T06:37:15.030528+0000","last_fullsized":"2024-09-19T06:37:15.030528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:27.900054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479040+0000","last_change":"2024-09-19T06:37:08.446363+0000","last_active":"2024-09-19T06:37:14.479040+0000","last_peered":"2024-09-19T06:37:14.479040+0000","last_clean":"2024-09-19T06:37:14.479040+0000","last_became_active":"2024-09-19T06:37:08.446053+0000","last_became_peered":"2024-09-19T06:37:08.446053+0000","last_unstale":"2024-09-19T06:37:14.479040+0000","last_undegraded":"2024-09-19T06:37:14.479040+0000","last_fullsized":"2024-09-19T06:37:14.479040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:22.488347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030495+0000","last_change":"2024-09-19T06:37:09.445124+0000","last_active":"2024-09-19T06:37:15.030495+0000","last_peered":"2024-09-19T06:37:15.030495+0000","last_clean":"2024-09-19T06:37:15.030495+0000","last_became_active":"2024-09-19T06:37:09.444824+0000","last_became_peered":"2024-09-19T06:37:09.444824+0000","last_unstale":"2024-09-19T06:37:15.030495+0000","last_undegraded":"2024-09-19T06:37:15.030495+0000","last_fullsized":"2024-09-19T06:37:15.030495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:40:05.642055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030082+0000","last_change":"2024-09-19T06:37:13.459720+0000","last_active":"2024-09-19T06:37:15.030082+0000","last_peered":"2024-09-19T06:37:15.030082+0000","last_clean":"2024-09-19T06:37:15.030082+0000","last_became_active":"2024-09-19T06:37:13.459350+0000","last_became_peered":"2024-09-19T06:37:13.459350+0000","last_unstale":"2024-09-19T06:37:15.030082+0000","last_undegraded":"2024-09-19T06:37:15.030082+0000","last_fullsized":"2024-09-19T06:37:15.030082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:29.546976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478406+0000","last_change":"2024-09-19T06:37:09.447795+0000","last_active":"2024-09-19T06:37:14.478406+0000","last_peered":"2024-09-19T06:37:14.478406+0000","last_clean":"2024-09-19T06:37:14.478406+0000","last_became_active":"2024-09-19T06:37:09.447502+0000","last_became_peered":"2024-09-19T06:37:09.447502+0000","last_unstale":"2024-09-19T06:37:14.478406+0000","last_undegraded":"2024-09-19T06:37:14.478406+0000","last_fullsized":"2024-09-19T06:37:14.478406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:51.384743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479493+0000","last_change":"2024-09-19T06:37:08.446179+0000","last_active":"2024-09-19T06:37:14.479493+0000","last_peered":"2024-09-19T06:37:14.479493+0000","last_clean":"2024-09-19T06:37:14.479493+0000","last_became_active":"2024-09-19T06:37:08.445834+0000","last_became_peered":"2024-09-19T06:37:08.445834+0000","last_unstale":"2024-09-19T06:37:14.479493+0000","last_undegraded":"2024-09-19T06:37:14.479493+0000","last_fullsized":"2024-09-19T06:37:14.479493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:03.783414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030572+0000","last_change":"2024-09-19T06:37:13.460344+0000","last_active":"2024-09-19T06:37:15.030572+0000","last_peered":"2024-09-19T06:37:15.030572+0000","last_clean":"2024-09-19T06:37:15.030572+0000","last_became_active":"2024-09-19T06:37:13.459967+0000","last_became_peered":"2024-09-19T06:37:13.459967+0000","last_unstale":"2024-09-19T06:37:15.030572+0000","last_undegraded":"2024-09-19T06:37:15.030572+0000","last_fullsized":"2024-09-19T06:37:15.030572+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:59.096218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477943+0000","last_change":"2024-09-19T06:37:09.449884+0000","last_active":"2024-09-19T06:37:14.477943+0000","last_peered":"2024-09-19T06:37:14.477943+0000","last_clean":"2024-09-19T06:37:14.477943+0000","last_became_active":"2024-09-19T06:37:09.449645+0000","last_became_peered":"2024-09-19T06:37:09.449645+0000","last_unstale":"2024-09-19T06:37:14.477943+0000","last_undegraded":"2024-09-19T06:37:14.477943+0000","last_fullsized":"2024-09-19T06:37:14.477943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:07.353098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030475+0000","last_change":"2024-09-19T06:37:08.437022+0000","last_active":"2024-09-19T06:37:15.030475+0000","last_peered":"2024-09-19T06:37:15.030475+0000","last_clean":"2024-09-19T06:37:15.030475+0000","last_became_active":"2024-09-19T06:37:08.436761+0000","last_became_peered":"2024-09-19T06:37:08.436761+0000","last_unstale":"2024-09-19T06:37:15.030475+0000","last_undegraded":"2024-09-19T06:37:15.030475+0000","last_fullsized":"2024-09-19T06:37:15.030475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:04.985581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030395+0000","last_change":"2024-09-19T06:37:13.460470+0000","last_active":"2024-09-19T06:37:15.030395+0000","last_peered":"2024-09-19T06:37:15.030395+0000","last_clean":"2024-09-19T06:37:15.030395+0000","last_became_active":"2024-09-19T06:37:13.460072+0000","last_became_peered":"2024-09-19T06:37:13.460072+0000","last_unstale":"2024-09-19T06:37:15.030395+0000","last_undegraded":"2024-09-19T06:37:15.030395+0000","last_fullsized":"2024-09-19T06:37:15.030395+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:50.835286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477295+0000","last_change":"2024-09-19T06:37:09.433042+0000","last_active":"2024-09-19T06:37:14.477295+0000","last_peered":"2024-09-19T06:37:14.477295+0000","last_clean":"2024-09-19T06:37:14.477295+0000","last_became_active":"2024-09-19T06:37:09.432589+0000","last_became_peered":"2024-09-19T06:37:09.432589+0000","last_unstale":"2024-09-19T06:37:14.477295+0000","last_undegraded":"2024-09-19T06:37:14.477295+0000","last_fullsized":"2024-09-19T06:37:14.477295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:18.661071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029869+0000","last_change":"2024-09-19T06:37:08.444408+0000","last_active":"2024-09-19T06:37:15.029869+0000","last_peered":"2024-09-19T06:37:15.029869+0000","last_clean":"2024-09-19T06:37:15.029869+0000","last_became_active":"2024-09-19T06:37:08.444160+0000","last_became_peered":"2024-09-19T06:37:08.444160+0000","last_unstale":"2024-09-19T06:37:15.029869+0000","last_undegraded":"2024-09-19T06:37:15.029869+0000","last_fullsized":"2024-09-19T06:37:15.029869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:54.304153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030788+0000","last_change":"2024-09-19T06:37:13.466175+0000","last_active":"2024-09-19T06:37:15.030788+0000","last_peered":"2024-09-19T06:37:15.030788+0000","last_clean":"2024-09-19T06:37:15.030788+0000","last_became_active":"2024-09-19T06:37:13.465731+0000","last_became_peered":"2024-09-19T06:37:13.465731+0000","last_unstale":"2024-09-19T06:37:15.030788+0000","last_undegraded":"2024-09-19T06:37:15.030788+0000","last_fullsized":"2024-09-19T06:37:15.030788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:01.100164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029947+0000","last_change":"2024-09-19T06:37:09.437254+0000","last_active":"2024-09-19T06:37:15.029947+0000","last_peered":"2024-09-19T06:37:15.029947+0000","last_clean":"2024-09-19T06:37:15.029947+0000","last_became_active":"2024-09-19T06:37:09.436512+0000","last_became_peered":"2024-09-19T06:37:09.436512+0000","last_unstale":"2024-09-19T06:37:15.029947+0000","last_undegraded":"2024-09-19T06:37:15.029947+0000","last_fullsized":"2024-09-19T06:37:15.029947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:21.893793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478028+0000","last_change":"2024-09-19T06:37:08.446216+0000","last_active":"2024-09-19T06:37:14.478028+0000","last_peered":"2024-09-19T06:37:14.478028+0000","last_clean":"2024-09-19T06:37:14.478028+0000","last_became_active":"2024-09-19T06:37:08.445845+0000","last_became_peered":"2024-09-19T06:37:08.445845+0000","last_unstale":"2024-09-19T06:37:14.478028+0000","last_undegraded":"2024-09-19T06:37:14.478028+0000","last_fullsized":"2024-09-19T06:37:14.478028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:04.033283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030215+0000","last_change":"2024-09-19T06:37:13.462192+0000","last_active":"2024-09-19T06:37:15.030215+0000","last_peered":"2024-09-19T06:37:15.030215+0000","last_clean":"2024-09-19T06:37:15.030215+0000","last_became_active":"2024-09-19T06:37:13.460955+0000","last_became_peered":"2024-09-19T06:37:13.460955+0000","last_unstale":"2024-09-19T06:37:15.030215+0000","last_undegraded":"2024-09-19T06:37:15.030215+0000","last_fullsized":"2024-09-19T06:37:15.030215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:53.583488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030554+0000","last_change":"2024-09-19T06:37:09.445989+0000","last_active":"2024-09-19T06:37:15.030554+0000","last_peered":"2024-09-19T06:37:15.030554+0000","last_clean":"2024-09-19T06:37:15.030554+0000","last_became_active":"2024-09-19T06:37:09.445705+0000","last_became_peered":"2024-09-19T06:37:09.445705+0000","last_unstale":"2024-09-19T06:37:15.030554+0000","last_undegraded":"2024-09-19T06:37:15.030554+0000","last_fullsized":"2024-09-19T06:37:15.030554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:24.592460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478969+0000","last_change":"2024-09-19T06:37:08.446226+0000","last_active":"2024-09-19T06:37:14.478969+0000","last_peered":"2024-09-19T06:37:14.478969+0000","last_clean":"2024-09-19T06:37:14.478969+0000","last_became_active":"2024-09-19T06:37:08.445929+0000","last_became_peered":"2024-09-19T06:37:08.445929+0000","last_unstale":"2024-09-19T06:37:14.478969+0000","last_undegraded":"2024-09-19T06:37:14.478969+0000","last_fullsized":"2024-09-19T06:37:14.478969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:32.233033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029648+0000","last_change":"2024-09-19T06:37:13.462598+0000","last_active":"2024-09-19T06:37:15.029648+0000","last_peered":"2024-09-19T06:37:15.029648+0000","last_clean":"2024-09-19T06:37:15.029648+0000","last_became_active":"2024-09-19T06:37:13.462217+0000","last_became_peered":"2024-09-19T06:37:13.462217+0000","last_unstale":"2024-09-19T06:37:15.029648+0000","last_undegraded":"2024-09-19T06:37:15.029648+0000","last_fullsized":"2024-09-19T06:37:15.029648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:04.109419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477866+0000","last_change":"2024-09-19T06:37:09.434309+0000","last_active":"2024-09-19T06:37:14.477866+0000","last_peered":"2024-09-19T06:37:14.477866+0000","last_clean":"2024-09-19T06:37:14.477866+0000","last_became_active":"2024-09-19T06:37:09.433897+0000","last_became_peered":"2024-09-19T06:37:09.433897+0000","last_unstale":"2024-09-19T06:37:14.477866+0000","last_undegraded":"2024-09-19T06:37:14.477866+0000","last_fullsized":"2024-09-19T06:37:14.477866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:59.054484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030307+0000","last_change":"2024-09-19T06:37:08.441525+0000","last_active":"2024-09-19T06:37:15.030307+0000","last_peered":"2024-09-19T06:37:15.030307+0000","last_clean":"2024-09-19T06:37:15.030307+0000","last_became_active":"2024-09-19T06:37:08.441245+0000","last_became_peered":"2024-09-19T06:37:08.441245+0000","last_unstale":"2024-09-19T06:37:15.030307+0000","last_undegraded":"2024-09-19T06:37:15.030307+0000","last_fullsized":"2024-09-19T06:37:15.030307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:19.820705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477133+0000","last_change":"2024-09-19T06:37:13.468486+0000","last_active":"2024-09-19T06:37:14.477133+0000","last_peered":"2024-09-19T06:37:14.477133+0000","last_clean":"2024-09-19T06:37:14.477133+0000","last_became_active":"2024-09-19T06:37:13.468074+0000","last_became_peered":"2024-09-19T06:37:13.468074+0000","last_unstale":"2024-09-19T06:37:14.477133+0000","last_undegraded":"2024-09-19T06:37:14.477133+0000","last_fullsized":"2024-09-19T06:37:14.477133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:36.783781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030772+0000","last_change":"2024-09-19T06:37:09.435864+0000","last_active":"2024-09-19T06:37:15.030772+0000","last_peered":"2024-09-19T06:37:15.030772+0000","last_clean":"2024-09-19T06:37:15.030772+0000","last_became_active":"2024-09-19T06:37:09.435597+0000","last_became_peered":"2024-09-19T06:37:09.435597+0000","last_unstale":"2024-09-19T06:37:15.030772+0000","last_undegraded":"2024-09-19T06:37:15.030772+0000","last_fullsized":"2024-09-19T06:37:15.030772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:20.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479615+0000","last_change":"2024-09-19T06:37:08.447931+0000","last_active":"2024-09-19T06:37:14.479615+0000","last_peered":"2024-09-19T06:37:14.479615+0000","last_clean":"2024-09-19T06:37:14.479615+0000","last_became_active":"2024-09-19T06:37:08.447630+0000","last_became_peered":"2024-09-19T06:37:08.447630+0000","last_unstale":"2024-09-19T06:37:14.479615+0000","last_undegraded":"2024-09-19T06:37:14.479615+0000","last_fullsized":"2024-09-19T06:37:14.479615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:17.375740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030552+0000","last_change":"2024-09-19T06:37:13.468360+0000","last_active":"2024-09-19T06:37:15.030552+0000","last_peered":"2024-09-19T06:37:15.030552+0000","last_clean":"2024-09-19T06:37:15.030552+0000","last_became_active":"2024-09-19T06:37:13.467926+0000","last_became_peered":"2024-09-19T06:37:13.467926+0000","last_unstale":"2024-09-19T06:37:15.030552+0000","last_undegraded":"2024-09-19T06:37:15.030552+0000","last_fullsized":"2024-09-19T06:37:15.030552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:55.089630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030606+0000","last_change":"2024-09-19T06:37:09.441678+0000","last_active":"2024-09-19T06:37:15.030606+0000","last_peered":"2024-09-19T06:37:15.030606+0000","last_clean":"2024-09-19T06:37:15.030606+0000","last_became_active":"2024-09-19T06:37:09.441406+0000","last_became_peered":"2024-09-19T06:37:09.441406+0000","last_unstale":"2024-09-19T06:37:15.030606+0000","last_undegraded":"2024-09-19T06:37:15.030606+0000","last_fullsized":"2024-09-19T06:37:15.030606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:14.638004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030831+0000","last_change":"2024-09-19T06:37:08.438805+0000","last_active":"2024-09-19T06:37:15.030831+0000","last_peered":"2024-09-19T06:37:15.030831+0000","last_clean":"2024-09-19T06:37:15.030831+0000","last_became_active":"2024-09-19T06:37:08.438528+0000","last_became_peered":"2024-09-19T06:37:08.438528+0000","last_unstale":"2024-09-19T06:37:15.030831+0000","last_undegraded":"2024-09-19T06:37:15.030831+0000","last_fullsized":"2024-09-19T06:37:15.030831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:55.500347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030303+0000","last_change":"2024-09-19T06:37:13.459697+0000","last_active":"2024-09-19T06:37:15.030303+0000","last_peered":"2024-09-19T06:37:15.030303+0000","last_clean":"2024-09-19T06:37:15.030303+0000","last_became_active":"2024-09-19T06:37:13.459303+0000","last_became_peered":"2024-09-19T06:37:13.459303+0000","last_unstale":"2024-09-19T06:37:15.030303+0000","last_undegraded":"2024-09-19T06:37:15.030303+0000","last_fullsized":"2024-09-19T06:37:15.030303+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:01.695905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.031009+0000","last_change":"2024-09-19T06:37:09.449701+0000","last_active":"2024-09-19T06:37:15.031009+0000","last_peered":"2024-09-19T06:37:15.031009+0000","last_clean":"2024-09-19T06:37:15.031009+0000","last_became_active":"2024-09-19T06:37:09.448899+0000","last_became_peered":"2024-09-19T06:37:09.448899+0000","last_unstale":"2024-09-19T06:37:15.031009+0000","last_undegraded":"2024-09-19T06:37:15.031009+0000","last_fullsized":"2024-09-19T06:37:15.031009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:17.448251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030609+0000","last_change":"2024-09-19T06:37:08.434263+0000","last_active":"2024-09-19T06:37:15.030609+0000","last_peered":"2024-09-19T06:37:15.030609+0000","last_clean":"2024-09-19T06:37:15.030609+0000","last_became_active":"2024-09-19T06:37:08.433984+0000","last_became_peered":"2024-09-19T06:37:08.433984+0000","last_unstale":"2024-09-19T06:37:15.030609+0000","last_undegraded":"2024-09-19T06:37:15.030609+0000","last_fullsized":"2024-09-19T06:37:15.030609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:05.599054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030728+0000","last_change":"2024-09-19T06:37:13.464527+0000","last_active":"2024-09-19T06:37:15.030728+0000","last_peered":"2024-09-19T06:37:15.030728+0000","last_clean":"2024-09-19T06:37:15.030728+0000","last_became_active":"2024-09-19T06:37:13.461685+0000","last_became_peered":"2024-09-19T06:37:13.461685+0000","last_unstale":"2024-09-19T06:37:15.030728+0000","last_undegraded":"2024-09-19T06:37:15.030728+0000","last_fullsized":"2024-09-19T06:37:15.030728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:57.229892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030028+0000","last_change":"2024-09-19T06:37:09.434421+0000","last_active":"2024-09-19T06:37:15.030028+0000","last_peered":"2024-09-19T06:37:15.030028+0000","last_clean":"2024-09-19T06:37:15.030028+0000","last_became_active":"2024-09-19T06:37:09.434119+0000","last_became_peered":"2024-09-19T06:37:09.434119+0000","last_unstale":"2024-09-19T06:37:15.030028+0000","last_undegraded":"2024-09-19T06:37:15.030028+0000","last_fullsized":"2024-09-19T06:37:15.030028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:56.984336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.814975+0000","last_change":"2024-09-19T06:37:08.436856+0000","last_active":"2024-09-19T06:37:14.814975+0000","last_peered":"2024-09-19T06:37:14.814975+0000","last_clean":"2024-09-19T06:37:14.814975+0000","last_became_active":"2024-09-19T06:37:08.435718+0000","last_became_peered":"2024-09-19T06:37:08.435718+0000","last_unstale":"2024-09-19T06:37:14.814975+0000","last_undegraded":"2024-09-19T06:37:14.814975+0000","last_fullsized":"2024-09-19T06:37:14.814975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:58.650430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030892+0000","last_change":"2024-09-19T06:37:13.466081+0000","last_active":"2024-09-19T06:37:15.030892+0000","last_peered":"2024-09-19T06:37:15.030892+0000","last_clean":"2024-09-19T06:37:15.030892+0000","last_became_active":"2024-09-19T06:37:13.465348+0000","last_became_peered":"2024-09-19T06:37:13.465348+0000","last_unstale":"2024-09-19T06:37:15.030892+0000","last_undegraded":"2024-09-19T06:37:15.030892+0000","last_fullsized":"2024-09-19T06:37:15.030892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:11.592737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029583+0000","last_change":"2024-09-19T06:37:09.444888+0000","last_active":"2024-09-19T06:37:15.029583+0000","last_peered":"2024-09-19T06:37:15.029583+0000","last_clean":"2024-09-19T06:37:15.029583+0000","last_became_active":"2024-09-19T06:37:09.444605+0000","last_became_peered":"2024-09-19T06:37:09.444605+0000","last_unstale":"2024-09-19T06:37:15.029583+0000","last_undegraded":"2024-09-19T06:37:15.029583+0000","last_fullsized":"2024-09-19T06:37:15.029583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:53.868356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478136+0000","last_change":"2024-09-19T06:37:08.446760+0000","last_active":"2024-09-19T06:37:14.478136+0000","last_peered":"2024-09-19T06:37:14.478136+0000","last_clean":"2024-09-19T06:37:14.478136+0000","last_became_active":"2024-09-19T06:37:08.446474+0000","last_became_peered":"2024-09-19T06:37:08.446474+0000","last_unstale":"2024-09-19T06:37:14.478136+0000","last_undegraded":"2024-09-19T06:37:14.478136+0000","last_fullsized":"2024-09-19T06:37:14.478136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:12.597952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030429+0000","last_change":"2024-09-19T06:37:13.471220+0000","last_active":"2024-09-19T06:37:15.030429+0000","last_peered":"2024-09-19T06:37:15.030429+0000","last_clean":"2024-09-19T06:37:15.030429+0000","last_became_active":"2024-09-19T06:37:13.470860+0000","last_became_peered":"2024-09-19T06:37:13.470860+0000","last_unstale":"2024-09-19T06:37:15.030429+0000","last_undegraded":"2024-09-19T06:37:15.030429+0000","last_fullsized":"2024-09-19T06:37:15.030429+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:07.659583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477346+0000","last_change":"2024-09-19T06:37:09.440366+0000","last_active":"2024-09-19T06:37:14.477346+0000","last_peered":"2024-09-19T06:37:14.477346+0000","last_clean":"2024-09-19T06:37:14.477346+0000","last_became_active":"2024-09-19T06:37:09.439478+0000","last_became_peered":"2024-09-19T06:37:09.439478+0000","last_unstale":"2024-09-19T06:37:14.477346+0000","last_undegraded":"2024-09-19T06:37:14.477346+0000","last_fullsized":"2024-09-19T06:37:14.477346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:21.837351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029827+0000","last_change":"2024-09-19T06:37:08.435473+0000","last_active":"2024-09-19T06:37:15.029827+0000","last_peered":"2024-09-19T06:37:15.029827+0000","last_clean":"2024-09-19T06:37:15.029827+0000","last_became_active":"2024-09-19T06:37:08.435183+0000","last_became_peered":"2024-09-19T06:37:08.435183+0000","last_unstale":"2024-09-19T06:37:15.029827+0000","last_undegraded":"2024-09-19T06:37:15.029827+0000","last_fullsized":"2024-09-19T06:37:15.029827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:53.115010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478240+0000","last_change":"2024-09-19T06:36:58.829099+0000","last_active":"2024-09-19T06:37:14.478240+0000","last_peered":"2024-09-19T06:37:14.478240+0000","last_clean":"2024-09-19T06:37:14.478240+0000","last_became_active":"2024-09-19T06:36:58.828079+0000","last_became_peered":"2024-09-19T06:36:58.828079+0000","last_unstale":"2024-09-19T06:37:14.478240+0000","last_undegraded":"2024-09-19T06:37:14.478240+0000","last_fullsized":"2024-09-19T06:37:14.478240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:36:57.771085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:36:57.771085+0000","last_clean_scrub_stamp":"2024-09-19T06:36:57.771085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:14.663925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477944+0000","last_change":"2024-09-19T06:37:13.464435+0000","last_active":"2024-09-19T06:37:14.477944+0000","last_peered":"2024-09-19T06:37:14.477944+0000","last_clean":"2024-09-19T06:37:14.477944+0000","last_became_active":"2024-09-19T06:37:13.464101+0000","last_became_peered":"2024-09-19T06:37:13.464101+0000","last_unstale":"2024-09-19T06:37:14.477944+0000","last_undegraded":"2024-09-19T06:37:14.477944+0000","last_fullsized":"2024-09-19T06:37:14.477944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:30.073937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479308+0000","last_change":"2024-09-19T06:37:09.442774+0000","last_active":"2024-09-19T06:37:14.479308+0000","last_peered":"2024-09-19T06:37:14.479308+0000","last_clean":"2024-09-19T06:37:14.479308+0000","last_became_active":"2024-09-19T06:37:09.442515+0000","last_became_peered":"2024-09-19T06:37:09.442515+0000","last_unstale":"2024-09-19T06:37:14.479308+0000","last_undegraded":"2024-09-19T06:37:14.479308+0000","last_fullsized":"2024-09-19T06:37:14.479308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:57.376059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815252+0000","last_change":"2024-09-19T06:37:08.438038+0000","last_active":"2024-09-19T06:37:14.815252+0000","last_peered":"2024-09-19T06:37:14.815252+0000","last_clean":"2024-09-19T06:37:14.815252+0000","last_became_active":"2024-09-19T06:37:08.437771+0000","last_became_peered":"2024-09-19T06:37:08.437771+0000","last_unstale":"2024-09-19T06:37:14.815252+0000","last_undegraded":"2024-09-19T06:37:14.815252+0000","last_fullsized":"2024-09-19T06:37:14.815252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:07.210382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477772+0000","last_change":"2024-09-19T06:37:13.470916+0000","last_active":"2024-09-19T06:37:14.477772+0000","last_peered":"2024-09-19T06:37:14.477772+0000","last_clean":"2024-09-19T06:37:14.477772+0000","last_became_active":"2024-09-19T06:37:13.470488+0000","last_became_peered":"2024-09-19T06:37:13.470488+0000","last_unstale":"2024-09-19T06:37:14.477772+0000","last_undegraded":"2024-09-19T06:37:14.477772+0000","last_fullsized":"2024-09-19T06:37:14.477772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:27.884932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030150+0000","last_change":"2024-09-19T06:37:09.442213+0000","last_active":"2024-09-19T06:37:15.030150+0000","last_peered":"2024-09-19T06:37:15.030150+0000","last_clean":"2024-09-19T06:37:15.030150+0000","last_became_active":"2024-09-19T06:37:09.441850+0000","last_became_peered":"2024-09-19T06:37:09.441850+0000","last_unstale":"2024-09-19T06:37:15.030150+0000","last_undegraded":"2024-09-19T06:37:15.030150+0000","last_fullsized":"2024-09-19T06:37:15.030150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:43.728914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030863+0000","last_change":"2024-09-19T06:37:08.431703+0000","last_active":"2024-09-19T06:37:15.030863+0000","last_peered":"2024-09-19T06:37:15.030863+0000","last_clean":"2024-09-19T06:37:15.030863+0000","last_became_active":"2024-09-19T06:37:08.431443+0000","last_became_peered":"2024-09-19T06:37:08.431443+0000","last_unstale":"2024-09-19T06:37:15.030863+0000","last_undegraded":"2024-09-19T06:37:15.030863+0000","last_fullsized":"2024-09-19T06:37:15.030863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:02.007521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030768+0000","last_change":"2024-09-19T06:37:13.469295+0000","last_active":"2024-09-19T06:37:15.030768+0000","last_peered":"2024-09-19T06:37:15.030768+0000","last_clean":"2024-09-19T06:37:15.030768+0000","last_became_active":"2024-09-19T06:37:13.468879+0000","last_became_peered":"2024-09-19T06:37:13.468879+0000","last_unstale":"2024-09-19T06:37:15.030768+0000","last_undegraded":"2024-09-19T06:37:15.030768+0000","last_fullsized":"2024-09-19T06:37:15.030768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:34.380034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479747+0000","last_change":"2024-09-19T06:37:09.439264+0000","last_active":"2024-09-19T06:37:14.479747+0000","last_peered":"2024-09-19T06:37:14.479747+0000","last_clean":"2024-09-19T06:37:14.479747+0000","last_became_active":"2024-09-19T06:37:09.438954+0000","last_became_peered":"2024-09-19T06:37:09.438954+0000","last_unstale":"2024-09-19T06:37:14.479747+0000","last_undegraded":"2024-09-19T06:37:14.479747+0000","last_fullsized":"2024-09-19T06:37:14.479747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:55.094093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815232+0000","last_change":"2024-09-19T06:37:08.437406+0000","last_active":"2024-09-19T06:37:14.815232+0000","last_peered":"2024-09-19T06:37:14.815232+0000","last_clean":"2024-09-19T06:37:14.815232+0000","last_became_active":"2024-09-19T06:37:08.437093+0000","last_became_peered":"2024-09-19T06:37:08.437093+0000","last_unstale":"2024-09-19T06:37:14.815232+0000","last_undegraded":"2024-09-19T06:37:14.815232+0000","last_fullsized":"2024-09-19T06:37:14.815232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:25.158027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029476+0000","last_change":"2024-09-19T06:37:13.460116+0000","last_active":"2024-09-19T06:37:15.029476+0000","last_peered":"2024-09-19T06:37:15.029476+0000","last_clean":"2024-09-19T06:37:15.029476+0000","last_became_active":"2024-09-19T06:37:13.459707+0000","last_became_peered":"2024-09-19T06:37:13.459707+0000","last_unstale":"2024-09-19T06:37:15.029476+0000","last_undegraded":"2024-09-19T06:37:15.029476+0000","last_fullsized":"2024-09-19T06:37:15.029476+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:02.657115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479032+0000","last_change":"2024-09-19T06:37:09.442670+0000","last_active":"2024-09-19T06:37:14.479032+0000","last_peered":"2024-09-19T06:37:14.479032+0000","last_clean":"2024-09-19T06:37:14.479032+0000","last_became_active":"2024-09-19T06:37:09.442390+0000","last_became_peered":"2024-09-19T06:37:09.442390+0000","last_unstale":"2024-09-19T06:37:14.479032+0000","last_undegraded":"2024-09-19T06:37:14.479032+0000","last_fullsized":"2024-09-19T06:37:14.479032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:02:26.726663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030129+0000","last_change":"2024-09-19T06:37:08.437263+0000","last_active":"2024-09-19T06:37:15.030129+0000","last_peered":"2024-09-19T06:37:15.030129+0000","last_clean":"2024-09-19T06:37:15.030129+0000","last_became_active":"2024-09-19T06:37:08.436982+0000","last_became_peered":"2024-09-19T06:37:08.436982+0000","last_unstale":"2024-09-19T06:37:15.030129+0000","last_undegraded":"2024-09-19T06:37:15.030129+0000","last_fullsized":"2024-09-19T06:37:15.030129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:14.895925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029466+0000","last_change":"2024-09-19T06:37:13.459433+0000","last_active":"2024-09-19T06:37:15.029466+0000","last_peered":"2024-09-19T06:37:15.029466+0000","last_clean":"2024-09-19T06:37:15.029466+0000","last_became_active":"2024-09-19T06:37:13.459031+0000","last_became_peered":"2024-09-19T06:37:13.459031+0000","last_unstale":"2024-09-19T06:37:15.029466+0000","last_undegraded":"2024-09-19T06:37:15.029466+0000","last_fullsized":"2024-09-19T06:37:15.029466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:07.294413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478514+0000","last_change":"2024-09-19T06:37:09.439142+0000","last_active":"2024-09-19T06:37:14.478514+0000","last_peered":"2024-09-19T06:37:14.478514+0000","last_clean":"2024-09-19T06:37:14.478514+0000","last_became_active":"2024-09-19T06:37:09.437717+0000","last_became_peered":"2024-09-19T06:37:09.437717+0000","last_unstale":"2024-09-19T06:37:14.478514+0000","last_undegraded":"2024-09-19T06:37:14.478514+0000","last_fullsized":"2024-09-19T06:37:14.478514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:32.934290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.814858+0000","last_change":"2024-09-19T06:37:08.430649+0000","last_active":"2024-09-19T06:37:14.814858+0000","last_peered":"2024-09-19T06:37:14.814858+0000","last_clean":"2024-09-19T06:37:14.814858+0000","last_became_active":"2024-09-19T06:37:08.430324+0000","last_became_peered":"2024-09-19T06:37:08.430324+0000","last_unstale":"2024-09-19T06:37:14.814858+0000","last_undegraded":"2024-09-19T06:37:14.814858+0000","last_fullsized":"2024-09-19T06:37:14.814858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:56.656357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030152+0000","last_change":"2024-09-19T06:37:13.463695+0000","last_active":"2024-09-19T06:37:15.030152+0000","last_peered":"2024-09-19T06:37:15.030152+0000","last_clean":"2024-09-19T06:37:15.030152+0000","last_became_active":"2024-09-19T06:37:13.463334+0000","last_became_peered":"2024-09-19T06:37:13.463334+0000","last_unstale":"2024-09-19T06:37:15.030152+0000","last_undegraded":"2024-09-19T06:37:15.030152+0000","last_fullsized":"2024-09-19T06:37:15.030152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:46.991800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477668+0000","last_change":"2024-09-19T06:37:09.450168+0000","last_active":"2024-09-19T06:37:14.477668+0000","last_peered":"2024-09-19T06:37:14.477668+0000","last_clean":"2024-09-19T06:37:14.477668+0000","last_became_active":"2024-09-19T06:37:09.449872+0000","last_became_peered":"2024-09-19T06:37:09.449872+0000","last_unstale":"2024-09-19T06:37:14.477668+0000","last_undegraded":"2024-09-19T06:37:14.477668+0000","last_fullsized":"2024-09-19T06:37:14.477668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:02:28.282840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478710+0000","last_change":"2024-09-19T06:37:08.442428+0000","last_active":"2024-09-19T06:37:14.478710+0000","last_peered":"2024-09-19T06:37:14.478710+0000","last_clean":"2024-09-19T06:37:14.478710+0000","last_became_active":"2024-09-19T06:37:08.442120+0000","last_became_peered":"2024-09-19T06:37:08.442120+0000","last_unstale":"2024-09-19T06:37:14.478710+0000","last_undegraded":"2024-09-19T06:37:14.478710+0000","last_fullsized":"2024-09-19T06:37:14.478710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:48.816822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477870+0000","last_change":"2024-09-19T06:37:13.471319+0000","last_active":"2024-09-19T06:37:14.477870+0000","last_peered":"2024-09-19T06:37:14.477870+0000","last_clean":"2024-09-19T06:37:14.477870+0000","last_became_active":"2024-09-19T06:37:13.470887+0000","last_became_peered":"2024-09-19T06:37:13.470887+0000","last_unstale":"2024-09-19T06:37:14.477870+0000","last_undegraded":"2024-09-19T06:37:14.477870+0000","last_fullsized":"2024-09-19T06:37:14.477870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:21.884985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479407+0000","last_change":"2024-09-19T06:37:09.439142+0000","last_active":"2024-09-19T06:37:14.479407+0000","last_peered":"2024-09-19T06:37:14.479407+0000","last_clean":"2024-09-19T06:37:14.479407+0000","last_became_active":"2024-09-19T06:37:09.437635+0000","last_became_peered":"2024-09-19T06:37:09.437635+0000","last_unstale":"2024-09-19T06:37:14.479407+0000","last_undegraded":"2024-09-19T06:37:14.479407+0000","last_fullsized":"2024-09-19T06:37:14.479407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:46.773889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030517+0000","last_change":"2024-09-19T06:37:08.438932+0000","last_active":"2024-09-19T06:37:15.030517+0000","last_peered":"2024-09-19T06:37:15.030517+0000","last_clean":"2024-09-19T06:37:15.030517+0000","last_became_active":"2024-09-19T06:37:08.438405+0000","last_became_peered":"2024-09-19T06:37:08.438405+0000","last_unstale":"2024-09-19T06:37:15.030517+0000","last_undegraded":"2024-09-19T06:37:15.030517+0000","last_fullsized":"2024-09-19T06:37:15.030517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:59.606628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477677+0000","last_change":"2024-09-19T06:37:13.459370+0000","last_active":"2024-09-19T06:37:14.477677+0000","last_peered":"2024-09-19T06:37:14.477677+0000","last_clean":"2024-09-19T06:37:14.477677+0000","last_became_active":"2024-09-19T06:37:13.458928+0000","last_became_peered":"2024-09-19T06:37:13.458928+0000","last_unstale":"2024-09-19T06:37:14.477677+0000","last_undegraded":"2024-09-19T06:37:14.477677+0000","last_fullsized":"2024-09-19T06:37:14.477677+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:00.179404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029933+0000","last_change":"2024-09-19T06:37:09.448958+0000","last_active":"2024-09-19T06:37:15.029933+0000","last_peered":"2024-09-19T06:37:15.029933+0000","last_clean":"2024-09-19T06:37:15.029933+0000","last_became_active":"2024-09-19T06:37:09.448697+0000","last_became_peered":"2024-09-19T06:37:09.448697+0000","last_unstale":"2024-09-19T06:37:15.029933+0000","last_undegraded":"2024-09-19T06:37:15.029933+0000","last_fullsized":"2024-09-19T06:37:15.029933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:16.306915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030900+0000","last_change":"2024-09-19T06:37:08.442685+0000","last_active":"2024-09-19T06:37:15.030900+0000","last_peered":"2024-09-19T06:37:15.030900+0000","last_clean":"2024-09-19T06:37:15.030900+0000","last_became_active":"2024-09-19T06:37:08.442436+0000","last_became_peered":"2024-09-19T06:37:08.442436+0000","last_unstale":"2024-09-19T06:37:15.030900+0000","last_undegraded":"2024-09-19T06:37:15.030900+0000","last_fullsized":"2024-09-19T06:37:15.030900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:09.952733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030332+0000","last_change":"2024-09-19T06:37:13.457651+0000","last_active":"2024-09-19T06:37:15.030332+0000","last_peered":"2024-09-19T06:37:15.030332+0000","last_clean":"2024-09-19T06:37:15.030332+0000","last_became_active":"2024-09-19T06:37:13.457246+0000","last_became_peered":"2024-09-19T06:37:13.457246+0000","last_unstale":"2024-09-19T06:37:15.030332+0000","last_undegraded":"2024-09-19T06:37:15.030332+0000","last_fullsized":"2024-09-19T06:37:15.030332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:18.553158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479228+0000","last_change":"2024-09-19T06:37:09.441212+0000","last_active":"2024-09-19T06:37:14.479228+0000","last_peered":"2024-09-19T06:37:14.479228+0000","last_clean":"2024-09-19T06:37:14.479228+0000","last_became_active":"2024-09-19T06:37:09.440209+0000","last_became_peered":"2024-09-19T06:37:09.440209+0000","last_unstale":"2024-09-19T06:37:14.479228+0000","last_undegraded":"2024-09-19T06:37:14.479228+0000","last_fullsized":"2024-09-19T06:37:14.479228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:52.173784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:24.168847+0000","last_change":"2024-09-19T06:37:08.442615+0000","last_active":"2024-09-19T06:37:24.168847+0000","last_peered":"2024-09-19T06:37:24.168847+0000","last_clean":"2024-09-19T06:37:24.168847+0000","last_became_active":"2024-09-19T06:37:08.442242+0000","last_became_peered":"2024-09-19T06:37:08.442242+0000","last_unstale":"2024-09-19T06:37:24.168847+0000","last_undegraded":"2024-09-19T06:37:24.168847+0000","last_fullsized":"2024-09-19T06:37:24.168847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:23.813400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030495+0000","last_change":"2024-09-19T06:37:13.464688+0000","last_active":"2024-09-19T06:37:15.030495+0000","last_peered":"2024-09-19T06:37:15.030495+0000","last_clean":"2024-09-19T06:37:15.030495+0000","last_became_active":"2024-09-19T06:37:13.461620+0000","last_became_peered":"2024-09-19T06:37:13.461620+0000","last_unstale":"2024-09-19T06:37:15.030495+0000","last_undegraded":"2024-09-19T06:37:15.030495+0000","last_fullsized":"2024-09-19T06:37:15.030495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:02.928332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030727+0000","last_change":"2024-09-19T06:37:09.440021+0000","last_active":"2024-09-19T06:37:15.030727+0000","last_peered":"2024-09-19T06:37:15.030727+0000","last_clean":"2024-09-19T06:37:15.030727+0000","last_became_active":"2024-09-19T06:37:09.437800+0000","last_became_peered":"2024-09-19T06:37:09.437800+0000","last_unstale":"2024-09-19T06:37:15.030727+0000","last_undegraded":"2024-09-19T06:37:15.030727+0000","last_fullsized":"2024-09-19T06:37:15.030727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:51.963097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030761+0000","last_change":"2024-09-19T06:37:08.434422+0000","last_active":"2024-09-19T06:37:15.030761+0000","last_peered":"2024-09-19T06:37:15.030761+0000","last_clean":"2024-09-19T06:37:15.030761+0000","last_became_active":"2024-09-19T06:37:08.434151+0000","last_became_peered":"2024-09-19T06:37:08.434151+0000","last_unstale":"2024-09-19T06:37:15.030761+0000","last_undegraded":"2024-09-19T06:37:15.030761+0000","last_fullsized":"2024-09-19T06:37:15.030761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:49.540748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030746+0000","last_change":"2024-09-19T06:37:13.459321+0000","last_active":"2024-09-19T06:37:15.030746+0000","last_peered":"2024-09-19T06:37:15.030746+0000","last_clean":"2024-09-19T06:37:15.030746+0000","last_became_active":"2024-09-19T06:37:13.458924+0000","last_became_peered":"2024-09-19T06:37:13.458924+0000","last_unstale":"2024-09-19T06:37:15.030746+0000","last_undegraded":"2024-09-19T06:37:15.030746+0000","last_fullsized":"2024-09-19T06:37:15.030746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:11.428574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030167+0000","last_change":"2024-09-19T06:37:09.448450+0000","last_active":"2024-09-19T06:37:15.030167+0000","last_peered":"2024-09-19T06:37:15.030167+0000","last_clean":"2024-09-19T06:37:15.030167+0000","last_became_active":"2024-09-19T06:37:09.448173+0000","last_became_peered":"2024-09-19T06:37:09.448173+0000","last_unstale":"2024-09-19T06:37:15.030167+0000","last_undegraded":"2024-09-19T06:37:15.030167+0000","last_fullsized":"2024-09-19T06:37:15.030167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:22.442374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030854+0000","last_change":"2024-09-19T06:37:08.442796+0000","last_active":"2024-09-19T06:37:15.030854+0000","last_peered":"2024-09-19T06:37:15.030854+0000","last_clean":"2024-09-19T06:37:15.030854+0000","last_became_active":"2024-09-19T06:37:08.442126+0000","last_became_peered":"2024-09-19T06:37:08.442126+0000","last_unstale":"2024-09-19T06:37:15.030854+0000","last_undegraded":"2024-09-19T06:37:15.030854+0000","last_fullsized":"2024-09-19T06:37:15.030854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:27.716141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477293+0000","last_change":"2024-09-19T06:37:13.464100+0000","last_active":"2024-09-19T06:37:14.477293+0000","last_peered":"2024-09-19T06:37:14.477293+0000","last_clean":"2024-09-19T06:37:14.477293+0000","last_became_active":"2024-09-19T06:37:13.462750+0000","last_became_peered":"2024-09-19T06:37:13.462750+0000","last_unstale":"2024-09-19T06:37:14.477293+0000","last_undegraded":"2024-09-19T06:37:14.477293+0000","last_fullsized":"2024-09-19T06:37:14.477293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:49.139841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030752+0000","last_change":"2024-09-19T06:37:09.448328+0000","last_active":"2024-09-19T06:37:15.030752+0000","last_peered":"2024-09-19T06:37:15.030752+0000","last_clean":"2024-09-19T06:37:15.030752+0000","last_became_active":"2024-09-19T06:37:09.448056+0000","last_became_peered":"2024-09-19T06:37:09.448056+0000","last_unstale":"2024-09-19T06:37:15.030752+0000","last_undegraded":"2024-09-19T06:37:15.030752+0000","last_fullsized":"2024-09-19T06:37:15.030752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:53.451104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478778+0000","last_change":"2024-09-19T06:37:08.439543+0000","last_active":"2024-09-19T06:37:14.478778+0000","last_peered":"2024-09-19T06:37:14.478778+0000","last_clean":"2024-09-19T06:37:14.478778+0000","last_became_active":"2024-09-19T06:37:08.438785+0000","last_became_peered":"2024-09-19T06:37:08.438785+0000","last_unstale":"2024-09-19T06:37:14.478778+0000","last_undegraded":"2024-09-19T06:37:14.478778+0000","last_fullsized":"2024-09-19T06:37:14.478778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:51.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477286+0000","last_change":"2024-09-19T06:37:13.462327+0000","last_active":"2024-09-19T06:37:14.477286+0000","last_peered":"2024-09-19T06:37:14.477286+0000","last_clean":"2024-09-19T06:37:14.477286+0000","last_became_active":"2024-09-19T06:37:13.461762+0000","last_became_peered":"2024-09-19T06:37:13.461762+0000","last_unstale":"2024-09-19T06:37:14.477286+0000","last_undegraded":"2024-09-19T06:37:14.477286+0000","last_fullsized":"2024-09-19T06:37:14.477286+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:26.931537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029982+0000","last_change":"2024-09-19T06:37:13.471309+0000","last_active":"2024-09-19T06:37:15.029982+0000","last_peered":"2024-09-19T06:37:15.029982+0000","last_clean":"2024-09-19T06:37:15.029982+0000","last_became_active":"2024-09-19T06:37:13.470969+0000","last_became_peered":"2024-09-19T06:37:13.470969+0000","last_unstale":"2024-09-19T06:37:15.029982+0000","last_undegraded":"2024-09-19T06:37:15.029982+0000","last_fullsized":"2024-09-19T06:37:15.029982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:30.990159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029769+0000","last_change":"2024-09-19T06:37:09.443308+0000","last_active":"2024-09-19T06:37:15.029769+0000","last_peered":"2024-09-19T06:37:15.029769+0000","last_clean":"2024-09-19T06:37:15.029769+0000","last_became_active":"2024-09-19T06:37:09.443069+0000","last_became_peered":"2024-09-19T06:37:09.443069+0000","last_unstale":"2024-09-19T06:37:15.029769+0000","last_undegraded":"2024-09-19T06:37:15.029769+0000","last_fullsized":"2024-09-19T06:37:15.029769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:31:33.708578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029646+0000","last_change":"2024-09-19T06:37:08.441967+0000","last_active":"2024-09-19T06:37:15.029646+0000","last_peered":"2024-09-19T06:37:15.029646+0000","last_clean":"2024-09-19T06:37:15.029646+0000","last_became_active":"2024-09-19T06:37:08.441698+0000","last_became_peered":"2024-09-19T06:37:08.441698+0000","last_unstale":"2024-09-19T06:37:15.029646+0000","last_undegraded":"2024-09-19T06:37:15.029646+0000","last_fullsized":"2024-09-19T06:37:15.029646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:56.933775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478180+0000","last_change":"2024-09-19T06:37:13.470903+0000","last_active":"2024-09-19T06:37:14.478180+0000","last_peered":"2024-09-19T06:37:14.478180+0000","last_clean":"2024-09-19T06:37:14.478180+0000","last_became_active":"2024-09-19T06:37:13.470528+0000","last_became_peered":"2024-09-19T06:37:13.470528+0000","last_unstale":"2024-09-19T06:37:14.478180+0000","last_undegraded":"2024-09-19T06:37:14.478180+0000","last_fullsized":"2024-09-19T06:37:14.478180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:45.999436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477209+0000","last_change":"2024-09-19T06:37:09.448953+0000","last_active":"2024-09-19T06:37:14.477209+0000","last_peered":"2024-09-19T06:37:14.477209+0000","last_clean":"2024-09-19T06:37:14.477209+0000","last_became_active":"2024-09-19T06:37:09.448658+0000","last_became_peered":"2024-09-19T06:37:09.448658+0000","last_unstale":"2024-09-19T06:37:14.477209+0000","last_undegraded":"2024-09-19T06:37:14.477209+0000","last_fullsized":"2024-09-19T06:37:14.477209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:07.333392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477562+0000","last_change":"2024-09-19T06:37:08.440800+0000","last_active":"2024-09-19T06:37:14.477562+0000","last_peered":"2024-09-19T06:37:14.477562+0000","last_clean":"2024-09-19T06:37:14.477562+0000","last_became_active":"2024-09-19T06:37:08.440591+0000","last_became_peered":"2024-09-19T06:37:08.440591+0000","last_unstale":"2024-09-19T06:37:14.477562+0000","last_undegraded":"2024-09-19T06:37:14.477562+0000","last_fullsized":"2024-09-19T06:37:14.477562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:05.540261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478578+0000","last_change":"2024-09-19T06:37:08.441268+0000","last_active":"2024-09-19T06:37:14.478578+0000","last_peered":"2024-09-19T06:37:14.478578+0000","last_clean":"2024-09-19T06:37:14.478578+0000","last_became_active":"2024-09-19T06:37:08.440969+0000","last_became_peered":"2024-09-19T06:37:08.440969+0000","last_unstale":"2024-09-19T06:37:14.478578+0000","last_undegraded":"2024-09-19T06:37:14.478578+0000","last_fullsized":"2024-09-19T06:37:14.478578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:59.426336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030814+0000","last_change":"2024-09-19T06:37:09.444857+0000","last_active":"2024-09-19T06:37:15.030814+0000","last_peered":"2024-09-19T06:37:15.030814+0000","last_clean":"2024-09-19T06:37:15.030814+0000","last_became_active":"2024-09-19T06:37:09.444562+0000","last_became_peered":"2024-09-19T06:37:09.444562+0000","last_unstale":"2024-09-19T06:37:15.030814+0000","last_undegraded":"2024-09-19T06:37:15.030814+0000","last_fullsized":"2024-09-19T06:37:15.030814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:02.470787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815254+0000","last_change":"2024-09-19T06:37:13.467183+0000","last_active":"2024-09-19T06:37:14.815254+0000","last_peered":"2024-09-19T06:37:14.815254+0000","last_clean":"2024-09-19T06:37:14.815254+0000","last_became_active":"2024-09-19T06:37:13.466765+0000","last_became_peered":"2024-09-19T06:37:13.466765+0000","last_unstale":"2024-09-19T06:37:14.815254+0000","last_undegraded":"2024-09-19T06:37:14.815254+0000","last_fullsized":"2024-09-19T06:37:14.815254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:35.184815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477901+0000","last_change":"2024-09-19T06:37:08.443993+0000","last_active":"2024-09-19T06:37:14.477901+0000","last_peered":"2024-09-19T06:37:14.477901+0000","last_clean":"2024-09-19T06:37:14.477901+0000","last_became_active":"2024-09-19T06:37:08.443774+0000","last_became_peered":"2024-09-19T06:37:08.443774+0000","last_unstale":"2024-09-19T06:37:14.477901+0000","last_undegraded":"2024-09-19T06:37:14.477901+0000","last_fullsized":"2024-09-19T06:37:14.477901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:16.005073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029942+0000","last_change":"2024-09-19T06:37:09.440258+0000","last_active":"2024-09-19T06:37:15.029942+0000","last_peered":"2024-09-19T06:37:15.029942+0000","last_clean":"2024-09-19T06:37:15.029942+0000","last_became_active":"2024-09-19T06:37:09.438457+0000","last_became_peered":"2024-09-19T06:37:09.438457+0000","last_unstale":"2024-09-19T06:37:15.029942+0000","last_undegraded":"2024-09-19T06:37:15.029942+0000","last_fullsized":"2024-09-19T06:37:15.029942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:24.636340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477624+0000","last_change":"2024-09-19T06:37:13.462800+0000","last_active":"2024-09-19T06:37:14.477624+0000","last_peered":"2024-09-19T06:37:14.477624+0000","last_clean":"2024-09-19T06:37:14.477624+0000","last_became_active":"2024-09-19T06:37:13.462393+0000","last_became_peered":"2024-09-19T06:37:13.462393+0000","last_unstale":"2024-09-19T06:37:14.477624+0000","last_undegraded":"2024-09-19T06:37:14.477624+0000","last_fullsized":"2024-09-19T06:37:14.477624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:35.901637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477580+0000","last_change":"2024-09-19T06:37:09.450421+0000","last_active":"2024-09-19T06:37:14.477580+0000","last_peered":"2024-09-19T06:37:14.477580+0000","last_clean":"2024-09-19T06:37:14.477580+0000","last_became_active":"2024-09-19T06:37:09.450147+0000","last_became_peered":"2024-09-19T06:37:09.450147+0000","last_unstale":"2024-09-19T06:37:14.477580+0000","last_undegraded":"2024-09-19T06:37:14.477580+0000","last_fullsized":"2024-09-19T06:37:14.477580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:42.949759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.814967+0000","last_change":"2024-09-19T06:37:09.435131+0000","last_active":"2024-09-19T06:37:14.814967+0000","last_peered":"2024-09-19T06:37:14.814967+0000","last_clean":"2024-09-19T06:37:14.814967+0000","last_became_active":"2024-09-19T06:37:09.434840+0000","last_became_peered":"2024-09-19T06:37:09.434840+0000","last_unstale":"2024-09-19T06:37:14.814967+0000","last_undegraded":"2024-09-19T06:37:14.814967+0000","last_fullsized":"2024-09-19T06:37:14.814967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:20.484554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030415+0000","last_change":"2024-09-19T06:37:09.445196+0000","last_active":"2024-09-19T06:37:15.030415+0000","last_peered":"2024-09-19T06:37:15.030415+0000","last_clean":"2024-09-19T06:37:15.030415+0000","last_became_active":"2024-09-19T06:37:09.444907+0000","last_became_peered":"2024-09-19T06:37:09.444907+0000","last_unstale":"2024-09-19T06:37:15.030415+0000","last_undegraded":"2024-09-19T06:37:15.030415+0000","last_fullsized":"2024-09-19T06:37:15.030415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:17.605675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030729+0000","last_change":"2024-09-19T06:37:09.447966+0000","last_active":"2024-09-19T06:37:15.030729+0000","last_peered":"2024-09-19T06:37:15.030729+0000","last_clean":"2024-09-19T06:37:15.030729+0000","last_became_active":"2024-09-19T06:37:09.447692+0000","last_became_peered":"2024-09-19T06:37:09.447692+0000","last_unstale":"2024-09-19T06:37:15.030729+0000","last_undegraded":"2024-09-19T06:37:15.030729+0000","last_fullsized":"2024-09-19T06:37:15.030729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:01.517824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477900+0000","last_change":"2024-09-19T06:37:09.442651+0000","last_active":"2024-09-19T06:37:14.477900+0000","last_peered":"2024-09-19T06:37:14.477900+0000","last_clean":"2024-09-19T06:37:14.477900+0000","last_became_active":"2024-09-19T06:37:09.442195+0000","last_became_peered":"2024-09-19T06:37:09.442195+0000","last_unstale":"2024-09-19T06:37:14.477900+0000","last_undegraded":"2024-09-19T06:37:14.477900+0000","last_fullsized":"2024-09-19T06:37:14.477900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:15.658285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030600+0000","last_change":"2024-09-19T06:37:09.441782+0000","last_active":"2024-09-19T06:37:15.030600+0000","last_peered":"2024-09-19T06:37:15.030600+0000","last_clean":"2024-09-19T06:37:15.030600+0000","last_became_active":"2024-09-19T06:37:09.441456+0000","last_became_peered":"2024-09-19T06:37:09.441456+0000","last_unstale":"2024-09-19T06:37:15.030600+0000","last_undegraded":"2024-09-19T06:37:15.030600+0000","last_fullsized":"2024-09-19T06:37:15.030600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:04:28.458974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479237+0000","last_change":"2024-09-19T06:37:09.449856+0000","last_active":"2024-09-19T06:37:14.479237+0000","last_peered":"2024-09-19T06:37:14.479237+0000","last_clean":"2024-09-19T06:37:14.479237+0000","last_became_active":"2024-09-19T06:37:09.449562+0000","last_became_peered":"2024-09-19T06:37:09.449562+0000","last_unstale":"2024-09-19T06:37:14.479237+0000","last_undegraded":"2024-09-19T06:37:14.479237+0000","last_fullsized":"2024-09-19T06:37:14.479237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:49.182126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477764+0000","last_change":"2024-09-19T06:37:09.438551+0000","last_active":"2024-09-19T06:37:14.477764+0000","last_peered":"2024-09-19T06:37:14.477764+0000","last_clean":"2024-09-19T06:37:14.477764+0000","last_became_active":"2024-09-19T06:37:09.437624+0000","last_became_peered":"2024-09-19T06:37:09.437624+0000","last_unstale":"2024-09-19T06:37:14.477764+0000","last_undegraded":"2024-09-19T06:37:14.477764+0000","last_fullsized":"2024-09-19T06:37:14.477764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:46.565780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029601+0000","last_change":"2024-09-19T06:37:09.438737+0000","last_active":"2024-09-19T06:37:15.029601+0000","last_peered":"2024-09-19T06:37:15.029601+0000","last_clean":"2024-09-19T06:37:15.029601+0000","last_became_active":"2024-09-19T06:37:09.438453+0000","last_became_peered":"2024-09-19T06:37:09.438453+0000","last_unstale":"2024-09-19T06:37:15.029601+0000","last_undegraded":"2024-09-19T06:37:15.029601+0000","last_fullsized":"2024-09-19T06:37:15.029601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.982275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477390+0000","last_change":"2024-09-19T06:37:09.442093+0000","last_active":"2024-09-19T06:37:14.477390+0000","last_peered":"2024-09-19T06:37:14.477390+0000","last_clean":"2024-09-19T06:37:14.477390+0000","last_became_active":"2024-09-19T06:37:09.439710+0000","last_became_peered":"2024-09-19T06:37:09.439710+0000","last_unstale":"2024-09-19T06:37:14.477390+0000","last_undegraded":"2024-09-19T06:37:14.477390+0000","last_fullsized":"2024-09-19T06:37:14.477390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:02.626854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030310+0000","last_change":"2024-09-19T06:37:09.438271+0000","last_active":"2024-09-19T06:37:15.030310+0000","last_peered":"2024-09-19T06:37:15.030310+0000","last_clean":"2024-09-19T06:37:15.030310+0000","last_became_active":"2024-09-19T06:37:09.438009+0000","last_became_peered":"2024-09-19T06:37:09.438009+0000","last_unstale":"2024-09-19T06:37:15.030310+0000","last_undegraded":"2024-09-19T06:37:15.030310+0000","last_fullsized":"2024-09-19T06:37:15.030310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:26.395210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030632+0000","last_change":"2024-09-19T06:37:09.449633+0000","last_active":"2024-09-19T06:37:15.030632+0000","last_peered":"2024-09-19T06:37:15.030632+0000","last_clean":"2024-09-19T06:37:15.030632+0000","last_became_active":"2024-09-19T06:37:09.449379+0000","last_became_peered":"2024-09-19T06:37:09.449379+0000","last_unstale":"2024-09-19T06:37:15.030632+0000","last_undegraded":"2024-09-19T06:37:15.030632+0000","last_fullsized":"2024-09-19T06:37:15.030632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:29.565038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478253+0000","last_change":"2024-09-19T06:37:09.447808+0000","last_active":"2024-09-19T06:37:14.478253+0000","last_peered":"2024-09-19T06:37:14.478253+0000","last_clean":"2024-09-19T06:37:14.478253+0000","last_became_active":"2024-09-19T06:37:09.447514+0000","last_became_peered":"2024-09-19T06:37:09.447514+0000","last_unstale":"2024-09-19T06:37:14.478253+0000","last_undegraded":"2024-09-19T06:37:14.478253+0000","last_fullsized":"2024-09-19T06:37:14.478253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:04.653997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479576+0000","last_change":"2024-09-19T06:37:09.439605+0000","last_active":"2024-09-19T06:37:14.479576+0000","last_peered":"2024-09-19T06:37:14.479576+0000","last_clean":"2024-09-19T06:37:14.479576+0000","last_became_active":"2024-09-19T06:37:09.432601+0000","last_became_peered":"2024-09-19T06:37:09.432601+0000","last_unstale":"2024-09-19T06:37:14.479576+0000","last_undegraded":"2024-09-19T06:37:14.479576+0000","last_fullsized":"2024-09-19T06:37:14.479576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:50.640062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815206+0000","last_change":"2024-09-19T06:37:09.440268+0000","last_active":"2024-09-19T06:37:14.815206+0000","last_peered":"2024-09-19T06:37:14.815206+0000","last_clean":"2024-09-19T06:37:14.815206+0000","last_became_active":"2024-09-19T06:37:09.439937+0000","last_became_peered":"2024-09-19T06:37:09.439937+0000","last_unstale":"2024-09-19T06:37:14.815206+0000","last_undegraded":"2024-09-19T06:37:14.815206+0000","last_fullsized":"2024-09-19T06:37:14.815206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:32:46.182979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030922+0000","last_change":"2024-09-19T06:37:09.437080+0000","last_active":"2024-09-19T06:37:15.030922+0000","last_peered":"2024-09-19T06:37:15.030922+0000","last_clean":"2024-09-19T06:37:15.030922+0000","last_became_active":"2024-09-19T06:37:09.436752+0000","last_became_peered":"2024-09-19T06:37:09.436752+0000","last_unstale":"2024-09-19T06:37:15.030922+0000","last_undegraded":"2024-09-19T06:37:15.030922+0000","last_fullsized":"2024-09-19T06:37:15.030922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:31.423640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029549+0000","last_change":"2024-09-19T06:37:09.448942+0000","last_active":"2024-09-19T06:37:15.029549+0000","last_peered":"2024-09-19T06:37:15.029549+0000","last_clean":"2024-09-19T06:37:15.029549+0000","last_became_active":"2024-09-19T06:37:09.448647+0000","last_became_peered":"2024-09-19T06:37:09.448647+0000","last_unstale":"2024-09-19T06:37:15.029549+0000","last_undegraded":"2024-09-19T06:37:15.029549+0000","last_fullsized":"2024-09-19T06:37:15.029549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:49.027909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029809+0000","last_change":"2024-09-19T06:37:09.445015+0000","last_active":"2024-09-19T06:37:15.029809+0000","last_peered":"2024-09-19T06:37:15.029809+0000","last_clean":"2024-09-19T06:37:15.029809+0000","last_became_active":"2024-09-19T06:37:09.444737+0000","last_became_peered":"2024-09-19T06:37:09.444737+0000","last_unstale":"2024-09-19T06:37:15.029809+0000","last_undegraded":"2024-09-19T06:37:15.029809+0000","last_fullsized":"2024-09-19T06:37:15.029809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:16.194580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029853+0000","last_change":"2024-09-19T06:37:09.446025+0000","last_active":"2024-09-19T06:37:15.029853+0000","last_peered":"2024-09-19T06:37:15.029853+0000","last_clean":"2024-09-19T06:37:15.029853+0000","last_became_active":"2024-09-19T06:37:09.445503+0000","last_became_peered":"2024-09-19T06:37:09.445503+0000","last_unstale":"2024-09-19T06:37:15.029853+0000","last_undegraded":"2024-09-19T06:37:15.029853+0000","last_fullsized":"2024-09-19T06:37:15.029853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:30.469995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477784+0000","last_change":"2024-09-19T06:37:09.441302+0000","last_active":"2024-09-19T06:37:14.477784+0000","last_peered":"2024-09-19T06:37:14.477784+0000","last_clean":"2024-09-19T06:37:14.477784+0000","last_became_active":"2024-09-19T06:37:09.439767+0000","last_became_peered":"2024-09-19T06:37:09.439767+0000","last_unstale":"2024-09-19T06:37:14.477784+0000","last_undegraded":"2024-09-19T06:37:14.477784+0000","last_fullsized":"2024-09-19T06:37:14.477784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:01.038823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030560+0000","last_change":"2024-09-19T06:37:09.440976+0000","last_active":"2024-09-19T06:37:15.030560+0000","last_peered":"2024-09-19T06:37:15.030560+0000","last_clean":"2024-09-19T06:37:15.030560+0000","last_became_active":"2024-09-19T06:37:09.440702+0000","last_became_peered":"2024-09-19T06:37:09.440702+0000","last_unstale":"2024-09-19T06:37:15.030560+0000","last_undegraded":"2024-09-19T06:37:15.030560+0000","last_fullsized":"2024-09-19T06:37:15.030560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:21.281400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477942+0000","last_change":"2024-09-19T06:37:09.442301+0000","last_active":"2024-09-19T06:37:14.477942+0000","last_peered":"2024-09-19T06:37:14.477942+0000","last_clean":"2024-09-19T06:37:14.477942+0000","last_became_active":"2024-09-19T06:37:09.442053+0000","last_became_peered":"2024-09-19T06:37:09.442053+0000","last_unstale":"2024-09-19T06:37:14.477942+0000","last_undegraded":"2024-09-19T06:37:14.477942+0000","last_fullsized":"2024-09-19T06:37:14.477942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:26.189384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479335+0000","last_change":"2024-09-19T06:37:09.441525+0000","last_active":"2024-09-19T06:37:14.479335+0000","last_peered":"2024-09-19T06:37:14.479335+0000","last_clean":"2024-09-19T06:37:14.479335+0000","last_became_active":"2024-09-19T06:37:09.441179+0000","last_became_peered":"2024-09-19T06:37:09.441179+0000","last_unstale":"2024-09-19T06:37:14.479335+0000","last_undegraded":"2024-09-19T06:37:14.479335+0000","last_fullsized":"2024-09-19T06:37:14.479335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:47.235113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479743+0000","last_change":"2024-09-19T06:37:09.437163+0000","last_active":"2024-09-19T06:37:14.479743+0000","last_peered":"2024-09-19T06:37:14.479743+0000","last_clean":"2024-09-19T06:37:14.479743+0000","last_became_active":"2024-09-19T06:37:09.436892+0000","last_became_peered":"2024-09-19T06:37:09.436892+0000","last_unstale":"2024-09-19T06:37:14.479743+0000","last_undegraded":"2024-09-19T06:37:14.479743+0000","last_fullsized":"2024-09-19T06:37:14.479743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:47:58.347385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477114+0000","last_change":"2024-09-19T06:37:09.437524+0000","last_active":"2024-09-19T06:37:14.477114+0000","last_peered":"2024-09-19T06:37:14.477114+0000","last_clean":"2024-09-19T06:37:14.477114+0000","last_became_active":"2024-09-19T06:37:09.437023+0000","last_became_peered":"2024-09-19T06:37:09.437023+0000","last_unstale":"2024-09-19T06:37:14.477114+0000","last_undegraded":"2024-09-19T06:37:14.477114+0000","last_fullsized":"2024-09-19T06:37:14.477114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:31.398914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478456+0000","last_change":"2024-09-19T06:37:09.448814+0000","last_active":"2024-09-19T06:37:14.478456+0000","last_peered":"2024-09-19T06:37:14.478456+0000","last_clean":"2024-09-19T06:37:14.478456+0000","last_became_active":"2024-09-19T06:37:09.448547+0000","last_became_peered":"2024-09-19T06:37:09.448547+0000","last_unstale":"2024-09-19T06:37:14.478456+0000","last_undegraded":"2024-09-19T06:37:14.478456+0000","last_fullsized":"2024-09-19T06:37:14.478456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:13.526300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030114+0000","last_change":"2024-09-19T06:37:09.446910+0000","last_active":"2024-09-19T06:37:15.030114+0000","last_peered":"2024-09-19T06:37:15.030114+0000","last_clean":"2024-09-19T06:37:15.030114+0000","last_became_active":"2024-09-19T06:37:09.446603+0000","last_became_peered":"2024-09-19T06:37:09.446603+0000","last_unstale":"2024-09-19T06:37:15.030114+0000","last_undegraded":"2024-09-19T06:37:15.030114+0000","last_fullsized":"2024-09-19T06:37:15.030114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:47.006354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479198+0000","last_change":"2024-09-19T06:37:09.430160+0000","last_active":"2024-09-19T06:37:14.479198+0000","last_peered":"2024-09-19T06:37:14.479198+0000","last_clean":"2024-09-19T06:37:14.479198+0000","last_became_active":"2024-09-19T06:37:09.429813+0000","last_became_peered":"2024-09-19T06:37:09.429813+0000","last_unstale":"2024-09-19T06:37:14.479198+0000","last_undegraded":"2024-09-19T06:37:14.479198+0000","last_fullsized":"2024-09-19T06:37:14.479198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:10.353834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030011+0000","last_change":"2024-09-19T06:37:09.446622+0000","last_active":"2024-09-19T06:37:15.030011+0000","last_peered":"2024-09-19T06:37:15.030011+0000","last_clean":"2024-09-19T06:37:15.030011+0000","last_became_active":"2024-09-19T06:37:09.446349+0000","last_became_peered":"2024-09-19T06:37:09.446349+0000","last_unstale":"2024-09-19T06:37:15.030011+0000","last_undegraded":"2024-09-19T06:37:15.030011+0000","last_fullsized":"2024-09-19T06:37:15.030011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:01.702039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030152+0000","last_change":"2024-09-19T06:37:09.446789+0000","last_active":"2024-09-19T06:37:15.030152+0000","last_peered":"2024-09-19T06:37:15.030152+0000","last_clean":"2024-09-19T06:37:15.030152+0000","last_became_active":"2024-09-19T06:37:09.446557+0000","last_became_peered":"2024-09-19T06:37:09.446557+0000","last_unstale":"2024-09-19T06:37:15.030152+0000","last_undegraded":"2024-09-19T06:37:15.030152+0000","last_fullsized":"2024-09-19T06:37:15.030152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:18.119474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030246+0000","last_change":"2024-09-19T06:37:09.448093+0000","last_active":"2024-09-19T06:37:15.030246+0000","last_peered":"2024-09-19T06:37:15.030246+0000","last_clean":"2024-09-19T06:37:15.030246+0000","last_became_active":"2024-09-19T06:37:09.447753+0000","last_became_peered":"2024-09-19T06:37:09.447753+0000","last_unstale":"2024-09-19T06:37:15.030246+0000","last_undegraded":"2024-09-19T06:37:15.030246+0000","last_fullsized":"2024-09-19T06:37:15.030246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:11.944092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479640+0000","last_change":"2024-09-19T06:37:09.442798+0000","last_active":"2024-09-19T06:37:14.479640+0000","last_peered":"2024-09-19T06:37:14.479640+0000","last_clean":"2024-09-19T06:37:14.479640+0000","last_became_active":"2024-09-19T06:37:09.442047+0000","last_became_peered":"2024-09-19T06:37:09.442047+0000","last_unstale":"2024-09-19T06:37:14.479640+0000","last_undegraded":"2024-09-19T06:37:14.479640+0000","last_fullsized":"2024-09-19T06:37:14.479640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:33.193185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65040,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":348160,"data_stored":698736,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":698680,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":107730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:37:29.777 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T06:37:29.777 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T06:37:29.777 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-19T06:37:29.778 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-19T06:37:29.778 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-19T06:37:29.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.908+0000 7ff68b5bd640 1 Processor -- start 2024-09-19T06:37:29.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.908+0000 7ff68b5bd640 1 -- start start 2024-09-19T06:37:29.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.909+0000 7ff68b5bd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6840cb660 0x7ff6840cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:29.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.909+0000 7ff68b5bd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff6840c6df0 0x7ff68415e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:29.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.909+0000 7ff68b5bd640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6840ccb90 con 0x7ff6840cba40 2024-09-19T06:37:29.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.909+0000 7ff68b5bd640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7ff6840cce20 con 0x7ff6840c6df0 2024-09-19T06:37:29.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.909+0000 7ff68b5bd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff6840cd100 con 0x7ff6840cb660 2024-09-19T06:37:29.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.909+0000 7ff688b58640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff6840c6df0 0x7ff68415e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:29.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.909+0000 7ff688b58640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff6840c6df0 0x7ff68415e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39358/0 (socket says 172.21.15.86:39358) 2024-09-19T06:37:29.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.909+0000 7ff688b58640 1 -- 172.21.15.86:0/765647851 learned_addr learned my addr 172.21.15.86:0/765647851 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:29.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.909+0000 7ff689359640 1 --2- 172.21.15.86:0/765647851 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6840cb660 0x7ff6840cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:29.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.910+0000 7ff688b58640 1 -- 172.21.15.86:0/765647851 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6840cb660 msgr2=0x7ff6840cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:29.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.910+0000 7ff688b58640 1 --2- 172.21.15.86:0/765647851 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6840cb660 0x7ff6840cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.910+0000 7ff688b58640 1 -- 172.21.15.86:0/765647851 >> v1:172.21.15.169:6789/0 conn(0x7ff6840cba40 legacy=0x7ff684158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:29.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.910+0000 7ff688b58640 1 -- 172.21.15.86:0/765647851 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6840c6310 con 0x7ff6840c6df0 2024-09-19T06:37:29.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.910+0000 7ff688b58640 1 --2- 172.21.15.86:0/765647851 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6840c6df0 0x7ff68415e8c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff674009870 tx=0x7ff67402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6cc4fcc03e7d160 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:29.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.910+0000 7ff67bfff640 1 -- 172.21.15.86:0/765647851 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff674037070 con 0x7ff6840c6df0 2024-09-19T06:37:29.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.910+0000 7ff67bfff640 1 -- 172.21.15.86:0/765647851 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff674032440 con 0x7ff6840c6df0 2024-09-19T06:37:29.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.910+0000 7ff67bfff640 1 -- 172.21.15.86:0/765647851 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff674032810 con 0x7ff6840c6df0 2024-09-19T06:37:29.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.911+0000 7ff68b5bd640 1 -- 172.21.15.86:0/765647851 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6840c6df0 msgr2=0x7ff68415e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:29.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.911+0000 7ff68b5bd640 1 --2- 172.21.15.86:0/765647851 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6840c6df0 0x7ff68415e8c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff674009870 tx=0x7ff67402a270 comp rx=0 tx=0).stop 2024-09-19T06:37:29.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.911+0000 7ff68b5bd640 1 -- 172.21.15.86:0/765647851 shutdown_connections 2024-09-19T06:37:29.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.911+0000 7ff68b5bd640 1 --2- 172.21.15.86:0/765647851 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6840c6df0 0x7ff68415e8c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.911+0000 7ff68b5bd640 1 --2- 172.21.15.86:0/765647851 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6840cb660 0x7ff6840cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.911+0000 7ff68b5bd640 1 -- 172.21.15.86:0/765647851 >> 172.21.15.86:0/765647851 conn(0x7ff68406bcc0 msgr2=0x7ff68406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:29.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.911+0000 7ff68b5bd640 1 -- 172.21.15.86:0/765647851 shutdown_connections 2024-09-19T06:37:29.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.911+0000 7ff68b5bd640 1 -- 172.21.15.86:0/765647851 wait complete. 2024-09-19T06:37:29.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.912+0000 7ff68b5bd640 1 Processor -- start 2024-09-19T06:37:29.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.912+0000 7ff68b5bd640 1 -- start start 2024-09-19T06:37:29.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.913+0000 7ff68b5bd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6840c6df0 0x7ff684153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:29.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.913+0000 7ff68b5bd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6840cb660 0x7ff68415d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:29.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.913+0000 7ff68b5bd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6840cba40 0x7ff68414b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:29.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.913+0000 7ff68b5bd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff6840c7e70 con 0x7ff6840cba40 2024-09-19T06:37:29.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.913+0000 7ff68b5bd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff6840c68d0 con 0x7ff6840cb660 2024-09-19T06:37:29.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.913+0000 7ff68b5bd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff68415ee00 con 0x7ff6840c6df0 2024-09-19T06:37:29.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.913+0000 7ff689b5a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6840cba40 0x7ff68414b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:29.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.913+0000 7ff689b5a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6840cba40 0x7ff68414b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39372/0 (socket says 172.21.15.86:39372) 2024-09-19T06:37:29.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.913+0000 7ff689b5a640 1 -- 172.21.15.86:0/3407490847 learned_addr learned my addr 172.21.15.86:0/3407490847 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:29.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.913+0000 7ff689359640 1 --2- 172.21.15.86:0/3407490847 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6840c6df0 0x7ff684153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:29.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.913+0000 7ff688b58640 1 --2- 172.21.15.86:0/3407490847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6840cb660 0x7ff68415d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:29.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.913+0000 7ff689b5a640 1 -- 172.21.15.86:0/3407490847 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6840c6df0 msgr2=0x7ff684153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:29.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.913+0000 7ff689b5a640 1 --2- 172.21.15.86:0/3407490847 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6840c6df0 0x7ff684153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.913+0000 7ff689b5a640 1 -- 172.21.15.86:0/3407490847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6840cb660 msgr2=0x7ff68415d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:29.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.913+0000 7ff689b5a640 1 --2- 172.21.15.86:0/3407490847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6840cb660 0x7ff68415d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.913+0000 7ff689b5a640 1 -- 172.21.15.86:0/3407490847 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff684159fe0 con 0x7ff6840cba40 2024-09-19T06:37:29.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.914+0000 7ff689b5a640 1 --2- 172.21.15.86:0/3407490847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6840cba40 0x7ff68414b4e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff67c00c3f0 tx=0x7ff67c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:29.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.914+0000 7ff679ffb640 1 -- 172.21.15.86:0/3407490847 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67c017070 con 0x7ff6840cba40 2024-09-19T06:37:29.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.914+0000 7ff679ffb640 1 -- 172.21.15.86:0/3407490847 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff67c0052d0 con 0x7ff6840cba40 2024-09-19T06:37:29.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.914+0000 7ff68b5bd640 1 -- 172.21.15.86:0/3407490847 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6841584f0 con 0x7ff6840cba40 2024-09-19T06:37:29.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.914+0000 7ff679ffb640 1 -- 172.21.15.86:0/3407490847 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67c003830 con 0x7ff6840cba40 2024-09-19T06:37:29.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.914+0000 7ff68b5bd640 1 -- 172.21.15.86:0/3407490847 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff684153930 con 0x7ff6840cba40 2024-09-19T06:37:29.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.915+0000 7ff68b5bd640 1 -- 172.21.15.86:0/3407490847 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6840c58f0 con 0x7ff6840cba40 2024-09-19T06:37:29.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.915+0000 7ff679ffb640 1 -- 172.21.15.86:0/3407490847 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff67c01a070 con 0x7ff6840cba40 2024-09-19T06:37:29.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.916+0000 7ff679ffb640 1 --2- 172.21.15.86:0/3407490847 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff66806c2e0 0x7ff66806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:29.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.916+0000 7ff679ffb640 1 -- 172.21.15.86:0/3407490847 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff67c08a8d0 con 0x7ff6840cba40 2024-09-19T06:37:29.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.916+0000 7ff689359640 1 --2- 172.21.15.86:0/3407490847 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff66806c2e0 0x7ff66806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:29.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.916+0000 7ff689359640 1 --2- 172.21.15.86:0/3407490847 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff66806c2e0 0x7ff66806e7a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff68415beb0 tx=0x7ff6800098d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:29.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:29.920+0000 7ff679ffb640 1 -- 172.21.15.86:0/3407490847 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff67c058800 con 0x7ff6840cba40 2024-09-19T06:37:30.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.132+0000 7ff68b5bd640 1 -- 172.21.15.86:0/3407490847 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7ff68415c550 con 0x7ff6840cba40 2024-09-19T06:37:30.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.135+0000 7ff679ffb640 1 -- 172.21.15.86:0/3407490847 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+173505 (secure 0 0 0) 0x7ff67c05cb00 con 0x7ff6840cba40 2024-09-19T06:37:30.139 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:30.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.137+0000 7ff68b5bd640 1 -- 172.21.15.86:0/3407490847 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff66806c2e0 msgr2=0x7ff66806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.137+0000 7ff68b5bd640 1 --2- 172.21.15.86:0/3407490847 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff66806c2e0 0x7ff66806e7a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff68415beb0 tx=0x7ff6800098d0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.137+0000 7ff68b5bd640 1 -- 172.21.15.86:0/3407490847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6840cba40 msgr2=0x7ff68414b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.137+0000 7ff68b5bd640 1 --2- 172.21.15.86:0/3407490847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6840cba40 0x7ff68414b4e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff67c00c3f0 tx=0x7ff67c00c7f0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.137+0000 7ff68b5bd640 1 -- 172.21.15.86:0/3407490847 shutdown_connections 2024-09-19T06:37:30.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.137+0000 7ff68b5bd640 1 --2- 172.21.15.86:0/3407490847 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff66806c2e0 0x7ff66806e7a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.137+0000 7ff68b5bd640 1 --2- 172.21.15.86:0/3407490847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6840cba40 0x7ff68414b4e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.137+0000 7ff68b5bd640 1 --2- 172.21.15.86:0/3407490847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6840cb660 0x7ff68415d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.137+0000 7ff68b5bd640 1 --2- 172.21.15.86:0/3407490847 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6840c6df0 0x7ff684153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.137+0000 7ff68b5bd640 1 -- 172.21.15.86:0/3407490847 >> 172.21.15.86:0/3407490847 conn(0x7ff68406bcc0 msgr2=0x7ff6840cbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:30.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.137+0000 7ff68b5bd640 1 -- 172.21.15.86:0/3407490847 shutdown_connections 2024-09-19T06:37:30.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.137+0000 7ff68b5bd640 1 -- 172.21.15.86:0/3407490847 wait complete. 2024-09-19T06:37:30.149 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":4165134248},{"type":"v1","addr":"172.21.15.86:6817","nonce":4165134248}]},"active_addr":"172.21.15.86:6817/4165134248","active_change":"2024-09-19T06:36:49.730999+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":4167818603}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":3179975377}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":3346999404}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":2041938018}]}]} 2024-09-19T06:37:30.154 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-19T06:37:30.154 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-19T06:37:30.154 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T06:37:30.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.251+0000 7f7278f03640 1 Processor -- start 2024-09-19T06:37:30.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.251+0000 7f7278f03640 1 -- start start 2024-09-19T06:37:30.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.252+0000 7f7278f03640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7274153050 0x7f72740cb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.252+0000 7f7278f03640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f72740c8b20 0x7f727415ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.252+0000 7f7278f03640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f727415cf60 0x7f7274073120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.252+0000 7f7278f03640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f72740c5da0 con 0x7f72740c8b20 2024-09-19T06:37:30.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.252+0000 7f7278f03640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f7274153430 con 0x7f7274153050 2024-09-19T06:37:30.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.252+0000 7f7278f03640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f72740c6040 con 0x7f727415cf60 2024-09-19T06:37:30.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.252+0000 7f7271d9b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f72740c8b20 0x7f727415ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.252+0000 7f7271d9b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f72740c8b20 0x7f727415ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39386/0 (socket says 172.21.15.86:39386) 2024-09-19T06:37:30.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.252+0000 7f7271d9b640 1 -- 172.21.15.86:0/1875292190 learned_addr learned my addr 172.21.15.86:0/1875292190 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:30.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.252+0000 7f727259c640 1 --2- 172.21.15.86:0/1875292190 >> v2:172.21.15.169:3300/0 conn(0x7f7274153050 0x7f72740cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.252+0000 7f7272d9d640 1 --2- 172.21.15.86:0/1875292190 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f727415cf60 0x7f7274073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.252+0000 7f7271d9b640 1 -- 172.21.15.86:0/1875292190 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f727415cf60 msgr2=0x7f7274073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:30.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.252+0000 7f7271d9b640 1 --2- 172.21.15.86:0/1875292190 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f727415cf60 0x7f7274073120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.252+0000 7f7271d9b640 1 -- 172.21.15.86:0/1875292190 >> v2:172.21.15.169:3300/0 conn(0x7f7274153050 msgr2=0x7f72740cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:30.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.252+0000 7f7271d9b640 1 --2- 172.21.15.86:0/1875292190 >> v2:172.21.15.169:3300/0 conn(0x7f7274153050 0x7f72740cb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.252+0000 7f7271d9b640 1 -- 172.21.15.86:0/1875292190 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72740c6320 con 0x7f72740c8b20 2024-09-19T06:37:30.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.252+0000 7f727259c640 1 --2- 172.21.15.86:0/1875292190 >> v2:172.21.15.169:3300/0 conn(0x7f7274153050 0x7f72740cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:30.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.253+0000 7f7271d9b640 1 --2- 172.21.15.86:0/1875292190 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72740c8b20 0x7f727415ca20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7274072e10 tx=0x7f726802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c006bff8f632fcca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:30.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.253+0000 7f727159a640 1 -- 172.21.15.86:0/1875292190 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7268037070 con 0x7f72740c8b20 2024-09-19T06:37:30.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.253+0000 7f727159a640 1 -- 172.21.15.86:0/1875292190 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7268032440 con 0x7f72740c8b20 2024-09-19T06:37:30.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.253+0000 7f727159a640 1 -- 172.21.15.86:0/1875292190 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7268032810 con 0x7f72740c8b20 2024-09-19T06:37:30.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.254+0000 7f7278f03640 1 -- 172.21.15.86:0/1875292190 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72740c8b20 msgr2=0x7f727415ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.254+0000 7f7278f03640 1 --2- 172.21.15.86:0/1875292190 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72740c8b20 0x7f727415ca20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7274072e10 tx=0x7f726802a1e0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.254+0000 7f7278f03640 1 -- 172.21.15.86:0/1875292190 shutdown_connections 2024-09-19T06:37:30.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.254+0000 7f7278f03640 1 --2- 172.21.15.86:0/1875292190 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72740c8b20 0x7f727415ca20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.254+0000 7f7278f03640 1 --2- 172.21.15.86:0/1875292190 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f727415cf60 0x7f7274073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.254+0000 7f7278f03640 1 --2- 172.21.15.86:0/1875292190 >> v2:172.21.15.169:3300/0 conn(0x7f7274153050 0x7f72740cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.254+0000 7f7278f03640 1 -- 172.21.15.86:0/1875292190 >> 172.21.15.86:0/1875292190 conn(0x7f7274070d10 msgr2=0x7f72740710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:30.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.254+0000 7f7278f03640 1 -- 172.21.15.86:0/1875292190 shutdown_connections 2024-09-19T06:37:30.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.254+0000 7f7278f03640 1 -- 172.21.15.86:0/1875292190 wait complete. 2024-09-19T06:37:30.260 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.255+0000 7f7278f03640 1 Processor -- start 2024-09-19T06:37:30.260 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.255+0000 7f7278f03640 1 -- start start 2024-09-19T06:37:30.260 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.256+0000 7f7278f03640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72740c8b20 0x7f72741558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.260 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.256+0000 7f7278f03640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7274153050 0x7f7274146c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.256+0000 7f7278f03640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f727415cf60 0x7f72741471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.256+0000 7f7278f03640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f727415c500 con 0x7f7274153050 2024-09-19T06:37:30.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.256+0000 7f7278f03640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f72740c68e0 con 0x7f72740c8b20 2024-09-19T06:37:30.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.256+0000 7f7278f03640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f72740cbe70 con 0x7f727415cf60 2024-09-19T06:37:30.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.256+0000 7f7271d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7274153050 0x7f7274146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.256+0000 7f7271d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7274153050 0x7f7274146c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39390/0 (socket says 172.21.15.86:39390) 2024-09-19T06:37:30.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.256+0000 7f7271d9b640 1 -- 172.21.15.86:0/1887050249 learned_addr learned my addr 172.21.15.86:0/1887050249 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:30.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.256+0000 7f7272d9d640 1 --2- 172.21.15.86:0/1887050249 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f727415cf60 0x7f72741471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.256+0000 7f727259c640 1 --2- 172.21.15.86:0/1887050249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72740c8b20 0x7f72741558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.256+0000 7f7271d9b640 1 -- 172.21.15.86:0/1887050249 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f727415cf60 msgr2=0x7f72741471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.256+0000 7f7271d9b640 1 --2- 172.21.15.86:0/1887050249 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f727415cf60 0x7f72741471a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.256+0000 7f7271d9b640 1 -- 172.21.15.86:0/1887050249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72740c8b20 msgr2=0x7f72741558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.256+0000 7f7271d9b640 1 --2- 172.21.15.86:0/1887050249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72740c8b20 0x7f72741558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.256+0000 7f7271d9b640 1 -- 172.21.15.86:0/1887050249 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7274156210 con 0x7f7274153050 2024-09-19T06:37:30.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.256+0000 7f7272d9d640 1 --2- 172.21.15.86:0/1887050249 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f727415cf60 0x7f72741471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:30.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.256+0000 7f727259c640 1 --2- 172.21.15.86:0/1887050249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72740c8b20 0x7f72741558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:30.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.256+0000 7f7271d9b640 1 --2- 172.21.15.86:0/1887050249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7274153050 0x7f7274146c60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f726802a220 tx=0x7f72680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:30.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.256+0000 7f7262ffd640 1 -- 172.21.15.86:0/1887050249 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7268037040 con 0x7f7274153050 2024-09-19T06:37:30.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.256+0000 7f7262ffd640 1 -- 172.21.15.86:0/1887050249 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7268042070 con 0x7f7274153050 2024-09-19T06:37:30.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.256+0000 7f7278f03640 1 -- 172.21.15.86:0/1887050249 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72741564f0 con 0x7f7274153050 2024-09-19T06:37:30.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.256+0000 7f7262ffd640 1 -- 172.21.15.86:0/1887050249 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7268030bb0 con 0x7f7274153050 2024-09-19T06:37:30.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.256+0000 7f7278f03640 1 -- 172.21.15.86:0/1887050249 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7274149130 con 0x7f7274153050 2024-09-19T06:37:30.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.257+0000 7f7278f03640 1 -- 172.21.15.86:0/1887050249 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7274148c40 con 0x7f7274153050 2024-09-19T06:37:30.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.258+0000 7f7262ffd640 1 -- 172.21.15.86:0/1887050249 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7268047460 con 0x7f7274153050 2024-09-19T06:37:30.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.258+0000 7f7262ffd640 1 --2- 172.21.15.86:0/1887050249 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f725406c2e0 0x7f725406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.258+0000 7f7262ffd640 1 -- 172.21.15.86:0/1887050249 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f72680ac3c0 con 0x7f7274153050 2024-09-19T06:37:30.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.258+0000 7f727259c640 1 --2- 172.21.15.86:0/1887050249 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f725406c2e0 0x7f725406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.259+0000 7f727259c640 1 --2- 172.21.15.86:0/1887050249 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f725406c2e0 0x7f725406e7a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7264006fd0 tx=0x7f7264008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:30.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.262+0000 7f7262ffd640 1 -- 172.21.15.86:0/1887050249 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7268045360 con 0x7f7274153050 2024-09-19T06:37:30.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.429+0000 7f7278f03640 1 -- 172.21.15.86:0/1887050249 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f727415ca20 con 0x7f7274153050 2024-09-19T06:37:30.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.430+0000 7f7262ffd640 1 -- 172.21.15.86:0/1887050249 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18586 (secure 0 0 0) 0x7f726807a760 con 0x7f7274153050 2024-09-19T06:37:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:30.432 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":26,"fsid":"1785f09f-0959-457d-8c4a-6cce2e655a37","created":"2024-09-19T06:36:45.671544+0000","modified":"2024-09-19T06:37:13.796252+0000","last_up_change":"2024-09-19T06:36:56.765680+0000","last_in_change":"2024-09-19T06:36:47.816681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:36:57.770634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:37:06.588120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:37:07.739726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T06:37:11.457476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bd3ce3f2-2a37-40ec-8dc3-69246437277c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6827","nonce":1588074611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6829","nonce":1588074611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6833","nonce":1588074611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6831","nonce":1588074611}]},"public_addr":"172.21.15.86:6827/1588074611","cluster_addr":"172.21.15.86:6829/1588074611","heartbeat_back_addr":"172.21.15.86:6833/1588074611","heartbeat_front_addr":"172.21.15.86:6831/1588074611","state":["exists","up"]},{"osd":1,"uuid":"871d7d23-ed03-4629-bca9-5b71ad0d926a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6819","nonce":1785682938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6821","nonce":1785682938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6825","nonce":1785682938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6823","nonce":1785682938}]},"public_addr":"172.21.15.86:6819/1785682938","cluster_addr":"172.21.15.86:6821/1785682938","heartbeat_back_addr":"172.21.15.86:6825/1785682938","heartbeat_front_addr":"172.21.15.86:6823/1785682938","state":["exists","up"]},{"osd":2,"uuid":"39d3562d-8c52-4af9-935a-2d90abb8b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6801","nonce":3306127846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6803","nonce":3306127846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6807","nonce":3306127846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6805","nonce":3306127846}]},"public_addr":"172.21.15.86:6801/3306127846","cluster_addr":"172.21.15.86:6803/3306127846","heartbeat_back_addr":"172.21.15.86:6807/3306127846","heartbeat_front_addr":"172.21.15.86:6805/3306127846","state":["exists","up"]},{"osd":3,"uuid":"7f88c5b1-042c-4a9f-a674-32456e0644a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6809","nonce":694275178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6811","nonce":694275178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6815","nonce":694275178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6813","nonce":694275178}]},"public_addr":"172.21.15.86:6809/694275178","cluster_addr":"172.21.15.86:6811/694275178","heartbeat_back_addr":"172.21.15.86:6815/694275178","heartbeat_front_addr":"172.21.15.86:6813/694275178","state":["exists","up"]},{"osd":4,"uuid":"18aa391b-0863-48bf-bff6-107e22ee9752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6811","nonce":1326795640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6815","nonce":1326795640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6823","nonce":1326795640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6819","nonce":1326795640}]},"public_addr":"172.21.15.169:6811/1326795640","cluster_addr":"172.21.15.169:6815/1326795640","heartbeat_back_addr":"172.21.15.169:6823/1326795640","heartbeat_front_addr":"172.21.15.169:6819/1326795640","state":["exists","up"]},{"osd":5,"uuid":"90fa5ca6-1815-4af1-a664-b45a9e19dd56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6825","nonce":3538913242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6827","nonce":3538913242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6831","nonce":3538913242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6829","nonce":3538913242}]},"public_addr":"172.21.15.169:6825/3538913242","cluster_addr":"172.21.15.169:6827/3538913242","heartbeat_back_addr":"172.21.15.169:6831/3538913242","heartbeat_front_addr":"172.21.15.169:6829/3538913242","state":["exists","up"]},{"osd":6,"uuid":"8b2019fc-6cc2-4394-9a7c-7951544f7cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6810","nonce":494424253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6814","nonce":494424253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6822","nonce":494424253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6818","nonce":494424253}]},"public_addr":"172.21.15.169:6810/494424253","cluster_addr":"172.21.15.169:6814/494424253","heartbeat_back_addr":"172.21.15.169:6822/494424253","heartbeat_front_addr":"172.21.15.169:6818/494424253","state":["exists","up"]},{"osd":7,"uuid":"622e3b2c-5302-4b0a-b7f2-f4050801401e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6801","nonce":797235989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6803","nonce":797235989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6807","nonce":797235989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6805","nonce":797235989}]},"public_addr":"172.21.15.169:6801/797235989","cluster_addr":"172.21.15.169:6803/797235989","heartbeat_back_addr":"172.21.15.169:6807/797235989","heartbeat_front_addr":"172.21.15.169:6805/797235989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.130643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.611572+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:53.419992+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.560112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.112065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.774642+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.341946+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.117884+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:37:30.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.432+0000 7f7278f03640 1 -- 172.21.15.86:0/1887050249 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f725406c2e0 msgr2=0x7f725406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.432+0000 7f7278f03640 1 --2- 172.21.15.86:0/1887050249 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f725406c2e0 0x7f725406e7a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7264006fd0 tx=0x7f7264008040 comp rx=0 tx=0).stop 2024-09-19T06:37:30.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.432+0000 7f7278f03640 1 -- 172.21.15.86:0/1887050249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7274153050 msgr2=0x7f7274146c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.432+0000 7f7278f03640 1 --2- 172.21.15.86:0/1887050249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7274153050 0x7f7274146c60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f726802a220 tx=0x7f72680046c0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.432+0000 7f7278f03640 1 -- 172.21.15.86:0/1887050249 shutdown_connections 2024-09-19T06:37:30.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.432+0000 7f7278f03640 1 --2- 172.21.15.86:0/1887050249 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f725406c2e0 0x7f725406e7a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.432+0000 7f7278f03640 1 --2- 172.21.15.86:0/1887050249 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f727415cf60 0x7f72741471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.432+0000 7f7278f03640 1 --2- 172.21.15.86:0/1887050249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7274153050 0x7f7274146c60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.432+0000 7f7278f03640 1 --2- 172.21.15.86:0/1887050249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72740c8b20 0x7f72741558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.432+0000 7f7278f03640 1 -- 172.21.15.86:0/1887050249 >> 172.21.15.86:0/1887050249 conn(0x7f7274070d10 msgr2=0x7f72740c5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:30.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.433+0000 7f7278f03640 1 -- 172.21.15.86:0/1887050249 shutdown_connections 2024-09-19T06:37:30.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.433+0000 7f7278f03640 1 -- 172.21.15.86:0/1887050249 wait complete. 2024-09-19T06:37:30.445 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-19T06:37:30.445 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T06:37:30.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.543+0000 7f896adc0640 1 Processor -- start 2024-09-19T06:37:30.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.543+0000 7f896adc0640 1 -- start start 2024-09-19T06:37:30.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f896adc0640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f89640c6df0 0x7f896415e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f896adc0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89640cba40 0x7f8964158360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f896adc0640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89640cce20 con 0x7f89640cb660 2024-09-19T06:37:30.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f896adc0640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f89640cd100 con 0x7f89640c6df0 2024-09-19T06:37:30.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f896adc0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f89640c6310 con 0x7f89640cba40 2024-09-19T06:37:30.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f8968b5c640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f89640cb660 0x7f89640cc650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39606/0 (socket says 172.21.15.86:39606) 2024-09-19T06:37:30.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f8968b5c640 1 -- 172.21.15.86:0/2861625907 learned_addr learned my addr 172.21.15.86:0/2861625907 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:30.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f896935d640 1 --2- 172.21.15.86:0/2861625907 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89640cba40 0x7f8964158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f8963fff640 1 --2- 172.21.15.86:0/2861625907 >> v2:172.21.15.169:3300/0 conn(0x7f89640c6df0 0x7f896415e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f89637fe640 1 -- 172.21.15.86:0/2861625907 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 94675655 0 0) 0x7f89640cce20 con 0x7f89640cb660 2024-09-19T06:37:30.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f89637fe640 1 -- 172.21.15.86:0/2861625907 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8954003520 con 0x7f89640cb660 2024-09-19T06:37:30.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f89637fe640 1 -- 172.21.15.86:0/2861625907 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1822780229 0 0) 0x7f8954003520 con 0x7f89640cb660 2024-09-19T06:37:30.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f89637fe640 1 -- 172.21.15.86:0/2861625907 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89640cba40 msgr2=0x7f8964158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:30.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f89637fe640 1 --2- 172.21.15.86:0/2861625907 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89640cba40 0x7f8964158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f89637fe640 1 -- 172.21.15.86:0/2861625907 >> v2:172.21.15.169:3300/0 conn(0x7f89640c6df0 msgr2=0x7f896415e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:30.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f89637fe640 1 --2- 172.21.15.86:0/2861625907 >> v2:172.21.15.169:3300/0 conn(0x7f89640c6df0 0x7f896415e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f89637fe640 1 -- 172.21.15.86:0/2861625907 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89640c65f0 con 0x7f89640cb660 2024-09-19T06:37:30.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f89637fe640 1 -- 172.21.15.86:0/2861625907 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f8958001670 con 0x7f89640cb660 2024-09-19T06:37:30.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f89637fe640 1 -- 172.21.15.86:0/2861625907 >> v1:172.21.15.86:6789/0 conn(0x7f89640cb660 legacy=0x7f89640cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f89637fe640 1 --2- 172.21.15.86:0/2861625907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89540039b0 0x7f8954003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f89637fe640 1 --2- 172.21.15.86:0/2861625907 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8954004800 0x7f8954004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f89637fe640 1 --2- 172.21.15.86:0/2861625907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89540051c0 0x7f895400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f89637fe640 1 -- 172.21.15.86:0/2861625907 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f89640cd100 con 0x7f89540039b0 2024-09-19T06:37:30.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f89637fe640 1 -- 172.21.15.86:0/2861625907 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f89640c6310 con 0x7f89540051c0 2024-09-19T06:37:30.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f89637fe640 1 -- 172.21.15.86:0/2861625907 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f895400bf00 con 0x7f8954004800 2024-09-19T06:37:30.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f896935d640 1 --2- 172.21.15.86:0/2861625907 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89640cba40 0x7f8964158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:37:30.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f8963fff640 1 --2- 172.21.15.86:0/2861625907 >> v2:172.21.15.169:3300/0 conn(0x7f89640c6df0 0x7f896415e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:37:30.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.544+0000 7f8968b5c640 1 --2- 172.21.15.86:0/2861625907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89540039b0 0x7f8954003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.545+0000 7f8968b5c640 1 -- 172.21.15.86:0/2861625907 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8954004800 msgr2=0x7f8954004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:30.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.545+0000 7f896935d640 1 --2- 172.21.15.86:0/2861625907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89540051c0 0x7f895400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.545+0000 7f8963fff640 1 --2- 172.21.15.86:0/2861625907 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8954004800 0x7f8954004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.545+0000 7f8968b5c640 1 --2- 172.21.15.86:0/2861625907 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8954004800 0x7f8954004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.545+0000 7f8968b5c640 1 -- 172.21.15.86:0/2861625907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89540051c0 msgr2=0x7f895400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:30.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.545+0000 7f8968b5c640 1 --2- 172.21.15.86:0/2861625907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89540051c0 0x7f895400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.545+0000 7f8968b5c640 1 -- 172.21.15.86:0/2861625907 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8954003520 con 0x7f89540039b0 2024-09-19T06:37:30.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.545+0000 7f896935d640 1 --2- 172.21.15.86:0/2861625907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89540051c0 0x7f895400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:30.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.545+0000 7f8963fff640 1 --2- 172.21.15.86:0/2861625907 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8954004800 0x7f8954004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:30.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.545+0000 7f8968b5c640 1 --2- 172.21.15.86:0/2861625907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89540039b0 0x7f8954003dd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f895800c270 tx=0x7f8954005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc096d372db27f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:30.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.545+0000 7f89637fe640 1 -- 172.21.15.86:0/2861625907 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8958007d30 con 0x7f89540039b0 2024-09-19T06:37:30.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.546+0000 7f89637fe640 1 -- 172.21.15.86:0/2861625907 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8958005ad0 con 0x7f89540039b0 2024-09-19T06:37:30.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.546+0000 7f89637fe640 1 -- 172.21.15.86:0/2861625907 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8958007070 con 0x7f89540039b0 2024-09-19T06:37:30.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.546+0000 7f896adc0640 1 -- 172.21.15.86:0/2861625907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89540039b0 msgr2=0x7f8954003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.546+0000 7f896adc0640 1 --2- 172.21.15.86:0/2861625907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89540039b0 0x7f8954003dd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f895800c270 tx=0x7f8954005830 comp rx=0 tx=0).stop 2024-09-19T06:37:30.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.546+0000 7f896935d640 1 -- 172.21.15.86:0/2861625907 reap_dead start 2024-09-19T06:37:30.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.546+0000 7f896adc0640 1 -- 172.21.15.86:0/2861625907 shutdown_connections 2024-09-19T06:37:30.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.546+0000 7f896adc0640 1 -- 172.21.15.86:0/2861625907 >> 172.21.15.86:0/2861625907 conn(0x7f896406bcc0 msgr2=0x7f896406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:30.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.546+0000 7f896adc0640 1 -- 172.21.15.86:0/2861625907 shutdown_connections 2024-09-19T06:37:30.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.546+0000 7f896adc0640 1 -- 172.21.15.86:0/2861625907 wait complete. 2024-09-19T06:37:30.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.547+0000 7f896adc0640 1 Processor -- start 2024-09-19T06:37:30.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.547+0000 7f896adc0640 1 -- start start 2024-09-19T06:37:30.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.548+0000 7f896adc0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89540039b0 0x7f89641e74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.548+0000 7f896adc0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89640c9940 0x7f89641e79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.548+0000 7f896adc0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8964155270 0x7f8964155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.548+0000 7f896adc0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f896415ee00 con 0x7f89640c9940 2024-09-19T06:37:30.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.548+0000 7f896adc0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f89640c7e70 con 0x7f89540039b0 2024-09-19T06:37:30.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.548+0000 7f896adc0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f896415ef80 con 0x7f8964155270 2024-09-19T06:37:30.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.548+0000 7f8963fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89640c9940 0x7f89641e79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.548+0000 7f8963fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89640c9940 0x7f89641e79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39404/0 (socket says 172.21.15.86:39404) 2024-09-19T06:37:30.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.548+0000 7f8963fff640 1 -- 172.21.15.86:0/2418730940 learned_addr learned my addr 172.21.15.86:0/2418730940 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:30.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.548+0000 7f8968b5c640 1 --2- 172.21.15.86:0/2418730940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89540039b0 0x7f89641e74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.548+0000 7f896935d640 1 --2- 172.21.15.86:0/2418730940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8964155270 0x7f8964155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.548+0000 7f8963fff640 1 -- 172.21.15.86:0/2418730940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8964155270 msgr2=0x7f8964155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.548+0000 7f8963fff640 1 --2- 172.21.15.86:0/2418730940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8964155270 0x7f8964155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.548+0000 7f8963fff640 1 -- 172.21.15.86:0/2418730940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89540039b0 msgr2=0x7f89641e74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.548+0000 7f8963fff640 1 --2- 172.21.15.86:0/2418730940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89540039b0 0x7f89641e74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.548+0000 7f8963fff640 1 -- 172.21.15.86:0/2418730940 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89640c9750 con 0x7f89640c9940 2024-09-19T06:37:30.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.548+0000 7f8968b5c640 1 --2- 172.21.15.86:0/2418730940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89540039b0 0x7f89641e74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:30.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.549+0000 7f8963fff640 1 --2- 172.21.15.86:0/2418730940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89640c9940 0x7f89641e79e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8950010920 tx=0x7f8950010de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:30.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.549+0000 7f89617fa640 1 -- 172.21.15.86:0/2418730940 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895000f040 con 0x7f89640c9940 2024-09-19T06:37:30.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.549+0000 7f89617fa640 1 -- 172.21.15.86:0/2418730940 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f895000ec20 con 0x7f89640c9940 2024-09-19T06:37:30.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.549+0000 7f896adc0640 1 -- 172.21.15.86:0/2418730940 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8964155c40 con 0x7f89640c9940 2024-09-19T06:37:30.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.549+0000 7f89617fa640 1 -- 172.21.15.86:0/2418730940 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895001c400 con 0x7f89640c9940 2024-09-19T06:37:30.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.549+0000 7f896adc0640 1 -- 172.21.15.86:0/2418730940 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8964156120 con 0x7f89640c9940 2024-09-19T06:37:30.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.550+0000 7f896adc0640 1 -- 172.21.15.86:0/2418730940 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89640c58f0 con 0x7f89640c9940 2024-09-19T06:37:30.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.550+0000 7f89617fa640 1 -- 172.21.15.86:0/2418730940 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f895001c5a0 con 0x7f89640c9940 2024-09-19T06:37:30.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.551+0000 7f89617fa640 1 --2- 172.21.15.86:0/2418730940 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f894806c2e0 0x7f894806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.551+0000 7f89617fa640 1 -- 172.21.15.86:0/2418730940 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f895008bd70 con 0x7f89640c9940 2024-09-19T06:37:30.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.551+0000 7f8968b5c640 1 --2- 172.21.15.86:0/2418730940 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f894806c2e0 0x7f894806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.551+0000 7f8968b5c640 1 --2- 172.21.15.86:0/2418730940 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f894806c2e0 0x7f894806e7a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8958033000 tx=0x7f8958009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:30.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.555+0000 7f89617fa640 1 -- 172.21.15.86:0/2418730940 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8950018030 con 0x7f89640c9940 2024-09-19T06:37:30.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.721+0000 7f896adc0640 1 -- 172.21.15.86:0/2418730940 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f896406db20 con 0x7f89640c9940 2024-09-19T06:37:30.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.722+0000 7f89617fa640 1 -- 172.21.15.86:0/2418730940 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18586 (secure 0 0 0) 0x7f895005a1a0 con 0x7f89640c9940 2024-09-19T06:37:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:30.724 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":26,"fsid":"1785f09f-0959-457d-8c4a-6cce2e655a37","created":"2024-09-19T06:36:45.671544+0000","modified":"2024-09-19T06:37:13.796252+0000","last_up_change":"2024-09-19T06:36:56.765680+0000","last_in_change":"2024-09-19T06:36:47.816681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:36:57.770634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:37:06.588120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:37:07.739726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T06:37:11.457476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bd3ce3f2-2a37-40ec-8dc3-69246437277c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6827","nonce":1588074611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6829","nonce":1588074611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6833","nonce":1588074611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6831","nonce":1588074611}]},"public_addr":"172.21.15.86:6827/1588074611","cluster_addr":"172.21.15.86:6829/1588074611","heartbeat_back_addr":"172.21.15.86:6833/1588074611","heartbeat_front_addr":"172.21.15.86:6831/1588074611","state":["exists","up"]},{"osd":1,"uuid":"871d7d23-ed03-4629-bca9-5b71ad0d926a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6819","nonce":1785682938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6821","nonce":1785682938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6825","nonce":1785682938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6823","nonce":1785682938}]},"public_addr":"172.21.15.86:6819/1785682938","cluster_addr":"172.21.15.86:6821/1785682938","heartbeat_back_addr":"172.21.15.86:6825/1785682938","heartbeat_front_addr":"172.21.15.86:6823/1785682938","state":["exists","up"]},{"osd":2,"uuid":"39d3562d-8c52-4af9-935a-2d90abb8b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6801","nonce":3306127846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6803","nonce":3306127846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6807","nonce":3306127846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6805","nonce":3306127846}]},"public_addr":"172.21.15.86:6801/3306127846","cluster_addr":"172.21.15.86:6803/3306127846","heartbeat_back_addr":"172.21.15.86:6807/3306127846","heartbeat_front_addr":"172.21.15.86:6805/3306127846","state":["exists","up"]},{"osd":3,"uuid":"7f88c5b1-042c-4a9f-a674-32456e0644a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6809","nonce":694275178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6811","nonce":694275178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6815","nonce":694275178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6813","nonce":694275178}]},"public_addr":"172.21.15.86:6809/694275178","cluster_addr":"172.21.15.86:6811/694275178","heartbeat_back_addr":"172.21.15.86:6815/694275178","heartbeat_front_addr":"172.21.15.86:6813/694275178","state":["exists","up"]},{"osd":4,"uuid":"18aa391b-0863-48bf-bff6-107e22ee9752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6811","nonce":1326795640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6815","nonce":1326795640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6823","nonce":1326795640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6819","nonce":1326795640}]},"public_addr":"172.21.15.169:6811/1326795640","cluster_addr":"172.21.15.169:6815/1326795640","heartbeat_back_addr":"172.21.15.169:6823/1326795640","heartbeat_front_addr":"172.21.15.169:6819/1326795640","state":["exists","up"]},{"osd":5,"uuid":"90fa5ca6-1815-4af1-a664-b45a9e19dd56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6825","nonce":3538913242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6827","nonce":3538913242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6831","nonce":3538913242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6829","nonce":3538913242}]},"public_addr":"172.21.15.169:6825/3538913242","cluster_addr":"172.21.15.169:6827/3538913242","heartbeat_back_addr":"172.21.15.169:6831/3538913242","heartbeat_front_addr":"172.21.15.169:6829/3538913242","state":["exists","up"]},{"osd":6,"uuid":"8b2019fc-6cc2-4394-9a7c-7951544f7cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6810","nonce":494424253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6814","nonce":494424253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6822","nonce":494424253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6818","nonce":494424253}]},"public_addr":"172.21.15.169:6810/494424253","cluster_addr":"172.21.15.169:6814/494424253","heartbeat_back_addr":"172.21.15.169:6822/494424253","heartbeat_front_addr":"172.21.15.169:6818/494424253","state":["exists","up"]},{"osd":7,"uuid":"622e3b2c-5302-4b0a-b7f2-f4050801401e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6801","nonce":797235989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6803","nonce":797235989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6807","nonce":797235989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6805","nonce":797235989}]},"public_addr":"172.21.15.169:6801/797235989","cluster_addr":"172.21.15.169:6803/797235989","heartbeat_back_addr":"172.21.15.169:6807/797235989","heartbeat_front_addr":"172.21.15.169:6805/797235989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.130643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.611572+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:53.419992+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.560112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.112065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.774642+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.341946+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.117884+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:37:30.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.724+0000 7f896adc0640 1 -- 172.21.15.86:0/2418730940 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f894806c2e0 msgr2=0x7f894806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.724+0000 7f896adc0640 1 --2- 172.21.15.86:0/2418730940 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f894806c2e0 0x7f894806e7a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8958033000 tx=0x7f8958009030 comp rx=0 tx=0).stop 2024-09-19T06:37:30.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.724+0000 7f896adc0640 1 -- 172.21.15.86:0/2418730940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89640c9940 msgr2=0x7f89641e79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.724+0000 7f896adc0640 1 --2- 172.21.15.86:0/2418730940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89640c9940 0x7f89641e79e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8950010920 tx=0x7f8950010de0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.724+0000 7f896adc0640 1 -- 172.21.15.86:0/2418730940 shutdown_connections 2024-09-19T06:37:30.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.724+0000 7f896adc0640 1 --2- 172.21.15.86:0/2418730940 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f894806c2e0 0x7f894806e7a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.724+0000 7f896adc0640 1 --2- 172.21.15.86:0/2418730940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8964155270 0x7f8964155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.724+0000 7f896adc0640 1 --2- 172.21.15.86:0/2418730940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89640c9940 0x7f89641e79e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.724+0000 7f896adc0640 1 --2- 172.21.15.86:0/2418730940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89540039b0 0x7f89641e74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.724+0000 7f896adc0640 1 -- 172.21.15.86:0/2418730940 >> 172.21.15.86:0/2418730940 conn(0x7f896406bcc0 msgr2=0x7f896406e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:30.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.724+0000 7f896adc0640 1 -- 172.21.15.86:0/2418730940 shutdown_connections 2024-09-19T06:37:30.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.724+0000 7f896adc0640 1 -- 172.21.15.86:0/2418730940 wait complete. 2024-09-19T06:37:30.737 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-19T06:37:30.737 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-19T06:37:30.738 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-19T06:37:30.738 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-19T06:37:30.738 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-19T06:37:30.739 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-19T06:37:30.739 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-19T06:37:30.740 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-19T06:37:30.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.905+0000 7f317b1c5640 1 Processor -- start 2024-09-19T06:37:30.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.905+0000 7f317b1c5640 1 -- start start 2024-09-19T06:37:30.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.905+0000 7fa062f3a640 1 Processor -- start 2024-09-19T06:37:30.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.905+0000 7ff08bdf8640 1 Processor -- start 2024-09-19T06:37:30.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.906+0000 7ff08bdf8640 1 -- start start 2024-09-19T06:37:30.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.907+0000 7f317b1c5640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3174151020 0x7f31741577d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.907+0000 7f317b1c5640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f317406cd30 0x7f317406bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.907+0000 7f00a6674640 1 Processor -- start 2024-09-19T06:37:30.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.907+0000 7f00a6674640 1 -- start start 2024-09-19T06:37:30.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.907+0000 7fdddccc4640 1 Processor -- start 2024-09-19T06:37:30.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.907+0000 7f31799c2640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f317406cd30 0x7f317406bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.906+0000 7fa062f3a640 1 -- start start 2024-09-19T06:37:30.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.907+0000 7fa062f3a640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa05404a6b0 0x7fa05404aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.907+0000 7fa062f3a640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa0540e29f0 0x7fa0540e2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.907+0000 7fa062f3a640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa054046520 con 0x7fa0540dcdc0 2024-09-19T06:37:30.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.907+0000 7fa062f3a640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fa054045980 con 0x7fa0540e29f0 2024-09-19T06:37:30.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.907+0000 7fa062f3a640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fa0540dd1a0 con 0x7fa05404a6b0 2024-09-19T06:37:30.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.907+0000 7ff08bdf8640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff084152fe0 0x7ff08415c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.907+0000 7fdddccc4640 1 -- start start 2024-09-19T06:37:30.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.907+0000 7f2610a1d640 1 Processor -- start 2024-09-19T06:37:30.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.907+0000 7f31799c2640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f317406cd30 0x7f317406bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39420/0 (socket says 172.21.15.86:39420) 2024-09-19T06:37:30.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.907+0000 7f31799c2640 1 -- 172.21.15.86:0/904553186 learned_addr learned my addr 172.21.15.86:0/904553186 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:30.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.907+0000 7f317a1c3640 1 --2- 172.21.15.86:0/904553186 >> v2:172.21.15.169:3300/0 conn(0x7f3174151020 0x7f31741577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.907+0000 7f81be27b640 1 Processor -- start 2024-09-19T06:37:30.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.907+0000 7fa0614d7640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa0540e29f0 0x7fa0540e2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.907+0000 7fa05bfff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa05404a6b0 0x7fa05404aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.907+0000 7f317b1c5640 1 -- 172.21.15.86:0/904553186 --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31740c4100 con 0x7f31740c4330 2024-09-19T06:37:30.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.907+0000 7fa05bfff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa05404a6b0 0x7fa05404aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:55642/0 (socket says 172.21.15.86:55642) 2024-09-19T06:37:30.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.907+0000 7fa060cd6640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fa0540dcdc0 0x7fa054045e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:52636/0 (socket says 172.21.15.86:52636) 2024-09-19T06:37:30.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7f81be27b640 1 -- start start 2024-09-19T06:37:30.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7fa060cd6640 1 -- 172.21.15.86:0/903126185 learned_addr learned my addr 172.21.15.86:0/903126185 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:30.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7fa0614d7640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa0540e29f0 0x7fa0540e2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39440/0 (socket says 172.21.15.86:39440) 2024-09-19T06:37:30.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7f317b1c5640 1 -- 172.21.15.86:0/904553186 --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f31740c5000 con 0x7f317406cd30 2024-09-19T06:37:30.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7ff089393640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ff0841597f0 0x7ff0840c9710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39628/0 (socket says 172.21.15.86:39628) 2024-09-19T06:37:30.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7ff089393640 1 -- 172.21.15.86:0/1530878338 learned_addr learned my addr 172.21.15.86:0/1530878338 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:30.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7f317b1c5640 1 -- 172.21.15.86:0/904553186 --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f3174157d10 con 0x7f3174151020 2024-09-19T06:37:30.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7f31791c1640 1 -- 172.21.15.86:0/904553186 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2440359971 0 0) 0x7f31740c4100 con 0x7f31740c4330 2024-09-19T06:37:30.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7ff08bdf8640 1 --2- 172.21.15.86:0/1530878338 >> v2:172.21.15.169:3300/0 conn(0x7ff084159c20 0x7ff084073840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7f31791c1640 1 -- 172.21.15.86:0/904553186 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3160003520 con 0x7f31740c4330 2024-09-19T06:37:30.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7fa05b7fe640 1 -- 172.21.15.86:0/903126185 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1410388968 0 0) 0x7fa054046520 con 0x7fa0540dcdc0 2024-09-19T06:37:30.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7f00a6674640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f00a0159490 0x7f00a0162900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7fa05b7fe640 1 -- 172.21.15.86:0/903126185 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa04c003520 con 0x7fa0540dcdc0 2024-09-19T06:37:30.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7ff08bdf8640 1 -- 172.21.15.86:0/1530878338 --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0840c9e20 con 0x7ff0841597f0 2024-09-19T06:37:30.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7ff08a395640 1 --2- 172.21.15.86:0/1530878338 >> v2:172.21.15.169:3300/0 conn(0x7ff084159c20 0x7ff084073840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7fa05bfff640 1 -- 172.21.15.86:0/903126185 >> v2:172.21.15.86:3300/0 conn(0x7fa0540e29f0 msgr2=0x7fa0540e2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:30.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7fa05bfff640 1 --2- 172.21.15.86:0/903126185 >> v2:172.21.15.86:3300/0 conn(0x7fa0540e29f0 0x7fa0540e2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7f00a6674640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00a015f420 con 0x7f00a0071eb0 2024-09-19T06:37:30.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7fa05bfff640 1 -- 172.21.15.86:0/903126185 >> v1:172.21.15.169:6789/0 conn(0x7fa0540dcdc0 legacy=0x7fa054045e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7fa05bfff640 1 -- 172.21.15.86:0/903126185 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0540e3820 con 0x7fa05404a6b0 2024-09-19T06:37:30.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7ff08bdf8640 1 -- 172.21.15.86:0/1530878338 --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7ff08415d390 con 0x7ff084152fe0 2024-09-19T06:37:30.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7f00a6674640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00a0072680 con 0x7f00a015fec0 2024-09-19T06:37:30.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7ff089b94640 1 --2- 172.21.15.86:0/1530878338 >> v2:172.21.15.86:3300/0 conn(0x7ff084152fe0 0x7ff08415c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7f00a6674640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f00a0072960 con 0x7f00a0159490 2024-09-19T06:37:30.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.907+0000 7f2610a1d640 1 -- start start 2024-09-19T06:37:30.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7ff08bdf8640 1 -- 172.21.15.86:0/1530878338 --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7ff08415caf0 con 0x7ff084159c20 2024-09-19T06:37:30.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7f31791c1640 1 -- 172.21.15.86:0/904553186 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2269722606 0 0) 0x7f3160003520 con 0x7f31740c4330 2024-09-19T06:37:30.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.908+0000 7f009ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f00a0159490 0x7f00a0162900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f31791c1640 1 -- 172.21.15.86:0/904553186 >> v2:172.21.15.169:3300/0 conn(0x7f3174151020 msgr2=0x7f31741577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:30.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f31791c1640 1 --2- 172.21.15.86:0/904553186 >> v2:172.21.15.169:3300/0 conn(0x7f3174151020 0x7f31741577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f2610a1d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f260c0c9470 0x7f260c0c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f2610a1d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f260c159700 0x7f260c06e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f2610a1d640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f260c15f1d0 con 0x7f260c0c9850 2024-09-19T06:37:30.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f2610a1d640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f260c1600a0 con 0x7f260c0c9470 2024-09-19T06:37:30.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f2610a1d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f260c15f490 con 0x7f260c159700 2024-09-19T06:37:30.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f630a191640 1 Processor -- start 2024-09-19T06:37:30.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f31791c1640 1 -- 172.21.15.86:0/904553186 >> v2:172.21.15.86:3300/0 conn(0x7f317406cd30 msgr2=0x7f317406bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:30.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f31791c1640 1 --2- 172.21.15.86:0/904553186 >> v2:172.21.15.86:3300/0 conn(0x7f317406cd30 0x7f317406bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f31791c1640 1 -- 172.21.15.86:0/904553186 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31740c3b40 con 0x7f31740c4330 2024-09-19T06:37:30.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f31791c1640 1 -- 172.21.15.86:0/904553186 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f316c0019f0 con 0x7f31740c4330 2024-09-19T06:37:30.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f31791c1640 1 -- 172.21.15.86:0/904553186 >> v1:172.21.15.86:6789/0 conn(0x7f31740c4330 legacy=0x7f31740c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f81be27b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f81b00d8920 0x7f81b004b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f81be27b640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81b0046270 con 0x7f81b004bc10 2024-09-19T06:37:30.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f630a191640 1 -- start start 2024-09-19T06:37:30.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f81be27b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81b00de760 con 0x7f81b0006a30 2024-09-19T06:37:30.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f81be27b640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f81b0008f80 con 0x7f81b00d8920 2024-09-19T06:37:30.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f260b59e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f260c159700 0x7f260c06e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f260b59e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f260c159700 0x7f260c06e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:55650/0 (socket says 172.21.15.86:55650) 2024-09-19T06:37:30.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f31791c1640 1 --2- 172.21.15.86:0/904553186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31600039b0 0x7f3160003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f260b59e640 1 -- 172.21.15.86:0/2827916238 learned_addr learned my addr 172.21.15.86:0/2827916238 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:30.927 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f31791c1640 1 --2- 172.21.15.86:0/904553186 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3160004800 0x7f3160004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.927 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f00a4c11640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f00a015fec0 0x7f00a00ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:52644/0 (socket says 172.21.15.86:52644) 2024-09-19T06:37:30.927 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f00a4c11640 1 -- 172.21.15.86:0/2757866887 learned_addr learned my addr 172.21.15.86:0/2757866887 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:30.927 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f009ffff640 1 -- 172.21.15.86:0/2757866887 >> v1:172.21.15.169:6789/0 conn(0x7f00a015fec0 legacy=0x7f00a00ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:30.928 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f31791c1640 1 --2- 172.21.15.86:0/904553186 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31600051c0 0x7f316000ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.928 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f260ad9d640 1 --2- 172.21.15.86:0/2827916238 >> v2:172.21.15.86:3300/0 conn(0x7f260c0c9470 0x7f260c0c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.928 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7fdddccc4640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fddd806cd30 0x7fddd81577d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.928 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7fdddccc4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fddd80c4330 0x7fddd806bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7fdddccc4640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddd81514c0 con 0x7fddd80cd0c0 2024-09-19T06:37:30.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7fdddccc4640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fddd80c5000 con 0x7fddd806cd30 2024-09-19T06:37:30.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7fdddccc4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fddd8157d10 con 0x7fddd80c4330 2024-09-19T06:37:30.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f81bd279640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f81b00d8920 0x7f81b004b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f81bda7a640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f81b0006a30 0x7f81b00e8f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:52652/0 (socket says 172.21.15.86:52652) 2024-09-19T06:37:30.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f81bda7a640 1 -- 172.21.15.86:0/1380616819 learned_addr learned my addr 172.21.15.86:0/1380616819 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:30.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f31791c1640 1 -- 172.21.15.86:0/904553186 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f31740c5000 con 0x7f3160004800 2024-09-19T06:37:30.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f31791c1640 1 -- 172.21.15.86:0/904553186 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3174157d10 con 0x7f31600039b0 2024-09-19T06:37:30.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f31791c1640 1 -- 172.21.15.86:0/904553186 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f316000bbc0 con 0x7f31600051c0 2024-09-19T06:37:30.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.910+0000 7fddd77fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fddd806cd30 0x7fddd81577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.910+0000 7f317a9c4640 1 --2- 172.21.15.86:0/904553186 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31600051c0 0x7f316000ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7ff08a395640 1 -- 172.21.15.86:0/1530878338 >> v2:172.21.15.86:3300/0 conn(0x7ff084152fe0 msgr2=0x7ff08415c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:30.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.910+0000 7fddd77fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fddd806cd30 0x7fddd81577d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39472/0 (socket says 172.21.15.86:39472) 2024-09-19T06:37:30.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.910+0000 7fddd77fe640 1 -- 172.21.15.86:0/2212625025 learned_addr learned my addr 172.21.15.86:0/2212625025 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:30.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.910+0000 7fddd7fff640 1 --2- 172.21.15.86:0/2212625025 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fddd80c4330 0x7fddd806bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7ff08a395640 1 --2- 172.21.15.86:0/1530878338 >> v2:172.21.15.86:3300/0 conn(0x7ff084152fe0 0x7ff08415c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7ff08a395640 1 -- 172.21.15.86:0/1530878338 >> v1:172.21.15.86:6789/0 conn(0x7ff0841597f0 legacy=0x7ff0840c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7ff08a395640 1 -- 172.21.15.86:0/1530878338 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08415cdd0 con 0x7ff084159c20 2024-09-19T06:37:30.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.910+0000 7fa05bfff640 1 --2- 172.21.15.86:0/903126185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa05404a6b0 0x7fa05404aae0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa054007560 tx=0x7fa04802a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9978e3bd397db30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:30.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.910+0000 7fa05b7fe640 1 -- 172.21.15.86:0/903126185 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa048037070 con 0x7fa05404a6b0 2024-09-19T06:37:30.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.910+0000 7fa05b7fe640 1 -- 172.21.15.86:0/903126185 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa048032440 con 0x7fa05404a6b0 2024-09-19T06:37:30.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.910+0000 7f81affff640 1 -- 172.21.15.86:0/1380616819 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 571754450 0 0) 0x7f81b00de760 con 0x7f81b0006a30 2024-09-19T06:37:30.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.910+0000 7fa05b7fe640 1 -- 172.21.15.86:0/903126185 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa048037070 con 0x7fa05404a6b0 2024-09-19T06:37:30.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.910+0000 7f81affff640 1 -- 172.21.15.86:0/1380616819 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81a4003520 con 0x7f81b0006a30 2024-09-19T06:37:30.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.910+0000 7f31799c2640 1 --2- 172.21.15.86:0/904553186 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3160004800 0x7f3160004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.910+0000 7f317a1c3640 1 --2- 172.21.15.86:0/904553186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31600039b0 0x7f3160003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.910+0000 7f317a9c4640 1 -- 172.21.15.86:0/904553186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31600039b0 msgr2=0x7f3160003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:30.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.910+0000 7ff08a395640 1 --2- 172.21.15.86:0/1530878338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff084159c20 0x7ff084073840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff07c009d90 tx=0x7ff07c02a6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd708e2a5b4cade3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:30.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f009ffff640 1 -- 172.21.15.86:0/2757866887 >> v1:172.21.15.86:6789/0 conn(0x7f00a0071eb0 legacy=0x7f00a00c42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:30.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.910+0000 7f2609d9b640 1 -- 172.21.15.86:0/2827916238 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3709393681 0 0) 0x7f260c15f1d0 con 0x7f260c0c9850 2024-09-19T06:37:30.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.910+0000 7f2609d9b640 1 -- 172.21.15.86:0/2827916238 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25f4003520 con 0x7f260c0c9850 2024-09-19T06:37:30.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.909+0000 7f009ffff640 1 -- 172.21.15.86:0/2757866887 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a015f6c0 con 0x7f00a0159490 2024-09-19T06:37:30.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.910+0000 7fddd77fe640 1 -- 172.21.15.86:0/2212625025 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fddd80c4330 msgr2=0x7fddd806bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:30.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.910+0000 7fddd77fe640 1 --2- 172.21.15.86:0/2212625025 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fddd80c4330 0x7fddd806bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.910+0000 7fddd77fe640 1 -- 172.21.15.86:0/2212625025 >> v1:172.21.15.169:6789/0 conn(0x7fddd80cd0c0 legacy=0x7fddd8150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:30.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.910+0000 7fddd77fe640 1 -- 172.21.15.86:0/2212625025 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd80c3b40 con 0x7fddd806cd30 2024-09-19T06:37:30.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f260b59e640 1 -- 172.21.15.86:0/2827916238 >> v2:172.21.15.86:3300/0 conn(0x7f260c0c9470 msgr2=0x7f260c0c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:30.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f260b59e640 1 --2- 172.21.15.86:0/2827916238 >> v2:172.21.15.86:3300/0 conn(0x7f260c0c9470 0x7f260c0c7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f260b59e640 1 -- 172.21.15.86:0/2827916238 >> v1:172.21.15.86:6789/0 conn(0x7f260c0c9850 legacy=0x7f260c158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7ff088b92640 1 -- 172.21.15.86:0/1530878338 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c007740 con 0x7ff084159c20 2024-09-19T06:37:30.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7ff088b92640 1 -- 172.21.15.86:0/1530878338 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff07c0078e0 con 0x7ff084159c20 2024-09-19T06:37:30.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7ff088b92640 1 -- 172.21.15.86:0/1530878338 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c007cb0 con 0x7ff084159c20 2024-09-19T06:37:30.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f81affff640 1 -- 172.21.15.86:0/1380616819 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 73102074 0 0) 0x7f81a4003520 con 0x7f81b0006a30 2024-09-19T06:37:30.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f81affff640 1 -- 172.21.15.86:0/1380616819 >> v2:172.21.15.86:3300/0 conn(0x7f81b00d8920 msgr2=0x7f81b004b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:30.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f81affff640 1 --2- 172.21.15.86:0/1380616819 >> v2:172.21.15.86:3300/0 conn(0x7f81b00d8920 0x7f81b004b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f81affff640 1 -- 172.21.15.86:0/1380616819 >> v1:172.21.15.86:6789/0 conn(0x7f81b004bc10 legacy=0x7f81b0046920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f81affff640 1 -- 172.21.15.86:0/1380616819 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b00d8d00 con 0x7f81b0006a30 2024-09-19T06:37:30.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f81affff640 1 -- 172.21.15.86:0/1380616819 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f81b8050800 con 0x7f81b0006a30 2024-09-19T06:37:30.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f81affff640 1 -- 172.21.15.86:0/1380616819 >> v1:172.21.15.169:6789/0 conn(0x7f81b0006a30 legacy=0x7f81b00e8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f81affff640 1 --2- 172.21.15.86:0/1380616819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81a40039d0 0x7f81a4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f81affff640 1 --2- 172.21.15.86:0/1380616819 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81a4004390 0x7f81a4004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f81affff640 1 --2- 172.21.15.86:0/1380616819 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81a40050a0 0x7f81a400b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f260b59e640 1 -- 172.21.15.86:0/2827916238 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f260c15f770 con 0x7f260c159700 2024-09-19T06:37:30.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f81affff640 1 -- 172.21.15.86:0/1380616819 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f81a400bfb0 con 0x7f81a40039d0 2024-09-19T06:37:30.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f81affff640 1 -- 172.21.15.86:0/1380616819 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f81a400c160 con 0x7f81a4004390 2024-09-19T06:37:30.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f81affff640 1 -- 172.21.15.86:0/1380616819 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f81a400c360 con 0x7f81a40050a0 2024-09-19T06:37:30.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f260ad9d640 1 --2- 172.21.15.86:0/2827916238 >> v2:172.21.15.86:3300/0 conn(0x7f260c0c9470 0x7f260c0c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:37:30.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f81bda7a640 1 --2- 172.21.15.86:0/1380616819 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81a40050a0 0x7f81a400b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f81bd279640 1 --2- 172.21.15.86:0/1380616819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81a40039d0 0x7f81a4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.910+0000 7f317a9c4640 1 --2- 172.21.15.86:0/904553186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31600039b0 0x7f3160003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.910+0000 7f317a9c4640 1 -- 172.21.15.86:0/904553186 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3160004800 msgr2=0x7f3160004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:30.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.910+0000 7f317a9c4640 1 --2- 172.21.15.86:0/904553186 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3160004800 0x7f3160004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.910+0000 7f317a9c4640 1 -- 172.21.15.86:0/904553186 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31740c3b40 con 0x7f31600051c0 2024-09-19T06:37:30.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f317a9c4640 1 -- 172.21.15.86:0/904553186 reap_dead start 2024-09-19T06:37:30.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7fa062f3a640 1 -- 172.21.15.86:0/903126185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa05404a6b0 msgr2=0x7fa05404aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7fa062f3a640 1 --2- 172.21.15.86:0/903126185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa05404a6b0 0x7fa05404aae0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa054007560 tx=0x7fa04802a250 comp rx=0 tx=0).stop 2024-09-19T06:37:30.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f317a1c3640 1 --2- 172.21.15.86:0/904553186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31600039b0 0x7f3160003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:30.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f317a9c4640 1 --2- 172.21.15.86:0/904553186 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31600051c0 0x7f316000ffd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f316c00c510 tx=0x7f3160005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=769aed7b90509a1a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:30.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f009ffff640 1 --2- 172.21.15.86:0/2757866887 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f00a0159490 0x7f00a0162900 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0090009dc0 tx=0x7f009002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91c6ed11eed31e47 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:30.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7fa062f3a640 1 -- 172.21.15.86:0/903126185 shutdown_connections 2024-09-19T06:37:30.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7fa062f3a640 1 --2- 172.21.15.86:0/903126185 >> v2:172.21.15.86:3300/0 conn(0x7fa0540e29f0 0x7fa0540e2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7fa062f3a640 1 --2- 172.21.15.86:0/903126185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa05404a6b0 0x7fa05404aae0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7fa062f3a640 1 -- 172.21.15.86:0/903126185 >> 172.21.15.86:0/903126185 conn(0x7fa05404fc80 msgr2=0x7fa054050090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:30.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f81bda7a640 1 -- 172.21.15.86:0/1380616819 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81a4004390 msgr2=0x7f81a4004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:30.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f81bda7a640 1 --2- 172.21.15.86:0/1380616819 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81a4004390 0x7f81a4004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f81bda7a640 1 -- 172.21.15.86:0/1380616819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81a40039d0 msgr2=0x7f81a4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:30.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f81bda7a640 1 --2- 172.21.15.86:0/1380616819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81a40039d0 0x7f81a4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f81bda7a640 1 -- 172.21.15.86:0/1380616819 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b00d8d00 con 0x7f81a40050a0 2024-09-19T06:37:30.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7ff08bdf8640 1 -- 172.21.15.86:0/1530878338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff084159c20 msgr2=0x7ff084073840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7ff08bdf8640 1 --2- 172.21.15.86:0/1530878338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff084159c20 0x7ff084073840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff07c009d90 tx=0x7ff07c02a6b0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7fddd77fe640 1 --2- 172.21.15.86:0/2212625025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddd806cd30 0x7fddd81577d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009870 tx=0x7fddc802a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2682b52c04a7120 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:30.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7fa062f3a640 1 -- 172.21.15.86:0/903126185 shutdown_connections 2024-09-19T06:37:30.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f630a191640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f62fc04aae0 0x7f62fc0e3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f630a191640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62fc046520 con 0x7f62fc04a6b0 2024-09-19T06:37:30.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f630a191640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62fc0e3820 con 0x7f62fc0dcdc0 2024-09-19T06:37:30.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.911+0000 7f630a191640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f62fc045980 con 0x7f62fc04aae0 2024-09-19T06:37:30.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7f63037fe640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f62fc0dcdc0 0x7f62fc045e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:52674/0 (socket says 172.21.15.86:52674) 2024-09-19T06:37:30.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7f63037fe640 1 -- 172.21.15.86:0/2747483316 learned_addr learned my addr 172.21.15.86:0/2747483316 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:30.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7f6303fff640 1 --2- 172.21.15.86:0/2747483316 >> v2:172.21.15.169:3300/0 conn(0x7f62fc04aae0 0x7f62fc0e3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7ff08bdf8640 1 -- 172.21.15.86:0/1530878338 shutdown_connections 2024-09-19T06:37:30.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7ff08bdf8640 1 --2- 172.21.15.86:0/1530878338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff084159c20 0x7ff084073840 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7ff08bdf8640 1 --2- 172.21.15.86:0/1530878338 >> v2:172.21.15.86:3300/0 conn(0x7ff084152fe0 0x7ff08415c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7ff08bdf8640 1 -- 172.21.15.86:0/1530878338 >> 172.21.15.86:0/1530878338 conn(0x7ff084067890 msgr2=0x7ff084067c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:30.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7f009effd640 1 -- 172.21.15.86:0/2757866887 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0090007740 con 0x7f00a0159490 2024-09-19T06:37:30.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7f009effd640 1 -- 172.21.15.86:0/2757866887 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00900078e0 con 0x7f00a0159490 2024-09-19T06:37:30.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7f009effd640 1 -- 172.21.15.86:0/2757866887 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0090007cb0 con 0x7f00a0159490 2024-09-19T06:37:30.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7f63027fc640 1 -- 172.21.15.86:0/2747483316 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2556079279 0 0) 0x7f62fc0e3820 con 0x7f62fc0dcdc0 2024-09-19T06:37:30.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7f63027fc640 1 -- 172.21.15.86:0/2747483316 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62ec003520 con 0x7f62fc0dcdc0 2024-09-19T06:37:30.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7f31791c1640 1 -- 172.21.15.86:0/904553186 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c00c0e0 con 0x7f31600051c0 2024-09-19T06:37:30.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7f63027fc640 1 -- 172.21.15.86:0/2747483316 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2476975175 0 0) 0x7f62fc046520 con 0x7f62fc04a6b0 2024-09-19T06:37:30.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7f63027fc640 1 -- 172.21.15.86:0/2747483316 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62fc0e3820 con 0x7f62fc04a6b0 2024-09-19T06:37:30.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7f31791c1640 1 -- 172.21.15.86:0/904553186 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f316c02c6c0 con 0x7f31600051c0 2024-09-19T06:37:30.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7ff08bdf8640 1 -- 172.21.15.86:0/1530878338 shutdown_connections 2024-09-19T06:37:30.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7f31791c1640 1 -- 172.21.15.86:0/904553186 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c02cab0 con 0x7f31600051c0 2024-09-19T06:37:30.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7ff08bdf8640 1 -- 172.21.15.86:0/1530878338 wait complete. 2024-09-19T06:37:30.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7f81bda7a640 1 -- 172.21.15.86:0/1380616819 reap_dead start 2024-09-19T06:37:30.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7fddd67fc640 1 -- 172.21.15.86:0/2212625025 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8037070 con 0x7fddd806cd30 2024-09-19T06:37:30.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7f81bda7a640 1 --2- 172.21.15.86:0/1380616819 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81a40050a0 0x7f81a400b9b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f81b80518b0 tx=0x7f81a4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb3f582a8a710fa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:30.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.913+0000 7fddd67fc640 1 -- 172.21.15.86:0/2212625025 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc8032440 con 0x7fddd806cd30 2024-09-19T06:37:30.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.913+0000 7fddd67fc640 1 -- 172.21.15.86:0/2212625025 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8032830 con 0x7fddd806cd30 2024-09-19T06:37:30.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7f6303fff640 1 -- 172.21.15.86:0/2747483316 >> v1:172.21.15.169:6789/0 conn(0x7f62fc0dcdc0 legacy=0x7f62fc045e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7f6303fff640 1 -- 172.21.15.86:0/2747483316 >> v1:172.21.15.86:6789/0 conn(0x7f62fc04a6b0 legacy=0x7f62fc0e29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.913+0000 7f81affff640 1 -- 172.21.15.86:0/1380616819 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b80768b0 con 0x7f81a40050a0 2024-09-19T06:37:30.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7f6303fff640 1 -- 172.21.15.86:0/2747483316 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62fc044d70 con 0x7f62fc04aae0 2024-09-19T06:37:30.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.913+0000 7f81affff640 1 -- 172.21.15.86:0/1380616819 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b806d070 con 0x7f81a40050a0 2024-09-19T06:37:30.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.913+0000 7f81affff640 1 -- 172.21.15.86:0/1380616819 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b806d460 con 0x7f81a40050a0 2024-09-19T06:37:30.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.912+0000 7fa062f3a640 1 -- 172.21.15.86:0/903126185 wait complete. 2024-09-19T06:37:30.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.913+0000 7f260b59e640 1 --2- 172.21.15.86:0/2827916238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f260c159700 0x7f260c06e300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f260c160220 tx=0x7f260402a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=165b5bf7367894b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:30.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.913+0000 7f00a6674640 1 -- 172.21.15.86:0/2757866887 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f00a0159490 msgr2=0x7f00a0162900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.913+0000 7f00a6674640 1 --2- 172.21.15.86:0/2757866887 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f00a0159490 0x7f00a0162900 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0090009dc0 tx=0x7f009002a710 comp rx=0 tx=0).stop 2024-09-19T06:37:30.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.913+0000 7f2609d9b640 1 -- 172.21.15.86:0/2827916238 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2604036070 con 0x7f260c159700 2024-09-19T06:37:30.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.913+0000 7f317b1c5640 1 -- 172.21.15.86:0/904553186 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31600051c0 msgr2=0x7f316000ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.913+0000 7f00a6674640 1 -- 172.21.15.86:0/2757866887 shutdown_connections 2024-09-19T06:37:30.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.913+0000 7f317b1c5640 1 --2- 172.21.15.86:0/904553186 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31600051c0 0x7f316000ffd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f316c00c510 tx=0x7f3160005830 comp rx=0 tx=0).stop 2024-09-19T06:37:30.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.913+0000 7f00a6674640 1 --2- 172.21.15.86:0/2757866887 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f00a0159490 0x7f00a0162900 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.913+0000 7f2609d9b640 1 -- 172.21.15.86:0/2827916238 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2604031600 con 0x7f260c159700 2024-09-19T06:37:30.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.913+0000 7f00a6674640 1 -- 172.21.15.86:0/2757866887 >> 172.21.15.86:0/2757866887 conn(0x7f00a006fd60 msgr2=0x7f00a0070140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:30.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.913+0000 7f2609d9b640 1 -- 172.21.15.86:0/2827916238 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26040319d0 con 0x7f260c159700 2024-09-19T06:37:30.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.913+0000 7f00a6674640 1 -- 172.21.15.86:0/2757866887 shutdown_connections 2024-09-19T06:37:30.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.914+0000 7f00a6674640 1 -- 172.21.15.86:0/2757866887 wait complete. 2024-09-19T06:37:30.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.914+0000 7fa062f3a640 1 Processor -- start 2024-09-19T06:37:30.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.914+0000 7fa062f3a640 1 -- start start 2024-09-19T06:37:30.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.913+0000 7f6303fff640 1 --2- 172.21.15.86:0/2747483316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62fc04aae0 0x7f62fc0e3100 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6304000b60 tx=0x7f63040a7160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=554b82384b77ebec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:30.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.914+0000 7f63027fc640 1 -- 172.21.15.86:0/2747483316 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63040b4070 con 0x7f62fc04aae0 2024-09-19T06:37:30.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.914+0000 7fdddccc4640 1 -- 172.21.15.86:0/2212625025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddd806cd30 msgr2=0x7fddd81577d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.914+0000 7fdddccc4640 1 --2- 172.21.15.86:0/2212625025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddd806cd30 0x7fddd81577d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009870 tx=0x7fddc802a290 comp rx=0 tx=0).stop 2024-09-19T06:37:30.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.914+0000 7fdddccc4640 1 -- 172.21.15.86:0/2212625025 shutdown_connections 2024-09-19T06:37:30.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.914+0000 7fdddccc4640 1 --2- 172.21.15.86:0/2212625025 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fddd80c4330 0x7fddd806bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.914+0000 7fdddccc4640 1 --2- 172.21.15.86:0/2212625025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddd806cd30 0x7fddd81577d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.914+0000 7fdddccc4640 1 -- 172.21.15.86:0/2212625025 >> 172.21.15.86:0/2212625025 conn(0x7fddd80cc5a0 msgr2=0x7fddd80cc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:30.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.914+0000 7f63027fc640 1 -- 172.21.15.86:0/2747483316 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63040af440 con 0x7f62fc04aae0 2024-09-19T06:37:30.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.914+0000 7fdddccc4640 1 -- 172.21.15.86:0/2212625025 shutdown_connections 2024-09-19T06:37:30.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.914+0000 7fdddccc4640 1 -- 172.21.15.86:0/2212625025 wait complete. 2024-09-19T06:37:30.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.914+0000 7f81be27b640 1 -- 172.21.15.86:0/1380616819 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81a40050a0 msgr2=0x7f81a400b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.914+0000 7f81be27b640 1 --2- 172.21.15.86:0/1380616819 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81a40050a0 0x7f81a400b9b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f81b80518b0 tx=0x7f81a4005830 comp rx=0 tx=0).stop 2024-09-19T06:37:30.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.914+0000 7f81be27b640 1 -- 172.21.15.86:0/1380616819 shutdown_connections 2024-09-19T06:37:30.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.914+0000 7f81be27b640 1 --2- 172.21.15.86:0/1380616819 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81a40050a0 0x7f81a400b9b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.914+0000 7ff08bdf8640 1 Processor -- start 2024-09-19T06:37:30.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.914+0000 7f81be27b640 1 -- 172.21.15.86:0/1380616819 >> 172.21.15.86:0/1380616819 conn(0x7f81b0050d50 msgr2=0x7f81b0051160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:30.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.914+0000 7f63027fc640 1 -- 172.21.15.86:0/2747483316 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63040b4070 con 0x7f62fc04aae0 2024-09-19T06:37:30.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.914+0000 7ff08bdf8640 1 -- start start 2024-09-19T06:37:30.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.914+0000 7f2610a1d640 1 -- 172.21.15.86:0/2827916238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f260c159700 msgr2=0x7f260c06e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.914+0000 7f81be27b640 1 -- 172.21.15.86:0/1380616819 shutdown_connections 2024-09-19T06:37:30.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.914+0000 7f2610a1d640 1 --2- 172.21.15.86:0/2827916238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f260c159700 0x7f260c06e300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f260c160220 tx=0x7f260402a730 comp rx=0 tx=0).stop 2024-09-19T06:37:30.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.915+0000 7f317b1c5640 1 -- 172.21.15.86:0/904553186 shutdown_connections 2024-09-19T06:37:30.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.915+0000 7f317b1c5640 1 --2- 172.21.15.86:0/904553186 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31600051c0 0x7f316000ffd0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.915+0000 7f317b1c5640 1 -- 172.21.15.86:0/904553186 >> 172.21.15.86:0/904553186 conn(0x7f31740cc5a0 msgr2=0x7f31740cc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:30.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.915+0000 7f630a191640 1 -- 172.21.15.86:0/2747483316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62fc04aae0 msgr2=0x7f62fc0e3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.915+0000 7f630a191640 1 --2- 172.21.15.86:0/2747483316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62fc04aae0 0x7f62fc0e3100 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6304000b60 tx=0x7f63040a7160 comp rx=0 tx=0).stop 2024-09-19T06:37:30.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.915+0000 7f81be27b640 1 -- 172.21.15.86:0/1380616819 wait complete. 2024-09-19T06:37:30.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.915+0000 7f2610a1d640 1 -- 172.21.15.86:0/2827916238 shutdown_connections 2024-09-19T06:37:30.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.915+0000 7f630a191640 1 -- 172.21.15.86:0/2747483316 shutdown_connections 2024-09-19T06:37:30.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.915+0000 7f630a191640 1 --2- 172.21.15.86:0/2747483316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62fc04aae0 0x7f62fc0e3100 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.915+0000 7f630a191640 1 -- 172.21.15.86:0/2747483316 >> 172.21.15.86:0/2747483316 conn(0x7f62fc04fc80 msgr2=0x7f62fc050090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:30.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.915+0000 7f2610a1d640 1 --2- 172.21.15.86:0/2827916238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f260c159700 0x7f260c06e300 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.915+0000 7fa062f3a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa05404a6b0 0x7fa0540e4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.915+0000 7f2610a1d640 1 --2- 172.21.15.86:0/2827916238 >> v2:172.21.15.86:3300/0 conn(0x7f260c0c9470 0x7f260c0c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.915+0000 7f2610a1d640 1 -- 172.21.15.86:0/2827916238 >> 172.21.15.86:0/2827916238 conn(0x7f260c06bda0 msgr2=0x7f260c06c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:30.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.915+0000 7f2610a1d640 1 -- 172.21.15.86:0/2827916238 shutdown_connections 2024-09-19T06:37:30.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.915+0000 7f2610a1d640 1 -- 172.21.15.86:0/2827916238 wait complete. 2024-09-19T06:37:30.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.915+0000 7f630a191640 1 -- 172.21.15.86:0/2747483316 shutdown_connections 2024-09-19T06:37:30.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.915+0000 7fa062f3a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0540dcdc0 0x7fa0540e48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.915+0000 7fa062f3a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0540e29f0 0x7fa0540c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.915+0000 7fdddccc4640 1 Processor -- start 2024-09-19T06:37:30.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.915+0000 7fa062f3a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa054045330 con 0x7fa0540e29f0 2024-09-19T06:37:30.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.915+0000 7fa062f3a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa054045050 con 0x7fa0540dcdc0 2024-09-19T06:37:30.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.916+0000 7f00a6674640 1 Processor -- start 2024-09-19T06:37:30.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.916+0000 7fa062f3a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa054045610 con 0x7fa05404a6b0 2024-09-19T06:37:30.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.916+0000 7fdddccc4640 1 -- start start 2024-09-19T06:37:30.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.916+0000 7ff08bdf8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff084152fe0 0x7ff0840cce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.916+0000 7f00a6674640 1 -- start start 2024-09-19T06:37:30.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.915+0000 7f630a191640 1 -- 172.21.15.86:0/2747483316 wait complete. 2024-09-19T06:37:30.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.915+0000 7f317b1c5640 1 -- 172.21.15.86:0/904553186 shutdown_connections 2024-09-19T06:37:30.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.916+0000 7fa060cd6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa05404a6b0 0x7fa0540e4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.916+0000 7fa060cd6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa05404a6b0 0x7fa0540e4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:40650/0 (socket says 172.21.15.86:40650) 2024-09-19T06:37:30.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.916+0000 7ff08bdf8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0841597f0 0x7ff0841f2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.916+0000 7ff089b94640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff084152fe0 0x7ff0840cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.916+0000 7ff089b94640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff084152fe0 0x7ff0840cce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:40656/0 (socket says 172.21.15.86:40656) 2024-09-19T06:37:30.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.916+0000 7fa060cd6640 1 -- 172.21.15.86:0/904566662 learned_addr learned my addr 172.21.15.86:0/904566662 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:30.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.916+0000 7f81be27b640 1 Processor -- start 2024-09-19T06:37:30.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.916+0000 7fa0614d7640 1 --2- 172.21.15.86:0/904566662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0540e29f0 0x7fa0540c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.916+0000 7ff089b94640 1 -- 172.21.15.86:0/1055814022 learned_addr learned my addr 172.21.15.86:0/1055814022 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:30.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.916+0000 7ff089393640 1 --2- 172.21.15.86:0/1055814022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0841597f0 0x7ff0841f2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.916+0000 7f81be27b640 1 -- start start 2024-09-19T06:37:30.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7ff08bdf8640 1 --2- 172.21.15.86:0/1055814022 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff08414c5a0 0x7ff0841f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7ff08bdf8640 1 -- 172.21.15.86:0/1055814022 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff0841533c0 con 0x7ff0841597f0 2024-09-19T06:37:30.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7fdddccc4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddd806cd30 0x7fddd80bacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7fdddccc4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fddd80c4330 0x7fddd80be9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7fdddccc4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fddd80cd0c0 0x7fddd81529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7fdddccc4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fddd80c4c90 con 0x7fddd806cd30 2024-09-19T06:37:30.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7fdddccc4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fddd80c49b0 con 0x7fddd80c4330 2024-09-19T06:37:30.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7fdddccc4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fddd806c100 con 0x7fddd80cd0c0 2024-09-19T06:37:30.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7fa060cd6640 1 -- 172.21.15.86:0/904566662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0540dcdc0 msgr2=0x7fa0540e48c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:37:30.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7ff08bdf8640 1 -- 172.21.15.86:0/1055814022 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff084158ff0 con 0x7ff08414c5a0 2024-09-19T06:37:30.972 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7ff08a395640 1 --2- 172.21.15.86:0/1055814022 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff08414c5a0 0x7ff0841f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.972 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7ff08bdf8640 1 -- 172.21.15.86:0/1055814022 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff084153540 con 0x7ff084152fe0 2024-09-19T06:37:30.972 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7fa060cd6640 1 --2- 172.21.15.86:0/904566662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0540dcdc0 0x7fa0540e48c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.972 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7fa060cd6640 1 -- 172.21.15.86:0/904566662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0540e29f0 msgr2=0x7fa0540c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.972 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7fddd77fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddd806cd30 0x7fddd80bacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7f630a191640 1 Processor -- start 2024-09-19T06:37:30.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7fa060cd6640 1 --2- 172.21.15.86:0/904566662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0540e29f0 0x7fa0540c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7f00a6674640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00a0071eb0 0x7f00a00c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7fa060cd6640 1 -- 172.21.15.86:0/904566662 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0540e3d60 con 0x7fa05404a6b0 2024-09-19T06:37:30.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7f2610a1d640 1 Processor -- start 2024-09-19T06:37:30.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7fa0614d7640 1 --2- 172.21.15.86:0/904566662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0540e29f0 0x7fa0540c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:37:30.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7f00a6674640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f00a0159490 0x7f00a01f8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7f630a191640 1 -- start start 2024-09-19T06:37:30.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7f317b1c5640 1 -- 172.21.15.86:0/904553186 wait complete. 2024-09-19T06:37:30.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7f009ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00a0071eb0 0x7f00a00c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7f81be27b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81a40050a0 0x7f81b00db940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7f81be27b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81b00d3e80 0x7f81b004a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7f009ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00a0071eb0 0x7f00a00c8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39528/0 (socket says 172.21.15.86:39528) 2024-09-19T06:37:30.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7f81be27b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81b004a660 0x7f81b00cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7f009ffff640 1 -- 172.21.15.86:0/1503726042 learned_addr learned my addr 172.21.15.86:0/1503726042 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:30.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7fddd77fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddd806cd30 0x7fddd80bacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39514/0 (socket says 172.21.15.86:39514) 2024-09-19T06:37:30.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7f81be27b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f81b00dea00 con 0x7f81a40050a0 2024-09-19T06:37:30.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7fddd77fe640 1 -- 172.21.15.86:0/1289048345 learned_addr learned my addr 172.21.15.86:0/1289048345 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:30.978 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7f81be27b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f81b00df050 con 0x7f81b00d3e80 2024-09-19T06:37:30.978 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7f81be27b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f81b00dece0 con 0x7f81b004a660 2024-09-19T06:37:30.978 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7f00a6674640 1 --2- 172.21.15.86:0/1503726042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f00a015fec0 0x7f00a01f9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.978 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7f81bda7a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81b004a660 0x7f81b00cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.978 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7f81bda7a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81b004a660 0x7f81b00cc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:40692/0 (socket says 172.21.15.86:40692) 2024-09-19T06:37:30.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7f81bda7a640 1 -- 172.21.15.86:0/2274485012 learned_addr learned my addr 172.21.15.86:0/2274485012 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:30.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7ff089b94640 1 -- 172.21.15.86:0/1055814022 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff08414c5a0 msgr2=0x7ff0841f27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7ff089b94640 1 --2- 172.21.15.86:0/1055814022 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff08414c5a0 0x7ff0841f27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7ff089b94640 1 -- 172.21.15.86:0/1055814022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0841597f0 msgr2=0x7ff0841f2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7ff089b94640 1 --2- 172.21.15.86:0/1055814022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0841597f0 0x7ff0841f2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7ff089b94640 1 -- 172.21.15.86:0/1055814022 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08414ce30 con 0x7ff084152fe0 2024-09-19T06:37:30.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7f00a6674640 1 -- 172.21.15.86:0/1503726042 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f00a0074080 con 0x7f00a0071eb0 2024-09-19T06:37:30.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7f00a6674640 1 -- 172.21.15.86:0/1503726042 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f00a0072c40 con 0x7f00a015fec0 2024-09-19T06:37:30.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7f00a6674640 1 -- 172.21.15.86:0/1503726042 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f00a00cab70 con 0x7f00a0159490 2024-09-19T06:37:30.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7f009f7fe640 1 --2- 172.21.15.86:0/1503726042 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f00a0159490 0x7f00a01f8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7f00a4c11640 1 --2- 172.21.15.86:0/1503726042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f00a015fec0 0x7f00a01f9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7f009f7fe640 1 -- 172.21.15.86:0/1503726042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f00a015fec0 msgr2=0x7f00a01f9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7f009f7fe640 1 --2- 172.21.15.86:0/1503726042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f00a015fec0 0x7f00a01f9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7f009f7fe640 1 -- 172.21.15.86:0/1503726042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00a0071eb0 msgr2=0x7f00a00c8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7f009f7fe640 1 --2- 172.21.15.86:0/1503726042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00a0071eb0 0x7f00a00c8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7f009f7fe640 1 -- 172.21.15.86:0/1503726042 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a015e890 con 0x7f00a0159490 2024-09-19T06:37:30.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7fddd77fe640 1 -- 172.21.15.86:0/1289048345 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fddd80cd0c0 msgr2=0x7fddd81529c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:37:30.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7fddd77fe640 1 --2- 172.21.15.86:0/1289048345 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fddd80cd0c0 0x7fddd81529c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7fddd77fe640 1 -- 172.21.15.86:0/1289048345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fddd80c4330 msgr2=0x7fddd80be9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:37:30.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7fddd77fe640 1 --2- 172.21.15.86:0/1289048345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fddd80c4330 0x7fddd80be9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7f009f7fe640 1 --2- 172.21.15.86:0/1503726042 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f00a0159490 0x7f00a01f8ae0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f008800c410 tx=0x7f008800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:30.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7f2610a1d640 1 -- start start 2024-09-19T06:37:30.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7f2610a1d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f260c0c9470 0x7f260c201280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7f2610a1d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f260c0c9850 0x7f260c0cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7f2610a1d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f260c159700 0x7f260c149ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7f2610a1d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f260c0c7610 con 0x7f260c159700 2024-09-19T06:37:30.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7fddd77fe640 1 -- 172.21.15.86:0/1289048345 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd80bb630 con 0x7fddd806cd30 2024-09-19T06:37:30.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7f2610a1d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f260c15fd30 con 0x7f260c0c9850 2024-09-19T06:37:30.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7f2610a1d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f260c0c7f60 con 0x7f260c0c9470 2024-09-19T06:37:30.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f630a191640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62fc04a6b0 0x7f62fc0493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7ff089b94640 1 --2- 172.21.15.86:0/1055814022 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff084152fe0 0x7ff0840cce80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff080009f60 tx=0x7ff080009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:30.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f260a59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f260c0c9850 0x7f260c0cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f260b59e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f260c159700 0x7f260c149ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f260b59e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f260c159700 0x7f260c149ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39548/0 (socket says 172.21.15.86:39548) 2024-09-19T06:37:30.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f260a59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f260c0c9850 0x7f260c0cb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:55782/0 (socket says 172.21.15.86:55782) 2024-09-19T06:37:30.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f260b59e640 1 -- 172.21.15.86:0/1381574203 learned_addr learned my addr 172.21.15.86:0/1381574203 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:30.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f630a191640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62fc04aae0 0x7f62fc0dd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f630a191640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62fc0dcdc0 0x7f62fc0dd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f630a191640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f62fc045330 con 0x7f62fc04a6b0 2024-09-19T06:37:30.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f630a191640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f62fc0dd1a0 con 0x7f62fc04aae0 2024-09-19T06:37:30.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f630a191640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f62fc045610 con 0x7f62fc0dcdc0 2024-09-19T06:37:30.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f63037fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62fc04a6b0 0x7f62fc0493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f63037fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62fc04a6b0 0x7f62fc0493c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39534/0 (socket says 172.21.15.86:39534) 2024-09-19T06:37:30.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f63037fe640 1 -- 172.21.15.86:0/1932734738 learned_addr learned my addr 172.21.15.86:0/1932734738 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:30.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7ff07a7fc640 1 -- 172.21.15.86:0/1055814022 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff080020070 con 0x7ff084152fe0 2024-09-19T06:37:30.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7ff07a7fc640 1 -- 172.21.15.86:0/1055814022 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff08000ca00 con 0x7ff084152fe0 2024-09-19T06:37:30.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7f81bd279640 1 --2- 172.21.15.86:0/2274485012 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81a40050a0 0x7f81b00db940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f81bca78640 1 --2- 172.21.15.86:0/2274485012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81b00d3e80 0x7f81b004a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7fddd77fe640 1 --2- 172.21.15.86:0/1289048345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddd806cd30 0x7fddd80bacf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009990 tx=0x7fddc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:30.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f6303fff640 1 --2- 172.21.15.86:0/1932734738 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62fc0dcdc0 0x7f62fc0dd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f63037fe640 1 -- 172.21.15.86:0/1932734738 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62fc0dcdc0 msgr2=0x7f62fc0dd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f63037fe640 1 --2- 172.21.15.86:0/1932734738 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62fc0dcdc0 0x7f62fc0dd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f63037fe640 1 -- 172.21.15.86:0/1932734738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62fc04aae0 msgr2=0x7f62fc0dd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f63037fe640 1 --2- 172.21.15.86:0/1932734738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62fc04aae0 0x7f62fc0dd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f63037fe640 1 -- 172.21.15.86:0/1932734738 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62fc16bfe0 con 0x7f62fc04a6b0 2024-09-19T06:37:30.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f260ad9d640 1 --2- 172.21.15.86:0/1381574203 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f260c0c9470 0x7f260c201280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:30.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f260b59e640 1 -- 172.21.15.86:0/1381574203 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f260c0c9470 msgr2=0x7f260c201280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7fddbffff640 1 -- 172.21.15.86:0/1289048345 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8041020 con 0x7fddd806cd30 2024-09-19T06:37:30.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.920+0000 7f260b59e640 1 --2- 172.21.15.86:0/1381574203 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f260c0c9470 0x7f260c201280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f81bca78640 1 -- 172.21.15.86:0/2274485012 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81b004a660 msgr2=0x7f81b00cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f81bca78640 1 --2- 172.21.15.86:0/2274485012 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81b004a660 0x7f81b00cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f81bca78640 1 -- 172.21.15.86:0/2274485012 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81a40050a0 msgr2=0x7f81b00db940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f81bca78640 1 --2- 172.21.15.86:0/2274485012 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81a40050a0 0x7f81b00db940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f81bca78640 1 -- 172.21.15.86:0/2274485012 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b00da860 con 0x7f81b00d3e80 2024-09-19T06:37:30.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.920+0000 7f260b59e640 1 -- 172.21.15.86:0/1381574203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f260c0c9850 msgr2=0x7f260c0cb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:30.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.920+0000 7fdddccc4640 1 -- 172.21.15.86:0/1289048345 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd81f0f10 con 0x7fddd806cd30 2024-09-19T06:37:30.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.920+0000 7f260b59e640 1 --2- 172.21.15.86:0/1381574203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f260c0c9850 0x7f260c0cb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:30.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.917+0000 7fa060cd6640 1 --2- 172.21.15.86:0/904566662 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa05404a6b0 0x7fa0540e4380 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa05000c530 tx=0x7fa05000c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:30.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7fa0597fa640 1 -- 172.21.15.86:0/904566662 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa050017070 con 0x7fa05404a6b0 2024-09-19T06:37:30.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.920+0000 7f260b59e640 1 -- 172.21.15.86:0/1381574203 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f260c14e5f0 con 0x7f260c159700 2024-09-19T06:37:30.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f009cff9640 1 -- 172.21.15.86:0/1503726042 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0088017070 con 0x7f00a0159490 2024-09-19T06:37:30.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7f009cff9640 1 -- 172.21.15.86:0/1503726042 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0088005230 con 0x7f00a0159490 2024-09-19T06:37:30.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.918+0000 7fa0597fa640 1 -- 172.21.15.86:0/904566662 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa050005ce0 con 0x7fa05404a6b0 2024-09-19T06:37:30.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.919+0000 7fa0597fa640 1 -- 172.21.15.86:0/904566662 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0500072b0 con 0x7fa05404a6b0 2024-09-19T06:37:30.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.920+0000 7f260a59c640 1 --2- 172.21.15.86:0/1381574203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f260c0c9850 0x7f260c0cb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:30.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.920+0000 7f63037fe640 1 --2- 172.21.15.86:0/1932734738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62fc04a6b0 0x7f62fc0493c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f62f800c460 tx=0x7f62f800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:30.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.920+0000 7fdddccc4640 1 -- 172.21.15.86:0/1289048345 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd81f14d0 con 0x7fddd806cd30 2024-09-19T06:37:30.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.920+0000 7f009cff9640 1 -- 172.21.15.86:0/1503726042 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00880045e0 con 0x7f00a0159490 2024-09-19T06:37:30.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.920+0000 7f00a6674640 1 -- 172.21.15.86:0/1503726042 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a015eb30 con 0x7f00a0159490 2024-09-19T06:37:30.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.920+0000 7f317b1c5640 1 Processor -- start 2024-09-19T06:37:30.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.920+0000 7fa062f3a640 1 -- 172.21.15.86:0/904566662 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0540e5af0 con 0x7fa05404a6b0 2024-09-19T06:37:30.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.920+0000 7fa062f3a640 1 -- 172.21.15.86:0/904566662 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0540e22e0 con 0x7fa05404a6b0 2024-09-19T06:37:30.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.920+0000 7f00a6674640 1 -- 172.21.15.86:0/1503726042 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a015f0f0 con 0x7f00a0159490 2024-09-19T06:37:30.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.920+0000 7f317b1c5640 1 -- start start 2024-09-19T06:37:30.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.920+0000 7f260b59e640 1 --2- 172.21.15.86:0/1381574203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f260c159700 0x7f260c149ce0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f260402ad20 tx=0x7f2604004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:30.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.920+0000 7f81bca78640 1 --2- 172.21.15.86:0/2274485012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81b00d3e80 0x7f81b004a120 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f81a800c490 tx=0x7f81a800c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:30.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.920+0000 7f81adffb640 1 -- 172.21.15.86:0/2274485012 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a8017070 con 0x7f81b00d3e80 2024-09-19T06:37:30.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.920+0000 7f81adffb640 1 -- 172.21.15.86:0/2274485012 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a80052d0 con 0x7f81b00d3e80 2024-09-19T06:37:30.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.920+0000 7f81be27b640 1 -- 172.21.15.86:0/2274485012 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81b00dab40 con 0x7f81b00d3e80 2024-09-19T06:37:30.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.920+0000 7f62ebfff640 1 -- 172.21.15.86:0/1932734738 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f8017070 con 0x7f62fc04a6b0 2024-09-19T06:37:30.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.921+0000 7f62ebfff640 1 -- 172.21.15.86:0/1932734738 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62f8005ce0 con 0x7f62fc04a6b0 2024-09-19T06:37:30.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.921+0000 7f630a191640 1 -- 172.21.15.86:0/1932734738 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62fc16c2c0 con 0x7f62fc04a6b0 2024-09-19T06:37:30.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.920+0000 7fddbffff640 1 -- 172.21.15.86:0/1289048345 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc8032440 con 0x7fddd806cd30 2024-09-19T06:37:30.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.921+0000 7f81be27b640 1 -- 172.21.15.86:0/2274485012 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81b0048330 con 0x7f81b00d3e80 2024-09-19T06:37:30.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.921+0000 7fddbffff640 1 -- 172.21.15.86:0/1289048345 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8041020 con 0x7fddd806cd30 2024-09-19T06:37:30.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.921+0000 7fdddccc4640 1 -- 172.21.15.86:0/1289048345 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fddb8001030 con 0x7fddd806cd30 2024-09-19T06:37:30.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.921+0000 7f00a6674640 1 -- 172.21.15.86:0/1503726042 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f00a00ce890 con 0x7f00a0159490 2024-09-19T06:37:30.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.920+0000 7ff08bdf8640 1 -- 172.21.15.86:0/1055814022 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff08414ef10 con 0x7ff084152fe0 2024-09-19T06:37:30.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.920+0000 7ff08bdf8640 1 -- 172.21.15.86:0/1055814022 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff084154b80 con 0x7ff084152fe0 2024-09-19T06:37:30.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.920+0000 7ff07a7fc640 1 -- 172.21.15.86:0/1055814022 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff080020070 con 0x7ff084152fe0 2024-09-19T06:37:30.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.921+0000 7f317b1c5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31600051c0 0x7f3174156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:30.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.921+0000 7f62ebfff640 1 -- 172.21.15.86:0/1932734738 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f8007270 con 0x7f62fc04a6b0 2024-09-19T06:37:30.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.921+0000 7f630a191640 1 -- 172.21.15.86:0/1932734738 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62fc16c880 con 0x7f62fc04a6b0 2024-09-19T06:37:30.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.922+0000 7f62e9ffb640 1 -- 172.21.15.86:0/1932734738 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f62fc16bd80 con 0x7f62fc04a6b0 2024-09-19T06:37:30.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.922+0000 7f81adffb640 1 -- 172.21.15.86:0/2274485012 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a8003830 con 0x7f81b00d3e80 2024-09-19T06:37:30.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.922+0000 7ff08bdf8640 1 -- 172.21.15.86:0/1055814022 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff0840c94f0 con 0x7ff084152fe0 2024-09-19T06:37:30.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.922+0000 7fa062f3a640 1 -- 172.21.15.86:0/904566662 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa0540e6180 con 0x7fa05404a6b0 2024-09-19T06:37:31.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.922+0000 7f25f37fe640 1 -- 172.21.15.86:0/1381574203 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260403f020 con 0x7f260c159700 2024-09-19T06:37:31.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.922+0000 7f2610a1d640 1 -- 172.21.15.86:0/1381574203 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f260c14eb00 con 0x7f260c159700 2024-09-19T06:37:31.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.922+0000 7f2610a1d640 1 -- 172.21.15.86:0/1381574203 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f260c14eda0 con 0x7f260c159700 2024-09-19T06:37:31.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.922+0000 7fa0597fa640 1 -- 172.21.15.86:0/904566662 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa05001a070 con 0x7fa05404a6b0 2024-09-19T06:37:31.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.923+0000 7fddbffff640 1 -- 172.21.15.86:0/1289048345 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fddc8044020 con 0x7fddd806cd30 2024-09-19T06:37:31.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.923+0000 7fa0597fa640 1 --2- 172.21.15.86:0/904566662 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa04006c380 0x7fa04006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.923+0000 7f81a37fe640 1 -- 172.21.15.86:0/2274485012 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f81b004b3a0 con 0x7f81b00d3e80 2024-09-19T06:37:31.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.923+0000 7f62ebfff640 1 -- 172.21.15.86:0/1932734738 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f62f801a070 con 0x7f62fc04a6b0 2024-09-19T06:37:31.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7f25f17fa640 1 -- 172.21.15.86:0/1381574203 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f25ec001030 con 0x7f260c159700 2024-09-19T06:37:31.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.923+0000 7fa0597fa640 1 -- 172.21.15.86:0/904566662 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa05008ab40 con 0x7fa05404a6b0 2024-09-19T06:37:31.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7fa0597fa640 1 --2- 172.21.15.86:0/904566662 >> [v2:172.21.15.86:6808/694275178,v1:172.21.15.86:6809/694275178] conn(0x7fa040075af0 0x7fa040077f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7fa0597fa640 1 -- 172.21.15.86:0/904566662 --> [v2:172.21.15.86:6808/694275178,v1:172.21.15.86:6809/694275178] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa050005ce0 con 0x7fa040075af0 2024-09-19T06:37:31.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7fa0597fa640 1 -- 172.21.15.86:0/904566662 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa05008f2a0 con 0x7fa05404a6b0 2024-09-19T06:37:31.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7fddbffff640 1 --2- 172.21.15.86:0/1289048345 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fddc406c4b0 0x7fddc406e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7f25f37fe640 1 -- 172.21.15.86:0/1381574203 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2604037040 con 0x7f260c159700 2024-09-19T06:37:31.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7f25f37fe640 1 -- 172.21.15.86:0/1381574203 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2604036070 con 0x7f260c159700 2024-09-19T06:37:31.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7fddbffff640 1 -- 172.21.15.86:0/1289048345 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fddc80abfa0 con 0x7fddd806cd30 2024-09-19T06:37:31.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7f62ebfff640 1 --2- 172.21.15.86:0/1932734738 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f62f006c300 0x7f62f006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7fddd6ffd640 1 --2- 172.21.15.86:0/1289048345 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fddc406c4b0 0x7fddc406e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7fddbffff640 1 --2- 172.21.15.86:0/1289048345 >> [v2:172.21.15.169:6800/797235989,v1:172.21.15.169:6801/797235989] conn(0x7fddc4075ba0 0x7fddc4077fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7fddbffff640 1 -- 172.21.15.86:0/1289048345 --> [v2:172.21.15.169:6800/797235989,v1:172.21.15.169:6801/797235989] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fddc800af30 con 0x7fddc4075ba0 2024-09-19T06:37:31.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7fddbffff640 1 -- 172.21.15.86:0/1289048345 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fddc80ac390 con 0x7fddd806cd30 2024-09-19T06:37:31.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7f317b1c5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3174153ea0 0x7f317414c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7f317b1c5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3174155590 0x7f3174155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7f317b1c5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f31740c4c90 con 0x7f31600051c0 2024-09-19T06:37:31.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7f317b1c5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f31740c49b0 con 0x7f3174155590 2024-09-19T06:37:31.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7f317b1c5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3174151400 con 0x7f3174153ea0 2024-09-19T06:37:31.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7f317a1c3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31600051c0 0x7f3174156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7f317a1c3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31600051c0 0x7f3174156320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39554/0 (socket says 172.21.15.86:39554) 2024-09-19T06:37:31.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7f317a1c3640 1 -- 172.21.15.86:0/2086493633 learned_addr learned my addr 172.21.15.86:0/2086493633 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:31.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.923+0000 7ff07a7fc640 1 -- 172.21.15.86:0/1055814022 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff080023070 con 0x7ff084152fe0 2024-09-19T06:37:31.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7ff07a7fc640 1 --2- 172.21.15.86:0/1055814022 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff06806c4e0 0x7ff06806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7f31799c2640 1 --2- 172.21.15.86:0/2086493633 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3174153ea0 0x7f317414c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7f62ebfff640 1 -- 172.21.15.86:0/1932734738 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f62f808f060 con 0x7f62fc04a6b0 2024-09-19T06:37:31.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7ff07a7fc640 1 -- 172.21.15.86:0/1055814022 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff08008f3f0 con 0x7ff084152fe0 2024-09-19T06:37:31.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7ff07a7fc640 1 --2- 172.21.15.86:0/1055814022 >> [v2:172.21.15.169:6824/3538913242,v1:172.21.15.169:6825/3538913242] conn(0x7ff068075be0 0x7ff068078020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7ff07a7fc640 1 -- 172.21.15.86:0/1055814022 --> [v2:172.21.15.169:6824/3538913242,v1:172.21.15.169:6825/3538913242] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff080015e50 con 0x7ff068075be0 2024-09-19T06:37:31.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7ff07a7fc640 1 -- 172.21.15.86:0/1055814022 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff08008f7e0 con 0x7ff084152fe0 2024-09-19T06:37:31.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.924+0000 7f62ebfff640 1 --2- 172.21.15.86:0/1932734738 >> [v2:172.21.15.169:6808/494424253,v1:172.21.15.169:6810/494424253] conn(0x7f62f0075a70 0x7f62f0077eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.923+0000 7f009cff9640 1 -- 172.21.15.86:0/1503726042 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f008801a070 con 0x7f00a0159490 2024-09-19T06:37:31.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.925+0000 7f62ebfff640 1 -- 172.21.15.86:0/1932734738 --> [v2:172.21.15.169:6808/494424253,v1:172.21.15.169:6810/494424253] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f62f0078580 con 0x7f62f0075a70 2024-09-19T06:37:31.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.925+0000 7f62ebfff640 1 -- 172.21.15.86:0/1932734738 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f62f808a9e0 con 0x7f62fc04a6b0 2024-09-19T06:37:31.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.925+0000 7fa05bfff640 1 --2- 172.21.15.86:0/904566662 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa04006c380 0x7fa04006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.925+0000 7f317a9c4640 1 --2- 172.21.15.86:0/2086493633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3174155590 0x7f3174155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.925+0000 7fddd7fff640 1 --2- 172.21.15.86:0/1289048345 >> [v2:172.21.15.169:6800/797235989,v1:172.21.15.169:6801/797235989] conn(0x7fddc4075ba0 0x7fddc4077fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.925+0000 7f6303fff640 1 --2- 172.21.15.86:0/1932734738 >> [v2:172.21.15.169:6808/494424253,v1:172.21.15.169:6810/494424253] conn(0x7f62f0075a70 0x7f62f0077eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.925+0000 7ff08a395640 1 --2- 172.21.15.86:0/1055814022 >> [v2:172.21.15.169:6824/3538913242,v1:172.21.15.169:6825/3538913242] conn(0x7ff068075be0 0x7ff068078020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.925+0000 7fa0614d7640 1 --2- 172.21.15.86:0/904566662 >> [v2:172.21.15.86:6808/694275178,v1:172.21.15.86:6809/694275178] conn(0x7fa040075af0 0x7fa040077f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.925+0000 7f009cff9640 1 --2- 172.21.15.86:0/1503726042 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f008006c300 0x7f008006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.925+0000 7fddd6ffd640 1 --2- 172.21.15.86:0/1289048345 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fddc406c4b0 0x7fddc406e970 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fddcc000f60 tx=0x7fddcc0079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.925+0000 7ff089393640 1 --2- 172.21.15.86:0/1055814022 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff06806c4e0 0x7ff06806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.925+0000 7f317a1c3640 1 -- 172.21.15.86:0/2086493633 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3174153ea0 msgr2=0x7f317414c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.925+0000 7f317a1c3640 1 --2- 172.21.15.86:0/2086493633 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3174153ea0 0x7f317414c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.925+0000 7f317a1c3640 1 -- 172.21.15.86:0/2086493633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3174155590 msgr2=0x7f3174155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.925+0000 7f317a1c3640 1 --2- 172.21.15.86:0/2086493633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3174155590 0x7f3174155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.925+0000 7f317a1c3640 1 -- 172.21.15.86:0/2086493633 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3174155f50 con 0x7f31600051c0 2024-09-19T06:37:31.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.925+0000 7f6303fff640 1 --2- 172.21.15.86:0/1932734738 >> [v2:172.21.15.169:6808/494424253,v1:172.21.15.169:6810/494424253] conn(0x7f62f0075a70 0x7f62f0077eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.925+0000 7f31799c2640 1 --2- 172.21.15.86:0/2086493633 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3174153ea0 0x7f317414c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:37:31.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.925+0000 7f317a9c4640 1 --2- 172.21.15.86:0/2086493633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3174155590 0x7f3174155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:37:31.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.926+0000 7f317a1c3640 1 --2- 172.21.15.86:0/2086493633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31600051c0 0x7f3174156320 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f317000e5c0 tx=0x7f317000ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.926+0000 7f009cff9640 1 -- 172.21.15.86:0/1503726042 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f008808acb0 con 0x7f00a0159490 2024-09-19T06:37:31.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.925+0000 7fa0614d7640 1 --2- 172.21.15.86:0/904566662 >> [v2:172.21.15.86:6808/694275178,v1:172.21.15.86:6809/694275178] conn(0x7fa040075af0 0x7fa040077f30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.926+0000 7f81adffb640 1 -- 172.21.15.86:0/2274485012 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f81a801a070 con 0x7f81b00d3e80 2024-09-19T06:37:31.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.925+0000 7ff08a395640 1 --2- 172.21.15.86:0/1055814022 >> [v2:172.21.15.169:6824/3538913242,v1:172.21.15.169:6825/3538913242] conn(0x7ff068075be0 0x7ff068078020 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.926+0000 7f6302ffd640 1 --2- 172.21.15.86:0/1932734738 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f62f006c300 0x7f62f006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.926+0000 7f009cff9640 1 --2- 172.21.15.86:0/1503726042 >> [v2:172.21.15.86:6800/3306127846,v1:172.21.15.86:6801/3306127846] conn(0x7f0080075a80 0x7f0080077ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.926+0000 7f009cff9640 1 -- 172.21.15.86:0/1503726042 --> [v2:172.21.15.86:6800/3306127846,v1:172.21.15.86:6801/3306127846] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0088007320 con 0x7f0080075a80 2024-09-19T06:37:31.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.926+0000 7f009cff9640 1 -- 172.21.15.86:0/1503726042 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f008808b0a0 con 0x7f00a0159490 2024-09-19T06:37:31.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.926+0000 7f00a4c11640 1 --2- 172.21.15.86:0/1503726042 >> [v2:172.21.15.86:6800/3306127846,v1:172.21.15.86:6801/3306127846] conn(0x7f0080075a80 0x7f0080077ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.926+0000 7f009ffff640 1 --2- 172.21.15.86:0/1503726042 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f008006c300 0x7f008006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.926+0000 7f316affd640 1 -- 172.21.15.86:0/2086493633 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3170017070 con 0x7f31600051c0 2024-09-19T06:37:31.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.926+0000 7f317b1c5640 1 -- 172.21.15.86:0/2086493633 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3174156e30 con 0x7f31600051c0 2024-09-19T06:37:31.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.926+0000 7f316affd640 1 -- 172.21.15.86:0/2086493633 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3170013610 con 0x7f31600051c0 2024-09-19T06:37:31.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.926+0000 7f317b1c5640 1 -- 172.21.15.86:0/2086493633 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31741ed3a0 con 0x7f31600051c0 2024-09-19T06:37:31.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.926+0000 7f81adffb640 1 --2- 172.21.15.86:0/2274485012 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f819c06c300 0x7f819c06e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.926+0000 7f00a4c11640 1 --2- 172.21.15.86:0/1503726042 >> [v2:172.21.15.86:6800/3306127846,v1:172.21.15.86:6801/3306127846] conn(0x7f0080075a80 0x7f0080077ec0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.927+0000 7f81adffb640 1 -- 172.21.15.86:0/2274485012 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f81a808aa90 con 0x7f81b00d3e80 2024-09-19T06:37:31.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.927+0000 7fa0597fa640 1 -- 172.21.15.86:0/904566662 <== osd.3 v2:172.21.15.86:6808/694275178 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa050005ce0 con 0x7fa040075af0 2024-09-19T06:37:31.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.927+0000 7ff07a7fc640 1 -- 172.21.15.86:0/1055814022 <== osd.5 v2:172.21.15.169:6824/3538913242 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff080015e50 con 0x7ff068075be0 2024-09-19T06:37:31.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.927+0000 7fddd7fff640 1 --2- 172.21.15.86:0/1289048345 >> [v2:172.21.15.169:6800/797235989,v1:172.21.15.169:6801/797235989] conn(0x7fddc4075ba0 0x7fddc4077fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.927+0000 7f81adffb640 1 --2- 172.21.15.86:0/2274485012 >> [v2:172.21.15.169:6809/1326795640,v1:172.21.15.169:6811/1326795640] conn(0x7f819c075a70 0x7f819c077eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.927+0000 7f81adffb640 1 -- 172.21.15.86:0/2274485012 --> [v2:172.21.15.169:6809/1326795640,v1:172.21.15.169:6811/1326795640] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f81a8015e70 con 0x7f819c075a70 2024-09-19T06:37:31.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.927+0000 7f81adffb640 1 -- 172.21.15.86:0/2274485012 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f81a808aef0 con 0x7f81b00d3e80 2024-09-19T06:37:31.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.927+0000 7ff089393640 1 --2- 172.21.15.86:0/1055814022 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff06806c4e0 0x7ff06806e9a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff08415b1f0 tx=0x7ff074009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.927+0000 7f316affd640 1 -- 172.21.15.86:0/2086493633 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317000f040 con 0x7f31600051c0 2024-09-19T06:37:31.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.927+0000 7f317b1c5640 1 -- 172.21.15.86:0/2086493633 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f31741ed5e0 con 0x7f31600051c0 2024-09-19T06:37:31.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.927+0000 7f62ebfff640 1 -- 172.21.15.86:0/1932734738 <== osd.6 v2:172.21.15.169:6808/494424253 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f62f0078580 con 0x7f62f0075a70 2024-09-19T06:37:31.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.928+0000 7f009cff9640 1 -- 172.21.15.86:0/1503726042 <== osd.2 v2:172.21.15.86:6800/3306127846 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0088007320 con 0x7f0080075a80 2024-09-19T06:37:31.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.928+0000 7fddbffff640 1 -- 172.21.15.86:0/1289048345 <== osd.7 v2:172.21.15.169:6800/797235989 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fddc800af30 con 0x7fddc4075ba0 2024-09-19T06:37:31.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.928+0000 7f25f37fe640 1 -- 172.21.15.86:0/1381574203 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2604042020 con 0x7f260c159700 2024-09-19T06:37:31.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.928+0000 7f25f37fe640 1 --2- 172.21.15.86:0/1381574203 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f25f806c380 0x7f25f806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.929+0000 7f25f37fe640 1 -- 172.21.15.86:0/1381574203 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f26040abf00 con 0x7f260c159700 2024-09-19T06:37:31.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.929+0000 7f6302ffd640 1 --2- 172.21.15.86:0/1932734738 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f62f006c300 0x7f62f006e7c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f62fc1701a0 tx=0x7f62f4007860 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.929+0000 7f316affd640 1 -- 172.21.15.86:0/2086493633 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f317001a070 con 0x7f31600051c0 2024-09-19T06:37:31.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.927+0000 7f81bd279640 1 --2- 172.21.15.86:0/2274485012 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f819c06c300 0x7f819c06e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.929+0000 7f81bda7a640 1 --2- 172.21.15.86:0/2274485012 >> [v2:172.21.15.169:6809/1326795640,v1:172.21.15.169:6811/1326795640] conn(0x7f819c075a70 0x7f819c077eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.929+0000 7f25f37fe640 1 --2- 172.21.15.86:0/1381574203 >> [v2:172.21.15.86:6826/1588074611,v1:172.21.15.86:6827/1588074611] conn(0x7f25f8075af0 0x7f25f8077f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.929+0000 7f260ad9d640 1 --2- 172.21.15.86:0/1381574203 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f25f806c380 0x7f25f806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.929+0000 7f25f37fe640 1 -- 172.21.15.86:0/1381574203 --> [v2:172.21.15.86:6826/1588074611,v1:172.21.15.86:6827/1588074611] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f25f8078600 con 0x7f25f8075af0 2024-09-19T06:37:31.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.929+0000 7fa05bfff640 1 --2- 172.21.15.86:0/904566662 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa04006c380 0x7fa04006e840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa054007560 tx=0x7fa04802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.929+0000 7f81bd279640 1 --2- 172.21.15.86:0/2274485012 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f819c06c300 0x7f819c06e7c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009a40 tx=0x7f81b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.929+0000 7f25f37fe640 1 -- 172.21.15.86:0/1381574203 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f26040ac2f0 con 0x7f260c159700 2024-09-19T06:37:31.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.929+0000 7f009ffff640 1 --2- 172.21.15.86:0/1503726042 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f008006c300 0x7f008006e7c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0090009bd0 tx=0x7f009002f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.930+0000 7f260ad9d640 1 --2- 172.21.15.86:0/1381574203 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f25f806c380 0x7f25f806e840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2600009560 tx=0x7f2600008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.930+0000 7f260a59c640 1 --2- 172.21.15.86:0/1381574203 >> [v2:172.21.15.86:6826/1588074611,v1:172.21.15.86:6827/1588074611] conn(0x7f25f8075af0 0x7f25f8077f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.930+0000 7f316affd640 1 --2- 172.21.15.86:0/2086493633 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f315806c2b0 0x7f315806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.930+0000 7f81bda7a640 1 --2- 172.21.15.86:0/2274485012 >> [v2:172.21.15.169:6809/1326795640,v1:172.21.15.169:6811/1326795640] conn(0x7f819c075a70 0x7f819c077eb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.930+0000 7f31799c2640 1 --2- 172.21.15.86:0/2086493633 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f315806c2b0 0x7f315806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.930+0000 7f260a59c640 1 --2- 172.21.15.86:0/1381574203 >> [v2:172.21.15.86:6826/1588074611,v1:172.21.15.86:6827/1588074611] conn(0x7f25f8075af0 0x7f25f8077f30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.931+0000 7f316affd640 1 -- 172.21.15.86:0/2086493633 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f317008b1d0 con 0x7f31600051c0 2024-09-19T06:37:31.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.931+0000 7f316affd640 1 --2- 172.21.15.86:0/2086493633 >> [v2:172.21.15.86:6818/1785682938,v1:172.21.15.86:6819/1785682938] conn(0x7f3158075a30 0x7f3158077e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.931+0000 7f316affd640 1 -- 172.21.15.86:0/2086493633 --> [v2:172.21.15.86:6818/1785682938,v1:172.21.15.86:6819/1785682938] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3170004470 con 0x7f3158075a30 2024-09-19T06:37:31.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.931+0000 7f81adffb640 1 -- 172.21.15.86:0/2274485012 <== osd.4 v2:172.21.15.169:6809/1326795640 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f81a8015e70 con 0x7f819c075a70 2024-09-19T06:37:31.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.931+0000 7f316affd640 1 -- 172.21.15.86:0/2086493633 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3170092050 con 0x7f31600051c0 2024-09-19T06:37:31.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.931+0000 7f317a9c4640 1 --2- 172.21.15.86:0/2086493633 >> [v2:172.21.15.86:6818/1785682938,v1:172.21.15.86:6819/1785682938] conn(0x7f3158075a30 0x7f3158077e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.931+0000 7f25f37fe640 1 -- 172.21.15.86:0/1381574203 <== osd.0 v2:172.21.15.86:6826/1588074611 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f25f8078600 con 0x7f25f8075af0 2024-09-19T06:37:31.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.931+0000 7f31799c2640 1 --2- 172.21.15.86:0/2086493633 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f315806c2b0 0x7f315806e770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f31741577f0 tx=0x7f3164008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.932+0000 7f317a9c4640 1 --2- 172.21.15.86:0/2086493633 >> [v2:172.21.15.86:6818/1785682938,v1:172.21.15.86:6819/1785682938] conn(0x7f3158075a30 0x7f3158077e70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.933+0000 7f316affd640 1 -- 172.21.15.86:0/2086493633 <== osd.1 v2:172.21.15.86:6818/1785682938 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3170004470 con 0x7f3158075a30 2024-09-19T06:37:31.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.958+0000 7ff08bdf8640 1 -- 172.21.15.86:0/1055814022 --> [v2:172.21.15.169:6824/3538913242,v1:172.21.15.169:6825/3538913242] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff0840c6370 con 0x7ff068075be0 2024-09-19T06:37:31.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.958+0000 7fa062f3a640 1 -- 172.21.15.86:0/904566662 --> [v2:172.21.15.86:6808/694275178,v1:172.21.15.86:6809/694275178] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa0540ee0e0 con 0x7fa040075af0 2024-09-19T06:37:31.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.958+0000 7f62e9ffb640 1 -- 172.21.15.86:0/1932734738 --> [v2:172.21.15.169:6808/494424253,v1:172.21.15.169:6810/494424253] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f62fc04aef0 con 0x7f62f0075a70 2024-09-19T06:37:31.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.958+0000 7f00a6674640 1 -- 172.21.15.86:0/1503726042 --> [v2:172.21.15.86:6800/3306127846,v1:172.21.15.86:6801/3306127846] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f00a006ce00 con 0x7f0080075a80 2024-09-19T06:37:31.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.959+0000 7ff07a7fc640 1 -- 172.21.15.86:0/1055814022 <== osd.5 v2:172.21.15.169:6824/3538913242 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff0840c6370 con 0x7ff068075be0 2024-09-19T06:37:31.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.959+0000 7fa0597fa640 1 -- 172.21.15.86:0/904566662 <== osd.3 v2:172.21.15.86:6808/694275178 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa0540ee0e0 con 0x7fa040075af0 2024-09-19T06:37:31.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.959+0000 7f009cff9640 1 -- 172.21.15.86:0/1503726042 <== osd.2 v2:172.21.15.86:6800/3306127846 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f00a006ce00 con 0x7f0080075a80 2024-09-19T06:37:31.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.959+0000 7f62ebfff640 1 -- 172.21.15.86:0/1932734738 <== osd.6 v2:172.21.15.169:6808/494424253 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f62fc04aef0 con 0x7f62f0075a70 2024-09-19T06:37:31.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.959+0000 7fdddccc4640 1 -- 172.21.15.86:0/1289048345 --> [v2:172.21.15.169:6800/797235989,v1:172.21.15.169:6801/797235989] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fddb8002dd0 con 0x7fddc4075ba0 2024-09-19T06:37:31.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.959+0000 7ff08bdf8640 1 -- 172.21.15.86:0/1055814022 >> [v2:172.21.15.169:6824/3538913242,v1:172.21.15.169:6825/3538913242] conn(0x7ff068075be0 msgr2=0x7ff068078020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.959+0000 7ff08bdf8640 1 --2- 172.21.15.86:0/1055814022 >> [v2:172.21.15.169:6824/3538913242,v1:172.21.15.169:6825/3538913242] conn(0x7ff068075be0 0x7ff068078020 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.959+0000 7f62e9ffb640 1 -- 172.21.15.86:0/1932734738 >> [v2:172.21.15.169:6808/494424253,v1:172.21.15.169:6810/494424253] conn(0x7f62f0075a70 msgr2=0x7f62f0077eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.959+0000 7f62e9ffb640 1 --2- 172.21.15.86:0/1932734738 >> [v2:172.21.15.169:6808/494424253,v1:172.21.15.169:6810/494424253] conn(0x7f62f0075a70 0x7f62f0077eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7f00a6674640 1 -- 172.21.15.86:0/1503726042 >> [v2:172.21.15.86:6800/3306127846,v1:172.21.15.86:6801/3306127846] conn(0x7f0080075a80 msgr2=0x7f0080077ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7f00a6674640 1 --2- 172.21.15.86:0/1503726042 >> [v2:172.21.15.86:6800/3306127846,v1:172.21.15.86:6801/3306127846] conn(0x7f0080075a80 0x7f0080077ec0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.959+0000 7ff08bdf8640 1 -- 172.21.15.86:0/1055814022 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff06806c4e0 msgr2=0x7ff06806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7ff08bdf8640 1 --2- 172.21.15.86:0/1055814022 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff06806c4e0 0x7ff06806e9a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff08415b1f0 tx=0x7ff074009040 comp rx=0 tx=0).stop 2024-09-19T06:37:31.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7ff08bdf8640 1 -- 172.21.15.86:0/1055814022 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff084152fe0 msgr2=0x7ff0840cce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7ff08bdf8640 1 --2- 172.21.15.86:0/1055814022 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff084152fe0 0x7ff0840cce80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff080009f60 tx=0x7ff080009f90 comp rx=0 tx=0).stop 2024-09-19T06:37:31.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7ff08a395640 1 -- 172.21.15.86:0/1055814022 reap_dead start 2024-09-19T06:37:31.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7f62e9ffb640 1 -- 172.21.15.86:0/1932734738 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f62f006c300 msgr2=0x7f62f006e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7f62e9ffb640 1 --2- 172.21.15.86:0/1932734738 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f62f006c300 0x7f62f006e7c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f62fc1701a0 tx=0x7f62f4007860 comp rx=0 tx=0).stop 2024-09-19T06:37:31.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7fa062f3a640 1 -- 172.21.15.86:0/904566662 >> [v2:172.21.15.86:6808/694275178,v1:172.21.15.86:6809/694275178] conn(0x7fa040075af0 msgr2=0x7fa040077f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7f62e9ffb640 1 -- 172.21.15.86:0/1932734738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62fc04a6b0 msgr2=0x7f62fc0493c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7f62e9ffb640 1 --2- 172.21.15.86:0/1932734738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62fc04a6b0 0x7f62fc0493c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f62f800c460 tx=0x7f62f800c920 comp rx=0 tx=0).stop 2024-09-19T06:37:31.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7fa062f3a640 1 --2- 172.21.15.86:0/904566662 >> [v2:172.21.15.86:6808/694275178,v1:172.21.15.86:6809/694275178] conn(0x7fa040075af0 0x7fa040077f30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7f6303fff640 1 -- 172.21.15.86:0/1932734738 reap_dead start 2024-09-19T06:37:31.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7ff08bdf8640 1 -- 172.21.15.86:0/1055814022 shutdown_connections 2024-09-19T06:37:31.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7ff08bdf8640 1 -- 172.21.15.86:0/1055814022 >> 172.21.15.86:0/1055814022 conn(0x7ff084067890 msgr2=0x7ff084158720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7f00a6674640 1 -- 172.21.15.86:0/1503726042 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f008006c300 msgr2=0x7f008006e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7f00a6674640 1 --2- 172.21.15.86:0/1503726042 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f008006c300 0x7f008006e7c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0090009bd0 tx=0x7f009002f000 comp rx=0 tx=0).stop 2024-09-19T06:37:31.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7f00a6674640 1 -- 172.21.15.86:0/1503726042 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f00a0159490 msgr2=0x7f00a01f8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7fa062f3a640 1 -- 172.21.15.86:0/904566662 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa04006c380 msgr2=0x7fa04006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7f62e9ffb640 1 -- 172.21.15.86:0/1932734738 shutdown_connections 2024-09-19T06:37:31.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7f62e9ffb640 1 -- 172.21.15.86:0/1932734738 >> 172.21.15.86:0/1932734738 conn(0x7f62fc04fc80 msgr2=0x7f62fc033a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7fddbffff640 1 -- 172.21.15.86:0/1289048345 <== osd.7 v2:172.21.15.169:6800/797235989 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fddb8002dd0 con 0x7fddc4075ba0 2024-09-19T06:37:31.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7f00a6674640 1 --2- 172.21.15.86:0/1503726042 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f00a0159490 0x7f00a01f8ae0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f008800c410 tx=0x7f008800c8d0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7f00a4c11640 1 -- 172.21.15.86:0/1503726042 reap_dead start 2024-09-19T06:37:31.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7fa062f3a640 1 --2- 172.21.15.86:0/904566662 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa04006c380 0x7fa04006e840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa054007560 tx=0x7fa04802e000 comp rx=0 tx=0).stop 2024-09-19T06:37:31.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7f00a6674640 1 -- 172.21.15.86:0/1503726042 shutdown_connections 2024-09-19T06:37:31.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7f00a6674640 1 -- 172.21.15.86:0/1503726042 >> 172.21.15.86:0/1503726042 conn(0x7f00a006fd60 msgr2=0x7f00a00735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7fa062f3a640 1 -- 172.21.15.86:0/904566662 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa05404a6b0 msgr2=0x7fa0540e4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7fa062f3a640 1 --2- 172.21.15.86:0/904566662 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa05404a6b0 0x7fa0540e4380 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa05000c530 tx=0x7fa05000c9f0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7ff08bdf8640 1 -- 172.21.15.86:0/1055814022 shutdown_connections 2024-09-19T06:37:31.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7ff08bdf8640 1 -- 172.21.15.86:0/1055814022 wait complete. 2024-09-19T06:37:31.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7fa0614d7640 1 -- 172.21.15.86:0/904566662 reap_dead start 2024-09-19T06:37:31.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7f62e9ffb640 1 -- 172.21.15.86:0/1932734738 shutdown_connections 2024-09-19T06:37:31.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7f62e9ffb640 1 -- 172.21.15.86:0/1932734738 wait complete. 2024-09-19T06:37:31.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7fa062f3a640 1 -- 172.21.15.86:0/904566662 shutdown_connections 2024-09-19T06:37:31.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7fa062f3a640 1 -- 172.21.15.86:0/904566662 >> 172.21.15.86:0/904566662 conn(0x7fa05404fc80 msgr2=0x7fa054005970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.960+0000 7f00a6674640 1 -- 172.21.15.86:0/1503726042 shutdown_connections 2024-09-19T06:37:31.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.961+0000 7f00a6674640 1 -- 172.21.15.86:0/1503726042 wait complete. 2024-09-19T06:37:31.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.961+0000 7fa062f3a640 1 -- 172.21.15.86:0/904566662 shutdown_connections 2024-09-19T06:37:31.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.961+0000 7f81a37fe640 1 -- 172.21.15.86:0/2274485012 --> [v2:172.21.15.169:6809/1326795640,v1:172.21.15.169:6811/1326795640] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f81b0047440 con 0x7f819c075a70 2024-09-19T06:37:31.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.961+0000 7fdddccc4640 1 -- 172.21.15.86:0/1289048345 >> [v2:172.21.15.169:6800/797235989,v1:172.21.15.169:6801/797235989] conn(0x7fddc4075ba0 msgr2=0x7fddc4077fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.961+0000 7fdddccc4640 1 --2- 172.21.15.86:0/1289048345 >> [v2:172.21.15.169:6800/797235989,v1:172.21.15.169:6801/797235989] conn(0x7fddc4075ba0 0x7fddc4077fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.961+0000 7fa062f3a640 1 -- 172.21.15.86:0/904566662 wait complete. 2024-09-19T06:37:31.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.961+0000 7fdddccc4640 1 -- 172.21.15.86:0/1289048345 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fddc406c4b0 msgr2=0x7fddc406e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.961+0000 7fdddccc4640 1 --2- 172.21.15.86:0/1289048345 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fddc406c4b0 0x7fddc406e970 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fddcc000f60 tx=0x7fddcc0079b0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.961+0000 7fdddccc4640 1 -- 172.21.15.86:0/1289048345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddd806cd30 msgr2=0x7fddd80bacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.961+0000 7fdddccc4640 1 --2- 172.21.15.86:0/1289048345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddd806cd30 0x7fddd80bacf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009990 tx=0x7fddc80046c0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.961+0000 7f81adffb640 1 -- 172.21.15.86:0/2274485012 <== osd.4 v2:172.21.15.169:6809/1326795640 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f81b0047440 con 0x7f819c075a70 2024-09-19T06:37:31.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.961+0000 7fddd7fff640 1 -- 172.21.15.86:0/1289048345 reap_dead start 2024-09-19T06:37:31.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.961+0000 7fdddccc4640 1 -- 172.21.15.86:0/1289048345 shutdown_connections 2024-09-19T06:37:31.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.961+0000 7fdddccc4640 1 -- 172.21.15.86:0/1289048345 >> 172.21.15.86:0/1289048345 conn(0x7fddd80cc5a0 msgr2=0x7fddd80c8080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.962+0000 7fdddccc4640 1 -- 172.21.15.86:0/1289048345 shutdown_connections 2024-09-19T06:37:31.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.962+0000 7fdddccc4640 1 -- 172.21.15.86:0/1289048345 wait complete. 2024-09-19T06:37:31.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.962+0000 7f81a37fe640 1 -- 172.21.15.86:0/2274485012 >> [v2:172.21.15.169:6809/1326795640,v1:172.21.15.169:6811/1326795640] conn(0x7f819c075a70 msgr2=0x7f819c077eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.962+0000 7f81a37fe640 1 --2- 172.21.15.86:0/2274485012 >> [v2:172.21.15.169:6809/1326795640,v1:172.21.15.169:6811/1326795640] conn(0x7f819c075a70 0x7f819c077eb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.962+0000 7f81a37fe640 1 -- 172.21.15.86:0/2274485012 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f819c06c300 msgr2=0x7f819c06e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.962+0000 7f81a37fe640 1 --2- 172.21.15.86:0/2274485012 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f819c06c300 0x7f819c06e7c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009a40 tx=0x7f81b4008040 comp rx=0 tx=0).stop 2024-09-19T06:37:31.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.962+0000 7f81a37fe640 1 -- 172.21.15.86:0/2274485012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81b00d3e80 msgr2=0x7f81b004a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.962+0000 7f81a37fe640 1 --2- 172.21.15.86:0/2274485012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81b00d3e80 0x7f81b004a120 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f81a800c490 tx=0x7f81a800c950 comp rx=0 tx=0).stop 2024-09-19T06:37:31.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.963+0000 7f81bda7a640 1 -- 172.21.15.86:0/2274485012 reap_dead start 2024-09-19T06:37:31.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.963+0000 7f81a37fe640 1 -- 172.21.15.86:0/2274485012 shutdown_connections 2024-09-19T06:37:31.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.963+0000 7f81a37fe640 1 -- 172.21.15.86:0/2274485012 >> 172.21.15.86:0/2274485012 conn(0x7f81b0050d50 msgr2=0x7f81b00ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.963+0000 7f25f17fa640 1 -- 172.21.15.86:0/1381574203 --> [v2:172.21.15.86:6826/1588074611,v1:172.21.15.86:6827/1588074611] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f25ec002dd0 con 0x7f25f8075af0 2024-09-19T06:37:31.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.964+0000 7f317b1c5640 1 -- 172.21.15.86:0/2086493633 --> [v2:172.21.15.86:6818/1785682938,v1:172.21.15.86:6819/1785682938] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f31740c6090 con 0x7f3158075a30 2024-09-19T06:37:31.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.964+0000 7f25f37fe640 1 -- 172.21.15.86:0/1381574203 <== osd.0 v2:172.21.15.86:6826/1588074611 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f25ec002dd0 con 0x7f25f8075af0 2024-09-19T06:37:31.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.964+0000 7f81a37fe640 1 -- 172.21.15.86:0/2274485012 shutdown_connections 2024-09-19T06:37:31.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.964+0000 7f81a37fe640 1 -- 172.21.15.86:0/2274485012 wait complete. 2024-09-19T06:37:31.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.964+0000 7f316affd640 1 -- 172.21.15.86:0/2086493633 <== osd.1 v2:172.21.15.86:6818/1785682938 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f31740c6090 con 0x7f3158075a30 2024-09-19T06:37:31.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.965+0000 7f25f17fa640 1 -- 172.21.15.86:0/1381574203 >> [v2:172.21.15.86:6826/1588074611,v1:172.21.15.86:6827/1588074611] conn(0x7f25f8075af0 msgr2=0x7f25f8077f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.965+0000 7f25f17fa640 1 --2- 172.21.15.86:0/1381574203 >> [v2:172.21.15.86:6826/1588074611,v1:172.21.15.86:6827/1588074611] conn(0x7f25f8075af0 0x7f25f8077f30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.965+0000 7f25f17fa640 1 -- 172.21.15.86:0/1381574203 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f25f806c380 msgr2=0x7f25f806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.965+0000 7f25f17fa640 1 --2- 172.21.15.86:0/1381574203 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f25f806c380 0x7f25f806e840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2600009560 tx=0x7f2600008040 comp rx=0 tx=0).stop 2024-09-19T06:37:31.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.965+0000 7f25f17fa640 1 -- 172.21.15.86:0/1381574203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f260c159700 msgr2=0x7f260c149ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.965+0000 7f25f17fa640 1 --2- 172.21.15.86:0/1381574203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f260c159700 0x7f260c149ce0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f260402ad20 tx=0x7f2604004a40 comp rx=0 tx=0).stop 2024-09-19T06:37:31.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.965+0000 7f317b1c5640 1 -- 172.21.15.86:0/2086493633 >> [v2:172.21.15.86:6818/1785682938,v1:172.21.15.86:6819/1785682938] conn(0x7f3158075a30 msgr2=0x7f3158077e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.965+0000 7f317b1c5640 1 --2- 172.21.15.86:0/2086493633 >> [v2:172.21.15.86:6818/1785682938,v1:172.21.15.86:6819/1785682938] conn(0x7f3158075a30 0x7f3158077e70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.965+0000 7f260b59e640 1 -- 172.21.15.86:0/1381574203 reap_dead start 2024-09-19T06:37:31.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.965+0000 7f25f17fa640 1 -- 172.21.15.86:0/1381574203 shutdown_connections 2024-09-19T06:37:31.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.965+0000 7f25f17fa640 1 -- 172.21.15.86:0/1381574203 >> 172.21.15.86:0/1381574203 conn(0x7f260c06bda0 msgr2=0x7f260c1572a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.965+0000 7f317b1c5640 1 -- 172.21.15.86:0/2086493633 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f315806c2b0 msgr2=0x7f315806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.965+0000 7f317b1c5640 1 --2- 172.21.15.86:0/2086493633 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f315806c2b0 0x7f315806e770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f31741577f0 tx=0x7f3164008040 comp rx=0 tx=0).stop 2024-09-19T06:37:31.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.966+0000 7f317b1c5640 1 -- 172.21.15.86:0/2086493633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31600051c0 msgr2=0x7f3174156320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.966+0000 7f317b1c5640 1 --2- 172.21.15.86:0/2086493633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31600051c0 0x7f3174156320 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f317000e5c0 tx=0x7f317000ea80 comp rx=0 tx=0).stop 2024-09-19T06:37:31.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.966+0000 7f317a9c4640 1 -- 172.21.15.86:0/2086493633 reap_dead start 2024-09-19T06:37:31.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.966+0000 7f317b1c5640 1 -- 172.21.15.86:0/2086493633 shutdown_connections 2024-09-19T06:37:31.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.966+0000 7f317b1c5640 1 -- 172.21.15.86:0/2086493633 >> 172.21.15.86:0/2086493633 conn(0x7f31740cc5a0 msgr2=0x7f317406bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.966+0000 7f25f17fa640 1 -- 172.21.15.86:0/1381574203 shutdown_connections 2024-09-19T06:37:31.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.966+0000 7f25f17fa640 1 -- 172.21.15.86:0/1381574203 wait complete. 2024-09-19T06:37:31.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.966+0000 7f317b1c5640 1 -- 172.21.15.86:0/2086493633 shutdown_connections 2024-09-19T06:37:31.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:30.966+0000 7f317b1c5640 1 -- 172.21.15.86:0/2086493633 wait complete. 2024-09-19T06:37:31.054 INFO:teuthology.orchestra.run.smithi086.stdout:60129542154 2024-09-19T06:37:31.055 INFO:teuthology.orchestra.run.smithi086.stdout:64424509450 2024-09-19T06:37:31.055 INFO:teuthology.orchestra.run.smithi086.stdout:60129542152 2024-09-19T06:37:31.056 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-19T06:37:31.057 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-19T06:37:31.057 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-19T06:37:31.058 INFO:teuthology.orchestra.run.smithi086.stdout:55834574859 2024-09-19T06:37:31.058 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-19T06:37:31.059 INFO:teuthology.orchestra.run.smithi086.stdout:60129542153 2024-09-19T06:37:31.059 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-19T06:37:31.060 INFO:teuthology.orchestra.run.smithi086.stdout:60129542153 2024-09-19T06:37:31.060 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-19T06:37:31.061 INFO:teuthology.orchestra.run.smithi086.stdout:64424509450 2024-09-19T06:37:31.061 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-19T06:37:31.062 INFO:teuthology.orchestra.run.smithi086.stdout:64424509449 2024-09-19T06:37:31.062 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-19T06:37:31.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.260+0000 7fe32a6b7640 1 Processor -- start 2024-09-19T06:37:31.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.260+0000 7fe32a6b7640 1 -- start start 2024-09-19T06:37:31.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.261+0000 7fe32a6b7640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe3241593e0 0x7fe3240c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.261+0000 7fe32a6b7640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3240c8de0 con 0x7fe324071740 2024-09-19T06:37:31.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.261+0000 7fe32a6b7640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe324163190 con 0x7fe324070f40 2024-09-19T06:37:31.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.261+0000 7fe32a6b7640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe3240c6f30 con 0x7fe3241593e0 2024-09-19T06:37:31.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.262+0000 7f1fde87b640 1 Processor -- start 2024-09-19T06:37:31.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.262+0000 7fe328c54640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe324071740 0x7fe324169a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39676/0 (socket says 172.21.15.86:39676) 2024-09-19T06:37:31.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.262+0000 7fe328c54640 1 -- 172.21.15.86:0/1699460176 learned_addr learned my addr 172.21.15.86:0/1699460176 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:31.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.262+0000 7fe323fff640 1 --2- 172.21.15.86:0/1699460176 >> v2:172.21.15.169:3300/0 conn(0x7fe3241593e0 0x7fe3240c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.262+0000 7f1fde87b640 1 -- start start 2024-09-19T06:37:31.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.262+0000 7fe322ffd640 1 -- 172.21.15.86:0/1699460176 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1072003395 0 0) 0x7fe3240c8de0 con 0x7fe324071740 2024-09-19T06:37:31.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.262+0000 7fe322ffd640 1 -- 172.21.15.86:0/1699460176 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe30c003520 con 0x7fe324071740 2024-09-19T06:37:31.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.262+0000 7fe322ffd640 1 -- 172.21.15.86:0/1699460176 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4220201 0 0) 0x7fe324163190 con 0x7fe324070f40 2024-09-19T06:37:31.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.262+0000 7fe322ffd640 1 -- 172.21.15.86:0/1699460176 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3240c8de0 con 0x7fe324070f40 2024-09-19T06:37:31.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.263+0000 7fe322ffd640 1 -- 172.21.15.86:0/1699460176 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1950488582 0 0) 0x7fe30c003520 con 0x7fe324071740 2024-09-19T06:37:31.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.263+0000 7fe322ffd640 1 -- 172.21.15.86:0/1699460176 >> v2:172.21.15.169:3300/0 conn(0x7fe3241593e0 msgr2=0x7fe3240c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:31.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.263+0000 7fe322ffd640 1 --2- 172.21.15.86:0/1699460176 >> v2:172.21.15.169:3300/0 conn(0x7fe3241593e0 0x7fe3240c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.263+0000 7fe322ffd640 1 -- 172.21.15.86:0/1699460176 >> v1:172.21.15.169:6789/0 conn(0x7fe324070f40 legacy=0x7fe3240c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.263+0000 7fe322ffd640 1 -- 172.21.15.86:0/1699460176 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe324163470 con 0x7fe324071740 2024-09-19T06:37:31.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.263+0000 7fe322ffd640 1 -- 172.21.15.86:0/1699460176 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7fe31c0019f0 con 0x7fe324071740 2024-09-19T06:37:31.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.263+0000 7fe322ffd640 1 -- 172.21.15.86:0/1699460176 >> v1:172.21.15.86:6789/0 conn(0x7fe324071740 legacy=0x7fe324169a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.263+0000 7fe322ffd640 1 --2- 172.21.15.86:0/1699460176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe30c003b70 0x7fe30c003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.263+0000 7fe322ffd640 1 --2- 172.21.15.86:0/1699460176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe30c004800 0x7fe30c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.263+0000 7fe322ffd640 1 --2- 172.21.15.86:0/1699460176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe30c0051c0 0x7fe30c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.263+0000 7fe322ffd640 1 -- 172.21.15.86:0/1699460176 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe3240c6f30 con 0x7fe30c003b70 2024-09-19T06:37:31.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.263+0000 7fe322ffd640 1 -- 172.21.15.86:0/1699460176 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c00c090 con 0x7fe30c0051c0 2024-09-19T06:37:31.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.263+0000 7fe322ffd640 1 -- 172.21.15.86:0/1699460176 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe30c00c290 con 0x7fe30c004800 2024-09-19T06:37:31.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.263+0000 7f1fde87b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1fd004a680 0x7f1fd004aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.263+0000 7f1fde87b640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fd00e6a70 con 0x7f1fd00e5f30 2024-09-19T06:37:31.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.263+0000 7f1fde87b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fd00e6d30 con 0x7f1fd00dcd90 2024-09-19T06:37:31.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.263+0000 7f1fde87b640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f1fd0044d40 con 0x7f1fd004a680 2024-09-19T06:37:31.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.263+0000 7fe323fff640 1 --2- 172.21.15.86:0/1699460176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe30c003b70 0x7fe30c003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.264+0000 7f1fde07a640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f1fd00e5f30 0x7f1fd00e6360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39686/0 (socket says 172.21.15.86:39686) 2024-09-19T06:37:31.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.264+0000 7f1fde07a640 1 -- 172.21.15.86:0/3337343158 learned_addr learned my addr 172.21.15.86:0/3337343158 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:31.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.264+0000 7f1fdd078640 1 --2- 172.21.15.86:0/3337343158 >> v2:172.21.15.169:3300/0 conn(0x7f1fd004a680 0x7f1fd004aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.264+0000 7fe328c54640 1 --2- 172.21.15.86:0/1699460176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe30c0051c0 0x7fe30c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.264+0000 7fe323fff640 1 -- 172.21.15.86:0/1699460176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe30c004800 msgr2=0x7fe30c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:31.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.264+0000 7fd06bfff640 1 Processor -- start 2024-09-19T06:37:31.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.264+0000 7f1fdc877640 1 -- 172.21.15.86:0/3337343158 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2236556265 0 0) 0x7f1fd00e6d30 con 0x7f1fd00dcd90 2024-09-19T06:37:31.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.264+0000 7f1fdc877640 1 -- 172.21.15.86:0/3337343158 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fc4003520 con 0x7f1fd00dcd90 2024-09-19T06:37:31.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.264+0000 7f1fdc877640 1 -- 172.21.15.86:0/3337343158 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2016635279 0 0) 0x7f1fd00e6a70 con 0x7f1fd00e5f30 2024-09-19T06:37:31.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.264+0000 7f1fdc877640 1 -- 172.21.15.86:0/3337343158 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fd00e6d30 con 0x7f1fd00e5f30 2024-09-19T06:37:31.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.264+0000 7fe323fff640 1 --2- 172.21.15.86:0/1699460176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe30c004800 0x7fe30c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.264+0000 7fe323fff640 1 -- 172.21.15.86:0/1699460176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe30c0051c0 msgr2=0x7fe30c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:31.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.264+0000 7fe323fff640 1 --2- 172.21.15.86:0/1699460176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe30c0051c0 0x7fe30c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.264+0000 7fe323fff640 1 -- 172.21.15.86:0/1699460176 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30c003520 con 0x7fe30c003b70 2024-09-19T06:37:31.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.264+0000 7fe328c54640 1 --2- 172.21.15.86:0/1699460176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe30c0051c0 0x7fe30c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:31.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.264+0000 7fe328c54640 1 -- 172.21.15.86:0/1699460176 reap_dead start 2024-09-19T06:37:31.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.264+0000 7f1fdc877640 1 -- 172.21.15.86:0/3337343158 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 798425654 0 0) 0x7f1fc4003520 con 0x7f1fd00dcd90 2024-09-19T06:37:31.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.264+0000 7f1fdc877640 1 -- 172.21.15.86:0/3337343158 >> v2:172.21.15.169:3300/0 conn(0x7f1fd004a680 msgr2=0x7f1fd004aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:31.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.264+0000 7f1fdc877640 1 --2- 172.21.15.86:0/3337343158 >> v2:172.21.15.169:3300/0 conn(0x7f1fd004a680 0x7f1fd004aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.264+0000 7f1fdc877640 1 -- 172.21.15.86:0/3337343158 >> v1:172.21.15.86:6789/0 conn(0x7f1fd00e5f30 legacy=0x7f1fd00e6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.264+0000 7f1fdc877640 1 -- 172.21.15.86:0/3337343158 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fd0044f90 con 0x7f1fd00dcd90 2024-09-19T06:37:31.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.264+0000 7f1fdc877640 1 -- 172.21.15.86:0/3337343158 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f1fd8050800 con 0x7f1fd00dcd90 2024-09-19T06:37:31.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.265+0000 7f1fdc877640 1 -- 172.21.15.86:0/3337343158 >> v1:172.21.15.169:6789/0 conn(0x7f1fd00dcd90 legacy=0x7f1fd0045d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.265+0000 7f1fdc877640 1 --2- 172.21.15.86:0/3337343158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fc4003b40 0x7f1fc4003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.265+0000 7f1fdc877640 1 --2- 172.21.15.86:0/3337343158 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fc4004800 0x7f1fc4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.265+0000 7f1fdc877640 1 --2- 172.21.15.86:0/3337343158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fc40051c0 0x7f1fc400b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.264+0000 7ff12fd5f640 1 Processor -- start 2024-09-19T06:37:31.277 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.265+0000 7f1fdc877640 1 -- 172.21.15.86:0/3337343158 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd0044d40 con 0x7f1fc40051c0 2024-09-19T06:37:31.277 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.265+0000 7f1fdc877640 1 -- 172.21.15.86:0/3337343158 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc400bef0 con 0x7f1fc4003b40 2024-09-19T06:37:31.277 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.265+0000 7f1fdc877640 1 -- 172.21.15.86:0/3337343158 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1fc400c070 con 0x7f1fc4004800 2024-09-19T06:37:31.277 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.265+0000 7f1fde07a640 1 --2- 172.21.15.86:0/3337343158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fc40051c0 0x7f1fc400b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.277 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.265+0000 7fd06bfff640 1 -- start start 2024-09-19T06:37:31.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.265+0000 7f1fdd879640 1 --2- 172.21.15.86:0/3337343158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fc4003b40 0x7f1fc4003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.265+0000 7ff12fd5f640 1 -- start start 2024-09-19T06:37:31.279 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.266+0000 7f30371d8640 1 Processor -- start 2024-09-19T06:37:31.279 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.266+0000 7fe9e6124640 1 Processor -- start 2024-09-19T06:37:31.280 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.266+0000 7fe323fff640 1 --2- 172.21.15.86:0/1699460176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe30c003b70 0x7fe30c003f50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe318009d20 tx=0x7fe30c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd51cfac16ef2358 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.280 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.266+0000 7fe322ffd640 1 -- 172.21.15.86:0/1699460176 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe318036070 con 0x7fe30c003b70 2024-09-19T06:37:31.280 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.266+0000 7fd06bfff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd0640d8760 0x7fd06400c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.266+0000 7fe322ffd640 1 -- 172.21.15.86:0/1699460176 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe318031400 con 0x7fe30c003b70 2024-09-19T06:37:31.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.266+0000 7fd06bfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0640d8b40 0x7fd06400c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.266+0000 7fd06bfff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd06404d9d0 0x7fd06404cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.266+0000 7fd06bfff640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fd0640e2b10 con 0x7fd0640d8760 2024-09-19T06:37:31.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.266+0000 7fd06bfff640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fd0640371a0 con 0x7fd06404d9d0 2024-09-19T06:37:31.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.266+0000 7fd06bfff640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd0640e1cf0 con 0x7fd0640d8b40 2024-09-19T06:37:31.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.265+0000 7f1fde07a640 1 -- 172.21.15.86:0/3337343158 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fc4004800 msgr2=0x7f1fc4004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:37:31.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.265+0000 7f1fde07a640 1 --2- 172.21.15.86:0/3337343158 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fc4004800 0x7f1fc4004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.267+0000 7fd06affd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd0640d8760 0x7fd06400c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.265+0000 7f1fde07a640 1 -- 172.21.15.86:0/3337343158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fc4003b40 msgr2=0x7f1fc4003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:31.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.267+0000 7fd06affd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd0640d8760 0x7fd06400c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39586/0 (socket says 172.21.15.86:39586) 2024-09-19T06:37:31.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.267+0000 7fd06affd640 1 -- 172.21.15.86:0/3367406342 learned_addr learned my addr 172.21.15.86:0/3367406342 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:31.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.265+0000 7f1fde07a640 1 --2- 172.21.15.86:0/3337343158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fc4003b40 0x7f1fc4003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.267+0000 7ff12fd5f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1200dcd90 0x7ff120045d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.265+0000 7f1fde07a640 1 -- 172.21.15.86:0/3337343158 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc4003520 con 0x7f1fc40051c0 2024-09-19T06:37:31.285 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.267+0000 7f30371d8640 1 -- start start 2024-09-19T06:37:31.285 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.267+0000 7ff12fd5f640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff12004a680 0x7ff12004aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.285 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.267+0000 7fd06b7fe640 1 --2- 172.21.15.86:0/3367406342 >> v2:172.21.15.169:3300/0 conn(0x7fd06404d9d0 0x7fd06404cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.267+0000 7fd06a7fc640 1 --2- 172.21.15.86:0/3367406342 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0640d8b40 0x7fd06400c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.267+0000 7ff12fd5f640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1200e6d30 con 0x7ff1200e5f30 2024-09-19T06:37:31.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.267+0000 7ff12fd5f640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7ff120044d40 con 0x7ff12004a680 2024-09-19T06:37:31.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.267+0000 7fe32a6b7640 1 -- 172.21.15.86:0/1699460176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe30c003b70 msgr2=0x7fe30c003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.267+0000 7fe32a6b7640 1 --2- 172.21.15.86:0/1699460176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe30c003b70 0x7fe30c003f50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe318009d20 tx=0x7fe30c005830 comp rx=0 tx=0).stop 2024-09-19T06:37:31.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.267+0000 7ff12fd5f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff1200dd170 con 0x7ff1200dcd90 2024-09-19T06:37:31.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.267+0000 7ff12dafb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1200dcd90 0x7ff120045d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.267+0000 7ff12dafb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1200dcd90 0x7ff120045d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:40772/0 (socket says 172.21.15.86:40772) 2024-09-19T06:37:31.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.267+0000 7ff12dafb640 1 -- 172.21.15.86:0/675012409 learned_addr learned my addr 172.21.15.86:0/675012409 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:31.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.267+0000 7fd06affd640 1 -- 172.21.15.86:0/3367406342 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0640d8b40 msgr2=0x7fd06400c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:31.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.266+0000 7fe9e6124640 1 -- start start 2024-09-19T06:37:31.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.267+0000 7fe9e6124640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe9e00c9470 0x7fe9e00c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.267+0000 7fe9e6124640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9e015f1d0 con 0x7fe9e00c9850 2024-09-19T06:37:31.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.267+0000 7fe9e6124640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9e015f490 con 0x7fe9e0159700 2024-09-19T06:37:31.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.267+0000 7fd06affd640 1 --2- 172.21.15.86:0/3367406342 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0640d8b40 0x7fd06400c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.267+0000 7fe9e6124640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fe9e01600a0 con 0x7fe9e00c9470 2024-09-19T06:37:31.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.267+0000 7fd06affd640 1 -- 172.21.15.86:0/3367406342 >> v2:172.21.15.169:3300/0 conn(0x7fd06404d9d0 msgr2=0x7fd06404cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:31.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.267+0000 7fd06affd640 1 --2- 172.21.15.86:0/3367406342 >> v2:172.21.15.169:3300/0 conn(0x7fd06404d9d0 0x7fd06404cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.268+0000 7ff12dafb640 1 -- 172.21.15.86:0/675012409 >> v2:172.21.15.86:3300/0 conn(0x7ff12004a680 msgr2=0x7ff12004aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:31.290 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.268+0000 7fd06affd640 1 -- 172.21.15.86:0/3367406342 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0640e1f90 con 0x7fd0640d8760 2024-09-19T06:37:31.290 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.268+0000 7fd06a7fc640 1 --2- 172.21.15.86:0/3367406342 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0640d8b40 0x7fd06400c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:37:31.290 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.268+0000 7f1fde07a640 1 -- 172.21.15.86:0/3337343158 reap_dead start 2024-09-19T06:37:31.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.268+0000 7fe32a6b7640 1 -- 172.21.15.86:0/1699460176 shutdown_connections 2024-09-19T06:37:31.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.268+0000 7fe32a6b7640 1 --2- 172.21.15.86:0/1699460176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe30c003b70 0x7fe30c003f50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.268+0000 7fe32a6b7640 1 -- 172.21.15.86:0/1699460176 >> 172.21.15.86:0/1699460176 conn(0x7fe32406e820 msgr2=0x7fe32406ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.268+0000 7fe32a6b7640 1 -- 172.21.15.86:0/1699460176 shutdown_connections 2024-09-19T06:37:31.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.268+0000 7fe9e4921640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe9e00c9850 0x7fe9e0158ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39708/0 (socket says 172.21.15.86:39708) 2024-09-19T06:37:31.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.268+0000 7fe9e4921640 1 -- 172.21.15.86:0/731280811 learned_addr learned my addr 172.21.15.86:0/731280811 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:31.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.268+0000 7fe9e5122640 1 --2- 172.21.15.86:0/731280811 >> v2:172.21.15.86:3300/0 conn(0x7fe9e00c9470 0x7fe9e00c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.268+0000 7fe9e5923640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fe9e0159700 0x7fe9e006e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:52688/0 (socket says 172.21.15.86:52688) 2024-09-19T06:37:31.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.268+0000 7fd06b7fe640 1 --2- 172.21.15.86:0/3367406342 >> v2:172.21.15.169:3300/0 conn(0x7fd06404d9d0 0x7fd06404cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:37:31.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.268+0000 7f1fde07a640 1 --2- 172.21.15.86:0/3337343158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fc40051c0 0x7f1fc400b9b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4001b00 tx=0x7f1fc4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f3eb26d7da6582 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.268+0000 7f30371d8640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f30280dcdc0 0x7f3028045e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.268+0000 7f7012cf1640 1 Processor -- start 2024-09-19T06:37:31.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.268+0000 7f7012cf1640 1 -- start start 2024-09-19T06:37:31.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.268+0000 7ff12dafb640 1 --2- 172.21.15.86:0/675012409 >> v2:172.21.15.86:3300/0 conn(0x7ff12004a680 0x7ff12004aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.268+0000 7ff12dafb640 1 -- 172.21.15.86:0/675012409 >> v1:172.21.15.86:6789/0 conn(0x7ff1200e5f30 legacy=0x7ff1200e63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:31.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.268+0000 7ff12dafb640 1 -- 172.21.15.86:0/675012409 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff120044f90 con 0x7ff1200dcd90 2024-09-19T06:37:31.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7f1fdc877640 1 -- 172.21.15.86:0/3337343158 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd40016d0 con 0x7f1fc40051c0 2024-09-19T06:37:31.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.268+0000 7f30371d8640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30280e3820 con 0x7f302804aae0 2024-09-19T06:37:31.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.268+0000 7f30371d8640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3028044d70 con 0x7f302804a6b0 2024-09-19T06:37:31.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.268+0000 7f30371d8640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f3028045980 con 0x7f30280dcdc0 2024-09-19T06:37:31.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7fd06affd640 1 --2- 172.21.15.86:0/3367406342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0640d8760 0x7fd06400c180 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd064047290 tx=0x7fd05c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1312dd3f2aab866d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7f302ffff640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f302804a6b0 0x7f30280e29f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:52692/0 (socket says 172.21.15.86:52692) 2024-09-19T06:37:31.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7ff12dafb640 1 --2- 172.21.15.86:0/675012409 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1200dcd90 0x7ff120045d50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff124009870 tx=0x7ff12402a2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96ea330277cf6c91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7f302ffff640 1 -- 172.21.15.86:0/3949102302 learned_addr learned my addr 172.21.15.86:0/3949102302 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:31.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7f3035775640 1 --1- 172.21.15.86:0/3949102302 >> v1:172.21.15.86:6789/0 conn(0x7f302804aae0 0x7f30280ed2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39710/0 (socket says 172.21.15.86:39710) 2024-09-19T06:37:31.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7f175dd66640 1 Processor -- start 2024-09-19T06:37:31.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7ff12caf9640 1 -- 172.21.15.86:0/675012409 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124037070 con 0x7ff1200dcd90 2024-09-19T06:37:31.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7ff12caf9640 1 -- 172.21.15.86:0/675012409 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff124032440 con 0x7ff1200dcd90 2024-09-19T06:37:31.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7fd069ffb640 1 -- 172.21.15.86:0/3367406342 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05c037070 con 0x7fd0640d8760 2024-09-19T06:37:31.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7f175dd66640 1 -- start start 2024-09-19T06:37:31.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7ff12caf9640 1 -- 172.21.15.86:0/675012409 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1240327f0 con 0x7ff1200dcd90 2024-09-19T06:37:31.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7f7012cf1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f700c070f40 0x7f700c0c7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7f7012cf1640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f700c0c8de0 con 0x7f700c1593e0 2024-09-19T06:37:31.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7f7012cf1640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f700c163190 con 0x7f700c0c7ec0 2024-09-19T06:37:31.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7f7012cf1640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f700c0c6f30 con 0x7f700c070f40 2024-09-19T06:37:31.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7fd069ffb640 1 -- 172.21.15.86:0/3367406342 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd05c032440 con 0x7fd0640d8760 2024-09-19T06:37:31.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7fd069ffb640 1 -- 172.21.15.86:0/3367406342 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05c032810 con 0x7fd0640d8760 2024-09-19T06:37:31.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7f7010a8d640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f700c1593e0 0x7f700c0c84e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39720/0 (socket says 172.21.15.86:39720) 2024-09-19T06:37:31.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7f7010a8d640 1 -- 172.21.15.86:0/1095406777 learned_addr learned my addr 172.21.15.86:0/1095406777 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:31.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7fe9d7fff640 1 -- 172.21.15.86:0/731280811 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1658016281 0 0) 0x7fe9e015f490 con 0x7fe9e0159700 2024-09-19T06:37:31.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7fe9d7fff640 1 -- 172.21.15.86:0/731280811 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9cc003520 con 0x7fe9e0159700 2024-09-19T06:37:31.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7fe9d7fff640 1 -- 172.21.15.86:0/731280811 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2613407728 0 0) 0x7fe9cc003520 con 0x7fe9e0159700 2024-09-19T06:37:31.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7fe9d7fff640 1 -- 172.21.15.86:0/731280811 >> v2:172.21.15.86:3300/0 conn(0x7fe9e00c9470 msgr2=0x7fe9e00c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:31.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7fe9d7fff640 1 --2- 172.21.15.86:0/731280811 >> v2:172.21.15.86:3300/0 conn(0x7fe9e00c9470 0x7fe9e00c7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7fe9d7fff640 1 -- 172.21.15.86:0/731280811 >> v1:172.21.15.86:6789/0 conn(0x7fe9e00c9850 legacy=0x7fe9e0158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7fe9d7fff640 1 -- 172.21.15.86:0/731280811 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e015f770 con 0x7fe9e0159700 2024-09-19T06:37:31.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7fe9d7fff640 1 -- 172.21.15.86:0/731280811 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7fe9dc0015a0 con 0x7fe9e0159700 2024-09-19T06:37:31.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7fe9d7fff640 1 -- 172.21.15.86:0/731280811 >> v1:172.21.15.169:6789/0 conn(0x7fe9e0159700 legacy=0x7fe9e006e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7fe9d7fff640 1 --2- 172.21.15.86:0/731280811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9cc003a00 0x7fe9cc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7fe9d7fff640 1 --2- 172.21.15.86:0/731280811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9cc004800 0x7fe9cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7fe9d7fff640 1 --2- 172.21.15.86:0/731280811 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9cc0051c0 0x7fe9cc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7fe9d7fff640 1 -- 172.21.15.86:0/731280811 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e01600a0 con 0x7fe9cc004800 2024-09-19T06:37:31.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7fe9d7fff640 1 -- 172.21.15.86:0/731280811 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc00c060 con 0x7fe9cc003a00 2024-09-19T06:37:31.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7fe9d7fff640 1 -- 172.21.15.86:0/731280811 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe9cc00c260 con 0x7fe9cc0051c0 2024-09-19T06:37:31.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7fe9e5122640 1 --2- 172.21.15.86:0/731280811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9cc003a00 0x7fe9cc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7ff12fd5f640 1 -- 172.21.15.86:0/675012409 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1200dcd90 msgr2=0x7ff120045d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7f302f7fe640 1 -- 172.21.15.86:0/3949102302 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3075831715 0 0) 0x7f3028044d70 con 0x7f302804a6b0 2024-09-19T06:37:31.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.269+0000 7f302f7fe640 1 -- 172.21.15.86:0/3949102302 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3020003520 con 0x7f302804a6b0 2024-09-19T06:37:31.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7f302f7fe640 1 -- 172.21.15.86:0/3949102302 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2238703621 0 0) 0x7f3020003520 con 0x7f302804a6b0 2024-09-19T06:37:31.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7f302f7fe640 1 -- 172.21.15.86:0/3949102302 >> v2:172.21.15.86:3300/0 conn(0x7f30280dcdc0 msgr2=0x7f3028045e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:31.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7f302f7fe640 1 --2- 172.21.15.86:0/3949102302 >> v2:172.21.15.86:3300/0 conn(0x7f30280dcdc0 0x7f3028045e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7ff12fd5f640 1 --2- 172.21.15.86:0/675012409 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1200dcd90 0x7ff120045d50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff124009870 tx=0x7ff12402a2c0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7f302f7fe640 1 -- 172.21.15.86:0/3949102302 >> v1:172.21.15.86:6789/0 conn(0x7f302804aae0 legacy=0x7f30280ed2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:31.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7f302f7fe640 1 -- 172.21.15.86:0/3949102302 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3028045050 con 0x7f302804a6b0 2024-09-19T06:37:31.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7f302f7fe640 1 -- 172.21.15.86:0/3949102302 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f3024001670 con 0x7f302804a6b0 2024-09-19T06:37:31.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7f302f7fe640 1 -- 172.21.15.86:0/3949102302 >> v1:172.21.15.169:6789/0 conn(0x7f302804a6b0 legacy=0x7f30280e29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7f302f7fe640 1 --2- 172.21.15.86:0/3949102302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30200039b0 0x7f3020003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7f302f7fe640 1 --2- 172.21.15.86:0/3949102302 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3020004800 0x7f3020004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7f302f7fe640 1 --2- 172.21.15.86:0/3949102302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30200052e0 0x7f302000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7f302ffff640 1 --2- 172.21.15.86:0/3949102302 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3020004800 0x7f3020004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7f302f7fe640 1 -- 172.21.15.86:0/3949102302 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f302000c110 con 0x7f30200052e0 2024-09-19T06:37:31.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7f302f7fe640 1 -- 172.21.15.86:0/3949102302 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f302000c2c0 con 0x7f30200039b0 2024-09-19T06:37:31.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7f302f7fe640 1 -- 172.21.15.86:0/3949102302 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f302000c4c0 con 0x7f3020004800 2024-09-19T06:37:31.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7f3035775640 1 --2- 172.21.15.86:0/3949102302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30200052e0 0x7f302000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7ff12fd5f640 1 -- 172.21.15.86:0/675012409 shutdown_connections 2024-09-19T06:37:31.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7ff12fd5f640 1 --2- 172.21.15.86:0/675012409 >> v2:172.21.15.86:3300/0 conn(0x7ff12004a680 0x7ff12004aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7ff12fd5f640 1 --2- 172.21.15.86:0/675012409 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1200dcd90 0x7ff120045d50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7ff12fd5f640 1 -- 172.21.15.86:0/675012409 >> 172.21.15.86:0/675012409 conn(0x7ff12004fc50 msgr2=0x7ff120050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7f302ffff640 1 -- 172.21.15.86:0/3949102302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30200039b0 msgr2=0x7f3020003dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:37:31.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7f302ffff640 1 --2- 172.21.15.86:0/3949102302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30200039b0 0x7f3020003dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7f302ffff640 1 -- 172.21.15.86:0/3949102302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30200052e0 msgr2=0x7f302000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:31.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7f302ffff640 1 --2- 172.21.15.86:0/3949102302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30200052e0 0x7f302000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7f302ffff640 1 -- 172.21.15.86:0/3949102302 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3020003520 con 0x7f3020004800 2024-09-19T06:37:31.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7f70037fe640 1 -- 172.21.15.86:0/1095406777 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3432924511 0 0) 0x7f700c163190 con 0x7f700c0c7ec0 2024-09-19T06:37:31.305 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7f70037fe640 1 -- 172.21.15.86:0/1095406777 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ff4003520 con 0x7f700c0c7ec0 2024-09-19T06:37:31.305 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7f70037fe640 1 -- 172.21.15.86:0/1095406777 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2321591191 0 0) 0x7f700c0c8de0 con 0x7f700c1593e0 2024-09-19T06:37:31.305 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7f175dd66640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1750005a00 0x7f17500da540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.305 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7fe9e5923640 1 --2- 172.21.15.86:0/731280811 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9cc0051c0 0x7fe9cc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.305 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7f70037fe640 1 -- 172.21.15.86:0/1095406777 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f700c163190 con 0x7f700c1593e0 2024-09-19T06:37:31.306 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7fe9e4921640 1 --2- 172.21.15.86:0/731280811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9cc004800 0x7fe9cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.306 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7fd06bfff640 1 -- 172.21.15.86:0/3367406342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0640d8760 msgr2=0x7fd06400c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.306 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7fd06bfff640 1 --2- 172.21.15.86:0/3367406342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0640d8760 0x7fd06400c180 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd064047290 tx=0x7fd05c02a1e0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7f3035775640 1 -- 172.21.15.86:0/3949102302 reap_dead start 2024-09-19T06:37:31.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7f1756ffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1750005a00 0x7f17500da540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7f1756ffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1750005a00 0x7f17500da540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:40818/0 (socket says 172.21.15.86:40818) 2024-09-19T06:37:31.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7f1756ffd640 1 -- 172.21.15.86:0/11827173 learned_addr learned my addr 172.21.15.86:0/11827173 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:31.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7fd06bfff640 1 -- 172.21.15.86:0/3367406342 shutdown_connections 2024-09-19T06:37:31.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7fd06bfff640 1 --2- 172.21.15.86:0/3367406342 >> v2:172.21.15.169:3300/0 conn(0x7fd06404d9d0 0x7fd06404cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7fd06bfff640 1 --2- 172.21.15.86:0/3367406342 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0640d8b40 0x7fd06400c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7fd06bfff640 1 --2- 172.21.15.86:0/3367406342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0640d8760 0x7fd06400c180 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7f1fdc877640 1 -- 172.21.15.86:0/3337343158 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fd402e070 con 0x7f1fc40051c0 2024-09-19T06:37:31.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7f1fde87b640 1 -- 172.21.15.86:0/3337343158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fc40051c0 msgr2=0x7f1fc400b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7f1fde87b640 1 --2- 172.21.15.86:0/3337343158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fc40051c0 0x7f1fc400b9b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4001b00 tx=0x7f1fc4005830 comp rx=0 tx=0).stop 2024-09-19T06:37:31.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7fd06bfff640 1 -- 172.21.15.86:0/3367406342 >> 172.21.15.86:0/3367406342 conn(0x7fd06400e290 msgr2=0x7fd064051e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7f175dd66640 1 -- 172.21.15.86:0/11827173 --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1750005fd0 con 0x7f17500d45f0 2024-09-19T06:37:31.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7f175dd66640 1 -- 172.21.15.86:0/11827173 --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17500062b0 con 0x7f1750050770 2024-09-19T06:37:31.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7f175dd66640 1 -- 172.21.15.86:0/11827173 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1750032c10 con 0x7f1750005a00 2024-09-19T06:37:31.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.268+0000 7fe32a6b7640 1 -- 172.21.15.86:0/1699460176 wait complete. 2024-09-19T06:37:31.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7fe9e5122640 1 -- 172.21.15.86:0/731280811 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9cc0051c0 msgr2=0x7fe9cc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:31.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7fe9e5122640 1 --2- 172.21.15.86:0/731280811 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9cc0051c0 0x7fe9cc00b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7fe9e5122640 1 -- 172.21.15.86:0/731280811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9cc004800 msgr2=0x7fe9cc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:31.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7fe9e5122640 1 --2- 172.21.15.86:0/731280811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9cc004800 0x7fe9cc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7fe9e5122640 1 -- 172.21.15.86:0/731280811 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9cc003520 con 0x7fe9cc003a00 2024-09-19T06:37:31.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7f7003fff640 1 --2- 172.21.15.86:0/1095406777 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f700c070f40 0x7f700c0c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7f7003fff640 1 -- 172.21.15.86:0/1095406777 >> v1:172.21.15.169:6789/0 conn(0x7f700c0c7ec0 legacy=0x7f700c071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7f7003fff640 1 -- 172.21.15.86:0/1095406777 >> v1:172.21.15.86:6789/0 conn(0x7f700c1593e0 legacy=0x7f700c0c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7f7003fff640 1 -- 172.21.15.86:0/1095406777 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f700c163470 con 0x7f700c070f40 2024-09-19T06:37:31.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7fe9e5923640 1 -- 172.21.15.86:0/731280811 reap_dead start 2024-09-19T06:37:31.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7fe32a6b7640 1 Processor -- start 2024-09-19T06:37:31.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.270+0000 7fe32a6b7640 1 -- start start 2024-09-19T06:37:31.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7fe32a6b7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe30c003b70 0x7fe3240cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7fe32a6b7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3241562a0 0x7fe32415a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7fe32a6b7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe324161300 0x7fe3241617b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7fe32a6b7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe324068a10 con 0x7fe30c003b70 2024-09-19T06:37:31.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7fe32a6b7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe3240c7460 con 0x7fe324161300 2024-09-19T06:37:31.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7fe32a6b7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe3241597c0 con 0x7fe3241562a0 2024-09-19T06:37:31.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7fe328c54640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe324161300 0x7fe3241617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7fe328c54640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe324161300 0x7fe3241617b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:55846/0 (socket says 172.21.15.86:55846) 2024-09-19T06:37:31.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7fe328c54640 1 -- 172.21.15.86:0/618592663 learned_addr learned my addr 172.21.15.86:0/618592663 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:31.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7fe3237fe640 1 --2- 172.21.15.86:0/618592663 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3241562a0 0x7fe32415a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.272+0000 7ff12fd5f640 1 -- 172.21.15.86:0/675012409 shutdown_connections 2024-09-19T06:37:31.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.272+0000 7ff12fd5f640 1 -- 172.21.15.86:0/675012409 wait complete. 2024-09-19T06:37:31.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.272+0000 7fd06bfff640 1 -- 172.21.15.86:0/3367406342 shutdown_connections 2024-09-19T06:37:31.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7f1fde87b640 1 -- 172.21.15.86:0/3337343158 shutdown_connections 2024-09-19T06:37:31.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7f1fde87b640 1 --2- 172.21.15.86:0/3337343158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fc40051c0 0x7f1fc400b9b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.271+0000 7f1fde87b640 1 -- 172.21.15.86:0/3337343158 >> 172.21.15.86:0/3337343158 conn(0x7f1fd004fc50 msgr2=0x7f1fd0050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.272+0000 7f1fde87b640 1 -- 172.21.15.86:0/3337343158 shutdown_connections 2024-09-19T06:37:31.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.272+0000 7f1fde87b640 1 -- 172.21.15.86:0/3337343158 wait complete. 2024-09-19T06:37:31.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.272+0000 7f1756ffd640 1 -- 172.21.15.86:0/11827173 >> v1:172.21.15.169:6789/0 conn(0x7f1750050770 legacy=0x7f1750034250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:31.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.272+0000 7f1756ffd640 1 -- 172.21.15.86:0/11827173 >> v1:172.21.15.86:6789/0 conn(0x7f17500d45f0 legacy=0x7f175004ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.272+0000 7f1756ffd640 1 -- 172.21.15.86:0/11827173 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1750006590 con 0x7f1750005a00 2024-09-19T06:37:31.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.272+0000 7fe328c54640 1 -- 172.21.15.86:0/618592663 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3241562a0 msgr2=0x7fe32415a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.272+0000 7fe328c54640 1 --2- 172.21.15.86:0/618592663 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3241562a0 0x7fe32415a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.272+0000 7fe328c54640 1 -- 172.21.15.86:0/618592663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe30c003b70 msgr2=0x7fe3240cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.272+0000 7fe328c54640 1 --2- 172.21.15.86:0/618592663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe30c003b70 0x7fe3240cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.272+0000 7fe328c54640 1 -- 172.21.15.86:0/618592663 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32415c5f0 con 0x7fe324161300 2024-09-19T06:37:31.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.272+0000 7fe328c54640 1 --2- 172.21.15.86:0/618592663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe324161300 0x7fe3241617b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe32406dee0 tx=0x7fe31c008c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.272+0000 7fe320ff9640 1 -- 172.21.15.86:0/618592663 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c01a070 con 0x7fe324161300 2024-09-19T06:37:31.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.272+0000 7fe320ff9640 1 -- 172.21.15.86:0/618592663 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe31c00fa80 con 0x7fe324161300 2024-09-19T06:37:31.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.272+0000 7fe320ff9640 1 -- 172.21.15.86:0/618592663 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c00fe70 con 0x7fe324161300 2024-09-19T06:37:31.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.272+0000 7fe32a6b7640 1 -- 172.21.15.86:0/618592663 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe32415c8d0 con 0x7fe324161300 2024-09-19T06:37:31.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.272+0000 7fe32a6b7640 1 -- 172.21.15.86:0/618592663 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe324159f90 con 0x7fe324161300 2024-09-19T06:37:31.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.272+0000 7fd06bfff640 1 -- 172.21.15.86:0/3367406342 wait complete. 2024-09-19T06:37:31.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.273+0000 7f1756ffd640 1 --2- 172.21.15.86:0/11827173 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1750005a00 0x7f17500da540 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f17440098a0 tx=0x7f174402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20f836d88bd49eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.273+0000 7f17567fc640 1 -- 172.21.15.86:0/11827173 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1744037070 con 0x7f1750005a00 2024-09-19T06:37:31.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.273+0000 7f17567fc640 1 -- 172.21.15.86:0/11827173 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f174402ae10 con 0x7f1750005a00 2024-09-19T06:37:31.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.273+0000 7f17567fc640 1 -- 172.21.15.86:0/11827173 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1744032660 con 0x7f1750005a00 2024-09-19T06:37:31.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.273+0000 7fe9e5122640 1 --2- 172.21.15.86:0/731280811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9cc003a00 0x7fe9cc003de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009ac0 tx=0x7fe9cc005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f507ebcfe201de0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.273+0000 7f7003fff640 1 --2- 172.21.15.86:0/1095406777 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f700c070f40 0x7f700c0c7980 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0097d0 tx=0x7f6ffc02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5eccda3c3ae572d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.273+0000 7f70037fe640 1 -- 172.21.15.86:0/1095406777 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc037070 con 0x7f700c070f40 2024-09-19T06:37:31.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.273+0000 7ff12fd5f640 1 Processor -- start 2024-09-19T06:37:31.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.273+0000 7f302ffff640 1 --2- 172.21.15.86:0/3949102302 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3020004800 0x7f3020004c80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f302400c190 tx=0x7f3020005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b65d1b3a5bf2ecb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.273+0000 7f70037fe640 1 -- 172.21.15.86:0/1095406777 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ffc02ae30 con 0x7f700c070f40 2024-09-19T06:37:31.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.273+0000 7f70037fe640 1 -- 172.21.15.86:0/1095406777 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc032640 con 0x7f700c070f40 2024-09-19T06:37:31.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.273+0000 7fe9d7fff640 1 -- 172.21.15.86:0/731280811 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0036070 con 0x7fe9cc003a00 2024-09-19T06:37:31.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.273+0000 7ff12fd5f640 1 -- start start 2024-09-19T06:37:31.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.274+0000 7fe9d7fff640 1 -- 172.21.15.86:0/731280811 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9d0031400 con 0x7fe9cc003a00 2024-09-19T06:37:31.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.274+0000 7fe32a6b7640 1 -- 172.21.15.86:0/618592663 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe32415cbb0 con 0x7fe324161300 2024-09-19T06:37:31.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.274+0000 7f7012cf1640 1 -- 172.21.15.86:0/1095406777 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f700c070f40 msgr2=0x7f700c0c7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.274+0000 7f7012cf1640 1 --2- 172.21.15.86:0/1095406777 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f700c070f40 0x7f700c0c7980 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0097d0 tx=0x7f6ffc02a1a0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.274+0000 7f7012cf1640 1 -- 172.21.15.86:0/1095406777 shutdown_connections 2024-09-19T06:37:31.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.274+0000 7f7012cf1640 1 --2- 172.21.15.86:0/1095406777 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f700c070f40 0x7f700c0c7980 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.274+0000 7f7012cf1640 1 -- 172.21.15.86:0/1095406777 >> 172.21.15.86:0/1095406777 conn(0x7f700c06e820 msgr2=0x7f700c06ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.274+0000 7fe9d7fff640 1 -- 172.21.15.86:0/731280811 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0036070 con 0x7fe9cc003a00 2024-09-19T06:37:31.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.273+0000 7f1fde87b640 1 Processor -- start 2024-09-19T06:37:31.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.273+0000 7f1fde87b640 1 -- start start 2024-09-19T06:37:31.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.274+0000 7fd06bfff640 1 Processor -- start 2024-09-19T06:37:31.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.274+0000 7f1fde87b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fc40051c0 0x7f1fd004ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.274+0000 7ff12fd5f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff12004a680 0x7ff1200d4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.274+0000 7f175dd66640 1 -- 172.21.15.86:0/11827173 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1750005a00 msgr2=0x7f17500da540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.274+0000 7f175dd66640 1 --2- 172.21.15.86:0/11827173 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1750005a00 0x7f17500da540 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f17440098a0 tx=0x7f174402a180 comp rx=0 tx=0).stop 2024-09-19T06:37:31.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7ff12fd5f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1200dcd90 0x7ff12016f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7f1fdd879640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fc40051c0 0x7f1fd004ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7ff12fd5f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1200e5f30 0x7ff120178990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7f175dd66640 1 -- 172.21.15.86:0/11827173 shutdown_connections 2024-09-19T06:37:31.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7f175dd66640 1 --2- 172.21.15.86:0/11827173 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1750005a00 0x7f17500da540 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7f175dd66640 1 -- 172.21.15.86:0/11827173 >> 172.21.15.86:0/11827173 conn(0x7f175004fc50 msgr2=0x7f1750050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7fe9e6124640 1 -- 172.21.15.86:0/731280811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9cc003a00 msgr2=0x7fe9cc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7fe9e6124640 1 --2- 172.21.15.86:0/731280811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9cc003a00 0x7fe9cc003de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009ac0 tx=0x7fe9cc005830 comp rx=0 tx=0).stop 2024-09-19T06:37:31.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7f1fdd879640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fc40051c0 0x7f1fd004ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39668/0 (socket says 172.21.15.86:39668) 2024-09-19T06:37:31.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7f1fdd879640 1 -- 172.21.15.86:0/2429098450 learned_addr learned my addr 172.21.15.86:0/2429098450 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:31.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7f1fde87b640 1 --2- 172.21.15.86:0/2429098450 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fd004d180 0x7f1fd00e4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7f7012cf1640 1 -- 172.21.15.86:0/1095406777 shutdown_connections 2024-09-19T06:37:31.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7f175dd66640 1 -- 172.21.15.86:0/11827173 shutdown_connections 2024-09-19T06:37:31.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7ff12d2fa640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1200dcd90 0x7ff12016f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7ff12e2fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1200e5f30 0x7ff120178990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7ff12e2fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1200e5f30 0x7ff120178990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39678/0 (socket says 172.21.15.86:39678) 2024-09-19T06:37:31.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7ff12d2fa640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1200dcd90 0x7ff12016f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:40834/0 (socket says 172.21.15.86:40834) 2024-09-19T06:37:31.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7fe320ff9640 1 -- 172.21.15.86:0/618592663 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe31c01d070 con 0x7fe324161300 2024-09-19T06:37:31.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7ff12e2fc640 1 -- 172.21.15.86:0/354892833 learned_addr learned my addr 172.21.15.86:0/354892833 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:31.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7ff12fd5f640 1 -- 172.21.15.86:0/354892833 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff120045550 con 0x7ff1200e5f30 2024-09-19T06:37:31.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7ff12fd5f640 1 -- 172.21.15.86:0/354892833 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff1200e6ad0 con 0x7ff12004a680 2024-09-19T06:37:31.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7ff12fd5f640 1 -- 172.21.15.86:0/354892833 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff120045830 con 0x7ff1200dcd90 2024-09-19T06:37:31.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7f7012cf1640 1 -- 172.21.15.86:0/1095406777 wait complete. 2024-09-19T06:37:31.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7f1fde87b640 1 --2- 172.21.15.86:0/2429098450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fd00d8060 0x7f1fd00d84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7f1fde87b640 1 -- 172.21.15.86:0/2429098450 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd0045550 con 0x7f1fc40051c0 2024-09-19T06:37:31.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7f1fde87b640 1 -- 172.21.15.86:0/2429098450 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd00dd170 con 0x7f1fd00d8060 2024-09-19T06:37:31.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7f1fde87b640 1 -- 172.21.15.86:0/2429098450 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1fd0045830 con 0x7f1fd004d180 2024-09-19T06:37:31.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7f1fdd078640 1 --2- 172.21.15.86:0/2429098450 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fd004d180 0x7f1fd00e4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7f302f7fe640 1 -- 172.21.15.86:0/3949102302 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3024007c80 con 0x7f3020004800 2024-09-19T06:37:31.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7f302f7fe640 1 -- 172.21.15.86:0/3949102302 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3024005ad0 con 0x7f3020004800 2024-09-19T06:37:31.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7f302f7fe640 1 -- 172.21.15.86:0/3949102302 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3024007070 con 0x7f3020004800 2024-09-19T06:37:31.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7ff12d2fa640 1 -- 172.21.15.86:0/354892833 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff12004a680 msgr2=0x7ff1200d4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7ff12d2fa640 1 --2- 172.21.15.86:0/354892833 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff12004a680 0x7ff1200d4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7ff12d2fa640 1 -- 172.21.15.86:0/354892833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1200e5f30 msgr2=0x7ff120178990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7ff12d2fa640 1 --2- 172.21.15.86:0/354892833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1200e5f30 0x7ff120178990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7ff12d2fa640 1 -- 172.21.15.86:0/354892833 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1200d58b0 con 0x7ff1200dcd90 2024-09-19T06:37:31.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7fd06bfff640 1 -- start start 2024-09-19T06:37:31.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7fd06bfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd06404d9d0 0x7fd0640d7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7fd06bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0640d8760 0x7fd064009fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7fd06bfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0640d8b40 0x7fd06404b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7fd06bfff640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd0640e2830 con 0x7fd0640d8760 2024-09-19T06:37:31.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7fd06bfff640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd0640e2550 con 0x7fd06404d9d0 2024-09-19T06:37:31.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7fd06bfff640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd06400d480 con 0x7fd0640d8b40 2024-09-19T06:37:31.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7fd06b7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0640d8b40 0x7fd06404b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7fd06b7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0640d8b40 0x7fd06404b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:40848/0 (socket says 172.21.15.86:40848) 2024-09-19T06:37:31.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7fd06b7fe640 1 -- 172.21.15.86:0/4265089287 learned_addr learned my addr 172.21.15.86:0/4265089287 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:31.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7fe9e6124640 1 -- 172.21.15.86:0/731280811 shutdown_connections 2024-09-19T06:37:31.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7fe9e6124640 1 --2- 172.21.15.86:0/731280811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9cc003a00 0x7fe9cc003de0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7fe9e6124640 1 -- 172.21.15.86:0/731280811 >> 172.21.15.86:0/731280811 conn(0x7fe9e006bda0 msgr2=0x7fe9e006c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7f1fde07a640 1 --2- 172.21.15.86:0/2429098450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fd00d8060 0x7f1fd00d84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7f30371d8640 1 -- 172.21.15.86:0/3949102302 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3020004800 msgr2=0x7f3020004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7f30371d8640 1 --2- 172.21.15.86:0/3949102302 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3020004800 0x7f3020004c80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f302400c190 tx=0x7f3020005830 comp rx=0 tx=0).stop 2024-09-19T06:37:31.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7f30371d8640 1 -- 172.21.15.86:0/3949102302 shutdown_connections 2024-09-19T06:37:31.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7f30371d8640 1 --2- 172.21.15.86:0/3949102302 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3020004800 0x7f3020004c80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7f30371d8640 1 -- 172.21.15.86:0/3949102302 >> 172.21.15.86:0/3949102302 conn(0x7f302804fc80 msgr2=0x7f3028050090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7f30371d8640 1 -- 172.21.15.86:0/3949102302 shutdown_connections 2024-09-19T06:37:31.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7f30371d8640 1 -- 172.21.15.86:0/3949102302 wait complete. 2024-09-19T06:37:31.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7fe320ff9640 1 --2- 172.21.15.86:0/618592663 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe31006c2e0 0x7fe31006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7fe320ff9640 1 -- 172.21.15.86:0/618592663 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe31c08b6d0 con 0x7fe324161300 2024-09-19T06:37:31.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7fe323fff640 1 --2- 172.21.15.86:0/618592663 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe31006c2e0 0x7fe31006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7f1fde07a640 1 -- 172.21.15.86:0/2429098450 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fd004d180 msgr2=0x7f1fd00e4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7f1fde07a640 1 --2- 172.21.15.86:0/2429098450 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fd004d180 0x7f1fd00e4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7f1fde07a640 1 -- 172.21.15.86:0/2429098450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fc40051c0 msgr2=0x7f1fd004ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.276+0000 7ff12d2fa640 1 --2- 172.21.15.86:0/354892833 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1200dcd90 0x7ff12016f5a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff11800b3f0 tx=0x7ff11800b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.275+0000 7f175dd66640 1 -- 172.21.15.86:0/11827173 wait complete. 2024-09-19T06:37:31.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.277+0000 7fd06affd640 1 --2- 172.21.15.86:0/4265089287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd06404d9d0 0x7fd0640d7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.277+0000 7f175dd66640 1 Processor -- start 2024-09-19T06:37:31.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.277+0000 7ff11e7fc640 1 -- 172.21.15.86:0/354892833 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118015020 con 0x7ff1200dcd90 2024-09-19T06:37:31.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.277+0000 7f1fde07a640 1 --2- 172.21.15.86:0/2429098450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fc40051c0 0x7f1fd004ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.277+0000 7f1fde07a640 1 -- 172.21.15.86:0/2429098450 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fd00d6490 con 0x7f1fd00d8060 2024-09-19T06:37:31.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.277+0000 7f1fdd879640 1 --2- 172.21.15.86:0/2429098450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fc40051c0 0x7f1fd004ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:37:31.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.277+0000 7ff11e7fc640 1 -- 172.21.15.86:0/354892833 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff118011850 con 0x7ff1200dcd90 2024-09-19T06:37:31.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.277+0000 7fe9e6124640 1 -- 172.21.15.86:0/731280811 shutdown_connections 2024-09-19T06:37:31.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.277+0000 7ff12fd5f640 1 -- 172.21.15.86:0/354892833 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff12017cdf0 con 0x7ff1200dcd90 2024-09-19T06:37:31.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.277+0000 7f7012cf1640 1 Processor -- start 2024-09-19T06:37:31.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.277+0000 7ff12fd5f640 1 -- 172.21.15.86:0/354892833 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff12017c030 con 0x7ff1200dcd90 2024-09-19T06:37:31.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.277+0000 7f7012cf1640 1 -- start start 2024-09-19T06:37:31.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.277+0000 7f1fde07a640 1 --2- 172.21.15.86:0/2429098450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fd00d8060 0x7f1fd00d84e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1fd000d9e0 tx=0x7f1fd40013c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.277+0000 7fd06a7fc640 1 --2- 172.21.15.86:0/4265089287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0640d8760 0x7fd064009fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.277+0000 7fe9e6124640 1 -- 172.21.15.86:0/731280811 wait complete. 2024-09-19T06:37:31.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.277+0000 7fd06a7fc640 1 -- 172.21.15.86:0/4265089287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0640d8b40 msgr2=0x7fd06404b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.277+0000 7fd06a7fc640 1 --2- 172.21.15.86:0/4265089287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0640d8b40 0x7fd06404b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.277+0000 7fd06a7fc640 1 -- 172.21.15.86:0/4265089287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd06404d9d0 msgr2=0x7fd0640d7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.277+0000 7fd06a7fc640 1 --2- 172.21.15.86:0/4265089287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd06404d9d0 0x7fd0640d7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.277+0000 7fd06a7fc640 1 -- 172.21.15.86:0/4265089287 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd064178bc0 con 0x7fd0640d8760 2024-09-19T06:37:31.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.278+0000 7fe323fff640 1 --2- 172.21.15.86:0/618592663 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe31006c2e0 0x7fe31006e7a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe318009d20 tx=0x7fe31802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.277+0000 7f175dd66640 1 -- start start 2024-09-19T06:37:31.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.278+0000 7fd06b7fe640 1 --2- 172.21.15.86:0/4265089287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0640d8b40 0x7fd06404b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:37:31.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.278+0000 7fd06a7fc640 1 --2- 172.21.15.86:0/4265089287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0640d8760 0x7fd064009fe0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd06000e870 tx=0x7fd06000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.278+0000 7ff11e7fc640 1 -- 172.21.15.86:0/354892833 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118011c40 con 0x7ff1200dcd90 2024-09-19T06:37:31.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.278+0000 7fd053fff640 1 -- 172.21.15.86:0/4265089287 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd060017070 con 0x7fd0640d8760 2024-09-19T06:37:31.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.278+0000 7f30371d8640 1 Processor -- start 2024-09-19T06:37:31.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.278+0000 7f175dd66640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1750005a00 0x7f17500cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.278+0000 7f175dd66640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1750050770 0x7f17500cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.278+0000 7f175dd66640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17500d45f0 0x7f175004dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.278+0000 7f30371d8640 1 -- start start 2024-09-19T06:37:31.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.278+0000 7fd06bfff640 1 -- 172.21.15.86:0/4265089287 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd064178040 con 0x7fd0640d8760 2024-09-19T06:37:31.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.278+0000 7fd053fff640 1 -- 172.21.15.86:0/4265089287 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd06000c8e0 con 0x7fd0640d8760 2024-09-19T06:37:31.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.278+0000 7fd053fff640 1 -- 172.21.15.86:0/4265089287 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06000ccb0 con 0x7fd0640d8760 2024-09-19T06:37:31.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.278+0000 7fd06bfff640 1 -- 172.21.15.86:0/4265089287 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd064178600 con 0x7fd0640d8760 2024-09-19T06:37:31.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.278+0000 7f1756ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1750050770 0x7f17500cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.278+0000 7f1756ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1750050770 0x7f17500cdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39690/0 (socket says 172.21.15.86:39690) 2024-09-19T06:37:31.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.279+0000 7f7012cf1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f700c070f40 0x7f700c0cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.279+0000 7f175dd66640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1750006b50 con 0x7f1750050770 2024-09-19T06:37:31.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.279+0000 7f175dd66640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f17500d4a40 con 0x7f17500d45f0 2024-09-19T06:37:31.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.279+0000 7f175dd66640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1750006e30 con 0x7f1750005a00 2024-09-19T06:37:31.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.279+0000 7f1756ffd640 1 -- 172.21.15.86:0/2334947780 learned_addr learned my addr 172.21.15.86:0/2334947780 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:31.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.279+0000 7f7012cf1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f700c0c7ec0 0x7f700c1f86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.279+0000 7f7010a8d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f700c070f40 0x7f700c0cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.279+0000 7f7010a8d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f700c070f40 0x7f700c0cb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:55896/0 (socket says 172.21.15.86:55896) 2024-09-19T06:37:31.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.279+0000 7f7010a8d640 1 -- 172.21.15.86:0/2916388814 learned_addr learned my addr 172.21.15.86:0/2916388814 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:31.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.279+0000 7f7012cf1640 1 --2- 172.21.15.86:0/2916388814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f700c1593e0 0x7f700c14d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.279+0000 7f7003fff640 1 --2- 172.21.15.86:0/2916388814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f700c0c7ec0 0x7f700c1f86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.280+0000 7f701128e640 1 --2- 172.21.15.86:0/2916388814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f700c1593e0 0x7f700c14d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.280+0000 7f7012cf1640 1 -- 172.21.15.86:0/2916388814 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f700c068a10 con 0x7f700c1593e0 2024-09-19T06:37:31.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.279+0000 7f1757fff640 1 --2- 172.21.15.86:0/2334947780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17500d45f0 0x7f175004dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.279+0000 7f1756ffd640 1 -- 172.21.15.86:0/2334947780 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1750005a00 msgr2=0x7f17500cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.279+0000 7f1756ffd640 1 --2- 172.21.15.86:0/2334947780 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1750005a00 0x7f17500cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.279+0000 7f1756ffd640 1 -- 172.21.15.86:0/2334947780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17500d45f0 msgr2=0x7f175004dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.279+0000 7f1756ffd640 1 --2- 172.21.15.86:0/2334947780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17500d45f0 0x7f175004dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.279+0000 7f1756ffd640 1 -- 172.21.15.86:0/2334947780 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17500cbea0 con 0x7f1750050770 2024-09-19T06:37:31.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.280+0000 7f1756ffd640 1 --2- 172.21.15.86:0/2334947780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1750050770 0x7f17500cdc20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f17440098a0 tx=0x7f17440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.280+0000 7ff11e7fc640 1 -- 172.21.15.86:0/354892833 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff118018020 con 0x7ff1200dcd90 2024-09-19T06:37:31.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.280+0000 7f30371d8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3020004800 0x7f30280e5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.280+0000 7ff12fd5f640 1 -- 172.21.15.86:0/354892833 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff120050da0 con 0x7ff1200dcd90 2024-09-19T06:37:31.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.280+0000 7f30371d8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30280e1cb0 0x7f30280d8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.280+0000 7f30371d8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30280df8c0 0x7f30280d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.355 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.280+0000 7f7012cf1640 1 -- 172.21.15.86:0/2916388814 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f700c0c7460 con 0x7f700c070f40 2024-09-19T06:37:31.355 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.280+0000 7f7012cf1640 1 -- 172.21.15.86:0/2916388814 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f700c1597c0 con 0x7f700c0c7ec0 2024-09-19T06:37:31.355 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.280+0000 7f1743fff640 1 -- 172.21.15.86:0/2334947780 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1744037040 con 0x7f1750050770 2024-09-19T06:37:31.355 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.280+0000 7f1743fff640 1 -- 172.21.15.86:0/2334947780 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1744004230 con 0x7f1750050770 2024-09-19T06:37:31.355 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.280+0000 7f1743fff640 1 -- 172.21.15.86:0/2334947780 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1744003610 con 0x7f1750050770 2024-09-19T06:37:31.356 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.280+0000 7fe9e6124640 1 Processor -- start 2024-09-19T06:37:31.356 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.280+0000 7fe9e6124640 1 -- start start 2024-09-19T06:37:31.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.280+0000 7f30371d8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3028045610 con 0x7f30280e1cb0 2024-09-19T06:37:31.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.280+0000 7f30371d8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f30280dd1a0 con 0x7f30280df8c0 2024-09-19T06:37:31.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.280+0000 7f30371d8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f302804aef0 con 0x7f3020004800 2024-09-19T06:37:31.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.280+0000 7f3034f74640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3020004800 0x7f30280e5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.280+0000 7f3034f74640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3020004800 0x7f30280e5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:40874/0 (socket says 172.21.15.86:40874) 2024-09-19T06:37:31.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.280+0000 7f3034f74640 1 -- 172.21.15.86:0/3357610102 learned_addr learned my addr 172.21.15.86:0/3357610102 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:31.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.281+0000 7f3035775640 1 --2- 172.21.15.86:0/3357610102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30280df8c0 0x7f30280d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.280+0000 7ff11e7fc640 1 --2- 172.21.15.86:0/354892833 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff10c06c380 0x7ff10c06e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.281+0000 7ff11e7fc640 1 -- 172.21.15.86:0/354892833 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff11808b660 con 0x7ff1200dcd90 2024-09-19T06:37:31.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.281+0000 7f302ffff640 1 --2- 172.21.15.86:0/3357610102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30280e1cb0 0x7f30280d8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.280+0000 7f175dd66640 1 -- 172.21.15.86:0/2334947780 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17500cc180 con 0x7f1750050770 2024-09-19T06:37:31.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.280+0000 7f175dd66640 1 -- 172.21.15.86:0/2334947780 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17500da140 con 0x7f1750050770 2024-09-19T06:37:31.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.280+0000 7fd06bfff640 1 -- 172.21.15.86:0/4265089287 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd04c005290 con 0x7fd0640d8760 2024-09-19T06:37:31.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.281+0000 7ff12dafb640 1 --2- 172.21.15.86:0/354892833 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff10c06c380 0x7ff10c06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.281+0000 7f3034f74640 1 -- 172.21.15.86:0/3357610102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30280df8c0 msgr2=0x7f30280d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.281+0000 7f3034f74640 1 --2- 172.21.15.86:0/3357610102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30280df8c0 0x7f30280d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.281+0000 7f3034f74640 1 -- 172.21.15.86:0/3357610102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30280e1cb0 msgr2=0x7f30280d8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.281+0000 7fe9e6124640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9cc003a00 0x7fe9e01fe3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.281+0000 7fe9e6124640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9e0148720 0x7fe9e01f7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.281+0000 7fe9e6124640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9e0151e80 0x7fe9e0152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.281+0000 7fe9e6124640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e00c7610 con 0x7fe9cc003a00 2024-09-19T06:37:31.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.281+0000 7fe9e6124640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e015fd30 con 0x7fe9e0151e80 2024-09-19T06:37:31.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.281+0000 7fe9e6124640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe9e00c8960 con 0x7fe9e0148720 2024-09-19T06:37:31.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.281+0000 7fe9e4921640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9e0148720 0x7fe9e01f7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.281+0000 7fe320ff9640 1 -- 172.21.15.86:0/618592663 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe32415cbb0 con 0x7fe324161300 2024-09-19T06:37:31.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.281+0000 7ff12dafb640 1 --2- 172.21.15.86:0/354892833 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff10c06c380 0x7ff10c06e840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff124034000 tx=0x7ff12402c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.281+0000 7fe9e4921640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9e0148720 0x7fe9e01f7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:40884/0 (socket says 172.21.15.86:40884) 2024-09-19T06:37:31.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.281+0000 7fe9e4921640 1 -- 172.21.15.86:0/70166008 learned_addr learned my addr 172.21.15.86:0/70166008 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:31.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.282+0000 7f3034f74640 1 --2- 172.21.15.86:0/3357610102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30280e1cb0 0x7f30280d8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.282+0000 7f3034f74640 1 -- 172.21.15.86:0/3357610102 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30280df410 con 0x7f3020004800 2024-09-19T06:37:31.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.282+0000 7f1fce7fc640 1 -- 172.21.15.86:0/2429098450 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd40016d0 con 0x7f1fd00d8060 2024-09-19T06:37:31.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.282+0000 7f302ffff640 1 --2- 172.21.15.86:0/3357610102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30280e1cb0 0x7f30280d8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:37:31.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.282+0000 7f7003fff640 1 -- 172.21.15.86:0/2916388814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f700c070f40 msgr2=0x7f700c0cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.282+0000 7f7003fff640 1 --2- 172.21.15.86:0/2916388814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f700c070f40 0x7f700c0cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.282+0000 7f7003fff640 1 -- 172.21.15.86:0/2916388814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f700c1593e0 msgr2=0x7f700c14d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.282+0000 7f1fde87b640 1 -- 172.21.15.86:0/2429098450 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fd00e4fb0 con 0x7f1fd00d8060 2024-09-19T06:37:31.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.282+0000 7f1fde87b640 1 -- 172.21.15.86:0/2429098450 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fd00d5e30 con 0x7f1fd00d8060 2024-09-19T06:37:31.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.282+0000 7f1fce7fc640 1 -- 172.21.15.86:0/2429098450 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fd4006280 con 0x7f1fd00d8060 2024-09-19T06:37:31.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.282+0000 7f1fce7fc640 1 -- 172.21.15.86:0/2429098450 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4006650 con 0x7f1fd00d8060 2024-09-19T06:37:31.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.283+0000 7f7003fff640 1 --2- 172.21.15.86:0/2916388814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f700c1593e0 0x7f700c14d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.283+0000 7f7003fff640 1 -- 172.21.15.86:0/2916388814 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f700c06cb00 con 0x7f700c0c7ec0 2024-09-19T06:37:31.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.283+0000 7f701128e640 1 --2- 172.21.15.86:0/2916388814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f700c1593e0 0x7f700c14d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:37:31.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.282+0000 7f3034f74640 1 --2- 172.21.15.86:0/3357610102 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3020004800 0x7f30280e5640 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f301c00b500 tx=0x7f301c00b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.282+0000 7fe9e5923640 1 --2- 172.21.15.86:0/70166008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9e0151e80 0x7fe9e0152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.283+0000 7fe9e5923640 1 -- 172.21.15.86:0/70166008 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9e0148720 msgr2=0x7fe9e01f7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.283+0000 7fe9e5923640 1 --2- 172.21.15.86:0/70166008 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9e0148720 0x7fe9e01f7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.283+0000 7fe9e5923640 1 -- 172.21.15.86:0/70166008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9cc003a00 msgr2=0x7fe9e01fe3f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:37:31.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.283+0000 7fe9e5923640 1 --2- 172.21.15.86:0/70166008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9cc003a00 0x7fe9e01fe3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.283+0000 7fe9e5923640 1 -- 172.21.15.86:0/70166008 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e012dc70 con 0x7fe9e0151e80 2024-09-19T06:37:31.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.283+0000 7fe9e5923640 1 --2- 172.21.15.86:0/70166008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9e0151e80 0x7fe9e0152330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe9e006f310 tx=0x7fe9dc00d810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.281+0000 7fd053fff640 1 -- 172.21.15.86:0/4265089287 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd06001a070 con 0x7fd0640d8760 2024-09-19T06:37:31.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.282+0000 7fd053fff640 1 --2- 172.21.15.86:0/4265089287 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd05806c2b0 0x7fd05806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.282+0000 7fd053fff640 1 -- 172.21.15.86:0/4265089287 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd06008b960 con 0x7fd0640d8760 2024-09-19T06:37:31.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.282+0000 7fd06affd640 1 --2- 172.21.15.86:0/4265089287 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd05806c2b0 0x7fd05806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.283+0000 7fe9d5ffb640 1 -- 172.21.15.86:0/70166008 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc0074e0 con 0x7fe9e0151e80 2024-09-19T06:37:31.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.283+0000 7f1fde87b640 1 -- 172.21.15.86:0/2429098450 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fd0045a70 con 0x7f1fd00d8060 2024-09-19T06:37:31.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.283+0000 7f175dd66640 1 -- 172.21.15.86:0/2334947780 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1738005290 con 0x7f1750050770 2024-09-19T06:37:31.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.283+0000 7f7003fff640 1 --2- 172.21.15.86:0/2916388814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f700c0c7ec0 0x7f700c1f86a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc031000 tx=0x7f6ffc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.284+0000 7f1743fff640 1 -- 172.21.15.86:0/2334947780 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f174403a040 con 0x7f1750050770 2024-09-19T06:37:31.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.283+0000 7fe9d5ffb640 1 -- 172.21.15.86:0/70166008 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9dc0047e0 con 0x7fe9e0151e80 2024-09-19T06:37:31.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.283+0000 7fe9d5ffb640 1 -- 172.21.15.86:0/70166008 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc004bd0 con 0x7fe9e0151e80 2024-09-19T06:37:31.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.283+0000 7fe9e6124640 1 -- 172.21.15.86:0/70166008 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e015d1e0 con 0x7fe9e0151e80 2024-09-19T06:37:31.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.284+0000 7fe9e6124640 1 -- 172.21.15.86:0/70166008 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e015d7a0 con 0x7fe9e0151e80 2024-09-19T06:37:31.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.284+0000 7f1743fff640 1 --2- 172.21.15.86:0/2334947780 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f173c06c2e0 0x7f173c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.284+0000 7f1fce7fc640 1 -- 172.21.15.86:0/2429098450 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1fd403a030 con 0x7f1fd00d8060 2024-09-19T06:37:31.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.284+0000 7fd06affd640 1 --2- 172.21.15.86:0/4265089287 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd05806c2b0 0x7fd05806e770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd05c034000 tx=0x7fd05c040040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.284+0000 7f17577fe640 1 --2- 172.21.15.86:0/2334947780 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f173c06c2e0 0x7f173c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.285+0000 7f1fce7fc640 1 --2- 172.21.15.86:0/2429098450 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1fbc06c4a0 0x7f1fbc06e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.285+0000 7f17577fe640 1 --2- 172.21.15.86:0/2334947780 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f173c06c2e0 0x7f173c06e7a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f174c003cc0 tx=0x7f174c0079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.285+0000 7f1fce7fc640 1 -- 172.21.15.86:0/2429098450 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1fd40ab0a0 con 0x7f1fd00d8060 2024-09-19T06:37:31.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.285+0000 7fe9e6124640 1 -- 172.21.15.86:0/70166008 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9e00c8d80 con 0x7fe9e0151e80 2024-09-19T06:37:31.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.285+0000 7f1fdd879640 1 --2- 172.21.15.86:0/2429098450 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1fbc06c4a0 0x7f1fbc06e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.285+0000 7f1743fff640 1 -- 172.21.15.86:0/2334947780 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1744077bf0 con 0x7f1750050770 2024-09-19T06:37:31.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.285+0000 7f1fdd879640 1 --2- 172.21.15.86:0/2429098450 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1fbc06c4a0 0x7f1fbc06e960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1fd807cdc0 tx=0x7f1fd808f040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.286+0000 7f302d7fa640 1 -- 172.21.15.86:0/3357610102 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c014070 con 0x7f3020004800 2024-09-19T06:37:31.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.286+0000 7f30371d8640 1 -- 172.21.15.86:0/3357610102 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30280e5cf0 con 0x7f3020004800 2024-09-19T06:37:31.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.286+0000 7f70017fa640 1 -- 172.21.15.86:0/2916388814 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc037040 con 0x7f700c0c7ec0 2024-09-19T06:37:31.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.286+0000 7f302d7fa640 1 -- 172.21.15.86:0/3357610102 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f301c010870 con 0x7f3020004800 2024-09-19T06:37:31.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.286+0000 7f30371d8640 1 -- 172.21.15.86:0/3357610102 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f30280dd6e0 con 0x7f3020004800 2024-09-19T06:37:31.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.286+0000 7f302d7fa640 1 -- 172.21.15.86:0/3357610102 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c014070 con 0x7f3020004800 2024-09-19T06:37:31.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.286+0000 7f70017fa640 1 -- 172.21.15.86:0/2916388814 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ffc004220 con 0x7f700c0c7ec0 2024-09-19T06:37:31.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.286+0000 7f7012cf1640 1 -- 172.21.15.86:0/2916388814 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f700c1626a0 con 0x7f700c0c7ec0 2024-09-19T06:37:31.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.286+0000 7f7012cf1640 1 -- 172.21.15.86:0/2916388814 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f700c162940 con 0x7f700c0c7ec0 2024-09-19T06:37:31.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.286+0000 7f70017fa640 1 -- 172.21.15.86:0/2916388814 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc037040 con 0x7f700c0c7ec0 2024-09-19T06:37:31.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.287+0000 7ff11e7fc640 1 -- 172.21.15.86:0/354892833 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff11801f020 con 0x7ff1200dcd90 2024-09-19T06:37:31.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.287+0000 7f30371d8640 1 -- 172.21.15.86:0/3357610102 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30280e6180 con 0x7f3020004800 2024-09-19T06:37:31.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.287+0000 7f7012cf1640 1 -- 172.21.15.86:0/2916388814 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f700c0c7980 con 0x7f700c0c7ec0 2024-09-19T06:37:31.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.288+0000 7f302d7fa640 1 -- 172.21.15.86:0/3357610102 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f301c017070 con 0x7f3020004800 2024-09-19T06:37:31.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.289+0000 7f1fce7fc640 1 -- 172.21.15.86:0/2429098450 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1fd0045a70 con 0x7f1fd00d8060 2024-09-19T06:37:31.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.289+0000 7f70017fa640 1 -- 172.21.15.86:0/2916388814 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6ffc03a070 con 0x7f700c0c7ec0 2024-09-19T06:37:31.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.289+0000 7fd053fff640 1 -- 172.21.15.86:0/4265089287 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd060059610 con 0x7fd0640d8760 2024-09-19T06:37:31.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.289+0000 7f302d7fa640 1 --2- 172.21.15.86:0/3357610102 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f301406c6e0 0x7f301406eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.289+0000 7f302ffff640 1 --2- 172.21.15.86:0/3357610102 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f301406c6e0 0x7f301406eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.289+0000 7f70017fa640 1 --2- 172.21.15.86:0/2916388814 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6ff806c4b0 0x7f6ff806e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.289+0000 7f70017fa640 1 -- 172.21.15.86:0/2916388814 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6ffc0aba00 con 0x7f700c0c7ec0 2024-09-19T06:37:31.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.290+0000 7f7010a8d640 1 --2- 172.21.15.86:0/2916388814 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6ff806c4b0 0x7f6ff806e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.290+0000 7f302d7fa640 1 -- 172.21.15.86:0/3357610102 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f301c010670 con 0x7f3020004800 2024-09-19T06:37:31.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.290+0000 7fe9d5ffb640 1 -- 172.21.15.86:0/70166008 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe9dc0133d0 con 0x7fe9e0151e80 2024-09-19T06:37:31.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.291+0000 7f302ffff640 1 --2- 172.21.15.86:0/3357610102 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f301406c6e0 0x7f301406eba0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3024032000 tx=0x7f3024009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.291+0000 7f7010a8d640 1 --2- 172.21.15.86:0/2916388814 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6ff806c4b0 0x7f6ff806e970 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7008000f60 tx=0x7f7008009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.291+0000 7fe9d5ffb640 1 --2- 172.21.15.86:0/70166008 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe9c406c3b0 0x7fe9c406e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.291+0000 7fe9d5ffb640 1 -- 172.21.15.86:0/70166008 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe9dc08b640 con 0x7fe9e0151e80 2024-09-19T06:37:31.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.291+0000 7fe9e5122640 1 --2- 172.21.15.86:0/70166008 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe9c406c3b0 0x7fe9c406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.292+0000 7fe9e5122640 1 --2- 172.21.15.86:0/70166008 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe9c406c3b0 0x7fe9c406e870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0033000 tx=0x7fe9d0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.292+0000 7f70017fa640 1 -- 172.21.15.86:0/2916388814 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6ffc04a030 con 0x7f700c0c7ec0 2024-09-19T06:37:31.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.294+0000 7fe9d5ffb640 1 -- 172.21.15.86:0/70166008 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe9e00c8d80 con 0x7fe9e0151e80 2024-09-19T06:37:31.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.296+0000 7f1743fff640 1 -- 172.21.15.86:0/2334947780 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f174404b030 con 0x7f1750050770 2024-09-19T06:37:31.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.297+0000 7f302d7fa640 1 -- 172.21.15.86:0/3357610102 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f301c058d10 con 0x7f3020004800 2024-09-19T06:37:31.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.666+0000 7fe32a6b7640 1 -- 172.21.15.86:0/618592663 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fe324159aa0 con 0x7fe324161300 2024-09-19T06:37:31.668 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.667+0000 7fe320ff9640 1 -- 172.21.15.86:0/618592663 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe31c059410 con 0x7fe324161300 2024-09-19T06:37:31.668 INFO:teuthology.orchestra.run.smithi086.stdout:64424509449 2024-09-19T06:37:31.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.670+0000 7fe30a7fc640 1 -- 172.21.15.86:0/618592663 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe31006c2e0 msgr2=0x7fe31006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.670+0000 7fe30a7fc640 1 --2- 172.21.15.86:0/618592663 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe31006c2e0 0x7fe31006e7a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe318009d20 tx=0x7fe31802e000 comp rx=0 tx=0).stop 2024-09-19T06:37:31.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.671+0000 7fe30a7fc640 1 -- 172.21.15.86:0/618592663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe324161300 msgr2=0x7fe3241617b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.671+0000 7fe30a7fc640 1 --2- 172.21.15.86:0/618592663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe324161300 0x7fe3241617b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe32406dee0 tx=0x7fe31c008c00 comp rx=0 tx=0).stop 2024-09-19T06:37:31.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.671+0000 7fe30a7fc640 1 -- 172.21.15.86:0/618592663 shutdown_connections 2024-09-19T06:37:31.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.671+0000 7fe30a7fc640 1 --2- 172.21.15.86:0/618592663 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe31006c2e0 0x7fe31006e7a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.671+0000 7fe30a7fc640 1 --2- 172.21.15.86:0/618592663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe324161300 0x7fe3241617b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.671+0000 7fe30a7fc640 1 --2- 172.21.15.86:0/618592663 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3241562a0 0x7fe32415a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.671+0000 7fe30a7fc640 1 --2- 172.21.15.86:0/618592663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe30c003b70 0x7fe3240cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.671+0000 7fe30a7fc640 1 -- 172.21.15.86:0/618592663 >> 172.21.15.86:0/618592663 conn(0x7fe32406e820 msgr2=0x7fe324152e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.671+0000 7fe30a7fc640 1 -- 172.21.15.86:0/618592663 shutdown_connections 2024-09-19T06:37:31.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.671+0000 7fe30a7fc640 1 -- 172.21.15.86:0/618592663 wait complete. 2024-09-19T06:37:31.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.5 2024-09-19T06:37:31.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.692+0000 7f30371d8640 1 -- 172.21.15.86:0/3357610102 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f302804b9b0 con 0x7f3020004800 2024-09-19T06:37:31.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.692+0000 7f302d7fa640 1 -- 172.21.15.86:0/3357610102 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f301c05d010 con 0x7f3020004800 2024-09-19T06:37:31.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.693+0000 7fd06bfff640 1 -- 172.21.15.86:0/4265089287 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd04c005580 con 0x7fd0640d8760 2024-09-19T06:37:31.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.693+0000 7f1fde87b640 1 -- 172.21.15.86:0/2429098450 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f1fd00e2c70 con 0x7f1fd00d8060 2024-09-19T06:37:31.695 INFO:teuthology.orchestra.run.smithi086.stdout:60129542151 2024-09-19T06:37:31.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.693+0000 7fd053fff640 1 -- 172.21.15.86:0/4265089287 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd06005d910 con 0x7fd0640d8760 2024-09-19T06:37:31.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.693+0000 7f1fce7fc640 1 -- 172.21.15.86:0/2429098450 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1fd4038040 con 0x7f1fd00d8060 2024-09-19T06:37:31.695 INFO:teuthology.orchestra.run.smithi086.stdout:60129542152 2024-09-19T06:37:31.696 INFO:teuthology.orchestra.run.smithi086.stdout:60129542152 2024-09-19T06:37:31.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.695+0000 7f30371d8640 1 -- 172.21.15.86:0/3357610102 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f301406c6e0 msgr2=0x7f301406eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.695+0000 7f30371d8640 1 --2- 172.21.15.86:0/3357610102 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f301406c6e0 0x7f301406eba0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3024032000 tx=0x7f3024009030 comp rx=0 tx=0).stop 2024-09-19T06:37:31.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.695+0000 7f7012cf1640 1 -- 172.21.15.86:0/2916388814 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f700c071520 con 0x7f700c0c7ec0 2024-09-19T06:37:31.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.695+0000 7f30371d8640 1 -- 172.21.15.86:0/3357610102 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3020004800 msgr2=0x7f30280e5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.695+0000 7f30371d8640 1 --2- 172.21.15.86:0/3357610102 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3020004800 0x7f30280e5640 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f301c00b500 tx=0x7f301c00b9c0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.696+0000 7f30371d8640 1 -- 172.21.15.86:0/3357610102 shutdown_connections 2024-09-19T06:37:31.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.696+0000 7f30371d8640 1 --2- 172.21.15.86:0/3357610102 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f301406c6e0 0x7f301406eba0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.696+0000 7f30371d8640 1 --2- 172.21.15.86:0/3357610102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30280df8c0 0x7f30280d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.696+0000 7f30371d8640 1 --2- 172.21.15.86:0/3357610102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30280e1cb0 0x7f30280d8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.696+0000 7f30371d8640 1 --2- 172.21.15.86:0/3357610102 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3020004800 0x7f30280e5640 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.696+0000 7f30371d8640 1 -- 172.21.15.86:0/3357610102 >> 172.21.15.86:0/3357610102 conn(0x7f302804fc80 msgr2=0x7f3028006a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.696+0000 7f30371d8640 1 -- 172.21.15.86:0/3357610102 shutdown_connections 2024-09-19T06:37:31.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.696+0000 7f30371d8640 1 -- 172.21.15.86:0/3357610102 wait complete. 2024-09-19T06:37:31.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.696+0000 7f70017fa640 1 -- 172.21.15.86:0/2916388814 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6ffc041030 con 0x7f700c0c7ec0 2024-09-19T06:37:31.701 INFO:teuthology.orchestra.run.smithi086.stdout:64424509449 2024-09-19T06:37:31.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.697+0000 7f1fde87b640 1 -- 172.21.15.86:0/2429098450 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1fbc06c4a0 msgr2=0x7f1fbc06e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.697+0000 7f1fde87b640 1 --2- 172.21.15.86:0/2429098450 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1fbc06c4a0 0x7f1fbc06e960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1fd807cdc0 tx=0x7f1fd808f040 comp rx=0 tx=0).stop 2024-09-19T06:37:31.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.697+0000 7fd06bfff640 1 -- 172.21.15.86:0/4265089287 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd05806c2b0 msgr2=0x7fd05806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.697+0000 7fd06bfff640 1 --2- 172.21.15.86:0/4265089287 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd05806c2b0 0x7fd05806e770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd05c034000 tx=0x7fd05c040040 comp rx=0 tx=0).stop 2024-09-19T06:37:31.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.697+0000 7fd06bfff640 1 -- 172.21.15.86:0/4265089287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0640d8760 msgr2=0x7fd064009fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.697+0000 7fd06bfff640 1 --2- 172.21.15.86:0/4265089287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0640d8760 0x7fd064009fe0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd06000e870 tx=0x7fd06000ed30 comp rx=0 tx=0).stop 2024-09-19T06:37:31.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.697+0000 7fd06bfff640 1 -- 172.21.15.86:0/4265089287 shutdown_connections 2024-09-19T06:37:31.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.697+0000 7fd06bfff640 1 --2- 172.21.15.86:0/4265089287 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd05806c2b0 0x7fd05806e770 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.697+0000 7fd06bfff640 1 --2- 172.21.15.86:0/4265089287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0640d8b40 0x7fd06404b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.697+0000 7fd06bfff640 1 --2- 172.21.15.86:0/4265089287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0640d8760 0x7fd064009fe0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.697+0000 7fd06bfff640 1 --2- 172.21.15.86:0/4265089287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd06404d9d0 0x7fd0640d7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.697+0000 7fd06bfff640 1 -- 172.21.15.86:0/4265089287 >> 172.21.15.86:0/4265089287 conn(0x7fd06400e290 msgr2=0x7fd064047640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.697+0000 7f1fde87b640 1 -- 172.21.15.86:0/2429098450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fd00d8060 msgr2=0x7f1fd00d84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.697+0000 7f1fde87b640 1 --2- 172.21.15.86:0/2429098450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fd00d8060 0x7f1fd00d84e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1fd000d9e0 tx=0x7f1fd40013c0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.697+0000 7f1fde87b640 1 -- 172.21.15.86:0/2429098450 shutdown_connections 2024-09-19T06:37:31.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.697+0000 7f1fde87b640 1 --2- 172.21.15.86:0/2429098450 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1fbc06c4a0 0x7f1fbc06e960 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.697+0000 7f1fde87b640 1 --2- 172.21.15.86:0/2429098450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fd00d8060 0x7f1fd00d84e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.697+0000 7f1fde87b640 1 --2- 172.21.15.86:0/2429098450 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fd004d180 0x7f1fd00e4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.697+0000 7f1fde87b640 1 --2- 172.21.15.86:0/2429098450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fc40051c0 0x7f1fd004ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.697+0000 7f1fde87b640 1 -- 172.21.15.86:0/2429098450 >> 172.21.15.86:0/2429098450 conn(0x7f1fd004fc50 msgr2=0x7f1fd00db1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.697+0000 7fd06bfff640 1 -- 172.21.15.86:0/4265089287 shutdown_connections 2024-09-19T06:37:31.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.697+0000 7fd06bfff640 1 -- 172.21.15.86:0/4265089287 wait complete. 2024-09-19T06:37:31.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.697+0000 7f1fde87b640 1 -- 172.21.15.86:0/2429098450 shutdown_connections 2024-09-19T06:37:31.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.697+0000 7f1fde87b640 1 -- 172.21.15.86:0/2429098450 wait complete. 2024-09-19T06:37:31.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.699+0000 7fe9e6124640 1 -- 172.21.15.86:0/70166008 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe9e0158ff0 con 0x7fe9e0151e80 2024-09-19T06:37:31.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.699+0000 7ff12fd5f640 1 -- 172.21.15.86:0/354892833 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ff120006400 con 0x7ff1200dcd90 2024-09-19T06:37:31.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.699+0000 7fe9d5ffb640 1 -- 172.21.15.86:0/70166008 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe9dc059ae0 con 0x7fe9e0151e80 2024-09-19T06:37:31.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.699+0000 7ff11e7fc640 1 -- 172.21.15.86:0/354892833 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff118059a70 con 0x7ff1200dcd90 2024-09-19T06:37:31.706 INFO:teuthology.orchestra.run.smithi086.stdout:60129542151 2024-09-19T06:37:31.707 INFO:teuthology.orchestra.run.smithi086.stdout:55834574857 2024-09-19T06:37:31.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.699+0000 7f7012cf1640 1 -- 172.21.15.86:0/2916388814 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6ff806c4b0 msgr2=0x7f6ff806e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.699+0000 7f7012cf1640 1 --2- 172.21.15.86:0/2916388814 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6ff806c4b0 0x7f6ff806e970 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7008000f60 tx=0x7f7008009040 comp rx=0 tx=0).stop 2024-09-19T06:37:31.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.700+0000 7f7012cf1640 1 -- 172.21.15.86:0/2916388814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f700c0c7ec0 msgr2=0x7f700c1f86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.700+0000 7f7012cf1640 1 --2- 172.21.15.86:0/2916388814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f700c0c7ec0 0x7f700c1f86a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc031000 tx=0x7f6ffc0046c0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.700+0000 7f7012cf1640 1 -- 172.21.15.86:0/2916388814 shutdown_connections 2024-09-19T06:37:31.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.700+0000 7f7012cf1640 1 --2- 172.21.15.86:0/2916388814 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6ff806c4b0 0x7f6ff806e970 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.700+0000 7f7012cf1640 1 --2- 172.21.15.86:0/2916388814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f700c1593e0 0x7f700c14d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.700+0000 7f7012cf1640 1 --2- 172.21.15.86:0/2916388814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f700c0c7ec0 0x7f700c1f86a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.700+0000 7f7012cf1640 1 --2- 172.21.15.86:0/2916388814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f700c070f40 0x7f700c0cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.700+0000 7f7012cf1640 1 -- 172.21.15.86:0/2916388814 >> 172.21.15.86:0/2916388814 conn(0x7f700c06e820 msgr2=0x7f700c14f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.700+0000 7f7012cf1640 1 -- 172.21.15.86:0/2916388814 shutdown_connections 2024-09-19T06:37:31.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.700+0000 7f7012cf1640 1 -- 172.21.15.86:0/2916388814 wait complete. 2024-09-19T06:37:31.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.703+0000 7ff12fd5f640 1 -- 172.21.15.86:0/354892833 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff10c06c380 msgr2=0x7ff10c06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.703+0000 7ff12fd5f640 1 --2- 172.21.15.86:0/354892833 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff10c06c380 0x7ff10c06e840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff124034000 tx=0x7ff12402c000 comp rx=0 tx=0).stop 2024-09-19T06:37:31.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.703+0000 7f175dd66640 1 -- 172.21.15.86:0/2334947780 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1738005850 con 0x7f1750050770 2024-09-19T06:37:31.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.703+0000 7ff12fd5f640 1 -- 172.21.15.86:0/354892833 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1200dcd90 msgr2=0x7ff12016f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.703+0000 7ff12fd5f640 1 --2- 172.21.15.86:0/354892833 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1200dcd90 0x7ff12016f5a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff11800b3f0 tx=0x7ff11800b8b0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.703+0000 7fe9e6124640 1 -- 172.21.15.86:0/70166008 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe9c406c3b0 msgr2=0x7fe9c406e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.703+0000 7fe9e6124640 1 --2- 172.21.15.86:0/70166008 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe9c406c3b0 0x7fe9c406e870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0033000 tx=0x7fe9d0008030 comp rx=0 tx=0).stop 2024-09-19T06:37:31.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.703+0000 7fe9e6124640 1 -- 172.21.15.86:0/70166008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9e0151e80 msgr2=0x7fe9e0152330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.703+0000 7fe9e6124640 1 --2- 172.21.15.86:0/70166008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9e0151e80 0x7fe9e0152330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe9e006f310 tx=0x7fe9dc00d810 comp rx=0 tx=0).stop 2024-09-19T06:37:31.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.703+0000 7fe9e6124640 1 -- 172.21.15.86:0/70166008 shutdown_connections 2024-09-19T06:37:31.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.703+0000 7fe9e6124640 1 --2- 172.21.15.86:0/70166008 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe9c406c3b0 0x7fe9c406e870 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.703+0000 7fe9e6124640 1 --2- 172.21.15.86:0/70166008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9e0151e80 0x7fe9e0152330 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.703+0000 7fe9e6124640 1 --2- 172.21.15.86:0/70166008 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9e0148720 0x7fe9e01f7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.703+0000 7fe9e6124640 1 --2- 172.21.15.86:0/70166008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9cc003a00 0x7fe9e01fe3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.703+0000 7ff12fd5f640 1 -- 172.21.15.86:0/354892833 shutdown_connections 2024-09-19T06:37:31.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.703+0000 7ff12fd5f640 1 --2- 172.21.15.86:0/354892833 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff10c06c380 0x7ff10c06e840 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.703+0000 7ff12fd5f640 1 --2- 172.21.15.86:0/354892833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1200e5f30 0x7ff120178990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.703+0000 7ff12fd5f640 1 --2- 172.21.15.86:0/354892833 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1200dcd90 0x7ff12016f5a0 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff11800b3f0 tx=0x7ff11800b8b0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.703+0000 7ff12fd5f640 1 --2- 172.21.15.86:0/354892833 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff12004a680 0x7ff1200d4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.703+0000 7ff12fd5f640 1 -- 172.21.15.86:0/354892833 >> 172.21.15.86:0/354892833 conn(0x7ff12004fc50 msgr2=0x7ff120004a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.703+0000 7fe9e6124640 1 -- 172.21.15.86:0/70166008 >> 172.21.15.86:0/70166008 conn(0x7fe9e006bda0 msgr2=0x7fe9e00c53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.703+0000 7fe9e6124640 1 -- 172.21.15.86:0/70166008 shutdown_connections 2024-09-19T06:37:31.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.703+0000 7fe9e6124640 1 -- 172.21.15.86:0/70166008 wait complete. 2024-09-19T06:37:31.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.704+0000 7f1743fff640 1 -- 172.21.15.86:0/2334947780 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f174404b030 con 0x7f1750050770 2024-09-19T06:37:31.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.704+0000 7ff12fd5f640 1 -- 172.21.15.86:0/354892833 shutdown_connections 2024-09-19T06:37:31.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.704+0000 7ff12fd5f640 1 -- 172.21.15.86:0/354892833 wait complete. 2024-09-19T06:37:31.713 INFO:teuthology.orchestra.run.smithi086.stdout:64424509448 2024-09-19T06:37:31.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.709+0000 7f175dd66640 1 -- 172.21.15.86:0/2334947780 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f173c06c2e0 msgr2=0x7f173c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.709+0000 7f175dd66640 1 --2- 172.21.15.86:0/2334947780 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f173c06c2e0 0x7f173c06e7a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f174c003cc0 tx=0x7f174c0079b0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.709+0000 7f175dd66640 1 -- 172.21.15.86:0/2334947780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1750050770 msgr2=0x7f17500cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.709+0000 7f175dd66640 1 --2- 172.21.15.86:0/2334947780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1750050770 0x7f17500cdc20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f17440098a0 tx=0x7f17440046c0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.709+0000 7f175dd66640 1 -- 172.21.15.86:0/2334947780 shutdown_connections 2024-09-19T06:37:31.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.709+0000 7f175dd66640 1 --2- 172.21.15.86:0/2334947780 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f173c06c2e0 0x7f173c06e7a0 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f174c003cc0 tx=0x7f174c0079b0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.709+0000 7f175dd66640 1 --2- 172.21.15.86:0/2334947780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17500d45f0 0x7f175004dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.709+0000 7f175dd66640 1 --2- 172.21.15.86:0/2334947780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1750050770 0x7f17500cdc20 secure :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f17440098a0 tx=0x7f17440046c0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.709+0000 7f175dd66640 1 --2- 172.21.15.86:0/2334947780 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1750005a00 0x7f17500cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.709+0000 7f175dd66640 1 -- 172.21.15.86:0/2334947780 >> 172.21.15.86:0/2334947780 conn(0x7f175004fc50 msgr2=0x7f17500cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.709+0000 7f175dd66640 1 -- 172.21.15.86:0/2334947780 shutdown_connections 2024-09-19T06:37:31.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:31.709+0000 7f175dd66640 1 -- 172.21.15.86:0/2334947780 wait complete. 2024-09-19T06:37:31.720 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.7 2024-09-19T06:37:31.721 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.4 2024-09-19T06:37:31.721 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542151 for osd.1 2024-09-19T06:37:31.722 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542152 for osd.3 2024-09-19T06:37:31.726 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.6 2024-09-19T06:37:31.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.2 2024-09-19T06:37:31.728 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.0 2024-09-19T06:37:32.691 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-19T06:37:32.721 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-19T06:37:32.722 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-19T06:37:32.723 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-19T06:37:32.723 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-19T06:37:32.727 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-19T06:37:32.728 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-19T06:37:32.728 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-19T06:37:32.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.833+0000 7f62cd7bc640 1 Processor -- start 2024-09-19T06:37:32.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.833+0000 7f62cd7bc640 1 -- start start 2024-09-19T06:37:32.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.834+0000 7f62cd7bc640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f62c8159410 0x7f62c806f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.834+0000 7f62cd7bc640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f62c806f550 0x7f62c806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.834+0000 7f62cd7bc640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62c815f3c0 con 0x7f62c80c8a40 2024-09-19T06:37:32.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.834+0000 7f62cd7bc640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f62c815f6a0 con 0x7f62c806f550 2024-09-19T06:37:32.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.834+0000 7f62cd7bc640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f62c815f980 con 0x7f62c8159410 2024-09-19T06:37:32.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.835+0000 7f62ccfbb640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f62c80c8a40 0x7f62c80c4bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:35146/0 (socket says 172.21.15.86:35146) 2024-09-19T06:37:32.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.835+0000 7f62ccfbb640 1 -- 172.21.15.86:0/1871659654 learned_addr learned my addr 172.21.15.86:0/1871659654 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:32.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.835+0000 7f62c77fe640 1 --2- 172.21.15.86:0/1871659654 >> v2:172.21.15.86:3300/0 conn(0x7f62c806f550 0x7f62c806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.835+0000 7f62c77fe640 1 -- 172.21.15.86:0/1871659654 >> v2:172.21.15.169:3300/0 conn(0x7f62c8159410 msgr2=0x7f62c806f010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:37:32.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.835+0000 7f62c77fe640 1 --2- 172.21.15.86:0/1871659654 >> v2:172.21.15.169:3300/0 conn(0x7f62c8159410 0x7f62c806f010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.835+0000 7f62c77fe640 1 -- 172.21.15.86:0/1871659654 >> v1:172.21.15.86:6789/0 conn(0x7f62c80c8a40 legacy=0x7f62c80c4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.835+0000 7f62c77fe640 1 -- 172.21.15.86:0/1871659654 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c815fc60 con 0x7f62c806f550 2024-09-19T06:37:32.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.836+0000 7f62c77fe640 1 --2- 172.21.15.86:0/1871659654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62c806f550 0x7f62c806e0c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f62c8069770 tx=0x7f62b802a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e776b2fea732f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:32.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.837+0000 7f62c6ffd640 1 -- 172.21.15.86:0/1871659654 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b8037070 con 0x7f62c806f550 2024-09-19T06:37:32.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.837+0000 7f62c6ffd640 1 -- 172.21.15.86:0/1871659654 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62b802ade0 con 0x7f62c806f550 2024-09-19T06:37:32.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.838+0000 7f62cd7bc640 1 -- 172.21.15.86:0/1871659654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62c806f550 msgr2=0x7f62c806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.838+0000 7f62cd7bc640 1 --2- 172.21.15.86:0/1871659654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62c806f550 0x7f62c806e0c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f62c8069770 tx=0x7f62b802a150 comp rx=0 tx=0).stop 2024-09-19T06:37:32.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.838+0000 7f62cd7bc640 1 -- 172.21.15.86:0/1871659654 shutdown_connections 2024-09-19T06:37:32.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.838+0000 7f62cd7bc640 1 --2- 172.21.15.86:0/1871659654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62c806f550 0x7f62c806e0c0 secure :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f62c8069770 tx=0x7f62b802a150 comp rx=0 tx=0).stop 2024-09-19T06:37:32.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.838+0000 7f62cd7bc640 1 --2- 172.21.15.86:0/1871659654 >> v2:172.21.15.169:3300/0 conn(0x7f62c8159410 0x7f62c806f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.838+0000 7f62cd7bc640 1 -- 172.21.15.86:0/1871659654 >> 172.21.15.86:0/1871659654 conn(0x7f62c80cc450 msgr2=0x7f62c80cc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:32.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.839+0000 7f62cd7bc640 1 -- 172.21.15.86:0/1871659654 shutdown_connections 2024-09-19T06:37:32.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.839+0000 7f62cd7bc640 1 -- 172.21.15.86:0/1871659654 wait complete. 2024-09-19T06:37:32.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.840+0000 7f62cd7bc640 1 Processor -- start 2024-09-19T06:37:32.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.841+0000 7f62cd7bc640 1 -- start start 2024-09-19T06:37:32.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.842+0000 7f62cd7bc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62c80c8a40 0x7f62c8161f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.842+0000 7f62cd7bc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62c8159410 0x7f62c813e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.842+0000 7f62cd7bc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62c8162bd0 0x7f62c8163050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.842+0000 7f62ccfbb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62c8162bd0 0x7f62c8163050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.842+0000 7f62ccfbb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62c8162bd0 0x7f62c8163050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56626/0 (socket says 172.21.15.86:56626) 2024-09-19T06:37:32.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.842+0000 7f62c77fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62c8159410 0x7f62c813e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.842+0000 7f62ccfbb640 1 -- 172.21.15.86:0/787015133 learned_addr learned my addr 172.21.15.86:0/787015133 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:32.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.842+0000 7f62cd7bc640 1 -- 172.21.15.86:0/787015133 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f62c8159970 con 0x7f62c8162bd0 2024-09-19T06:37:32.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.842+0000 7f62cd7bc640 1 -- 172.21.15.86:0/787015133 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f62c81597f0 con 0x7f62c8159410 2024-09-19T06:37:32.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.842+0000 7f62cd7bc640 1 -- 172.21.15.86:0/787015133 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f62c80c52d0 con 0x7f62c80c8a40 2024-09-19T06:37:32.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.842+0000 7f62c7fff640 1 --2- 172.21.15.86:0/787015133 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62c80c8a40 0x7f62c8161f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.843+0000 7f62c77fe640 1 -- 172.21.15.86:0/787015133 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62c80c8a40 msgr2=0x7f62c8161f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.843+0000 7f62c77fe640 1 --2- 172.21.15.86:0/787015133 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62c80c8a40 0x7f62c8161f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.843+0000 7f62c77fe640 1 -- 172.21.15.86:0/787015133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62c8162bd0 msgr2=0x7f62c8163050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.843+0000 7f62c77fe640 1 --2- 172.21.15.86:0/787015133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62c8162bd0 0x7f62c8163050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.843+0000 7f62c77fe640 1 -- 172.21.15.86:0/787015133 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c8142910 con 0x7f62c8159410 2024-09-19T06:37:32.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.843+0000 7f62c77fe640 1 --2- 172.21.15.86:0/787015133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62c8159410 0x7f62c813e860 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f62b8031000 tx=0x7f62b8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:32.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.844+0000 7f62c4ff9640 1 -- 172.21.15.86:0/787015133 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b8037050 con 0x7f62c8159410 2024-09-19T06:37:32.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.844+0000 7f62ccfbb640 1 --2- 172.21.15.86:0/787015133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62c8162bd0 0x7f62c8163050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:32.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.844+0000 7f62cd7bc640 1 -- 172.21.15.86:0/787015133 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62c8143770 con 0x7f62c8159410 2024-09-19T06:37:32.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.844+0000 7f62cd7bc640 1 -- 172.21.15.86:0/787015133 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62c81607a0 con 0x7f62c8159410 2024-09-19T06:37:32.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.845+0000 7f62c4ff9640 1 -- 172.21.15.86:0/787015133 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62b8043070 con 0x7f62c8159410 2024-09-19T06:37:32.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.846+0000 7f62c4ff9640 1 -- 172.21.15.86:0/787015133 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b8030db0 con 0x7f62c8159410 2024-09-19T06:37:32.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.848+0000 7f62c4ff9640 1 -- 172.21.15.86:0/787015133 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f62b8048460 con 0x7f62c8159410 2024-09-19T06:37:32.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.849+0000 7f62c4ff9640 1 --2- 172.21.15.86:0/787015133 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f62b406c380 0x7f62b406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.850+0000 7f62c7fff640 1 --2- 172.21.15.86:0/787015133 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f62b406c380 0x7f62b406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.850+0000 7f62c4ff9640 1 -- 172.21.15.86:0/787015133 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f62b80ac120 con 0x7f62c8159410 2024-09-19T06:37:32.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.850+0000 7f62cd7bc640 1 -- 172.21.15.86:0/787015133 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62a8005290 con 0x7f62c8159410 2024-09-19T06:37:32.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.851+0000 7f62c7fff640 1 --2- 172.21.15.86:0/787015133 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f62b406c380 0x7f62b406e840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f62bc006fd0 tx=0x7f62bc009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:32.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.859+0000 7f62c4ff9640 1 -- 172.21.15.86:0/787015133 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f62b807a5c0 con 0x7f62c8159410 2024-09-19T06:37:32.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.897+0000 7f62b0f64640 1 Processor -- start 2024-09-19T06:37:32.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.897+0000 7f62b0f64640 1 -- start start 2024-09-19T06:37:32.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.899+0000 7f62b0f64640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62ac071160 0x7f62ac073d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.899+0000 7f62b0f64640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f62ac0c8a40 0x7f62ac06f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.899+0000 7f62b0f64640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62ac168050 con 0x7f62ac06e0c0 2024-09-19T06:37:32.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.899+0000 7f62b0f64640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f62ac168980 con 0x7f62ac0c8a40 2024-09-19T06:37:32.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.899+0000 7f62b0f64640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f62ac168330 con 0x7f62ac071160 2024-09-19T06:37:32.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.899+0000 7f62ab7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62ac071160 0x7f62ac073d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.899+0000 7f62ab7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62ac071160 0x7f62ac073d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:58412/0 (socket says 172.21.15.86:58412) 2024-09-19T06:37:32.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.899+0000 7f62ab7fe640 1 -- 172.21.15.86:0/1661641862 learned_addr learned my addr 172.21.15.86:0/1661641862 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:32.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.899+0000 7f62aaffd640 1 --2- 172.21.15.86:0/1661641862 >> v2:172.21.15.169:3300/0 conn(0x7f62ac0c8a40 0x7f62ac06f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.900+0000 7f62ab7fe640 1 -- 172.21.15.86:0/1661641862 >> v2:172.21.15.169:3300/0 conn(0x7f62ac0c8a40 msgr2=0x7f62ac06f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:32.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.900+0000 7f62aa7fc640 1 -- 172.21.15.86:0/1661641862 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1653628035 0 0) 0x7f62ac168050 con 0x7f62ac06e0c0 2024-09-19T06:37:32.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.900+0000 7f62ab7fe640 1 --2- 172.21.15.86:0/1661641862 >> v2:172.21.15.169:3300/0 conn(0x7f62ac0c8a40 0x7f62ac06f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.900+0000 7f62ab7fe640 1 -- 172.21.15.86:0/1661641862 >> v1:172.21.15.169:6789/0 conn(0x7f62ac06e0c0 legacy=0x7f62ac0c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.900+0000 7f62ab7fe640 1 -- 172.21.15.86:0/1661641862 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62ac168610 con 0x7f62ac071160 2024-09-19T06:37:32.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.902+0000 7fe99b6af640 1 Processor -- start 2024-09-19T06:37:32.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.902+0000 7f1799a01640 1 Processor -- start 2024-09-19T06:37:32.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.903+0000 7f6999ed9640 1 Processor -- start 2024-09-19T06:37:32.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.903+0000 7f62ab7fe640 1 --2- 172.21.15.86:0/1661641862 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62ac071160 0x7f62ac073d90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009870 tx=0x7f62a002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebf638aa342f2350 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:32.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.902+0000 7fe99b6af640 1 -- start start 2024-09-19T06:37:32.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7fe99b6af640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9940c8450 0x7fe994157b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.902+0000 7f1799a01640 1 -- start start 2024-09-19T06:37:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f1799a01640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f17941594f0 0x7f179415f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f1799a01640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1794071740 0x7f1794071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f1799a01640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17940c7770 con 0x7f17940c6f30 2024-09-19T06:37:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f1799a01640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f17940712b0 con 0x7f17941594f0 2024-09-19T06:37:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f1799a01640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f17940c7a50 con 0x7f1794071740 2024-09-19T06:37:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.902+0000 7f2997c53640 1 Processor -- start 2024-09-19T06:37:32.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.903+0000 7f8e04726640 1 Processor -- start 2024-09-19T06:37:32.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.903+0000 7f8e04726640 1 -- start start 2024-09-19T06:37:32.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7fe99b6af640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe9940c9da0 0x7fe9940c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7fe99b6af640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9940c7e30 con 0x7fe9940c8830 2024-09-19T06:37:32.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7fe99b6af640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe994071200 con 0x7fe9940c9da0 2024-09-19T06:37:32.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7fe99b6af640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe9941580a0 con 0x7fe9940c8450 2024-09-19T06:37:32.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.903+0000 7f6999ed9640 1 -- start start 2024-09-19T06:37:32.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f6999ed9640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6994162b20 0x7f6994162fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f6999ed9640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69940b31f0 con 0x7f69940c81f0 2024-09-19T06:37:32.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f6999ed9640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69940c1e90 con 0x7f6994159ae0 2024-09-19T06:37:32.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.902+0000 7f2997c53640 1 -- start start 2024-09-19T06:37:32.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f6999ed9640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f699406d8b0 con 0x7f6994162b20 2024-09-19T06:37:32.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f2997c53640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29901553a0 0x7f29900cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f2997c53640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f299015e6f0 0x7f29900d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f2997c53640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f29900d0ff0 0x7f29900c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f2997c53640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f299015ec50 con 0x7f29900d0ff0 2024-09-19T06:37:32.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f2997c53640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f299015ef30 con 0x7f299015e6f0 2024-09-19T06:37:32.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f2997c53640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f299015f210 con 0x7f29901553a0 2024-09-19T06:37:32.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7fe99944b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9940c8450 0x7fe994157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f17937fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1794071740 0x7f1794071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f17927fc640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f17940c6f30 0x7f17940c8310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:38332/0 (socket says 172.21.15.86:38332) 2024-09-19T06:37:32.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f17937fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1794071740 0x7f1794071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:40996/0 (socket says 172.21.15.86:40996) 2024-09-19T06:37:32.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f17937fe640 1 -- 172.21.15.86:0/1197579387 learned_addr learned my addr 172.21.15.86:0/1197579387 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:32.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f29951ee640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f299015e6f0 0x7f29900d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f29959ef640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29901553a0 0x7f29900cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f1792ffd640 1 --2- 172.21.15.86:0/1197579387 >> v2:172.21.15.86:3300/0 conn(0x7f17941594f0 0x7f179415f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f29951ee640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f299015e6f0 0x7f29900d0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:40984/0 (socket says 172.21.15.86:40984) 2024-09-19T06:37:32.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f29951ee640 1 -- 172.21.15.86:0/2045293181 learned_addr learned my addr 172.21.15.86:0/2045293181 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:32.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.903+0000 7f62aa7fc640 1 -- 172.21.15.86:0/1661641862 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a0037070 con 0x7f62ac071160 2024-09-19T06:37:32.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.903+0000 7f62aa7fc640 1 -- 172.21.15.86:0/1661641862 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a0032440 con 0x7f62ac071160 2024-09-19T06:37:32.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.903+0000 7f62aa7fc640 1 -- 172.21.15.86:0/1661641862 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a0032810 con 0x7f62ac071160 2024-09-19T06:37:32.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f62b0f64640 1 -- 172.21.15.86:0/1661641862 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62ac071160 msgr2=0x7f62ac073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f62b0f64640 1 --2- 172.21.15.86:0/1661641862 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62ac071160 0x7f62ac073d90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009870 tx=0x7f62a002a270 comp rx=0 tx=0).stop 2024-09-19T06:37:32.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f62b0f64640 1 -- 172.21.15.86:0/1661641862 shutdown_connections 2024-09-19T06:37:32.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f62b0f64640 1 --2- 172.21.15.86:0/1661641862 >> v2:172.21.15.169:3300/0 conn(0x7f62ac0c8a40 0x7f62ac06f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f62b0f64640 1 --2- 172.21.15.86:0/1661641862 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62ac071160 0x7f62ac073d90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f62b0f64640 1 -- 172.21.15.86:0/1661641862 >> 172.21.15.86:0/1661641862 conn(0x7f62ac0cc450 msgr2=0x7f62ac0cc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:32.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f8e04726640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8dfc072730 0x7f8dfc06bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f8e04726640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dfc0713a0 con 0x7f8dfc0c7a40 2024-09-19T06:37:32.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f8e04726640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dfc071680 con 0x7f8dfc0c7e20 2024-09-19T06:37:32.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7f8e04726640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8dfc071170 con 0x7f8dfc072730 2024-09-19T06:37:32.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7fe99944b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9940c8450 0x7fe994157b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:58416/0 (socket says 172.21.15.86:58416) 2024-09-19T06:37:32.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.904+0000 7fe99944b640 1 -- 172.21.15.86:0/3313203321 learned_addr learned my addr 172.21.15.86:0/3313203321 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:32.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7f69937fe640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f6994159ae0 0x7f69940b2ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:38334/0 (socket says 172.21.15.86:38334) 2024-09-19T06:37:32.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7f6992ffd640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f69940c81f0 0x7f699406dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:35174/0 (socket says 172.21.15.86:35174) 2024-09-19T06:37:32.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7f69937fe640 1 -- 172.21.15.86:0/642313527 learned_addr learned my addr 172.21.15.86:0/642313527 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:32.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7f62b0f64640 1 -- 172.21.15.86:0/1661641862 shutdown_connections 2024-09-19T06:37:32.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7f8e024c2640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f8dfc0c7a40 0x7f8dfc1632d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:35158/0 (socket says 172.21.15.86:35158) 2024-09-19T06:37:32.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7f8e024c2640 1 -- 172.21.15.86:0/2119316823 learned_addr learned my addr 172.21.15.86:0/2119316823 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:32.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7f6993fff640 1 --2- 172.21.15.86:0/642313527 >> v2:172.21.15.86:3300/0 conn(0x7f6994162b20 0x7f6994162fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7fd2df0ba640 1 Processor -- start 2024-09-19T06:37:32.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7f62b0f64640 1 -- 172.21.15.86:0/1661641862 wait complete. 2024-09-19T06:37:32.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7fd2df0ba640 1 -- start start 2024-09-19T06:37:32.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7fe99944b640 1 -- 172.21.15.86:0/3313203321 >> v2:172.21.15.169:3300/0 conn(0x7fe9940c9da0 msgr2=0x7fe9940c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:32.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7fe999c4c640 1 --2- 172.21.15.86:0/3313203321 >> v2:172.21.15.169:3300/0 conn(0x7fe9940c9da0 0x7fe9940c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7fe99944b640 1 --2- 172.21.15.86:0/3313203321 >> v2:172.21.15.169:3300/0 conn(0x7fe9940c9da0 0x7fe9940c8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7f69927fc640 1 -- 172.21.15.86:0/642313527 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2379640351 0 0) 0x7f69940c1e90 con 0x7f6994159ae0 2024-09-19T06:37:32.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7f69927fc640 1 -- 172.21.15.86:0/642313527 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f697c003520 con 0x7f6994159ae0 2024-09-19T06:37:32.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7fe99944b640 1 -- 172.21.15.86:0/3313203321 >> v1:172.21.15.86:6789/0 conn(0x7fe9940c8830 legacy=0x7fe99406cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7fe99944b640 1 -- 172.21.15.86:0/3313203321 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99406bbc0 con 0x7fe9940c8450 2024-09-19T06:37:32.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7f6993fff640 1 -- 172.21.15.86:0/642313527 >> v1:172.21.15.169:6789/0 conn(0x7f6994159ae0 legacy=0x7f69940b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7f6993fff640 1 -- 172.21.15.86:0/642313527 >> v1:172.21.15.86:6789/0 conn(0x7f69940c81f0 legacy=0x7f699406dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7f6993fff640 1 -- 172.21.15.86:0/642313527 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69940c86e0 con 0x7f6994162b20 2024-09-19T06:37:32.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7f29961f0640 1 --2- 172.21.15.86:0/2045293181 >> v2:172.21.15.86:3300/0 conn(0x7f29900d0ff0 0x7f29900c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7f29959ef640 1 -- 172.21.15.86:0/2045293181 >> v2:172.21.15.169:3300/0 conn(0x7f299015e6f0 msgr2=0x7f29900d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:32.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7f29959ef640 1 --2- 172.21.15.86:0/2045293181 >> v2:172.21.15.169:3300/0 conn(0x7f299015e6f0 0x7f29900d0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7f29959ef640 1 -- 172.21.15.86:0/2045293181 >> v2:172.21.15.86:3300/0 conn(0x7f29900d0ff0 msgr2=0x7f29900c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:32.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7f29959ef640 1 --2- 172.21.15.86:0/2045293181 >> v2:172.21.15.86:3300/0 conn(0x7f29900d0ff0 0x7f29900c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7f29959ef640 1 -- 172.21.15.86:0/2045293181 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f299015f4f0 con 0x7f29901553a0 2024-09-19T06:37:32.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.906+0000 7f8e01cc1640 1 --2- 172.21.15.86:0/2119316823 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8dfc072730 0x7f8dfc06bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.906+0000 7f8e014c0640 1 -- 172.21.15.86:0/2119316823 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 852247215 0 0) 0x7f8dfc071680 con 0x7f8dfc0c7e20 2024-09-19T06:37:32.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7f1792ffd640 1 -- 172.21.15.86:0/1197579387 >> v2:172.21.15.169:3300/0 conn(0x7f1794071740 msgr2=0x7f1794071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:32.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7f1792ffd640 1 --2- 172.21.15.86:0/1197579387 >> v2:172.21.15.169:3300/0 conn(0x7f1794071740 0x7f1794071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7f1792ffd640 1 -- 172.21.15.86:0/1197579387 >> v1:172.21.15.169:6789/0 conn(0x7f17940c6f30 legacy=0x7f17940c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.905+0000 7f1792ffd640 1 -- 172.21.15.86:0/1197579387 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17940c7d30 con 0x7f17941594f0 2024-09-19T06:37:32.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.906+0000 7f8e014c0640 1 -- 172.21.15.86:0/2119316823 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8de8003520 con 0x7f8dfc0c7e20 2024-09-19T06:37:32.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.906+0000 7f8e014c0640 1 -- 172.21.15.86:0/2119316823 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 864839965 0 0) 0x7f8de8003520 con 0x7f8dfc0c7e20 2024-09-19T06:37:32.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.906+0000 7f8e014c0640 1 -- 172.21.15.86:0/2119316823 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8dfc072730 msgr2=0x7f8dfc06bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:32.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.906+0000 7f8e014c0640 1 --2- 172.21.15.86:0/2119316823 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8dfc072730 0x7f8dfc06bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.906+0000 7f8e014c0640 1 -- 172.21.15.86:0/2119316823 >> v1:172.21.15.86:6789/0 conn(0x7f8dfc0c7a40 legacy=0x7f8dfc1632d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.906+0000 7f8e014c0640 1 -- 172.21.15.86:0/2119316823 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dfc071c50 con 0x7f8dfc0c7e20 2024-09-19T06:37:32.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.906+0000 7f8e014c0640 1 -- 172.21.15.86:0/2119316823 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f8df40019f0 con 0x7f8dfc0c7e20 2024-09-19T06:37:32.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.906+0000 7fd2df0ba640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2d004b6b0 0x7fd2d00e2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7f6993fff640 1 --2- 172.21.15.86:0/642313527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6994162b20 0x7f6994162fd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f698c009d90 tx=0x7f698c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5895cd91c38083ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:32.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7fd2df0ba640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2d004aa90 con 0x7fd2d00d8aa0 2024-09-19T06:37:32.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.906+0000 7f8e014c0640 1 -- 172.21.15.86:0/2119316823 >> v1:172.21.15.169:6789/0 conn(0x7f8dfc0c7e20 legacy=0x7f8dfc159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7f8e014c0640 1 --2- 172.21.15.86:0/2119316823 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8dfc072730 0x7f8de80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7f8e014c0640 1 --2- 172.21.15.86:0/2119316823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8de8003f80 0x7f8de8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7f8e014c0640 1 --2- 172.21.15.86:0/2119316823 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8de8004d40 0x7f8de80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7f8e014c0640 1 -- 172.21.15.86:0/2119316823 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8de800bb30 con 0x7f8de8003f80 2024-09-19T06:37:32.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7f8e014c0640 1 -- 172.21.15.86:0/2119316823 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8de800bce0 con 0x7f8de8004d40 2024-09-19T06:37:32.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7f8e014c0640 1 -- 172.21.15.86:0/2119316823 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8de800bee0 con 0x7f8dfc072730 2024-09-19T06:37:32.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7f8e024c2640 1 --2- 172.21.15.86:0/2119316823 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8dfc072730 0x7f8de80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7f29959ef640 1 --2- 172.21.15.86:0/2045293181 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29901553a0 0x7f29900cbaa0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f299008e790 tx=0x7f298c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=438fb2338fbb2949 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:32.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7f62b0f64640 1 Processor -- start 2024-09-19T06:37:32.927 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7fd2df0ba640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2d004ad30 con 0x7fd2d0005a00 2024-09-19T06:37:32.927 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7fd2dd657640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fd2d0005a00 0x7fd2d004bc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:38348/0 (socket says 172.21.15.86:38348) 2024-09-19T06:37:32.927 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7fd2dd657640 1 -- 172.21.15.86:0/1761916355 learned_addr learned my addr 172.21.15.86:0/1761916355 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:32.927 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7fd2df0ba640 1 -- 172.21.15.86:0/1761916355 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd2d004b010 con 0x7fd2d004b6b0 2024-09-19T06:37:32.928 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7f62b0f64640 1 -- start start 2024-09-19T06:37:32.928 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7fd2d7fff640 1 --2- 172.21.15.86:0/1761916355 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2d004b6b0 0x7fd2d00e2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.928 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7fe99944b640 1 --2- 172.21.15.86:0/3313203321 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9940c8450 0x7fe994157b60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009e50 tx=0x7fe98c02a7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88b0e0bc8623c3be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:32.928 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7f29949ed640 1 -- 172.21.15.86:0/2045293181 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f298c037070 con 0x7f29901553a0 2024-09-19T06:37:32.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7fd2d77fe640 1 -- 172.21.15.86:0/1761916355 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3393018540 0 0) 0x7fd2d004ad30 con 0x7fd2d0005a00 2024-09-19T06:37:32.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7fd2d77fe640 1 -- 172.21.15.86:0/1761916355 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2c8003520 con 0x7fd2d0005a00 2024-09-19T06:37:32.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7f29949ed640 1 -- 172.21.15.86:0/2045293181 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f298c032440 con 0x7f29901553a0 2024-09-19T06:37:32.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7f29949ed640 1 -- 172.21.15.86:0/2045293181 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f298c032810 con 0x7f29901553a0 2024-09-19T06:37:32.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7f8e024c2640 1 -- 172.21.15.86:0/2119316823 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8de8004d40 msgr2=0x7f8de80051c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:37:32.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7f8e024c2640 1 --2- 172.21.15.86:0/2119316823 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8de8004d40 0x7f8de80051c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7f8e024c2640 1 -- 172.21.15.86:0/2119316823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8de8003f80 msgr2=0x7f8de8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:32.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7f8e024c2640 1 --2- 172.21.15.86:0/2119316823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8de8003f80 0x7f8de8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7f8e024c2640 1 -- 172.21.15.86:0/2119316823 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de8003520 con 0x7f8dfc072730 2024-09-19T06:37:32.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7f69927fc640 1 -- 172.21.15.86:0/642313527 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c007740 con 0x7f6994162b20 2024-09-19T06:37:32.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7f1792ffd640 1 --2- 172.21.15.86:0/1197579387 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17941594f0 0x7f179415f240 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1794071430 tx=0x7f178802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c382be366b4860c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:32.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7fe98bfff640 1 -- 172.21.15.86:0/3313203321 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c036070 con 0x7fe9940c8450 2024-09-19T06:37:32.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7fe98bfff640 1 -- 172.21.15.86:0/3313203321 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe98c031600 con 0x7fe9940c8450 2024-09-19T06:37:32.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7fe98bfff640 1 -- 172.21.15.86:0/3313203321 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c0319d0 con 0x7fe9940c8450 2024-09-19T06:37:32.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7f62b0f64640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62ac06e0c0 0x7f62ac168f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7f62b0f64640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62ac071160 0x7f62ac209800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7f62b0f64640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62ac0c8a40 0x7f62ac209d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7f62b0f64640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f62ac0c44e0 con 0x7f62ac071160 2024-09-19T06:37:32.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7f62b0f64640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f62ac0c4360 con 0x7f62ac06e0c0 2024-09-19T06:37:32.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7f62b0f64640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f62ac0c4f60 con 0x7f62ac0c8a40 2024-09-19T06:37:32.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7fd2d77fe640 1 -- 172.21.15.86:0/1761916355 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 238002156 0 0) 0x7fd2c8003520 con 0x7fd2d0005a00 2024-09-19T06:37:32.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7fd2d77fe640 1 -- 172.21.15.86:0/1761916355 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2d004b6b0 msgr2=0x7fd2d00e2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:32.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7fd2d77fe640 1 --2- 172.21.15.86:0/1761916355 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2d004b6b0 0x7fd2d00e2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7fd2d77fe640 1 -- 172.21.15.86:0/1761916355 >> v1:172.21.15.86:6789/0 conn(0x7fd2d00d8aa0 legacy=0x7fd2d00df000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7fd2d77fe640 1 -- 172.21.15.86:0/1761916355 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d00e1c70 con 0x7fd2d0005a00 2024-09-19T06:37:32.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7fd2d77fe640 1 -- 172.21.15.86:0/1761916355 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7fd2d8050800 con 0x7fd2d0005a00 2024-09-19T06:37:32.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7fd2d77fe640 1 -- 172.21.15.86:0/1761916355 >> v1:172.21.15.169:6789/0 conn(0x7fd2d0005a00 legacy=0x7fd2d004bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7fd2d77fe640 1 --2- 172.21.15.86:0/1761916355 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2c80039b0 0x7fd2c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7fd2d77fe640 1 --2- 172.21.15.86:0/1761916355 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2c8004310 0x7fd2c8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7fd2d77fe640 1 --2- 172.21.15.86:0/1761916355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2c8004f20 0x7fd2c800b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7f69927fc640 1 -- 172.21.15.86:0/642313527 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f698c0078e0 con 0x7f6994162b20 2024-09-19T06:37:32.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.907+0000 7f69927fc640 1 -- 172.21.15.86:0/642313527 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c007c90 con 0x7f6994162b20 2024-09-19T06:37:32.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7f62abfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62ac0c8a40 0x7f62ac209d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7fd2d77fe640 1 -- 172.21.15.86:0/1761916355 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d004b010 con 0x7fd2c80039b0 2024-09-19T06:37:32.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7f62ab7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62ac06e0c0 0x7f62ac168f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7f62ab7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62ac06e0c0 0x7f62ac168f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:41016/0 (socket says 172.21.15.86:41016) 2024-09-19T06:37:32.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7f62ab7fe640 1 -- 172.21.15.86:0/520655213 learned_addr learned my addr 172.21.15.86:0/520655213 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:32.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7fd2d77fe640 1 -- 172.21.15.86:0/1761916355 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c800bef0 con 0x7fd2c8004f20 2024-09-19T06:37:32.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7fd2d77fe640 1 -- 172.21.15.86:0/1761916355 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd2c800c070 con 0x7fd2c8004310 2024-09-19T06:37:32.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7f2997c53640 1 -- 172.21.15.86:0/2045293181 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29901553a0 msgr2=0x7f29900cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7f2997c53640 1 --2- 172.21.15.86:0/2045293181 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29901553a0 0x7f29900cbaa0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f299008e790 tx=0x7f298c02a1a0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7f6999ed9640 1 -- 172.21.15.86:0/642313527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6994162b20 msgr2=0x7f6994162fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7f6999ed9640 1 --2- 172.21.15.86:0/642313527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6994162b20 0x7f6994162fd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f698c009d90 tx=0x7f698c02a710 comp rx=0 tx=0).stop 2024-09-19T06:37:32.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.908+0000 7fd2dd657640 1 --2- 172.21.15.86:0/1761916355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2c8004f20 0x7fd2c800b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7f6999ed9640 1 -- 172.21.15.86:0/642313527 shutdown_connections 2024-09-19T06:37:32.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7f6999ed9640 1 --2- 172.21.15.86:0/642313527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6994162b20 0x7f6994162fd0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7f6999ed9640 1 -- 172.21.15.86:0/642313527 >> 172.21.15.86:0/642313527 conn(0x7f699406eb60 msgr2=0x7f699406ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:32.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7f8e024c2640 1 --2- 172.21.15.86:0/2119316823 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8dfc072730 0x7f8de80039b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8dec007fd0 tx=0x7f8de8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79fda7c810326f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:32.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7f6999ed9640 1 -- 172.21.15.86:0/642313527 shutdown_connections 2024-09-19T06:37:32.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7fd2d7fff640 1 --2- 172.21.15.86:0/1761916355 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2c8004310 0x7fd2c8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7fd2dce56640 1 --2- 172.21.15.86:0/1761916355 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2c80039b0 0x7fd2c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7f2997c53640 1 -- 172.21.15.86:0/2045293181 shutdown_connections 2024-09-19T06:37:32.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7f2997c53640 1 --2- 172.21.15.86:0/2045293181 >> v2:172.21.15.86:3300/0 conn(0x7f29900d0ff0 0x7f29900c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7f2997c53640 1 --2- 172.21.15.86:0/2045293181 >> v2:172.21.15.169:3300/0 conn(0x7f299015e6f0 0x7f29900d0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7f2997c53640 1 --2- 172.21.15.86:0/2045293181 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29901553a0 0x7f29900cbaa0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7f2997c53640 1 -- 172.21.15.86:0/2045293181 >> 172.21.15.86:0/2045293181 conn(0x7f2990067890 msgr2=0x7f2990067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:32.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7fe99b6af640 1 -- 172.21.15.86:0/3313203321 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9940c8450 msgr2=0x7fe994157b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7fe99b6af640 1 --2- 172.21.15.86:0/3313203321 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9940c8450 0x7fe994157b60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009e50 tx=0x7fe98c02a7a0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7fe99b6af640 1 -- 172.21.15.86:0/3313203321 shutdown_connections 2024-09-19T06:37:32.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7fe99b6af640 1 --2- 172.21.15.86:0/3313203321 >> v2:172.21.15.169:3300/0 conn(0x7fe9940c9da0 0x7fe9940c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7fe99b6af640 1 --2- 172.21.15.86:0/3313203321 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9940c8450 0x7fe994157b60 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009e50 tx=0x7fe98c02a7a0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7fe99b6af640 1 -- 172.21.15.86:0/3313203321 >> 172.21.15.86:0/3313203321 conn(0x7fe9940c9280 msgr2=0x7fe9940c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:32.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7f8e014c0640 1 -- 172.21.15.86:0/2119316823 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec001460 con 0x7f8dfc072730 2024-09-19T06:37:32.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7f8e014c0640 1 -- 172.21.15.86:0/2119316823 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dec02e070 con 0x7f8dfc072730 2024-09-19T06:37:32.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7f8e014c0640 1 -- 172.21.15.86:0/2119316823 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec02ad70 con 0x7f8dfc072730 2024-09-19T06:37:32.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7f2997c53640 1 -- 172.21.15.86:0/2045293181 shutdown_connections 2024-09-19T06:37:32.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7f62abfff640 1 -- 172.21.15.86:0/520655213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62ac06e0c0 msgr2=0x7f62ac168f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7f62abfff640 1 --2- 172.21.15.86:0/520655213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62ac06e0c0 0x7f62ac168f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7f62abfff640 1 -- 172.21.15.86:0/520655213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62ac071160 msgr2=0x7f62ac209800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:37:32.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7fd2dd657640 1 -- 172.21.15.86:0/1761916355 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2c8004310 msgr2=0x7fd2c8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:32.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7fd2dd657640 1 --2- 172.21.15.86:0/1761916355 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2c8004310 0x7fd2c8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7fd2dd657640 1 -- 172.21.15.86:0/1761916355 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2c80039b0 msgr2=0x7fd2c8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:32.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7fd2dd657640 1 --2- 172.21.15.86:0/1761916355 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2c80039b0 0x7fd2c8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7fd2dd657640 1 -- 172.21.15.86:0/1761916355 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c8003520 con 0x7fd2c8004f20 2024-09-19T06:37:32.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7f1791ffb640 1 -- 172.21.15.86:0/1197579387 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1788037070 con 0x7f17941594f0 2024-09-19T06:37:32.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7fe99b6af640 1 -- 172.21.15.86:0/3313203321 shutdown_connections 2024-09-19T06:37:32.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7f1791ffb640 1 -- 172.21.15.86:0/1197579387 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1788032440 con 0x7f17941594f0 2024-09-19T06:37:32.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7f2997c53640 1 -- 172.21.15.86:0/2045293181 wait complete. 2024-09-19T06:37:32.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.909+0000 7f6999ed9640 1 -- 172.21.15.86:0/642313527 wait complete. 2024-09-19T06:37:32.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.910+0000 7f62aaffd640 1 --2- 172.21.15.86:0/520655213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62ac071160 0x7f62ac209800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.910+0000 7f62abfff640 1 --2- 172.21.15.86:0/520655213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62ac071160 0x7f62ac209800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.910+0000 7f62abfff640 1 -- 172.21.15.86:0/520655213 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62ac156f30 con 0x7f62ac0c8a40 2024-09-19T06:37:32.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.910+0000 7f62aaffd640 1 --2- 172.21.15.86:0/520655213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62ac071160 0x7f62ac209800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:32.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.910+0000 7fe99b6af640 1 -- 172.21.15.86:0/3313203321 wait complete. 2024-09-19T06:37:32.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.910+0000 7f8e04726640 1 -- 172.21.15.86:0/2119316823 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8dfc072730 msgr2=0x7f8de80039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.910+0000 7f8e04726640 1 --2- 172.21.15.86:0/2119316823 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8dfc072730 0x7f8de80039b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8dec007fd0 tx=0x7f8de8005830 comp rx=0 tx=0).stop 2024-09-19T06:37:32.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.910+0000 7fd2dd657640 1 --2- 172.21.15.86:0/1761916355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2c8004f20 0x7fd2c800b9b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd2d806ab20 tx=0x7fd2c8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c871a3a8979be64d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:32.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.910+0000 7f62abfff640 1 --2- 172.21.15.86:0/520655213 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62ac0c8a40 0x7f62ac209d40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f62a400c780 tx=0x7f62a400cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:32.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.910+0000 7fd2d77fe640 1 -- 172.21.15.86:0/1761916355 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d806dbe0 con 0x7fd2c8004f20 2024-09-19T06:37:32.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.910+0000 7f1791ffb640 1 -- 172.21.15.86:0/1197579387 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1788032850 con 0x7f17941594f0 2024-09-19T06:37:32.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.910+0000 7fd2d77fe640 1 -- 172.21.15.86:0/1761916355 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d80ac030 con 0x7fd2c8004f20 2024-09-19T06:37:32.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.910+0000 7fd2d77fe640 1 -- 172.21.15.86:0/1761916355 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8063290 con 0x7fd2c8004f20 2024-09-19T06:37:32.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.910+0000 7f8e02cc3640 1 -- 172.21.15.86:0/2119316823 reap_dead start 2024-09-19T06:37:32.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.910+0000 7f8e04726640 1 -- 172.21.15.86:0/2119316823 shutdown_connections 2024-09-19T06:37:32.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.910+0000 7f8e04726640 1 -- 172.21.15.86:0/2119316823 >> 172.21.15.86:0/2119316823 conn(0x7f8dfc0c9280 msgr2=0x7f8dfc0c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:32.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.910+0000 7f8e04726640 1 -- 172.21.15.86:0/2119316823 shutdown_connections 2024-09-19T06:37:32.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.911+0000 7f6999ed9640 1 Processor -- start 2024-09-19T06:37:32.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.911+0000 7f6293fff640 1 -- 172.21.15.86:0/520655213 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a4003b70 con 0x7f62ac0c8a40 2024-09-19T06:37:32.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.911+0000 7f6293fff640 1 -- 172.21.15.86:0/520655213 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a4003d30 con 0x7f62ac0c8a40 2024-09-19T06:37:32.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.911+0000 7f62b0f64640 1 -- 172.21.15.86:0/520655213 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62ac159580 con 0x7f62ac0c8a40 2024-09-19T06:37:32.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.911+0000 7f2997c53640 1 Processor -- start 2024-09-19T06:37:32.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.911+0000 7f1799a01640 1 -- 172.21.15.86:0/1197579387 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17941594f0 msgr2=0x7f179415f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.911+0000 7f62b0f64640 1 -- 172.21.15.86:0/520655213 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f62ac15bda0 con 0x7f62ac0c8a40 2024-09-19T06:37:32.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.911+0000 7f6293fff640 1 -- 172.21.15.86:0/520655213 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a40052b0 con 0x7f62ac0c8a40 2024-09-19T06:37:32.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.911+0000 7fd2df0ba640 1 -- 172.21.15.86:0/1761916355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2c8004f20 msgr2=0x7fd2c800b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.911+0000 7fd2df0ba640 1 --2- 172.21.15.86:0/1761916355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2c8004f20 0x7fd2c800b9b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd2d806ab20 tx=0x7fd2c8005830 comp rx=0 tx=0).stop 2024-09-19T06:37:32.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.912+0000 7fd2dd657640 1 -- 172.21.15.86:0/1761916355 reap_dead start 2024-09-19T06:37:32.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.911+0000 7f6999ed9640 1 -- start start 2024-09-19T06:37:32.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.912+0000 7fd2df0ba640 1 -- 172.21.15.86:0/1761916355 shutdown_connections 2024-09-19T06:37:32.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.912+0000 7fd2df0ba640 1 -- 172.21.15.86:0/1761916355 >> 172.21.15.86:0/1761916355 conn(0x7fd2d004fc50 msgr2=0x7fd2d0050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:32.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.911+0000 7f8e04726640 1 -- 172.21.15.86:0/2119316823 wait complete. 2024-09-19T06:37:32.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.912+0000 7fe99b6af640 1 Processor -- start 2024-09-19T06:37:32.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.911+0000 7f2997c53640 1 -- start start 2024-09-19T06:37:32.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.911+0000 7f1799a01640 1 --2- 172.21.15.86:0/1197579387 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17941594f0 0x7f179415f240 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1794071430 tx=0x7f178802a250 comp rx=0 tx=0).stop 2024-09-19T06:37:32.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.912+0000 7f1799a01640 1 -- 172.21.15.86:0/1197579387 shutdown_connections 2024-09-19T06:37:32.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.912+0000 7f1799a01640 1 --2- 172.21.15.86:0/1197579387 >> v2:172.21.15.169:3300/0 conn(0x7f1794071740 0x7f1794071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.912+0000 7f1799a01640 1 --2- 172.21.15.86:0/1197579387 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17941594f0 0x7f179415f240 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.912+0000 7f1799a01640 1 -- 172.21.15.86:0/1197579387 >> 172.21.15.86:0/1197579387 conn(0x7f17940cc530 msgr2=0x7f17940cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:32.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.912+0000 7fd2df0ba640 1 -- 172.21.15.86:0/1761916355 shutdown_connections 2024-09-19T06:37:32.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.912+0000 7fd2df0ba640 1 -- 172.21.15.86:0/1761916355 wait complete. 2024-09-19T06:37:32.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.912+0000 7f1799a01640 1 -- 172.21.15.86:0/1197579387 shutdown_connections 2024-09-19T06:37:32.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.912+0000 7f2997c53640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29900d0ff0 0x7f299014c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.912+0000 7f2997c53640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29901553a0 0x7f29901f49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.912+0000 7f2997c53640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f299015e6f0 0x7f29901f4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.912+0000 7f2997c53640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f29900c66d0 con 0x7f29900d0ff0 2024-09-19T06:37:32.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.912+0000 7f2997c53640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f29900cbfe0 con 0x7f29901553a0 2024-09-19T06:37:32.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.913+0000 7f62b0f64640 1 -- 172.21.15.86:0/520655213 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62ac06f010 con 0x7f62ac0c8a40 2024-09-19T06:37:32.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.912+0000 7f2997c53640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f29900cc2d0 con 0x7f299015e6f0 2024-09-19T06:37:32.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.913+0000 7f29959ef640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29900d0ff0 0x7f299014c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.913+0000 7f29959ef640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29900d0ff0 0x7f299014c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56700/0 (socket says 172.21.15.86:56700) 2024-09-19T06:37:32.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.913+0000 7f29959ef640 1 -- 172.21.15.86:0/3594422320 learned_addr learned my addr 172.21.15.86:0/3594422320 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:32.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.912+0000 7f1799a01640 1 -- 172.21.15.86:0/1197579387 wait complete. 2024-09-19T06:37:32.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.913+0000 7f29959ef640 1 -- 172.21.15.86:0/3594422320 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f299015e6f0 msgr2=0x7f29901f4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.913+0000 7f29961f0640 1 --2- 172.21.15.86:0/3594422320 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f299015e6f0 0x7f29901f4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.913+0000 7f29959ef640 1 --2- 172.21.15.86:0/3594422320 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f299015e6f0 0x7f29901f4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.912+0000 7fe99b6af640 1 -- start start 2024-09-19T06:37:32.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.913+0000 7fe99b6af640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9940c8830 0x7fe994159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.912+0000 7f6999ed9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69940c81f0 0x7f69940cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.912+0000 7f6999ed9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6994159ae0 0x7f69940c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.913+0000 7f29959ef640 1 -- 172.21.15.86:0/3594422320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29901553a0 msgr2=0x7f29901f49b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:37:32.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.913+0000 7f29959ef640 1 --2- 172.21.15.86:0/3594422320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29901553a0 0x7f29901f49b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.913+0000 7f29959ef640 1 -- 172.21.15.86:0/3594422320 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f299014e300 con 0x7f29900d0ff0 2024-09-19T06:37:32.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.913+0000 7f6999ed9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6994162b20 0x7f6994162070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.913+0000 7f6999ed9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f699406d260 con 0x7f69940c81f0 2024-09-19T06:37:32.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.913+0000 7fe99b6af640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9940c9da0 0x7fe994158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.913+0000 7fe99b6af640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9941525e0 0x7fe9941472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.913+0000 7f29959ef640 1 --2- 172.21.15.86:0/3594422320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29900d0ff0 0x7f299014c3c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f298c000c00 tx=0x7f298c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:32.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.913+0000 7f69937fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69940c81f0 0x7f69940cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.914+0000 7f6992ffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6994159ae0 0x7f69940c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.914+0000 7f6992ffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6994159ae0 0x7f69940c4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:58502/0 (socket says 172.21.15.86:58502) 2024-09-19T06:37:32.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.914+0000 7f29867fc640 1 -- 172.21.15.86:0/3594422320 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f298c037040 con 0x7f29900d0ff0 2024-09-19T06:37:32.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.914+0000 7f2997c53640 1 -- 172.21.15.86:0/3594422320 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29901e6860 con 0x7f29900d0ff0 2024-09-19T06:37:32.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.914+0000 7f2997c53640 1 -- 172.21.15.86:0/3594422320 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f299014da60 con 0x7f29900d0ff0 2024-09-19T06:37:32.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.914+0000 7fd2df0ba640 1 Processor -- start 2024-09-19T06:37:32.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.913+0000 7f8e04726640 1 Processor -- start 2024-09-19T06:37:32.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.914+0000 7f1799a01640 1 Processor -- start 2024-09-19T06:37:32.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.914+0000 7f6992ffd640 1 -- 172.21.15.86:0/4167382432 learned_addr learned my addr 172.21.15.86:0/4167382432 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:32.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.914+0000 7f6999ed9640 1 -- 172.21.15.86:0/4167382432 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f699406cf80 con 0x7f6994162b20 2024-09-19T06:37:32.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.914+0000 7f6999ed9640 1 -- 172.21.15.86:0/4167382432 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f699406d540 con 0x7f6994159ae0 2024-09-19T06:37:32.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.914+0000 7f6993fff640 1 --2- 172.21.15.86:0/4167382432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6994162b20 0x7f6994162070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.972 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.914+0000 7fd2df0ba640 1 -- start start 2024-09-19T06:37:32.972 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.913+0000 7f8e04726640 1 -- start start 2024-09-19T06:37:32.972 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.914+0000 7f8e04726640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8dfc15c700 0x7f8dfc162b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.972 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.914+0000 7f8e04726640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8dfc15ffe0 0x7f8dfc163040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.972 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.914+0000 7f8e04726640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dfc1f8550 0x7f8dfc1f89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.915+0000 7f1799a01640 1 -- start start 2024-09-19T06:37:32.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.915+0000 7f8e024c2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8dfc15c700 0x7f8dfc162b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.915+0000 7f6992ffd640 1 -- 172.21.15.86:0/4167382432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6994162b20 msgr2=0x7f6994162070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.915+0000 7f8e024c2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8dfc15c700 0x7f8dfc162b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:41056/0 (socket says 172.21.15.86:41056) 2024-09-19T06:37:32.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.914+0000 7fe99b6af640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe99406c460 con 0x7fe9941525e0 2024-09-19T06:37:32.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.914+0000 7fe99b6af640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe99406c180 con 0x7fe9940c9da0 2024-09-19T06:37:32.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.914+0000 7fe99b6af640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe99406d370 con 0x7fe9940c8830 2024-09-19T06:37:32.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.915+0000 7f29867fc640 1 -- 172.21.15.86:0/3594422320 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f298c042070 con 0x7f29900d0ff0 2024-09-19T06:37:32.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.915+0000 7f6992ffd640 1 --2- 172.21.15.86:0/4167382432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6994162b20 0x7f6994162070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.915+0000 7f6992ffd640 1 -- 172.21.15.86:0/4167382432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69940c81f0 msgr2=0x7f69940cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.915+0000 7f6992ffd640 1 --2- 172.21.15.86:0/4167382432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69940c81f0 0x7f69940cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.915+0000 7fe99944b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9940c8830 0x7fe994159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.915+0000 7fe99944b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9940c8830 0x7fe994159830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:58488/0 (socket says 172.21.15.86:58488) 2024-09-19T06:37:32.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.915+0000 7fe99944b640 1 -- 172.21.15.86:0/1181546693 learned_addr learned my addr 172.21.15.86:0/1181546693 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:32.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.915+0000 7f6293fff640 1 -- 172.21.15.86:0/520655213 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f62a4005450 con 0x7f62ac0c8a40 2024-09-19T06:37:32.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.915+0000 7f6992ffd640 1 -- 172.21.15.86:0/4167382432 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69940c4680 con 0x7f6994159ae0 2024-09-19T06:37:32.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.915+0000 7f6992ffd640 1 --2- 172.21.15.86:0/4167382432 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6994159ae0 0x7f69940c4140 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f698800c480 tx=0x7f698800c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:32.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7f69937fe640 1 --2- 172.21.15.86:0/4167382432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69940c81f0 0x7f69940cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:37:32.978 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7f1799a01640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1794071740 0x7f1794155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.978 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7fe998c4a640 1 --2- 172.21.15.86:0/1181546693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9940c9da0 0x7fe994158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.978 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7fe99944b640 1 -- 172.21.15.86:0/1181546693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9940c9da0 msgr2=0x7fe994158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.978 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7fe99944b640 1 --2- 172.21.15.86:0/1181546693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9940c9da0 0x7fe994158240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7fe99944b640 1 -- 172.21.15.86:0/1181546693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9941525e0 msgr2=0x7fe9941472a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:37:32.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7fd2df0ba640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2d004ee20 0x7fd2d0047030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7fd2df0ba640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2d004f200 0x7fd2d00d3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7fd2df0ba640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2d0177770 0x7fd2d0168c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7f29867fc640 1 -- 172.21.15.86:0/3594422320 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f298c030920 con 0x7f29900d0ff0 2024-09-19T06:37:32.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.915+0000 7f8e02cc3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dfc1f8550 0x7f8dfc1f89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.915+0000 7f8e02cc3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dfc1f8550 0x7f8dfc1f89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56712/0 (socket says 172.21.15.86:56712) 2024-09-19T06:37:32.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.915+0000 7f8e024c2640 1 -- 172.21.15.86:0/2883291589 learned_addr learned my addr 172.21.15.86:0/2883291589 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:32.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.915+0000 7f8e04726640 1 -- 172.21.15.86:0/2883291589 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc072b30 con 0x7f8dfc1f8550 2024-09-19T06:37:32.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.915+0000 7f8e04726640 1 -- 172.21.15.86:0/2883291589 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc071a00 con 0x7f8dfc15c700 2024-09-19T06:37:32.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.915+0000 7f8e04726640 1 -- 172.21.15.86:0/2883291589 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8dfc0c8e70 con 0x7f8dfc15ffe0 2024-09-19T06:37:32.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.915+0000 7f8e02cc3640 1 -- 172.21.15.86:0/2883291589 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8dfc15ffe0 msgr2=0x7f8dfc163040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:37:32.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.915+0000 7f8e02cc3640 1 --2- 172.21.15.86:0/2883291589 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8dfc15ffe0 0x7f8dfc163040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.915+0000 7f8e02cc3640 1 -- 172.21.15.86:0/2883291589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8dfc15c700 msgr2=0x7f8dfc162b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.915+0000 7f8e02cc3640 1 --2- 172.21.15.86:0/2883291589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8dfc15c700 0x7f8dfc162b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.915+0000 7f8e02cc3640 1 -- 172.21.15.86:0/2883291589 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dfc1f8f10 con 0x7f8dfc1f8550 2024-09-19T06:37:32.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7f8e02cc3640 1 --2- 172.21.15.86:0/2883291589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dfc1f8550 0x7f8dfc1f89d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0c3b30 tx=0x7f8df400ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:32.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7f1799a01640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17940c6f30 0x7f1794155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7f1799a01640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17941594f0 0x7f179415ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7f1799a01640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1794072090 con 0x7f1794071740 2024-09-19T06:37:32.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.915+0000 7f6293fff640 1 --2- 172.21.15.86:0/520655213 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f629806c3b0 0x7f629806e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7f6293fff640 1 -- 172.21.15.86:0/520655213 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f62a408b7f0 con 0x7f62ac0c8a40 2024-09-19T06:37:32.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7fd2dce56640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2d004ee20 0x7fd2d0047030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7f1799a01640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1794070f40 con 0x7f17941594f0 2024-09-19T06:37:32.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7f1799a01640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f17941598d0 con 0x7f17940c6f30 2024-09-19T06:37:32.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7f62ab7fe640 1 --2- 172.21.15.86:0/520655213 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f629806c3b0 0x7f629806e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7fd2d7fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2d004f200 0x7fd2d00d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7fd2df0ba640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d0005eb0 con 0x7fd2d0177770 2024-09-19T06:37:32.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7fd2df0ba640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d00e22c0 con 0x7fd2d004ee20 2024-09-19T06:37:32.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7fd2dce56640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2d004ee20 0x7fd2d0047030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:41070/0 (socket says 172.21.15.86:41070) 2024-09-19T06:37:32.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7fd2df0ba640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd2d0045100 con 0x7fd2d004f200 2024-09-19T06:37:32.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7fd2dce56640 1 -- 172.21.15.86:0/3841450971 learned_addr learned my addr 172.21.15.86:0/3841450971 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:32.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.917+0000 7fd2dce56640 1 -- 172.21.15.86:0/3841450971 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2d004f200 msgr2=0x7fd2d00d3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.917+0000 7fd2dce56640 1 --2- 172.21.15.86:0/3841450971 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2d004f200 0x7fd2d00d3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.917+0000 7fd2dce56640 1 -- 172.21.15.86:0/3841450971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2d0177770 msgr2=0x7fd2d0168c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.917+0000 7fd2dd657640 1 --2- 172.21.15.86:0/3841450971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2d0177770 0x7fd2d0168c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.917+0000 7fd2dce56640 1 --2- 172.21.15.86:0/3841450971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2d0177770 0x7fd2d0168c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.917+0000 7fd2dce56640 1 -- 172.21.15.86:0/3841450971 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d01785c0 con 0x7fd2d004ee20 2024-09-19T06:37:32.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.917+0000 7fd2dd657640 1 --2- 172.21.15.86:0/3841450971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2d0177770 0x7fd2d0168c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:32.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7f1792ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1794071740 0x7f1794155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7f1792ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1794071740 0x7f1794155610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56734/0 (socket says 172.21.15.86:56734) 2024-09-19T06:37:32.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7f1792ffd640 1 -- 172.21.15.86:0/74374788 learned_addr learned my addr 172.21.15.86:0/74374788 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:32.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7f17927fc640 1 --2- 172.21.15.86:0/74374788 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17940c6f30 0x7f1794155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7f2997c53640 1 -- 172.21.15.86:0/3594422320 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2978005290 con 0x7f29900d0ff0 2024-09-19T06:37:32.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.917+0000 7f17937fe640 1 --2- 172.21.15.86:0/74374788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17941594f0 0x7f179415ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.917+0000 7f8df2ffd640 1 -- 172.21.15.86:0/2883291589 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df4017070 con 0x7f8dfc1f8550 2024-09-19T06:37:32.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.917+0000 7f8e04726640 1 -- 172.21.15.86:0/2883291589 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dfc1f5040 con 0x7f8dfc1f8550 2024-09-19T06:37:32.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.917+0000 7fd2dce56640 1 --2- 172.21.15.86:0/3841450971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2d004ee20 0x7fd2d0047030 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc001c70 tx=0x7fd2cc00c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:32.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.917+0000 7f17927fc640 1 -- 172.21.15.86:0/74374788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17941594f0 msgr2=0x7f179415ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7fe99944b640 1 --2- 172.21.15.86:0/1181546693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9941525e0 0x7fe9941472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.917+0000 7f17927fc640 1 --2- 172.21.15.86:0/74374788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17941594f0 0x7f179415ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.916+0000 7fe99944b640 1 -- 172.21.15.86:0/1181546693 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe994158780 con 0x7fe9940c8830 2024-09-19T06:37:32.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.917+0000 7fe99944b640 1 --2- 172.21.15.86:0/1181546693 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9940c8830 0x7fe994159830 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe98c02ad10 tx=0x7fe98c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:32.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.917+0000 7f17927fc640 1 -- 172.21.15.86:0/74374788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1794071740 msgr2=0x7f1794155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:32.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.917+0000 7f8e04726640 1 -- 172.21.15.86:0/2883291589 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dfc1f5600 con 0x7f8dfc1f8550 2024-09-19T06:37:32.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.917+0000 7f17927fc640 1 --2- 172.21.15.86:0/74374788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1794071740 0x7f1794155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:32.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.917+0000 7f62ab7fe640 1 --2- 172.21.15.86:0/520655213 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f629806c3b0 0x7f629806e870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f62a002a2b0 tx=0x7f62a002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:32.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.917+0000 7f17927fc640 1 -- 172.21.15.86:0/74374788 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17940c3e70 con 0x7f17940c6f30 2024-09-19T06:37:32.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.917+0000 7f1792ffd640 1 --2- 172.21.15.86:0/74374788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1794071740 0x7f1794155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:37:32.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.918+0000 7f29867fc640 1 -- 172.21.15.86:0/3594422320 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f298c030ac0 con 0x7f29900d0ff0 2024-09-19T06:37:32.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.918+0000 7fd2d57fa640 1 -- 172.21.15.86:0/3841450971 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc0050d0 con 0x7fd2d004ee20 2024-09-19T06:37:32.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.918+0000 7fd2df0ba640 1 -- 172.21.15.86:0/3841450971 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2d0177d20 con 0x7fd2d004ee20 2024-09-19T06:37:32.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.918+0000 7f29867fc640 1 --2- 172.21.15.86:0/3594422320 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f297406c380 0x7f297406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:32.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.918+0000 7f29951ee640 1 --2- 172.21.15.86:0/3594422320 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f297406c380 0x7f297406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:32.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.918+0000 7f29867fc640 1 -- 172.21.15.86:0/3594422320 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f298c0acb40 con 0x7f29900d0ff0 2024-09-19T06:37:32.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.919+0000 7f8e04726640 1 -- 172.21.15.86:0/2883291589 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dfc0cad90 con 0x7f8dfc1f8550 2024-09-19T06:37:32.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.918+0000 7fd2d57fa640 1 -- 172.21.15.86:0/3841450971 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2cc005270 con 0x7fd2d004ee20 2024-09-19T06:37:32.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.918+0000 7fd2df0ba640 1 -- 172.21.15.86:0/3841450971 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2d01782e0 con 0x7fd2d004ee20 2024-09-19T06:37:32.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.919+0000 7fd2d57fa640 1 -- 172.21.15.86:0/3841450971 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc0050d0 con 0x7fd2d004ee20 2024-09-19T06:37:32.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.919+0000 7fe989ffb640 1 -- 172.21.15.86:0/1181546693 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c041020 con 0x7fe9940c8830 2024-09-19T06:37:32.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.919+0000 7f697bfff640 1 -- 172.21.15.86:0/4167382432 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6988018070 con 0x7f6994159ae0 2024-09-19T06:37:32.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.919+0000 7f697bfff640 1 -- 172.21.15.86:0/4167382432 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6988007480 con 0x7f6994159ae0 2024-09-19T06:37:32.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.919+0000 7f697bfff640 1 -- 172.21.15.86:0/4167382432 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69880047e0 con 0x7f6994159ae0 2024-09-19T06:37:32.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.919+0000 7fe99b6af640 1 -- 172.21.15.86:0/1181546693 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9941f1980 con 0x7fe9940c8830 2024-09-19T06:37:32.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.919+0000 7f6999ed9640 1 -- 172.21.15.86:0/4167382432 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69940c5a00 con 0x7f6994159ae0 2024-09-19T06:37:32.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.919+0000 7f6999ed9640 1 -- 172.21.15.86:0/4167382432 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f69940c6300 con 0x7f6994159ae0 2024-09-19T06:37:32.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.919+0000 7fe989ffb640 1 -- 172.21.15.86:0/1181546693 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe98c008790 con 0x7fe9940c8830 2024-09-19T06:37:32.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.919+0000 7fe989ffb640 1 -- 172.21.15.86:0/1181546693 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c036040 con 0x7fe9940c8830 2024-09-19T06:37:32.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.919+0000 7fd2df0ba640 1 -- 172.21.15.86:0/3841450971 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2d0035810 con 0x7fd2d004ee20 2024-09-19T06:37:32.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.919+0000 7f29951ee640 1 --2- 172.21.15.86:0/3594422320 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f297406c380 0x7f297406e840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f29900d0fc0 tx=0x7f2980009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:32.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.919+0000 7f6293fff640 1 -- 172.21.15.86:0/520655213 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f62a4059c00 con 0x7f62ac0c8a40 2024-09-19T06:37:32.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.920+0000 7fe99b6af640 1 -- 172.21.15.86:0/1181546693 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe994151b00 con 0x7fe9940c8830 2024-09-19T06:37:32.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.920+0000 7f17927fc640 1 --2- 172.21.15.86:0/74374788 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17940c6f30 0x7f1794155b50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f178400c460 tx=0x7f178400c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:32.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.921+0000 7f177bfff640 1 -- 172.21.15.86:0/74374788 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17840074e0 con 0x7f17940c6f30 2024-09-19T06:37:32.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.921+0000 7f177bfff640 1 -- 172.21.15.86:0/74374788 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1784007680 con 0x7f17940c6f30 2024-09-19T06:37:32.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.921+0000 7f177bfff640 1 -- 172.21.15.86:0/74374788 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17840049e0 con 0x7f17940c6f30 2024-09-19T06:37:32.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.921+0000 7f1799a01640 1 -- 172.21.15.86:0/74374788 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17940c4150 con 0x7f17940c6f30 2024-09-19T06:37:32.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.921+0000 7f1799a01640 1 -- 172.21.15.86:0/74374788 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f17940c4ab0 con 0x7f17940c6f30 2024-09-19T06:37:32.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.921+0000 7fe99b6af640 1 -- 172.21.15.86:0/1181546693 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9940c4600 con 0x7fe9940c8830 2024-09-19T06:37:32.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.921+0000 7f697bfff640 1 -- 172.21.15.86:0/4167382432 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f698801b070 con 0x7f6994159ae0 2024-09-19T06:37:32.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.921+0000 7f6999ed9640 1 -- 172.21.15.86:0/4167382432 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69940c74d0 con 0x7f6994159ae0 2024-09-19T06:37:32.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.921+0000 7fd2d57fa640 1 -- 172.21.15.86:0/3841450971 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd2cc015960 con 0x7fd2d004ee20 2024-09-19T06:37:33.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.922+0000 7f697bfff640 1 --2- 172.21.15.86:0/4167382432 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f698006c380 0x7f698006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:33.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.922+0000 7f697bfff640 1 -- 172.21.15.86:0/4167382432 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f698808aad0 con 0x7f6994159ae0 2024-09-19T06:37:33.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.922+0000 7f69937fe640 1 --2- 172.21.15.86:0/4167382432 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f698006c380 0x7f698006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:33.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.922+0000 7fd2d57fa640 1 --2- 172.21.15.86:0/3841450971 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd2bc06c4b0 0x7fd2bc06e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:33.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.923+0000 7f1799a01640 1 -- 172.21.15.86:0/74374788 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17940c7360 con 0x7f17940c6f30 2024-09-19T06:37:33.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.923+0000 7fd2d57fa640 1 -- 172.21.15.86:0/3841450971 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd2cc093930 con 0x7fd2d004ee20 2024-09-19T06:37:33.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.923+0000 7f69937fe640 1 --2- 172.21.15.86:0/4167382432 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f698006c380 0x7f698006e840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f69840011e0 tx=0x7f6984007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:33.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.923+0000 7fd2d7fff640 1 --2- 172.21.15.86:0/3841450971 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd2bc06c4b0 0x7fd2bc06e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:33.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.923+0000 7f177bfff640 1 -- 172.21.15.86:0/74374788 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f178401a020 con 0x7f17940c6f30 2024-09-19T06:37:33.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.923+0000 7fd2d7fff640 1 --2- 172.21.15.86:0/3841450971 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd2bc06c4b0 0x7fd2bc06e970 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd2d00d4aa0 tx=0x7fd2c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:33.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.923+0000 7fe989ffb640 1 -- 172.21.15.86:0/1181546693 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe98c044020 con 0x7fe9940c8830 2024-09-19T06:37:33.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.924+0000 7fe989ffb640 1 --2- 172.21.15.86:0/1181546693 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe97806c2e0 0x7fe97806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:33.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.924+0000 7f177bfff640 1 --2- 172.21.15.86:0/74374788 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f178006c300 0x7f178006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:33.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.924+0000 7f1792ffd640 1 --2- 172.21.15.86:0/74374788 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f178006c300 0x7f178006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:33.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.924+0000 7fd2d57fa640 1 -- 172.21.15.86:0/3841450971 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd2d0035810 con 0x7fd2d004ee20 2024-09-19T06:37:33.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.924+0000 7fe989ffb640 1 -- 172.21.15.86:0/1181546693 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe98c0ac440 con 0x7fe9940c8830 2024-09-19T06:37:33.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.924+0000 7fe998c4a640 1 --2- 172.21.15.86:0/1181546693 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe97806c2e0 0x7fe97806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:33.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.925+0000 7f177bfff640 1 -- 172.21.15.86:0/74374788 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f178408ad10 con 0x7f17940c6f30 2024-09-19T06:37:33.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.925+0000 7f1792ffd640 1 --2- 172.21.15.86:0/74374788 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f178006c300 0x7f178006e7c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f17880325c0 tx=0x7f178802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:33.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.925+0000 7fe998c4a640 1 --2- 172.21.15.86:0/1181546693 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe97806c2e0 0x7fe97806e7a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe994148b00 tx=0x7fe984009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:33.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.925+0000 7f8df2ffd640 1 -- 172.21.15.86:0/2883291589 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8df4005d40 con 0x7f8dfc1f8550 2024-09-19T06:37:33.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.925+0000 7f8df2ffd640 1 -- 172.21.15.86:0/2883291589 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df4020060 con 0x7f8dfc1f8550 2024-09-19T06:37:33.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.925+0000 7f29867fc640 1 -- 172.21.15.86:0/3594422320 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f298c07b070 con 0x7f29900d0ff0 2024-09-19T06:37:33.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.927+0000 7f697bfff640 1 -- 172.21.15.86:0/4167382432 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6988058890 con 0x7f6994159ae0 2024-09-19T06:37:33.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.927+0000 7f8df2ffd640 1 -- 172.21.15.86:0/2883291589 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8df400a8d0 con 0x7f8dfc1f8550 2024-09-19T06:37:33.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.928+0000 7f8df2ffd640 1 --2- 172.21.15.86:0/2883291589 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8de006c2b0 0x7f8de006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:33.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.928+0000 7f8df2ffd640 1 -- 172.21.15.86:0/2883291589 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8df408b2d0 con 0x7f8dfc1f8550 2024-09-19T06:37:33.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.928+0000 7f8e024c2640 1 --2- 172.21.15.86:0/2883291589 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8de006c2b0 0x7f8de006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:33.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.929+0000 7f8e024c2640 1 --2- 172.21.15.86:0/2883291589 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8de006c2b0 0x7f8de006e770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8dec001050 tx=0x7f8dec007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:33.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.931+0000 7fe989ffb640 1 -- 172.21.15.86:0/1181546693 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe9940c4600 con 0x7fe9940c8830 2024-09-19T06:37:33.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.936+0000 7f8df2ffd640 1 -- 172.21.15.86:0/2883291589 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8dfc0cad90 con 0x7f8dfc1f8550 2024-09-19T06:37:33.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:32.936+0000 7f177bfff640 1 -- 172.21.15.86:0/74374788 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f17840592b0 con 0x7f17940c6f30 2024-09-19T06:37:33.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.223+0000 7f62cd7bc640 1 -- 172.21.15.86:0/787015133 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f62a8005580 con 0x7f62c8159410 2024-09-19T06:37:33.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.224+0000 7f62c4ff9640 1 -- 172.21.15.86:0/787015133 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f62b8079ec0 con 0x7f62c8159410 2024-09-19T06:37:33.225 INFO:teuthology.orchestra.run.smithi086.stdout:64424509450 2024-09-19T06:37:33.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.227+0000 7f62ae7fc640 1 -- 172.21.15.86:0/787015133 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f62b406c380 msgr2=0x7f62b406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.227+0000 7f62ae7fc640 1 --2- 172.21.15.86:0/787015133 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f62b406c380 0x7f62b406e840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f62bc006fd0 tx=0x7f62bc009060 comp rx=0 tx=0).stop 2024-09-19T06:37:33.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.227+0000 7f62ae7fc640 1 -- 172.21.15.86:0/787015133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62c8159410 msgr2=0x7f62c813e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.227+0000 7f62ae7fc640 1 --2- 172.21.15.86:0/787015133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62c8159410 0x7f62c813e860 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f62b8031000 tx=0x7f62b8004730 comp rx=0 tx=0).stop 2024-09-19T06:37:33.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.228+0000 7f62ae7fc640 1 -- 172.21.15.86:0/787015133 shutdown_connections 2024-09-19T06:37:33.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.228+0000 7f62ae7fc640 1 --2- 172.21.15.86:0/787015133 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f62b406c380 0x7f62b406e840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.228+0000 7f62ae7fc640 1 --2- 172.21.15.86:0/787015133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62c8162bd0 0x7f62c8163050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.228+0000 7f62ae7fc640 1 --2- 172.21.15.86:0/787015133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62c8159410 0x7f62c813e860 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.228+0000 7f62ae7fc640 1 --2- 172.21.15.86:0/787015133 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62c80c8a40 0x7f62c8161f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.228+0000 7f62ae7fc640 1 -- 172.21.15.86:0/787015133 >> 172.21.15.86:0/787015133 conn(0x7f62c80cc450 msgr2=0x7f62c8143ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:33.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.228+0000 7f62ae7fc640 1 -- 172.21.15.86:0/787015133 shutdown_connections 2024-09-19T06:37:33.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.228+0000 7f62ae7fc640 1 -- 172.21.15.86:0/787015133 wait complete. 2024-09-19T06:37:33.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.5 2024-09-19T06:37:33.246 DEBUG:teuthology.parallel:result is None 2024-09-19T06:37:33.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.276+0000 7f2997c53640 1 -- 172.21.15.86:0/3594422320 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f2978005850 con 0x7f29900d0ff0 2024-09-19T06:37:33.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.276+0000 7f29867fc640 1 -- 172.21.15.86:0/3594422320 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f298c0aae20 con 0x7f29900d0ff0 2024-09-19T06:37:33.278 INFO:teuthology.orchestra.run.smithi086.stdout:60129542153 2024-09-19T06:37:33.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.278+0000 7f2997c53640 1 -- 172.21.15.86:0/3594422320 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f297406c380 msgr2=0x7f297406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.278+0000 7f2997c53640 1 --2- 172.21.15.86:0/3594422320 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f297406c380 0x7f297406e840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f29900d0fc0 tx=0x7f2980009240 comp rx=0 tx=0).stop 2024-09-19T06:37:33.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.278+0000 7f2997c53640 1 -- 172.21.15.86:0/3594422320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29900d0ff0 msgr2=0x7f299014c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.279+0000 7f2997c53640 1 --2- 172.21.15.86:0/3594422320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29900d0ff0 0x7f299014c3c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f298c000c00 tx=0x7f298c0046c0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.279+0000 7f2997c53640 1 -- 172.21.15.86:0/3594422320 shutdown_connections 2024-09-19T06:37:33.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.279+0000 7f2997c53640 1 --2- 172.21.15.86:0/3594422320 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f297406c380 0x7f297406e840 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.279+0000 7f2997c53640 1 --2- 172.21.15.86:0/3594422320 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f299015e6f0 0x7f29901f4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.279+0000 7f2997c53640 1 --2- 172.21.15.86:0/3594422320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29901553a0 0x7f29901f49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.279+0000 7f2997c53640 1 --2- 172.21.15.86:0/3594422320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29900d0ff0 0x7f299014c3c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.279+0000 7f2997c53640 1 -- 172.21.15.86:0/3594422320 >> 172.21.15.86:0/3594422320 conn(0x7f2990067890 msgr2=0x7f2990153a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:33.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.279+0000 7f2997c53640 1 -- 172.21.15.86:0/3594422320 shutdown_connections 2024-09-19T06:37:33.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.279+0000 7f2997c53640 1 -- 172.21.15.86:0/3594422320 wait complete. 2024-09-19T06:37:33.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.1 2024-09-19T06:37:33.291 DEBUG:teuthology.parallel:result is None 2024-09-19T06:37:33.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.323+0000 7f62b0f64640 1 -- 172.21.15.86:0/520655213 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f62ac08dd80 con 0x7f62ac0c8a40 2024-09-19T06:37:33.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.324+0000 7f6293fff640 1 -- 172.21.15.86:0/520655213 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f62a4059500 con 0x7f62ac0c8a40 2024-09-19T06:37:33.326 INFO:teuthology.orchestra.run.smithi086.stdout:55834574859 2024-09-19T06:37:33.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.325+0000 7fd2df0ba640 1 -- 172.21.15.86:0/3841450971 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd2d004a8f0 con 0x7fd2d004ee20 2024-09-19T06:37:33.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.325+0000 7fd2d57fa640 1 -- 172.21.15.86:0/3841450971 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd2d0035810 con 0x7fd2d004ee20 2024-09-19T06:37:33.327 INFO:teuthology.orchestra.run.smithi086.stdout:64424509449 2024-09-19T06:37:33.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.327+0000 7f62b0f64640 1 -- 172.21.15.86:0/520655213 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f629806c3b0 msgr2=0x7f629806e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.327+0000 7f62b0f64640 1 --2- 172.21.15.86:0/520655213 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f629806c3b0 0x7f629806e870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f62a002a2b0 tx=0x7f62a002e000 comp rx=0 tx=0).stop 2024-09-19T06:37:33.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.327+0000 7f62b0f64640 1 -- 172.21.15.86:0/520655213 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62ac0c8a40 msgr2=0x7f62ac209d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.327+0000 7f62b0f64640 1 --2- 172.21.15.86:0/520655213 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62ac0c8a40 0x7f62ac209d40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f62a400c780 tx=0x7f62a400cc40 comp rx=0 tx=0).stop 2024-09-19T06:37:33.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.328+0000 7f62b0f64640 1 -- 172.21.15.86:0/520655213 shutdown_connections 2024-09-19T06:37:33.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.328+0000 7f62b0f64640 1 --2- 172.21.15.86:0/520655213 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f629806c3b0 0x7f629806e870 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.328+0000 7f62b0f64640 1 --2- 172.21.15.86:0/520655213 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62ac0c8a40 0x7f62ac209d40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.328+0000 7f62b0f64640 1 --2- 172.21.15.86:0/520655213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62ac071160 0x7f62ac209800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.328+0000 7f62b0f64640 1 --2- 172.21.15.86:0/520655213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62ac06e0c0 0x7f62ac168f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.328+0000 7f62b0f64640 1 -- 172.21.15.86:0/520655213 >> 172.21.15.86:0/520655213 conn(0x7f62ac0cc450 msgr2=0x7f62ac0cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:33.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.328+0000 7f62b0f64640 1 -- 172.21.15.86:0/520655213 shutdown_connections 2024-09-19T06:37:33.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.328+0000 7f62b0f64640 1 -- 172.21.15.86:0/520655213 wait complete. 2024-09-19T06:37:33.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.328+0000 7fd2df0ba640 1 -- 172.21.15.86:0/3841450971 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd2bc06c4b0 msgr2=0x7fd2bc06e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.328+0000 7fd2df0ba640 1 --2- 172.21.15.86:0/3841450971 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd2bc06c4b0 0x7fd2bc06e970 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd2d00d4aa0 tx=0x7fd2c4008040 comp rx=0 tx=0).stop 2024-09-19T06:37:33.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.329+0000 7fd2df0ba640 1 -- 172.21.15.86:0/3841450971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2d004ee20 msgr2=0x7fd2d0047030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.329+0000 7fd2df0ba640 1 --2- 172.21.15.86:0/3841450971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2d004ee20 0x7fd2d0047030 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc001c70 tx=0x7fd2cc00c4b0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.329+0000 7f6999ed9640 1 -- 172.21.15.86:0/4167382432 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f6994074200 con 0x7f6994159ae0 2024-09-19T06:37:33.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.329+0000 7fd2df0ba640 1 -- 172.21.15.86:0/3841450971 shutdown_connections 2024-09-19T06:37:33.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.329+0000 7fd2df0ba640 1 --2- 172.21.15.86:0/3841450971 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd2bc06c4b0 0x7fd2bc06e970 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.329+0000 7fd2df0ba640 1 --2- 172.21.15.86:0/3841450971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2d0177770 0x7fd2d0168c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.329+0000 7fd2df0ba640 1 --2- 172.21.15.86:0/3841450971 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2d004f200 0x7fd2d00d3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.329+0000 7fd2df0ba640 1 --2- 172.21.15.86:0/3841450971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2d004ee20 0x7fd2d0047030 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.329+0000 7fd2df0ba640 1 -- 172.21.15.86:0/3841450971 >> 172.21.15.86:0/3841450971 conn(0x7fd2d004fc50 msgr2=0x7fd2d0045540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:33.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.329+0000 7fd2df0ba640 1 -- 172.21.15.86:0/3841450971 shutdown_connections 2024-09-19T06:37:33.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.329+0000 7fd2df0ba640 1 -- 172.21.15.86:0/3841450971 wait complete. 2024-09-19T06:37:33.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.329+0000 7f697bfff640 1 -- 172.21.15.86:0/4167382432 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f698805cb90 con 0x7f6994159ae0 2024-09-19T06:37:33.335 INFO:teuthology.orchestra.run.smithi086.stdout:60129542152 2024-09-19T06:37:33.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.331+0000 7fe99b6af640 1 -- 172.21.15.86:0/1181546693 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fe9940c79f0 con 0x7fe9940c8830 2024-09-19T06:37:33.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.331+0000 7fe989ffb640 1 -- 172.21.15.86:0/1181546693 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe9940c4600 con 0x7fe9940c8830 2024-09-19T06:37:33.336 INFO:teuthology.orchestra.run.smithi086.stdout:60129542154 2024-09-19T06:37:33.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.331+0000 7f1799a01640 1 -- 172.21.15.86:0/74374788 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f1794158210 con 0x7f17940c6f30 2024-09-19T06:37:33.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.332+0000 7f177bfff640 1 -- 172.21.15.86:0/74374788 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1784058bb0 con 0x7f17940c6f30 2024-09-19T06:37:33.337 INFO:teuthology.orchestra.run.smithi086.stdout:64424509450 2024-09-19T06:37:33.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.332+0000 7f8e04726640 1 -- 172.21.15.86:0/2883291589 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8dfc0c82b0 con 0x7f8dfc1f8550 2024-09-19T06:37:33.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.333+0000 7f6999ed9640 1 -- 172.21.15.86:0/4167382432 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f698006c380 msgr2=0x7f698006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.333+0000 7f6999ed9640 1 --2- 172.21.15.86:0/4167382432 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f698006c380 0x7f698006e840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f69840011e0 tx=0x7f6984007d30 comp rx=0 tx=0).stop 2024-09-19T06:37:33.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.333+0000 7f6999ed9640 1 -- 172.21.15.86:0/4167382432 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6994159ae0 msgr2=0x7f69940c4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.333+0000 7f6999ed9640 1 --2- 172.21.15.86:0/4167382432 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6994159ae0 0x7f69940c4140 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f698800c480 tx=0x7f698800c940 comp rx=0 tx=0).stop 2024-09-19T06:37:33.338 INFO:teuthology.orchestra.run.smithi086.stdout:60129542153 2024-09-19T06:37:33.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.333+0000 7f8df2ffd640 1 -- 172.21.15.86:0/2883291589 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8dfc1f8f10 con 0x7f8dfc1f8550 2024-09-19T06:37:33.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.333+0000 7f6999ed9640 1 -- 172.21.15.86:0/4167382432 shutdown_connections 2024-09-19T06:37:33.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.333+0000 7f6999ed9640 1 --2- 172.21.15.86:0/4167382432 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f698006c380 0x7f698006e840 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.333+0000 7f6999ed9640 1 --2- 172.21.15.86:0/4167382432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6994162b20 0x7f6994162070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.333+0000 7f6999ed9640 1 --2- 172.21.15.86:0/4167382432 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6994159ae0 0x7f69940c4140 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.333+0000 7f6999ed9640 1 --2- 172.21.15.86:0/4167382432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69940c81f0 0x7f69940cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.333+0000 7f6999ed9640 1 -- 172.21.15.86:0/4167382432 >> 172.21.15.86:0/4167382432 conn(0x7f699406eb60 msgr2=0x7f6994158900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:33.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.333+0000 7f6999ed9640 1 -- 172.21.15.86:0/4167382432 shutdown_connections 2024-09-19T06:37:33.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.333+0000 7f6999ed9640 1 -- 172.21.15.86:0/4167382432 wait complete. 2024-09-19T06:37:33.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.334+0000 7f1799a01640 1 -- 172.21.15.86:0/74374788 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f178006c300 msgr2=0x7f178006e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.334+0000 7f1799a01640 1 --2- 172.21.15.86:0/74374788 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f178006c300 0x7f178006e7c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f17880325c0 tx=0x7f178802e000 comp rx=0 tx=0).stop 2024-09-19T06:37:33.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.334+0000 7f1799a01640 1 -- 172.21.15.86:0/74374788 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17940c6f30 msgr2=0x7f1794155b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.334+0000 7f1799a01640 1 --2- 172.21.15.86:0/74374788 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17940c6f30 0x7f1794155b50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f178400c460 tx=0x7f178400c920 comp rx=0 tx=0).stop 2024-09-19T06:37:33.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.334+0000 7fe99b6af640 1 -- 172.21.15.86:0/1181546693 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe97806c2e0 msgr2=0x7fe97806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.334+0000 7fe99b6af640 1 --2- 172.21.15.86:0/1181546693 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe97806c2e0 0x7fe97806e7a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe994148b00 tx=0x7fe984009040 comp rx=0 tx=0).stop 2024-09-19T06:37:33.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.334+0000 7fe99b6af640 1 -- 172.21.15.86:0/1181546693 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9940c8830 msgr2=0x7fe994159830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.334+0000 7fe99b6af640 1 --2- 172.21.15.86:0/1181546693 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9940c8830 0x7fe994159830 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe98c02ad10 tx=0x7fe98c004a40 comp rx=0 tx=0).stop 2024-09-19T06:37:33.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.334+0000 7fe99b6af640 1 -- 172.21.15.86:0/1181546693 shutdown_connections 2024-09-19T06:37:33.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.334+0000 7fe99b6af640 1 --2- 172.21.15.86:0/1181546693 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe97806c2e0 0x7fe97806e7a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.334+0000 7fe99b6af640 1 --2- 172.21.15.86:0/1181546693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9941525e0 0x7fe9941472a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.334+0000 7fe99b6af640 1 --2- 172.21.15.86:0/1181546693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9940c9da0 0x7fe994158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.334+0000 7fe99b6af640 1 --2- 172.21.15.86:0/1181546693 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9940c8830 0x7fe994159830 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.335+0000 7fe99b6af640 1 -- 172.21.15.86:0/1181546693 >> 172.21.15.86:0/1181546693 conn(0x7fe9940c9280 msgr2=0x7fe9940c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:33.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.335+0000 7f1799a01640 1 -- 172.21.15.86:0/74374788 shutdown_connections 2024-09-19T06:37:33.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.335+0000 7f1799a01640 1 --2- 172.21.15.86:0/74374788 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f178006c300 0x7f178006e7c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.335+0000 7f1799a01640 1 --2- 172.21.15.86:0/74374788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17941594f0 0x7f179415ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.335+0000 7f1799a01640 1 --2- 172.21.15.86:0/74374788 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17940c6f30 0x7f1794155b50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.335+0000 7f1799a01640 1 --2- 172.21.15.86:0/74374788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1794071740 0x7f1794155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.335+0000 7f1799a01640 1 -- 172.21.15.86:0/74374788 >> 172.21.15.86:0/74374788 conn(0x7f17940cc530 msgr2=0x7f1794156d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:33.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.335+0000 7fe99b6af640 1 -- 172.21.15.86:0/1181546693 shutdown_connections 2024-09-19T06:37:33.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.335+0000 7f1799a01640 1 -- 172.21.15.86:0/74374788 shutdown_connections 2024-09-19T06:37:33.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.335+0000 7f1799a01640 1 -- 172.21.15.86:0/74374788 wait complete. 2024-09-19T06:37:33.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.335+0000 7fe99b6af640 1 -- 172.21.15.86:0/1181546693 wait complete. 2024-09-19T06:37:33.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.336+0000 7f8e04726640 1 -- 172.21.15.86:0/2883291589 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8de006c2b0 msgr2=0x7f8de006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.336+0000 7f8e04726640 1 --2- 172.21.15.86:0/2883291589 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8de006c2b0 0x7f8de006e770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8dec001050 tx=0x7f8dec007000 comp rx=0 tx=0).stop 2024-09-19T06:37:33.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.336+0000 7f8e04726640 1 -- 172.21.15.86:0/2883291589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dfc1f8550 msgr2=0x7f8dfc1f89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.336+0000 7f8e04726640 1 --2- 172.21.15.86:0/2883291589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dfc1f8550 0x7f8dfc1f89d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0c3b30 tx=0x7f8df400ce40 comp rx=0 tx=0).stop 2024-09-19T06:37:33.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.336+0000 7f8e04726640 1 -- 172.21.15.86:0/2883291589 shutdown_connections 2024-09-19T06:37:33.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.336+0000 7f8e04726640 1 --2- 172.21.15.86:0/2883291589 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8de006c2b0 0x7f8de006e770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.336+0000 7f8e04726640 1 --2- 172.21.15.86:0/2883291589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dfc1f8550 0x7f8dfc1f89d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.336+0000 7f8e04726640 1 --2- 172.21.15.86:0/2883291589 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8dfc15ffe0 0x7f8dfc163040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.336+0000 7f8e04726640 1 --2- 172.21.15.86:0/2883291589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8dfc15c700 0x7f8dfc162b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.336+0000 7f8e04726640 1 -- 172.21.15.86:0/2883291589 >> 172.21.15.86:0/2883291589 conn(0x7f8dfc0c9280 msgr2=0x7f8dfc0ca680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:33.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.337+0000 7f8e04726640 1 -- 172.21.15.86:0/2883291589 shutdown_connections 2024-09-19T06:37:33.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.337+0000 7f8e04726640 1 -- 172.21.15.86:0/2883291589 wait complete. 2024-09-19T06:37:33.351 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.2 2024-09-19T06:37:33.352 DEBUG:teuthology.parallel:result is None 2024-09-19T06:37:33.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.6 2024-09-19T06:37:33.352 DEBUG:teuthology.parallel:result is None 2024-09-19T06:37:33.353 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.0 2024-09-19T06:37:33.353 DEBUG:teuthology.parallel:result is None 2024-09-19T06:37:33.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.4 2024-09-19T06:37:33.354 DEBUG:teuthology.parallel:result is None 2024-09-19T06:37:33.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.3 2024-09-19T06:37:33.356 DEBUG:teuthology.parallel:result is None 2024-09-19T06:37:33.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.7 2024-09-19T06:37:33.357 DEBUG:teuthology.parallel:result is None 2024-09-19T06:37:33.357 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T06:37:33.358 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:37:33.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.496+0000 7fe4f3ef8640 1 Processor -- start 2024-09-19T06:37:33.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.496+0000 7fe4f3ef8640 1 -- start start 2024-09-19T06:37:33.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.497+0000 7fe4f3ef8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4ec0d11c0 0x7fe4ec15e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:33.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.497+0000 7fe4f3ef8640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe4ec155000 0x7fe4ec155490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:33.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.497+0000 7fe4f3ef8640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4ec0cc5c0 con 0x7fe4ec0d0de0 2024-09-19T06:37:33.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.497+0000 7fe4f3ef8640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe4ec15ee10 con 0x7fe4ec155000 2024-09-19T06:37:33.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.497+0000 7fe4f3ef8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe4ec15f0f0 con 0x7fe4ec0d11c0 2024-09-19T06:37:33.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.497+0000 7fe4f1c94640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe4ec0d0de0 0x7fe4ec0cbb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:35198/0 (socket says 172.21.15.86:35198) 2024-09-19T06:37:33.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.497+0000 7fe4f1c94640 1 -- 172.21.15.86:0/1709590527 learned_addr learned my addr 172.21.15.86:0/1709590527 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:33.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.497+0000 7fe4f1493640 1 --2- 172.21.15.86:0/1709590527 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4ec0d11c0 0x7fe4ec15e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:33.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.497+0000 7fe4f2495640 1 --2- 172.21.15.86:0/1709590527 >> v2:172.21.15.169:3300/0 conn(0x7fe4ec155000 0x7fe4ec155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:33.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.497+0000 7fe4f0c92640 1 -- 172.21.15.86:0/1709590527 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2134212260 0 0) 0x7fe4ec0cc5c0 con 0x7fe4ec0d0de0 2024-09-19T06:37:33.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.497+0000 7fe4f0c92640 1 -- 172.21.15.86:0/1709590527 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4d8003520 con 0x7fe4ec0d0de0 2024-09-19T06:37:33.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.497+0000 7fe4f2495640 1 -- 172.21.15.86:0/1709590527 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4ec0d11c0 msgr2=0x7fe4ec15e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:33.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.497+0000 7fe4f2495640 1 --2- 172.21.15.86:0/1709590527 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4ec0d11c0 0x7fe4ec15e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.497+0000 7fe4f2495640 1 -- 172.21.15.86:0/1709590527 >> v1:172.21.15.86:6789/0 conn(0x7fe4ec0d0de0 legacy=0x7fe4ec0cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.497+0000 7fe4f2495640 1 -- 172.21.15.86:0/1709590527 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4ec15f3d0 con 0x7fe4ec155000 2024-09-19T06:37:33.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.497+0000 7fe4f1493640 1 --2- 172.21.15.86:0/1709590527 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4ec0d11c0 0x7fe4ec15e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:37:33.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.498+0000 7fe4f2495640 1 --2- 172.21.15.86:0/1709590527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4ec155000 0x7fe4ec155490 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009d90 tx=0x7fe4e402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5db3c45d1374023e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:33.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.498+0000 7fe4f0c92640 1 -- 172.21.15.86:0/1709590527 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e4007740 con 0x7fe4ec155000 2024-09-19T06:37:33.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.498+0000 7fe4f0c92640 1 -- 172.21.15.86:0/1709590527 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e40078e0 con 0x7fe4ec155000 2024-09-19T06:37:33.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.498+0000 7fe4f0c92640 1 -- 172.21.15.86:0/1709590527 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e4007c90 con 0x7fe4ec155000 2024-09-19T06:37:33.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.499+0000 7fe4f3ef8640 1 -- 172.21.15.86:0/1709590527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4ec155000 msgr2=0x7fe4ec155490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.499+0000 7fe4f3ef8640 1 --2- 172.21.15.86:0/1709590527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4ec155000 0x7fe4ec155490 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009d90 tx=0x7fe4e402a6f0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.499+0000 7fe4f3ef8640 1 -- 172.21.15.86:0/1709590527 shutdown_connections 2024-09-19T06:37:33.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.499+0000 7fe4f3ef8640 1 --2- 172.21.15.86:0/1709590527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4ec155000 0x7fe4ec155490 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.499+0000 7fe4f3ef8640 1 --2- 172.21.15.86:0/1709590527 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4ec0d11c0 0x7fe4ec15e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.499+0000 7fe4f3ef8640 1 -- 172.21.15.86:0/1709590527 >> 172.21.15.86:0/1709590527 conn(0x7fe4ec06d9f0 msgr2=0x7fe4ec06de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:33.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.499+0000 7fe4f3ef8640 1 -- 172.21.15.86:0/1709590527 shutdown_connections 2024-09-19T06:37:33.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.499+0000 7fe4f3ef8640 1 -- 172.21.15.86:0/1709590527 wait complete. 2024-09-19T06:37:33.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.500+0000 7fe4f3ef8640 1 Processor -- start 2024-09-19T06:37:33.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.500+0000 7fe4f3ef8640 1 -- start start 2024-09-19T06:37:33.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.501+0000 7fe4f3ef8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4ec0d0de0 0x7fe4ec155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:33.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.501+0000 7fe4f3ef8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4ec0d11c0 0x7fe4ec15c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:33.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.501+0000 7fe4f3ef8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4ec155000 0x7fe4ec1f3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:33.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.501+0000 7fe4f3ef8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ec0c7050 con 0x7fe4ec155000 2024-09-19T06:37:33.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.501+0000 7fe4f3ef8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ec0c6b30 con 0x7fe4ec0d11c0 2024-09-19T06:37:33.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.501+0000 7fe4f3ef8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe4ec0c71d0 con 0x7fe4ec0d0de0 2024-09-19T06:37:33.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.501+0000 7fe4f2495640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4ec155000 0x7fe4ec1f3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:33.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.501+0000 7fe4f2495640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4ec155000 0x7fe4ec1f3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56764/0 (socket says 172.21.15.86:56764) 2024-09-19T06:37:33.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.501+0000 7fe4f2495640 1 -- 172.21.15.86:0/852416029 learned_addr learned my addr 172.21.15.86:0/852416029 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:33.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.501+0000 7fe4f1c94640 1 --2- 172.21.15.86:0/852416029 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4ec0d0de0 0x7fe4ec155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:33.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.501+0000 7fe4f1493640 1 --2- 172.21.15.86:0/852416029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4ec0d11c0 0x7fe4ec15c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:33.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.501+0000 7fe4f2495640 1 -- 172.21.15.86:0/852416029 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4ec0d0de0 msgr2=0x7fe4ec155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.501+0000 7fe4f2495640 1 --2- 172.21.15.86:0/852416029 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4ec0d0de0 0x7fe4ec155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.501+0000 7fe4f2495640 1 -- 172.21.15.86:0/852416029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4ec0d11c0 msgr2=0x7fe4ec15c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.501+0000 7fe4f2495640 1 --2- 172.21.15.86:0/852416029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4ec0d11c0 0x7fe4ec15c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.501+0000 7fe4f2495640 1 -- 172.21.15.86:0/852416029 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4ec15c800 con 0x7fe4ec155000 2024-09-19T06:37:33.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.501+0000 7fe4f2495640 1 --2- 172.21.15.86:0/852416029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4ec155000 0x7fe4ec1f3f00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009eb0 tx=0x7fe4e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:33.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.501+0000 7fe4e27fc640 1 -- 172.21.15.86:0/852416029 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e4040030 con 0x7fe4ec155000 2024-09-19T06:37:33.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.501+0000 7fe4e27fc640 1 -- 172.21.15.86:0/852416029 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e4031a40 con 0x7fe4ec155000 2024-09-19T06:37:33.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.501+0000 7fe4e27fc640 1 -- 172.21.15.86:0/852416029 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e4009450 con 0x7fe4ec155000 2024-09-19T06:37:33.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.501+0000 7fe4f3ef8640 1 -- 172.21.15.86:0/852416029 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4ec0b6a90 con 0x7fe4ec155000 2024-09-19T06:37:33.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.501+0000 7fe4f3ef8640 1 -- 172.21.15.86:0/852416029 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4ec0b5af0 con 0x7fe4ec155000 2024-09-19T06:37:33.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.502+0000 7fe4f3ef8640 1 -- 172.21.15.86:0/852416029 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4ec155490 con 0x7fe4ec155000 2024-09-19T06:37:33.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.503+0000 7fe4e27fc640 1 -- 172.21.15.86:0/852416029 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe4e403b410 con 0x7fe4ec155000 2024-09-19T06:37:33.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.503+0000 7fe4e27fc640 1 --2- 172.21.15.86:0/852416029 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe4d006c2b0 0x7fe4d006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:33.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.503+0000 7fe4f1c94640 1 --2- 172.21.15.86:0/852416029 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe4d006c2b0 0x7fe4d006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:33.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.504+0000 7fe4e27fc640 1 -- 172.21.15.86:0/852416029 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe4e40ac560 con 0x7fe4ec155000 2024-09-19T06:37:33.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.504+0000 7fe4f1c94640 1 --2- 172.21.15.86:0/852416029 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe4d006c2b0 0x7fe4d006e770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8005880 tx=0x7fe4e8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:33.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.508+0000 7fe4e27fc640 1 -- 172.21.15.86:0/852416029 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe4e407a2b0 con 0x7fe4ec155000 2024-09-19T06:37:33.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.671+0000 7fe4f3ef8640 1 -- 172.21.15.86:0/852416029 --> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe4ec0d18b0 con 0x7fe4d006c2b0 2024-09-19T06:37:33.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.679+0000 7fe4e27fc640 1 -- 172.21.15.86:0/852416029 <== mgr.4105 v2:172.21.15.86:6816/4165134248 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332611 (secure 0 0 0) 0x7fe4ec0d18b0 con 0x7fe4d006c2b0 2024-09-19T06:37:33.684 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:33.686 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-09-19T06:37:33.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.682+0000 7fe4f3ef8640 1 -- 172.21.15.86:0/852416029 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe4d006c2b0 msgr2=0x7fe4d006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.682+0000 7fe4f3ef8640 1 --2- 172.21.15.86:0/852416029 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe4d006c2b0 0x7fe4d006e770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8005880 tx=0x7fe4e8009040 comp rx=0 tx=0).stop 2024-09-19T06:37:33.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.682+0000 7fe4f3ef8640 1 -- 172.21.15.86:0/852416029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4ec155000 msgr2=0x7fe4ec1f3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.682+0000 7fe4f3ef8640 1 --2- 172.21.15.86:0/852416029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4ec155000 0x7fe4ec1f3f00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009eb0 tx=0x7fe4e4004a40 comp rx=0 tx=0).stop 2024-09-19T06:37:33.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.682+0000 7fe4f3ef8640 1 -- 172.21.15.86:0/852416029 shutdown_connections 2024-09-19T06:37:33.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.682+0000 7fe4f3ef8640 1 --2- 172.21.15.86:0/852416029 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe4d006c2b0 0x7fe4d006e770 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.682+0000 7fe4f3ef8640 1 --2- 172.21.15.86:0/852416029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4ec155000 0x7fe4ec1f3f00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.682+0000 7fe4f3ef8640 1 --2- 172.21.15.86:0/852416029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4ec0d11c0 0x7fe4ec15c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.683+0000 7fe4f3ef8640 1 --2- 172.21.15.86:0/852416029 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4ec0d0de0 0x7fe4ec155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.683+0000 7fe4f3ef8640 1 -- 172.21.15.86:0/852416029 >> 172.21.15.86:0/852416029 conn(0x7fe4ec06d9f0 msgr2=0x7fe4ec152330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:33.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.683+0000 7fe4f3ef8640 1 -- 172.21.15.86:0/852416029 shutdown_connections 2024-09-19T06:37:33.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.683+0000 7fe4f3ef8640 1 -- 172.21.15.86:0/852416029 wait complete. 2024-09-19T06:37:33.695 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-19T06:37:31.745958+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218536,"kb_used_data":2304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756184,"statfs":{"total":773094113280,"available":772870332416,"internally_reserved":0,"allocated":2359296,"data_stored":2051860,"data_compressed":65040,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002691"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030305+0000","last_change":"2024-09-19T06:37:08.446272+0000","last_active":"2024-09-19T06:37:15.030305+0000","last_peered":"2024-09-19T06:37:15.030305+0000","last_clean":"2024-09-19T06:37:15.030305+0000","last_became_active":"2024-09-19T06:37:08.446044+0000","last_became_peered":"2024-09-19T06:37:08.446044+0000","last_unstale":"2024-09-19T06:37:15.030305+0000","last_undegraded":"2024-09-19T06:37:15.030305+0000","last_fullsized":"2024-09-19T06:37:15.030305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:37.623543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477629+0000","last_change":"2024-09-19T06:37:09.441539+0000","last_active":"2024-09-19T06:37:14.477629+0000","last_peered":"2024-09-19T06:37:14.477629+0000","last_clean":"2024-09-19T06:37:14.477629+0000","last_became_active":"2024-09-19T06:37:09.440839+0000","last_became_peered":"2024-09-19T06:37:09.440839+0000","last_unstale":"2024-09-19T06:37:14.477629+0000","last_undegraded":"2024-09-19T06:37:14.477629+0000","last_fullsized":"2024-09-19T06:37:14.477629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:49.222252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477205+0000","last_change":"2024-09-19T06:37:13.461355+0000","last_active":"2024-09-19T06:37:14.477205+0000","last_peered":"2024-09-19T06:37:14.477205+0000","last_clean":"2024-09-19T06:37:14.477205+0000","last_became_active":"2024-09-19T06:37:13.460936+0000","last_became_peered":"2024-09-19T06:37:13.460936+0000","last_unstale":"2024-09-19T06:37:14.477205+0000","last_undegraded":"2024-09-19T06:37:14.477205+0000","last_fullsized":"2024-09-19T06:37:14.477205+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:59.860583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477847+0000","last_change":"2024-09-19T06:37:08.438583+0000","last_active":"2024-09-19T06:37:14.477847+0000","last_peered":"2024-09-19T06:37:14.477847+0000","last_clean":"2024-09-19T06:37:14.477847+0000","last_became_active":"2024-09-19T06:37:08.437921+0000","last_became_peered":"2024-09-19T06:37:08.437921+0000","last_unstale":"2024-09-19T06:37:14.477847+0000","last_undegraded":"2024-09-19T06:37:14.477847+0000","last_fullsized":"2024-09-19T06:37:14.477847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:58:23.269120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030018+0000","last_change":"2024-09-19T06:37:09.450731+0000","last_active":"2024-09-19T06:37:15.030018+0000","last_peered":"2024-09-19T06:37:15.030018+0000","last_clean":"2024-09-19T06:37:15.030018+0000","last_became_active":"2024-09-19T06:37:09.450430+0000","last_became_peered":"2024-09-19T06:37:09.450430+0000","last_unstale":"2024-09-19T06:37:15.030018+0000","last_undegraded":"2024-09-19T06:37:15.030018+0000","last_fullsized":"2024-09-19T06:37:15.030018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:21.701872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029552+0000","last_change":"2024-09-19T06:37:13.459445+0000","last_active":"2024-09-19T06:37:15.029552+0000","last_peered":"2024-09-19T06:37:15.029552+0000","last_clean":"2024-09-19T06:37:15.029552+0000","last_became_active":"2024-09-19T06:37:13.459040+0000","last_became_peered":"2024-09-19T06:37:13.459040+0000","last_unstale":"2024-09-19T06:37:15.029552+0000","last_undegraded":"2024-09-19T06:37:15.029552+0000","last_fullsized":"2024-09-19T06:37:15.029552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:37.676097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479475+0000","last_change":"2024-09-19T06:37:08.448303+0000","last_active":"2024-09-19T06:37:14.479475+0000","last_peered":"2024-09-19T06:37:14.479475+0000","last_clean":"2024-09-19T06:37:14.479475+0000","last_became_active":"2024-09-19T06:37:08.447559+0000","last_became_peered":"2024-09-19T06:37:08.447559+0000","last_unstale":"2024-09-19T06:37:14.479475+0000","last_undegraded":"2024-09-19T06:37:14.479475+0000","last_fullsized":"2024-09-19T06:37:14.479475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:43.093216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030079+0000","last_change":"2024-09-19T06:37:09.445971+0000","last_active":"2024-09-19T06:37:15.030079+0000","last_peered":"2024-09-19T06:37:15.030079+0000","last_clean":"2024-09-19T06:37:15.030079+0000","last_became_active":"2024-09-19T06:37:09.444806+0000","last_became_peered":"2024-09-19T06:37:09.444806+0000","last_unstale":"2024-09-19T06:37:15.030079+0000","last_undegraded":"2024-09-19T06:37:15.030079+0000","last_fullsized":"2024-09-19T06:37:15.030079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:15.765835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030528+0000","last_change":"2024-09-19T06:37:13.459035+0000","last_active":"2024-09-19T06:37:15.030528+0000","last_peered":"2024-09-19T06:37:15.030528+0000","last_clean":"2024-09-19T06:37:15.030528+0000","last_became_active":"2024-09-19T06:37:13.458588+0000","last_became_peered":"2024-09-19T06:37:13.458588+0000","last_unstale":"2024-09-19T06:37:15.030528+0000","last_undegraded":"2024-09-19T06:37:15.030528+0000","last_fullsized":"2024-09-19T06:37:15.030528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:27.900054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479040+0000","last_change":"2024-09-19T06:37:08.446363+0000","last_active":"2024-09-19T06:37:14.479040+0000","last_peered":"2024-09-19T06:37:14.479040+0000","last_clean":"2024-09-19T06:37:14.479040+0000","last_became_active":"2024-09-19T06:37:08.446053+0000","last_became_peered":"2024-09-19T06:37:08.446053+0000","last_unstale":"2024-09-19T06:37:14.479040+0000","last_undegraded":"2024-09-19T06:37:14.479040+0000","last_fullsized":"2024-09-19T06:37:14.479040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:22.488347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030495+0000","last_change":"2024-09-19T06:37:09.445124+0000","last_active":"2024-09-19T06:37:15.030495+0000","last_peered":"2024-09-19T06:37:15.030495+0000","last_clean":"2024-09-19T06:37:15.030495+0000","last_became_active":"2024-09-19T06:37:09.444824+0000","last_became_peered":"2024-09-19T06:37:09.444824+0000","last_unstale":"2024-09-19T06:37:15.030495+0000","last_undegraded":"2024-09-19T06:37:15.030495+0000","last_fullsized":"2024-09-19T06:37:15.030495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:40:05.642055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030082+0000","last_change":"2024-09-19T06:37:13.459720+0000","last_active":"2024-09-19T06:37:15.030082+0000","last_peered":"2024-09-19T06:37:15.030082+0000","last_clean":"2024-09-19T06:37:15.030082+0000","last_became_active":"2024-09-19T06:37:13.459350+0000","last_became_peered":"2024-09-19T06:37:13.459350+0000","last_unstale":"2024-09-19T06:37:15.030082+0000","last_undegraded":"2024-09-19T06:37:15.030082+0000","last_fullsized":"2024-09-19T06:37:15.030082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:29.546976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478406+0000","last_change":"2024-09-19T06:37:09.447795+0000","last_active":"2024-09-19T06:37:14.478406+0000","last_peered":"2024-09-19T06:37:14.478406+0000","last_clean":"2024-09-19T06:37:14.478406+0000","last_became_active":"2024-09-19T06:37:09.447502+0000","last_became_peered":"2024-09-19T06:37:09.447502+0000","last_unstale":"2024-09-19T06:37:14.478406+0000","last_undegraded":"2024-09-19T06:37:14.478406+0000","last_fullsized":"2024-09-19T06:37:14.478406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:51.384743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479493+0000","last_change":"2024-09-19T06:37:08.446179+0000","last_active":"2024-09-19T06:37:14.479493+0000","last_peered":"2024-09-19T06:37:14.479493+0000","last_clean":"2024-09-19T06:37:14.479493+0000","last_became_active":"2024-09-19T06:37:08.445834+0000","last_became_peered":"2024-09-19T06:37:08.445834+0000","last_unstale":"2024-09-19T06:37:14.479493+0000","last_undegraded":"2024-09-19T06:37:14.479493+0000","last_fullsized":"2024-09-19T06:37:14.479493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:03.783414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030572+0000","last_change":"2024-09-19T06:37:13.460344+0000","last_active":"2024-09-19T06:37:15.030572+0000","last_peered":"2024-09-19T06:37:15.030572+0000","last_clean":"2024-09-19T06:37:15.030572+0000","last_became_active":"2024-09-19T06:37:13.459967+0000","last_became_peered":"2024-09-19T06:37:13.459967+0000","last_unstale":"2024-09-19T06:37:15.030572+0000","last_undegraded":"2024-09-19T06:37:15.030572+0000","last_fullsized":"2024-09-19T06:37:15.030572+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:59.096218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477943+0000","last_change":"2024-09-19T06:37:09.449884+0000","last_active":"2024-09-19T06:37:14.477943+0000","last_peered":"2024-09-19T06:37:14.477943+0000","last_clean":"2024-09-19T06:37:14.477943+0000","last_became_active":"2024-09-19T06:37:09.449645+0000","last_became_peered":"2024-09-19T06:37:09.449645+0000","last_unstale":"2024-09-19T06:37:14.477943+0000","last_undegraded":"2024-09-19T06:37:14.477943+0000","last_fullsized":"2024-09-19T06:37:14.477943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:07.353098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030475+0000","last_change":"2024-09-19T06:37:08.437022+0000","last_active":"2024-09-19T06:37:15.030475+0000","last_peered":"2024-09-19T06:37:15.030475+0000","last_clean":"2024-09-19T06:37:15.030475+0000","last_became_active":"2024-09-19T06:37:08.436761+0000","last_became_peered":"2024-09-19T06:37:08.436761+0000","last_unstale":"2024-09-19T06:37:15.030475+0000","last_undegraded":"2024-09-19T06:37:15.030475+0000","last_fullsized":"2024-09-19T06:37:15.030475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:04.985581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030395+0000","last_change":"2024-09-19T06:37:13.460470+0000","last_active":"2024-09-19T06:37:15.030395+0000","last_peered":"2024-09-19T06:37:15.030395+0000","last_clean":"2024-09-19T06:37:15.030395+0000","last_became_active":"2024-09-19T06:37:13.460072+0000","last_became_peered":"2024-09-19T06:37:13.460072+0000","last_unstale":"2024-09-19T06:37:15.030395+0000","last_undegraded":"2024-09-19T06:37:15.030395+0000","last_fullsized":"2024-09-19T06:37:15.030395+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:50.835286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477295+0000","last_change":"2024-09-19T06:37:09.433042+0000","last_active":"2024-09-19T06:37:14.477295+0000","last_peered":"2024-09-19T06:37:14.477295+0000","last_clean":"2024-09-19T06:37:14.477295+0000","last_became_active":"2024-09-19T06:37:09.432589+0000","last_became_peered":"2024-09-19T06:37:09.432589+0000","last_unstale":"2024-09-19T06:37:14.477295+0000","last_undegraded":"2024-09-19T06:37:14.477295+0000","last_fullsized":"2024-09-19T06:37:14.477295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:18.661071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029869+0000","last_change":"2024-09-19T06:37:08.444408+0000","last_active":"2024-09-19T06:37:15.029869+0000","last_peered":"2024-09-19T06:37:15.029869+0000","last_clean":"2024-09-19T06:37:15.029869+0000","last_became_active":"2024-09-19T06:37:08.444160+0000","last_became_peered":"2024-09-19T06:37:08.444160+0000","last_unstale":"2024-09-19T06:37:15.029869+0000","last_undegraded":"2024-09-19T06:37:15.029869+0000","last_fullsized":"2024-09-19T06:37:15.029869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:54.304153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030788+0000","last_change":"2024-09-19T06:37:13.466175+0000","last_active":"2024-09-19T06:37:15.030788+0000","last_peered":"2024-09-19T06:37:15.030788+0000","last_clean":"2024-09-19T06:37:15.030788+0000","last_became_active":"2024-09-19T06:37:13.465731+0000","last_became_peered":"2024-09-19T06:37:13.465731+0000","last_unstale":"2024-09-19T06:37:15.030788+0000","last_undegraded":"2024-09-19T06:37:15.030788+0000","last_fullsized":"2024-09-19T06:37:15.030788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:01.100164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029947+0000","last_change":"2024-09-19T06:37:09.437254+0000","last_active":"2024-09-19T06:37:15.029947+0000","last_peered":"2024-09-19T06:37:15.029947+0000","last_clean":"2024-09-19T06:37:15.029947+0000","last_became_active":"2024-09-19T06:37:09.436512+0000","last_became_peered":"2024-09-19T06:37:09.436512+0000","last_unstale":"2024-09-19T06:37:15.029947+0000","last_undegraded":"2024-09-19T06:37:15.029947+0000","last_fullsized":"2024-09-19T06:37:15.029947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:21.893793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478028+0000","last_change":"2024-09-19T06:37:08.446216+0000","last_active":"2024-09-19T06:37:14.478028+0000","last_peered":"2024-09-19T06:37:14.478028+0000","last_clean":"2024-09-19T06:37:14.478028+0000","last_became_active":"2024-09-19T06:37:08.445845+0000","last_became_peered":"2024-09-19T06:37:08.445845+0000","last_unstale":"2024-09-19T06:37:14.478028+0000","last_undegraded":"2024-09-19T06:37:14.478028+0000","last_fullsized":"2024-09-19T06:37:14.478028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:04.033283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030215+0000","last_change":"2024-09-19T06:37:13.462192+0000","last_active":"2024-09-19T06:37:15.030215+0000","last_peered":"2024-09-19T06:37:15.030215+0000","last_clean":"2024-09-19T06:37:15.030215+0000","last_became_active":"2024-09-19T06:37:13.460955+0000","last_became_peered":"2024-09-19T06:37:13.460955+0000","last_unstale":"2024-09-19T06:37:15.030215+0000","last_undegraded":"2024-09-19T06:37:15.030215+0000","last_fullsized":"2024-09-19T06:37:15.030215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:53.583488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030554+0000","last_change":"2024-09-19T06:37:09.445989+0000","last_active":"2024-09-19T06:37:15.030554+0000","last_peered":"2024-09-19T06:37:15.030554+0000","last_clean":"2024-09-19T06:37:15.030554+0000","last_became_active":"2024-09-19T06:37:09.445705+0000","last_became_peered":"2024-09-19T06:37:09.445705+0000","last_unstale":"2024-09-19T06:37:15.030554+0000","last_undegraded":"2024-09-19T06:37:15.030554+0000","last_fullsized":"2024-09-19T06:37:15.030554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:24.592460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478969+0000","last_change":"2024-09-19T06:37:08.446226+0000","last_active":"2024-09-19T06:37:14.478969+0000","last_peered":"2024-09-19T06:37:14.478969+0000","last_clean":"2024-09-19T06:37:14.478969+0000","last_became_active":"2024-09-19T06:37:08.445929+0000","last_became_peered":"2024-09-19T06:37:08.445929+0000","last_unstale":"2024-09-19T06:37:14.478969+0000","last_undegraded":"2024-09-19T06:37:14.478969+0000","last_fullsized":"2024-09-19T06:37:14.478969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:32.233033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029648+0000","last_change":"2024-09-19T06:37:13.462598+0000","last_active":"2024-09-19T06:37:15.029648+0000","last_peered":"2024-09-19T06:37:15.029648+0000","last_clean":"2024-09-19T06:37:15.029648+0000","last_became_active":"2024-09-19T06:37:13.462217+0000","last_became_peered":"2024-09-19T06:37:13.462217+0000","last_unstale":"2024-09-19T06:37:15.029648+0000","last_undegraded":"2024-09-19T06:37:15.029648+0000","last_fullsized":"2024-09-19T06:37:15.029648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:04.109419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477866+0000","last_change":"2024-09-19T06:37:09.434309+0000","last_active":"2024-09-19T06:37:14.477866+0000","last_peered":"2024-09-19T06:37:14.477866+0000","last_clean":"2024-09-19T06:37:14.477866+0000","last_became_active":"2024-09-19T06:37:09.433897+0000","last_became_peered":"2024-09-19T06:37:09.433897+0000","last_unstale":"2024-09-19T06:37:14.477866+0000","last_undegraded":"2024-09-19T06:37:14.477866+0000","last_fullsized":"2024-09-19T06:37:14.477866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:59.054484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030307+0000","last_change":"2024-09-19T06:37:08.441525+0000","last_active":"2024-09-19T06:37:15.030307+0000","last_peered":"2024-09-19T06:37:15.030307+0000","last_clean":"2024-09-19T06:37:15.030307+0000","last_became_active":"2024-09-19T06:37:08.441245+0000","last_became_peered":"2024-09-19T06:37:08.441245+0000","last_unstale":"2024-09-19T06:37:15.030307+0000","last_undegraded":"2024-09-19T06:37:15.030307+0000","last_fullsized":"2024-09-19T06:37:15.030307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:19.820705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477133+0000","last_change":"2024-09-19T06:37:13.468486+0000","last_active":"2024-09-19T06:37:14.477133+0000","last_peered":"2024-09-19T06:37:14.477133+0000","last_clean":"2024-09-19T06:37:14.477133+0000","last_became_active":"2024-09-19T06:37:13.468074+0000","last_became_peered":"2024-09-19T06:37:13.468074+0000","last_unstale":"2024-09-19T06:37:14.477133+0000","last_undegraded":"2024-09-19T06:37:14.477133+0000","last_fullsized":"2024-09-19T06:37:14.477133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:36.783781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030772+0000","last_change":"2024-09-19T06:37:09.435864+0000","last_active":"2024-09-19T06:37:15.030772+0000","last_peered":"2024-09-19T06:37:15.030772+0000","last_clean":"2024-09-19T06:37:15.030772+0000","last_became_active":"2024-09-19T06:37:09.435597+0000","last_became_peered":"2024-09-19T06:37:09.435597+0000","last_unstale":"2024-09-19T06:37:15.030772+0000","last_undegraded":"2024-09-19T06:37:15.030772+0000","last_fullsized":"2024-09-19T06:37:15.030772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:20.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479615+0000","last_change":"2024-09-19T06:37:08.447931+0000","last_active":"2024-09-19T06:37:14.479615+0000","last_peered":"2024-09-19T06:37:14.479615+0000","last_clean":"2024-09-19T06:37:14.479615+0000","last_became_active":"2024-09-19T06:37:08.447630+0000","last_became_peered":"2024-09-19T06:37:08.447630+0000","last_unstale":"2024-09-19T06:37:14.479615+0000","last_undegraded":"2024-09-19T06:37:14.479615+0000","last_fullsized":"2024-09-19T06:37:14.479615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:17.375740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030552+0000","last_change":"2024-09-19T06:37:13.468360+0000","last_active":"2024-09-19T06:37:15.030552+0000","last_peered":"2024-09-19T06:37:15.030552+0000","last_clean":"2024-09-19T06:37:15.030552+0000","last_became_active":"2024-09-19T06:37:13.467926+0000","last_became_peered":"2024-09-19T06:37:13.467926+0000","last_unstale":"2024-09-19T06:37:15.030552+0000","last_undegraded":"2024-09-19T06:37:15.030552+0000","last_fullsized":"2024-09-19T06:37:15.030552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:55.089630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030606+0000","last_change":"2024-09-19T06:37:09.441678+0000","last_active":"2024-09-19T06:37:15.030606+0000","last_peered":"2024-09-19T06:37:15.030606+0000","last_clean":"2024-09-19T06:37:15.030606+0000","last_became_active":"2024-09-19T06:37:09.441406+0000","last_became_peered":"2024-09-19T06:37:09.441406+0000","last_unstale":"2024-09-19T06:37:15.030606+0000","last_undegraded":"2024-09-19T06:37:15.030606+0000","last_fullsized":"2024-09-19T06:37:15.030606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:14.638004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030831+0000","last_change":"2024-09-19T06:37:08.438805+0000","last_active":"2024-09-19T06:37:15.030831+0000","last_peered":"2024-09-19T06:37:15.030831+0000","last_clean":"2024-09-19T06:37:15.030831+0000","last_became_active":"2024-09-19T06:37:08.438528+0000","last_became_peered":"2024-09-19T06:37:08.438528+0000","last_unstale":"2024-09-19T06:37:15.030831+0000","last_undegraded":"2024-09-19T06:37:15.030831+0000","last_fullsized":"2024-09-19T06:37:15.030831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:55.500347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030303+0000","last_change":"2024-09-19T06:37:13.459697+0000","last_active":"2024-09-19T06:37:15.030303+0000","last_peered":"2024-09-19T06:37:15.030303+0000","last_clean":"2024-09-19T06:37:15.030303+0000","last_became_active":"2024-09-19T06:37:13.459303+0000","last_became_peered":"2024-09-19T06:37:13.459303+0000","last_unstale":"2024-09-19T06:37:15.030303+0000","last_undegraded":"2024-09-19T06:37:15.030303+0000","last_fullsized":"2024-09-19T06:37:15.030303+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:01.695905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.031009+0000","last_change":"2024-09-19T06:37:09.449701+0000","last_active":"2024-09-19T06:37:15.031009+0000","last_peered":"2024-09-19T06:37:15.031009+0000","last_clean":"2024-09-19T06:37:15.031009+0000","last_became_active":"2024-09-19T06:37:09.448899+0000","last_became_peered":"2024-09-19T06:37:09.448899+0000","last_unstale":"2024-09-19T06:37:15.031009+0000","last_undegraded":"2024-09-19T06:37:15.031009+0000","last_fullsized":"2024-09-19T06:37:15.031009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:17.448251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030609+0000","last_change":"2024-09-19T06:37:08.434263+0000","last_active":"2024-09-19T06:37:15.030609+0000","last_peered":"2024-09-19T06:37:15.030609+0000","last_clean":"2024-09-19T06:37:15.030609+0000","last_became_active":"2024-09-19T06:37:08.433984+0000","last_became_peered":"2024-09-19T06:37:08.433984+0000","last_unstale":"2024-09-19T06:37:15.030609+0000","last_undegraded":"2024-09-19T06:37:15.030609+0000","last_fullsized":"2024-09-19T06:37:15.030609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:05.599054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030728+0000","last_change":"2024-09-19T06:37:13.464527+0000","last_active":"2024-09-19T06:37:15.030728+0000","last_peered":"2024-09-19T06:37:15.030728+0000","last_clean":"2024-09-19T06:37:15.030728+0000","last_became_active":"2024-09-19T06:37:13.461685+0000","last_became_peered":"2024-09-19T06:37:13.461685+0000","last_unstale":"2024-09-19T06:37:15.030728+0000","last_undegraded":"2024-09-19T06:37:15.030728+0000","last_fullsized":"2024-09-19T06:37:15.030728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:57.229892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030028+0000","last_change":"2024-09-19T06:37:09.434421+0000","last_active":"2024-09-19T06:37:15.030028+0000","last_peered":"2024-09-19T06:37:15.030028+0000","last_clean":"2024-09-19T06:37:15.030028+0000","last_became_active":"2024-09-19T06:37:09.434119+0000","last_became_peered":"2024-09-19T06:37:09.434119+0000","last_unstale":"2024-09-19T06:37:15.030028+0000","last_undegraded":"2024-09-19T06:37:15.030028+0000","last_fullsized":"2024-09-19T06:37:15.030028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:56.984336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.814975+0000","last_change":"2024-09-19T06:37:08.436856+0000","last_active":"2024-09-19T06:37:14.814975+0000","last_peered":"2024-09-19T06:37:14.814975+0000","last_clean":"2024-09-19T06:37:14.814975+0000","last_became_active":"2024-09-19T06:37:08.435718+0000","last_became_peered":"2024-09-19T06:37:08.435718+0000","last_unstale":"2024-09-19T06:37:14.814975+0000","last_undegraded":"2024-09-19T06:37:14.814975+0000","last_fullsized":"2024-09-19T06:37:14.814975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:58.650430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030892+0000","last_change":"2024-09-19T06:37:13.466081+0000","last_active":"2024-09-19T06:37:15.030892+0000","last_peered":"2024-09-19T06:37:15.030892+0000","last_clean":"2024-09-19T06:37:15.030892+0000","last_became_active":"2024-09-19T06:37:13.465348+0000","last_became_peered":"2024-09-19T06:37:13.465348+0000","last_unstale":"2024-09-19T06:37:15.030892+0000","last_undegraded":"2024-09-19T06:37:15.030892+0000","last_fullsized":"2024-09-19T06:37:15.030892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:11.592737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029583+0000","last_change":"2024-09-19T06:37:09.444888+0000","last_active":"2024-09-19T06:37:15.029583+0000","last_peered":"2024-09-19T06:37:15.029583+0000","last_clean":"2024-09-19T06:37:15.029583+0000","last_became_active":"2024-09-19T06:37:09.444605+0000","last_became_peered":"2024-09-19T06:37:09.444605+0000","last_unstale":"2024-09-19T06:37:15.029583+0000","last_undegraded":"2024-09-19T06:37:15.029583+0000","last_fullsized":"2024-09-19T06:37:15.029583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:53.868356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478136+0000","last_change":"2024-09-19T06:37:08.446760+0000","last_active":"2024-09-19T06:37:14.478136+0000","last_peered":"2024-09-19T06:37:14.478136+0000","last_clean":"2024-09-19T06:37:14.478136+0000","last_became_active":"2024-09-19T06:37:08.446474+0000","last_became_peered":"2024-09-19T06:37:08.446474+0000","last_unstale":"2024-09-19T06:37:14.478136+0000","last_undegraded":"2024-09-19T06:37:14.478136+0000","last_fullsized":"2024-09-19T06:37:14.478136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:12.597952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030429+0000","last_change":"2024-09-19T06:37:13.471220+0000","last_active":"2024-09-19T06:37:15.030429+0000","last_peered":"2024-09-19T06:37:15.030429+0000","last_clean":"2024-09-19T06:37:15.030429+0000","last_became_active":"2024-09-19T06:37:13.470860+0000","last_became_peered":"2024-09-19T06:37:13.470860+0000","last_unstale":"2024-09-19T06:37:15.030429+0000","last_undegraded":"2024-09-19T06:37:15.030429+0000","last_fullsized":"2024-09-19T06:37:15.030429+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:07.659583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477346+0000","last_change":"2024-09-19T06:37:09.440366+0000","last_active":"2024-09-19T06:37:14.477346+0000","last_peered":"2024-09-19T06:37:14.477346+0000","last_clean":"2024-09-19T06:37:14.477346+0000","last_became_active":"2024-09-19T06:37:09.439478+0000","last_became_peered":"2024-09-19T06:37:09.439478+0000","last_unstale":"2024-09-19T06:37:14.477346+0000","last_undegraded":"2024-09-19T06:37:14.477346+0000","last_fullsized":"2024-09-19T06:37:14.477346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:21.837351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029827+0000","last_change":"2024-09-19T06:37:08.435473+0000","last_active":"2024-09-19T06:37:15.029827+0000","last_peered":"2024-09-19T06:37:15.029827+0000","last_clean":"2024-09-19T06:37:15.029827+0000","last_became_active":"2024-09-19T06:37:08.435183+0000","last_became_peered":"2024-09-19T06:37:08.435183+0000","last_unstale":"2024-09-19T06:37:15.029827+0000","last_undegraded":"2024-09-19T06:37:15.029827+0000","last_fullsized":"2024-09-19T06:37:15.029827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:53.115010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478240+0000","last_change":"2024-09-19T06:36:58.829099+0000","last_active":"2024-09-19T06:37:14.478240+0000","last_peered":"2024-09-19T06:37:14.478240+0000","last_clean":"2024-09-19T06:37:14.478240+0000","last_became_active":"2024-09-19T06:36:58.828079+0000","last_became_peered":"2024-09-19T06:36:58.828079+0000","last_unstale":"2024-09-19T06:37:14.478240+0000","last_undegraded":"2024-09-19T06:37:14.478240+0000","last_fullsized":"2024-09-19T06:37:14.478240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:36:57.771085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:36:57.771085+0000","last_clean_scrub_stamp":"2024-09-19T06:36:57.771085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:14.663925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477944+0000","last_change":"2024-09-19T06:37:13.464435+0000","last_active":"2024-09-19T06:37:14.477944+0000","last_peered":"2024-09-19T06:37:14.477944+0000","last_clean":"2024-09-19T06:37:14.477944+0000","last_became_active":"2024-09-19T06:37:13.464101+0000","last_became_peered":"2024-09-19T06:37:13.464101+0000","last_unstale":"2024-09-19T06:37:14.477944+0000","last_undegraded":"2024-09-19T06:37:14.477944+0000","last_fullsized":"2024-09-19T06:37:14.477944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:30.073937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479308+0000","last_change":"2024-09-19T06:37:09.442774+0000","last_active":"2024-09-19T06:37:14.479308+0000","last_peered":"2024-09-19T06:37:14.479308+0000","last_clean":"2024-09-19T06:37:14.479308+0000","last_became_active":"2024-09-19T06:37:09.442515+0000","last_became_peered":"2024-09-19T06:37:09.442515+0000","last_unstale":"2024-09-19T06:37:14.479308+0000","last_undegraded":"2024-09-19T06:37:14.479308+0000","last_fullsized":"2024-09-19T06:37:14.479308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:57.376059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815252+0000","last_change":"2024-09-19T06:37:08.438038+0000","last_active":"2024-09-19T06:37:14.815252+0000","last_peered":"2024-09-19T06:37:14.815252+0000","last_clean":"2024-09-19T06:37:14.815252+0000","last_became_active":"2024-09-19T06:37:08.437771+0000","last_became_peered":"2024-09-19T06:37:08.437771+0000","last_unstale":"2024-09-19T06:37:14.815252+0000","last_undegraded":"2024-09-19T06:37:14.815252+0000","last_fullsized":"2024-09-19T06:37:14.815252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:07.210382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477772+0000","last_change":"2024-09-19T06:37:13.470916+0000","last_active":"2024-09-19T06:37:14.477772+0000","last_peered":"2024-09-19T06:37:14.477772+0000","last_clean":"2024-09-19T06:37:14.477772+0000","last_became_active":"2024-09-19T06:37:13.470488+0000","last_became_peered":"2024-09-19T06:37:13.470488+0000","last_unstale":"2024-09-19T06:37:14.477772+0000","last_undegraded":"2024-09-19T06:37:14.477772+0000","last_fullsized":"2024-09-19T06:37:14.477772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:27.884932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030150+0000","last_change":"2024-09-19T06:37:09.442213+0000","last_active":"2024-09-19T06:37:15.030150+0000","last_peered":"2024-09-19T06:37:15.030150+0000","last_clean":"2024-09-19T06:37:15.030150+0000","last_became_active":"2024-09-19T06:37:09.441850+0000","last_became_peered":"2024-09-19T06:37:09.441850+0000","last_unstale":"2024-09-19T06:37:15.030150+0000","last_undegraded":"2024-09-19T06:37:15.030150+0000","last_fullsized":"2024-09-19T06:37:15.030150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:43.728914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030863+0000","last_change":"2024-09-19T06:37:08.431703+0000","last_active":"2024-09-19T06:37:15.030863+0000","last_peered":"2024-09-19T06:37:15.030863+0000","last_clean":"2024-09-19T06:37:15.030863+0000","last_became_active":"2024-09-19T06:37:08.431443+0000","last_became_peered":"2024-09-19T06:37:08.431443+0000","last_unstale":"2024-09-19T06:37:15.030863+0000","last_undegraded":"2024-09-19T06:37:15.030863+0000","last_fullsized":"2024-09-19T06:37:15.030863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:02.007521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030768+0000","last_change":"2024-09-19T06:37:13.469295+0000","last_active":"2024-09-19T06:37:15.030768+0000","last_peered":"2024-09-19T06:37:15.030768+0000","last_clean":"2024-09-19T06:37:15.030768+0000","last_became_active":"2024-09-19T06:37:13.468879+0000","last_became_peered":"2024-09-19T06:37:13.468879+0000","last_unstale":"2024-09-19T06:37:15.030768+0000","last_undegraded":"2024-09-19T06:37:15.030768+0000","last_fullsized":"2024-09-19T06:37:15.030768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:34.380034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479747+0000","last_change":"2024-09-19T06:37:09.439264+0000","last_active":"2024-09-19T06:37:14.479747+0000","last_peered":"2024-09-19T06:37:14.479747+0000","last_clean":"2024-09-19T06:37:14.479747+0000","last_became_active":"2024-09-19T06:37:09.438954+0000","last_became_peered":"2024-09-19T06:37:09.438954+0000","last_unstale":"2024-09-19T06:37:14.479747+0000","last_undegraded":"2024-09-19T06:37:14.479747+0000","last_fullsized":"2024-09-19T06:37:14.479747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:55.094093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815232+0000","last_change":"2024-09-19T06:37:08.437406+0000","last_active":"2024-09-19T06:37:14.815232+0000","last_peered":"2024-09-19T06:37:14.815232+0000","last_clean":"2024-09-19T06:37:14.815232+0000","last_became_active":"2024-09-19T06:37:08.437093+0000","last_became_peered":"2024-09-19T06:37:08.437093+0000","last_unstale":"2024-09-19T06:37:14.815232+0000","last_undegraded":"2024-09-19T06:37:14.815232+0000","last_fullsized":"2024-09-19T06:37:14.815232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:25.158027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029476+0000","last_change":"2024-09-19T06:37:13.460116+0000","last_active":"2024-09-19T06:37:15.029476+0000","last_peered":"2024-09-19T06:37:15.029476+0000","last_clean":"2024-09-19T06:37:15.029476+0000","last_became_active":"2024-09-19T06:37:13.459707+0000","last_became_peered":"2024-09-19T06:37:13.459707+0000","last_unstale":"2024-09-19T06:37:15.029476+0000","last_undegraded":"2024-09-19T06:37:15.029476+0000","last_fullsized":"2024-09-19T06:37:15.029476+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:02.657115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479032+0000","last_change":"2024-09-19T06:37:09.442670+0000","last_active":"2024-09-19T06:37:14.479032+0000","last_peered":"2024-09-19T06:37:14.479032+0000","last_clean":"2024-09-19T06:37:14.479032+0000","last_became_active":"2024-09-19T06:37:09.442390+0000","last_became_peered":"2024-09-19T06:37:09.442390+0000","last_unstale":"2024-09-19T06:37:14.479032+0000","last_undegraded":"2024-09-19T06:37:14.479032+0000","last_fullsized":"2024-09-19T06:37:14.479032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:02:26.726663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030129+0000","last_change":"2024-09-19T06:37:08.437263+0000","last_active":"2024-09-19T06:37:15.030129+0000","last_peered":"2024-09-19T06:37:15.030129+0000","last_clean":"2024-09-19T06:37:15.030129+0000","last_became_active":"2024-09-19T06:37:08.436982+0000","last_became_peered":"2024-09-19T06:37:08.436982+0000","last_unstale":"2024-09-19T06:37:15.030129+0000","last_undegraded":"2024-09-19T06:37:15.030129+0000","last_fullsized":"2024-09-19T06:37:15.030129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:14.895925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029466+0000","last_change":"2024-09-19T06:37:13.459433+0000","last_active":"2024-09-19T06:37:15.029466+0000","last_peered":"2024-09-19T06:37:15.029466+0000","last_clean":"2024-09-19T06:37:15.029466+0000","last_became_active":"2024-09-19T06:37:13.459031+0000","last_became_peered":"2024-09-19T06:37:13.459031+0000","last_unstale":"2024-09-19T06:37:15.029466+0000","last_undegraded":"2024-09-19T06:37:15.029466+0000","last_fullsized":"2024-09-19T06:37:15.029466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:07.294413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478514+0000","last_change":"2024-09-19T06:37:09.439142+0000","last_active":"2024-09-19T06:37:14.478514+0000","last_peered":"2024-09-19T06:37:14.478514+0000","last_clean":"2024-09-19T06:37:14.478514+0000","last_became_active":"2024-09-19T06:37:09.437717+0000","last_became_peered":"2024-09-19T06:37:09.437717+0000","last_unstale":"2024-09-19T06:37:14.478514+0000","last_undegraded":"2024-09-19T06:37:14.478514+0000","last_fullsized":"2024-09-19T06:37:14.478514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:32.934290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.814858+0000","last_change":"2024-09-19T06:37:08.430649+0000","last_active":"2024-09-19T06:37:14.814858+0000","last_peered":"2024-09-19T06:37:14.814858+0000","last_clean":"2024-09-19T06:37:14.814858+0000","last_became_active":"2024-09-19T06:37:08.430324+0000","last_became_peered":"2024-09-19T06:37:08.430324+0000","last_unstale":"2024-09-19T06:37:14.814858+0000","last_undegraded":"2024-09-19T06:37:14.814858+0000","last_fullsized":"2024-09-19T06:37:14.814858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:56.656357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030152+0000","last_change":"2024-09-19T06:37:13.463695+0000","last_active":"2024-09-19T06:37:15.030152+0000","last_peered":"2024-09-19T06:37:15.030152+0000","last_clean":"2024-09-19T06:37:15.030152+0000","last_became_active":"2024-09-19T06:37:13.463334+0000","last_became_peered":"2024-09-19T06:37:13.463334+0000","last_unstale":"2024-09-19T06:37:15.030152+0000","last_undegraded":"2024-09-19T06:37:15.030152+0000","last_fullsized":"2024-09-19T06:37:15.030152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:46.991800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477668+0000","last_change":"2024-09-19T06:37:09.450168+0000","last_active":"2024-09-19T06:37:14.477668+0000","last_peered":"2024-09-19T06:37:14.477668+0000","last_clean":"2024-09-19T06:37:14.477668+0000","last_became_active":"2024-09-19T06:37:09.449872+0000","last_became_peered":"2024-09-19T06:37:09.449872+0000","last_unstale":"2024-09-19T06:37:14.477668+0000","last_undegraded":"2024-09-19T06:37:14.477668+0000","last_fullsized":"2024-09-19T06:37:14.477668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:02:28.282840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478710+0000","last_change":"2024-09-19T06:37:08.442428+0000","last_active":"2024-09-19T06:37:14.478710+0000","last_peered":"2024-09-19T06:37:14.478710+0000","last_clean":"2024-09-19T06:37:14.478710+0000","last_became_active":"2024-09-19T06:37:08.442120+0000","last_became_peered":"2024-09-19T06:37:08.442120+0000","last_unstale":"2024-09-19T06:37:14.478710+0000","last_undegraded":"2024-09-19T06:37:14.478710+0000","last_fullsized":"2024-09-19T06:37:14.478710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:48.816822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477870+0000","last_change":"2024-09-19T06:37:13.471319+0000","last_active":"2024-09-19T06:37:14.477870+0000","last_peered":"2024-09-19T06:37:14.477870+0000","last_clean":"2024-09-19T06:37:14.477870+0000","last_became_active":"2024-09-19T06:37:13.470887+0000","last_became_peered":"2024-09-19T06:37:13.470887+0000","last_unstale":"2024-09-19T06:37:14.477870+0000","last_undegraded":"2024-09-19T06:37:14.477870+0000","last_fullsized":"2024-09-19T06:37:14.477870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:21.884985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479407+0000","last_change":"2024-09-19T06:37:09.439142+0000","last_active":"2024-09-19T06:37:14.479407+0000","last_peered":"2024-09-19T06:37:14.479407+0000","last_clean":"2024-09-19T06:37:14.479407+0000","last_became_active":"2024-09-19T06:37:09.437635+0000","last_became_peered":"2024-09-19T06:37:09.437635+0000","last_unstale":"2024-09-19T06:37:14.479407+0000","last_undegraded":"2024-09-19T06:37:14.479407+0000","last_fullsized":"2024-09-19T06:37:14.479407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:46.773889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030517+0000","last_change":"2024-09-19T06:37:08.438932+0000","last_active":"2024-09-19T06:37:15.030517+0000","last_peered":"2024-09-19T06:37:15.030517+0000","last_clean":"2024-09-19T06:37:15.030517+0000","last_became_active":"2024-09-19T06:37:08.438405+0000","last_became_peered":"2024-09-19T06:37:08.438405+0000","last_unstale":"2024-09-19T06:37:15.030517+0000","last_undegraded":"2024-09-19T06:37:15.030517+0000","last_fullsized":"2024-09-19T06:37:15.030517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:59.606628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477677+0000","last_change":"2024-09-19T06:37:13.459370+0000","last_active":"2024-09-19T06:37:14.477677+0000","last_peered":"2024-09-19T06:37:14.477677+0000","last_clean":"2024-09-19T06:37:14.477677+0000","last_became_active":"2024-09-19T06:37:13.458928+0000","last_became_peered":"2024-09-19T06:37:13.458928+0000","last_unstale":"2024-09-19T06:37:14.477677+0000","last_undegraded":"2024-09-19T06:37:14.477677+0000","last_fullsized":"2024-09-19T06:37:14.477677+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:00.179404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029933+0000","last_change":"2024-09-19T06:37:09.448958+0000","last_active":"2024-09-19T06:37:15.029933+0000","last_peered":"2024-09-19T06:37:15.029933+0000","last_clean":"2024-09-19T06:37:15.029933+0000","last_became_active":"2024-09-19T06:37:09.448697+0000","last_became_peered":"2024-09-19T06:37:09.448697+0000","last_unstale":"2024-09-19T06:37:15.029933+0000","last_undegraded":"2024-09-19T06:37:15.029933+0000","last_fullsized":"2024-09-19T06:37:15.029933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:16.306915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030900+0000","last_change":"2024-09-19T06:37:08.442685+0000","last_active":"2024-09-19T06:37:15.030900+0000","last_peered":"2024-09-19T06:37:15.030900+0000","last_clean":"2024-09-19T06:37:15.030900+0000","last_became_active":"2024-09-19T06:37:08.442436+0000","last_became_peered":"2024-09-19T06:37:08.442436+0000","last_unstale":"2024-09-19T06:37:15.030900+0000","last_undegraded":"2024-09-19T06:37:15.030900+0000","last_fullsized":"2024-09-19T06:37:15.030900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:09.952733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030332+0000","last_change":"2024-09-19T06:37:13.457651+0000","last_active":"2024-09-19T06:37:15.030332+0000","last_peered":"2024-09-19T06:37:15.030332+0000","last_clean":"2024-09-19T06:37:15.030332+0000","last_became_active":"2024-09-19T06:37:13.457246+0000","last_became_peered":"2024-09-19T06:37:13.457246+0000","last_unstale":"2024-09-19T06:37:15.030332+0000","last_undegraded":"2024-09-19T06:37:15.030332+0000","last_fullsized":"2024-09-19T06:37:15.030332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:18.553158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479228+0000","last_change":"2024-09-19T06:37:09.441212+0000","last_active":"2024-09-19T06:37:14.479228+0000","last_peered":"2024-09-19T06:37:14.479228+0000","last_clean":"2024-09-19T06:37:14.479228+0000","last_became_active":"2024-09-19T06:37:09.440209+0000","last_became_peered":"2024-09-19T06:37:09.440209+0000","last_unstale":"2024-09-19T06:37:14.479228+0000","last_undegraded":"2024-09-19T06:37:14.479228+0000","last_fullsized":"2024-09-19T06:37:14.479228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:52.173784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:24.168847+0000","last_change":"2024-09-19T06:37:08.442615+0000","last_active":"2024-09-19T06:37:24.168847+0000","last_peered":"2024-09-19T06:37:24.168847+0000","last_clean":"2024-09-19T06:37:24.168847+0000","last_became_active":"2024-09-19T06:37:08.442242+0000","last_became_peered":"2024-09-19T06:37:08.442242+0000","last_unstale":"2024-09-19T06:37:24.168847+0000","last_undegraded":"2024-09-19T06:37:24.168847+0000","last_fullsized":"2024-09-19T06:37:24.168847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:23.813400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030495+0000","last_change":"2024-09-19T06:37:13.464688+0000","last_active":"2024-09-19T06:37:15.030495+0000","last_peered":"2024-09-19T06:37:15.030495+0000","last_clean":"2024-09-19T06:37:15.030495+0000","last_became_active":"2024-09-19T06:37:13.461620+0000","last_became_peered":"2024-09-19T06:37:13.461620+0000","last_unstale":"2024-09-19T06:37:15.030495+0000","last_undegraded":"2024-09-19T06:37:15.030495+0000","last_fullsized":"2024-09-19T06:37:15.030495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:02.928332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030727+0000","last_change":"2024-09-19T06:37:09.440021+0000","last_active":"2024-09-19T06:37:15.030727+0000","last_peered":"2024-09-19T06:37:15.030727+0000","last_clean":"2024-09-19T06:37:15.030727+0000","last_became_active":"2024-09-19T06:37:09.437800+0000","last_became_peered":"2024-09-19T06:37:09.437800+0000","last_unstale":"2024-09-19T06:37:15.030727+0000","last_undegraded":"2024-09-19T06:37:15.030727+0000","last_fullsized":"2024-09-19T06:37:15.030727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:51.963097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030761+0000","last_change":"2024-09-19T06:37:08.434422+0000","last_active":"2024-09-19T06:37:15.030761+0000","last_peered":"2024-09-19T06:37:15.030761+0000","last_clean":"2024-09-19T06:37:15.030761+0000","last_became_active":"2024-09-19T06:37:08.434151+0000","last_became_peered":"2024-09-19T06:37:08.434151+0000","last_unstale":"2024-09-19T06:37:15.030761+0000","last_undegraded":"2024-09-19T06:37:15.030761+0000","last_fullsized":"2024-09-19T06:37:15.030761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:49.540748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030746+0000","last_change":"2024-09-19T06:37:13.459321+0000","last_active":"2024-09-19T06:37:15.030746+0000","last_peered":"2024-09-19T06:37:15.030746+0000","last_clean":"2024-09-19T06:37:15.030746+0000","last_became_active":"2024-09-19T06:37:13.458924+0000","last_became_peered":"2024-09-19T06:37:13.458924+0000","last_unstale":"2024-09-19T06:37:15.030746+0000","last_undegraded":"2024-09-19T06:37:15.030746+0000","last_fullsized":"2024-09-19T06:37:15.030746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:11.428574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030167+0000","last_change":"2024-09-19T06:37:09.448450+0000","last_active":"2024-09-19T06:37:15.030167+0000","last_peered":"2024-09-19T06:37:15.030167+0000","last_clean":"2024-09-19T06:37:15.030167+0000","last_became_active":"2024-09-19T06:37:09.448173+0000","last_became_peered":"2024-09-19T06:37:09.448173+0000","last_unstale":"2024-09-19T06:37:15.030167+0000","last_undegraded":"2024-09-19T06:37:15.030167+0000","last_fullsized":"2024-09-19T06:37:15.030167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:22.442374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030854+0000","last_change":"2024-09-19T06:37:08.442796+0000","last_active":"2024-09-19T06:37:15.030854+0000","last_peered":"2024-09-19T06:37:15.030854+0000","last_clean":"2024-09-19T06:37:15.030854+0000","last_became_active":"2024-09-19T06:37:08.442126+0000","last_became_peered":"2024-09-19T06:37:08.442126+0000","last_unstale":"2024-09-19T06:37:15.030854+0000","last_undegraded":"2024-09-19T06:37:15.030854+0000","last_fullsized":"2024-09-19T06:37:15.030854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:27.716141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477293+0000","last_change":"2024-09-19T06:37:13.464100+0000","last_active":"2024-09-19T06:37:14.477293+0000","last_peered":"2024-09-19T06:37:14.477293+0000","last_clean":"2024-09-19T06:37:14.477293+0000","last_became_active":"2024-09-19T06:37:13.462750+0000","last_became_peered":"2024-09-19T06:37:13.462750+0000","last_unstale":"2024-09-19T06:37:14.477293+0000","last_undegraded":"2024-09-19T06:37:14.477293+0000","last_fullsized":"2024-09-19T06:37:14.477293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:49.139841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030752+0000","last_change":"2024-09-19T06:37:09.448328+0000","last_active":"2024-09-19T06:37:15.030752+0000","last_peered":"2024-09-19T06:37:15.030752+0000","last_clean":"2024-09-19T06:37:15.030752+0000","last_became_active":"2024-09-19T06:37:09.448056+0000","last_became_peered":"2024-09-19T06:37:09.448056+0000","last_unstale":"2024-09-19T06:37:15.030752+0000","last_undegraded":"2024-09-19T06:37:15.030752+0000","last_fullsized":"2024-09-19T06:37:15.030752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:53.451104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478778+0000","last_change":"2024-09-19T06:37:08.439543+0000","last_active":"2024-09-19T06:37:14.478778+0000","last_peered":"2024-09-19T06:37:14.478778+0000","last_clean":"2024-09-19T06:37:14.478778+0000","last_became_active":"2024-09-19T06:37:08.438785+0000","last_became_peered":"2024-09-19T06:37:08.438785+0000","last_unstale":"2024-09-19T06:37:14.478778+0000","last_undegraded":"2024-09-19T06:37:14.478778+0000","last_fullsized":"2024-09-19T06:37:14.478778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:51.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477286+0000","last_change":"2024-09-19T06:37:13.462327+0000","last_active":"2024-09-19T06:37:14.477286+0000","last_peered":"2024-09-19T06:37:14.477286+0000","last_clean":"2024-09-19T06:37:14.477286+0000","last_became_active":"2024-09-19T06:37:13.461762+0000","last_became_peered":"2024-09-19T06:37:13.461762+0000","last_unstale":"2024-09-19T06:37:14.477286+0000","last_undegraded":"2024-09-19T06:37:14.477286+0000","last_fullsized":"2024-09-19T06:37:14.477286+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:26.931537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029982+0000","last_change":"2024-09-19T06:37:13.471309+0000","last_active":"2024-09-19T06:37:15.029982+0000","last_peered":"2024-09-19T06:37:15.029982+0000","last_clean":"2024-09-19T06:37:15.029982+0000","last_became_active":"2024-09-19T06:37:13.470969+0000","last_became_peered":"2024-09-19T06:37:13.470969+0000","last_unstale":"2024-09-19T06:37:15.029982+0000","last_undegraded":"2024-09-19T06:37:15.029982+0000","last_fullsized":"2024-09-19T06:37:15.029982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:30.990159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029769+0000","last_change":"2024-09-19T06:37:09.443308+0000","last_active":"2024-09-19T06:37:15.029769+0000","last_peered":"2024-09-19T06:37:15.029769+0000","last_clean":"2024-09-19T06:37:15.029769+0000","last_became_active":"2024-09-19T06:37:09.443069+0000","last_became_peered":"2024-09-19T06:37:09.443069+0000","last_unstale":"2024-09-19T06:37:15.029769+0000","last_undegraded":"2024-09-19T06:37:15.029769+0000","last_fullsized":"2024-09-19T06:37:15.029769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:31:33.708578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029646+0000","last_change":"2024-09-19T06:37:08.441967+0000","last_active":"2024-09-19T06:37:15.029646+0000","last_peered":"2024-09-19T06:37:15.029646+0000","last_clean":"2024-09-19T06:37:15.029646+0000","last_became_active":"2024-09-19T06:37:08.441698+0000","last_became_peered":"2024-09-19T06:37:08.441698+0000","last_unstale":"2024-09-19T06:37:15.029646+0000","last_undegraded":"2024-09-19T06:37:15.029646+0000","last_fullsized":"2024-09-19T06:37:15.029646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:56.933775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478180+0000","last_change":"2024-09-19T06:37:13.470903+0000","last_active":"2024-09-19T06:37:14.478180+0000","last_peered":"2024-09-19T06:37:14.478180+0000","last_clean":"2024-09-19T06:37:14.478180+0000","last_became_active":"2024-09-19T06:37:13.470528+0000","last_became_peered":"2024-09-19T06:37:13.470528+0000","last_unstale":"2024-09-19T06:37:14.478180+0000","last_undegraded":"2024-09-19T06:37:14.478180+0000","last_fullsized":"2024-09-19T06:37:14.478180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:45.999436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477209+0000","last_change":"2024-09-19T06:37:09.448953+0000","last_active":"2024-09-19T06:37:14.477209+0000","last_peered":"2024-09-19T06:37:14.477209+0000","last_clean":"2024-09-19T06:37:14.477209+0000","last_became_active":"2024-09-19T06:37:09.448658+0000","last_became_peered":"2024-09-19T06:37:09.448658+0000","last_unstale":"2024-09-19T06:37:14.477209+0000","last_undegraded":"2024-09-19T06:37:14.477209+0000","last_fullsized":"2024-09-19T06:37:14.477209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:07.333392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477562+0000","last_change":"2024-09-19T06:37:08.440800+0000","last_active":"2024-09-19T06:37:14.477562+0000","last_peered":"2024-09-19T06:37:14.477562+0000","last_clean":"2024-09-19T06:37:14.477562+0000","last_became_active":"2024-09-19T06:37:08.440591+0000","last_became_peered":"2024-09-19T06:37:08.440591+0000","last_unstale":"2024-09-19T06:37:14.477562+0000","last_undegraded":"2024-09-19T06:37:14.477562+0000","last_fullsized":"2024-09-19T06:37:14.477562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:05.540261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478578+0000","last_change":"2024-09-19T06:37:08.441268+0000","last_active":"2024-09-19T06:37:14.478578+0000","last_peered":"2024-09-19T06:37:14.478578+0000","last_clean":"2024-09-19T06:37:14.478578+0000","last_became_active":"2024-09-19T06:37:08.440969+0000","last_became_peered":"2024-09-19T06:37:08.440969+0000","last_unstale":"2024-09-19T06:37:14.478578+0000","last_undegraded":"2024-09-19T06:37:14.478578+0000","last_fullsized":"2024-09-19T06:37:14.478578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:59.426336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030814+0000","last_change":"2024-09-19T06:37:09.444857+0000","last_active":"2024-09-19T06:37:15.030814+0000","last_peered":"2024-09-19T06:37:15.030814+0000","last_clean":"2024-09-19T06:37:15.030814+0000","last_became_active":"2024-09-19T06:37:09.444562+0000","last_became_peered":"2024-09-19T06:37:09.444562+0000","last_unstale":"2024-09-19T06:37:15.030814+0000","last_undegraded":"2024-09-19T06:37:15.030814+0000","last_fullsized":"2024-09-19T06:37:15.030814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:02.470787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815254+0000","last_change":"2024-09-19T06:37:13.467183+0000","last_active":"2024-09-19T06:37:14.815254+0000","last_peered":"2024-09-19T06:37:14.815254+0000","last_clean":"2024-09-19T06:37:14.815254+0000","last_became_active":"2024-09-19T06:37:13.466765+0000","last_became_peered":"2024-09-19T06:37:13.466765+0000","last_unstale":"2024-09-19T06:37:14.815254+0000","last_undegraded":"2024-09-19T06:37:14.815254+0000","last_fullsized":"2024-09-19T06:37:14.815254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:35.184815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477901+0000","last_change":"2024-09-19T06:37:08.443993+0000","last_active":"2024-09-19T06:37:14.477901+0000","last_peered":"2024-09-19T06:37:14.477901+0000","last_clean":"2024-09-19T06:37:14.477901+0000","last_became_active":"2024-09-19T06:37:08.443774+0000","last_became_peered":"2024-09-19T06:37:08.443774+0000","last_unstale":"2024-09-19T06:37:14.477901+0000","last_undegraded":"2024-09-19T06:37:14.477901+0000","last_fullsized":"2024-09-19T06:37:14.477901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:16.005073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029942+0000","last_change":"2024-09-19T06:37:09.440258+0000","last_active":"2024-09-19T06:37:15.029942+0000","last_peered":"2024-09-19T06:37:15.029942+0000","last_clean":"2024-09-19T06:37:15.029942+0000","last_became_active":"2024-09-19T06:37:09.438457+0000","last_became_peered":"2024-09-19T06:37:09.438457+0000","last_unstale":"2024-09-19T06:37:15.029942+0000","last_undegraded":"2024-09-19T06:37:15.029942+0000","last_fullsized":"2024-09-19T06:37:15.029942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:24.636340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477624+0000","last_change":"2024-09-19T06:37:13.462800+0000","last_active":"2024-09-19T06:37:14.477624+0000","last_peered":"2024-09-19T06:37:14.477624+0000","last_clean":"2024-09-19T06:37:14.477624+0000","last_became_active":"2024-09-19T06:37:13.462393+0000","last_became_peered":"2024-09-19T06:37:13.462393+0000","last_unstale":"2024-09-19T06:37:14.477624+0000","last_undegraded":"2024-09-19T06:37:14.477624+0000","last_fullsized":"2024-09-19T06:37:14.477624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:35.901637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477580+0000","last_change":"2024-09-19T06:37:09.450421+0000","last_active":"2024-09-19T06:37:14.477580+0000","last_peered":"2024-09-19T06:37:14.477580+0000","last_clean":"2024-09-19T06:37:14.477580+0000","last_became_active":"2024-09-19T06:37:09.450147+0000","last_became_peered":"2024-09-19T06:37:09.450147+0000","last_unstale":"2024-09-19T06:37:14.477580+0000","last_undegraded":"2024-09-19T06:37:14.477580+0000","last_fullsized":"2024-09-19T06:37:14.477580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:42.949759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.814967+0000","last_change":"2024-09-19T06:37:09.435131+0000","last_active":"2024-09-19T06:37:14.814967+0000","last_peered":"2024-09-19T06:37:14.814967+0000","last_clean":"2024-09-19T06:37:14.814967+0000","last_became_active":"2024-09-19T06:37:09.434840+0000","last_became_peered":"2024-09-19T06:37:09.434840+0000","last_unstale":"2024-09-19T06:37:14.814967+0000","last_undegraded":"2024-09-19T06:37:14.814967+0000","last_fullsized":"2024-09-19T06:37:14.814967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:20.484554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030415+0000","last_change":"2024-09-19T06:37:09.445196+0000","last_active":"2024-09-19T06:37:15.030415+0000","last_peered":"2024-09-19T06:37:15.030415+0000","last_clean":"2024-09-19T06:37:15.030415+0000","last_became_active":"2024-09-19T06:37:09.444907+0000","last_became_peered":"2024-09-19T06:37:09.444907+0000","last_unstale":"2024-09-19T06:37:15.030415+0000","last_undegraded":"2024-09-19T06:37:15.030415+0000","last_fullsized":"2024-09-19T06:37:15.030415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:17.605675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030729+0000","last_change":"2024-09-19T06:37:09.447966+0000","last_active":"2024-09-19T06:37:15.030729+0000","last_peered":"2024-09-19T06:37:15.030729+0000","last_clean":"2024-09-19T06:37:15.030729+0000","last_became_active":"2024-09-19T06:37:09.447692+0000","last_became_peered":"2024-09-19T06:37:09.447692+0000","last_unstale":"2024-09-19T06:37:15.030729+0000","last_undegraded":"2024-09-19T06:37:15.030729+0000","last_fullsized":"2024-09-19T06:37:15.030729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:01.517824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477900+0000","last_change":"2024-09-19T06:37:09.442651+0000","last_active":"2024-09-19T06:37:14.477900+0000","last_peered":"2024-09-19T06:37:14.477900+0000","last_clean":"2024-09-19T06:37:14.477900+0000","last_became_active":"2024-09-19T06:37:09.442195+0000","last_became_peered":"2024-09-19T06:37:09.442195+0000","last_unstale":"2024-09-19T06:37:14.477900+0000","last_undegraded":"2024-09-19T06:37:14.477900+0000","last_fullsized":"2024-09-19T06:37:14.477900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:15.658285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030600+0000","last_change":"2024-09-19T06:37:09.441782+0000","last_active":"2024-09-19T06:37:15.030600+0000","last_peered":"2024-09-19T06:37:15.030600+0000","last_clean":"2024-09-19T06:37:15.030600+0000","last_became_active":"2024-09-19T06:37:09.441456+0000","last_became_peered":"2024-09-19T06:37:09.441456+0000","last_unstale":"2024-09-19T06:37:15.030600+0000","last_undegraded":"2024-09-19T06:37:15.030600+0000","last_fullsized":"2024-09-19T06:37:15.030600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:04:28.458974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479237+0000","last_change":"2024-09-19T06:37:09.449856+0000","last_active":"2024-09-19T06:37:14.479237+0000","last_peered":"2024-09-19T06:37:14.479237+0000","last_clean":"2024-09-19T06:37:14.479237+0000","last_became_active":"2024-09-19T06:37:09.449562+0000","last_became_peered":"2024-09-19T06:37:09.449562+0000","last_unstale":"2024-09-19T06:37:14.479237+0000","last_undegraded":"2024-09-19T06:37:14.479237+0000","last_fullsized":"2024-09-19T06:37:14.479237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:49.182126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477764+0000","last_change":"2024-09-19T06:37:09.438551+0000","last_active":"2024-09-19T06:37:14.477764+0000","last_peered":"2024-09-19T06:37:14.477764+0000","last_clean":"2024-09-19T06:37:14.477764+0000","last_became_active":"2024-09-19T06:37:09.437624+0000","last_became_peered":"2024-09-19T06:37:09.437624+0000","last_unstale":"2024-09-19T06:37:14.477764+0000","last_undegraded":"2024-09-19T06:37:14.477764+0000","last_fullsized":"2024-09-19T06:37:14.477764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:46.565780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029601+0000","last_change":"2024-09-19T06:37:09.438737+0000","last_active":"2024-09-19T06:37:15.029601+0000","last_peered":"2024-09-19T06:37:15.029601+0000","last_clean":"2024-09-19T06:37:15.029601+0000","last_became_active":"2024-09-19T06:37:09.438453+0000","last_became_peered":"2024-09-19T06:37:09.438453+0000","last_unstale":"2024-09-19T06:37:15.029601+0000","last_undegraded":"2024-09-19T06:37:15.029601+0000","last_fullsized":"2024-09-19T06:37:15.029601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.982275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477390+0000","last_change":"2024-09-19T06:37:09.442093+0000","last_active":"2024-09-19T06:37:14.477390+0000","last_peered":"2024-09-19T06:37:14.477390+0000","last_clean":"2024-09-19T06:37:14.477390+0000","last_became_active":"2024-09-19T06:37:09.439710+0000","last_became_peered":"2024-09-19T06:37:09.439710+0000","last_unstale":"2024-09-19T06:37:14.477390+0000","last_undegraded":"2024-09-19T06:37:14.477390+0000","last_fullsized":"2024-09-19T06:37:14.477390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:02.626854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030310+0000","last_change":"2024-09-19T06:37:09.438271+0000","last_active":"2024-09-19T06:37:15.030310+0000","last_peered":"2024-09-19T06:37:15.030310+0000","last_clean":"2024-09-19T06:37:15.030310+0000","last_became_active":"2024-09-19T06:37:09.438009+0000","last_became_peered":"2024-09-19T06:37:09.438009+0000","last_unstale":"2024-09-19T06:37:15.030310+0000","last_undegraded":"2024-09-19T06:37:15.030310+0000","last_fullsized":"2024-09-19T06:37:15.030310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:26.395210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030632+0000","last_change":"2024-09-19T06:37:09.449633+0000","last_active":"2024-09-19T06:37:15.030632+0000","last_peered":"2024-09-19T06:37:15.030632+0000","last_clean":"2024-09-19T06:37:15.030632+0000","last_became_active":"2024-09-19T06:37:09.449379+0000","last_became_peered":"2024-09-19T06:37:09.449379+0000","last_unstale":"2024-09-19T06:37:15.030632+0000","last_undegraded":"2024-09-19T06:37:15.030632+0000","last_fullsized":"2024-09-19T06:37:15.030632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:29.565038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478253+0000","last_change":"2024-09-19T06:37:09.447808+0000","last_active":"2024-09-19T06:37:14.478253+0000","last_peered":"2024-09-19T06:37:14.478253+0000","last_clean":"2024-09-19T06:37:14.478253+0000","last_became_active":"2024-09-19T06:37:09.447514+0000","last_became_peered":"2024-09-19T06:37:09.447514+0000","last_unstale":"2024-09-19T06:37:14.478253+0000","last_undegraded":"2024-09-19T06:37:14.478253+0000","last_fullsized":"2024-09-19T06:37:14.478253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:04.653997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479576+0000","last_change":"2024-09-19T06:37:09.439605+0000","last_active":"2024-09-19T06:37:14.479576+0000","last_peered":"2024-09-19T06:37:14.479576+0000","last_clean":"2024-09-19T06:37:14.479576+0000","last_became_active":"2024-09-19T06:37:09.432601+0000","last_became_peered":"2024-09-19T06:37:09.432601+0000","last_unstale":"2024-09-19T06:37:14.479576+0000","last_undegraded":"2024-09-19T06:37:14.479576+0000","last_fullsized":"2024-09-19T06:37:14.479576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:50.640062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815206+0000","last_change":"2024-09-19T06:37:09.440268+0000","last_active":"2024-09-19T06:37:14.815206+0000","last_peered":"2024-09-19T06:37:14.815206+0000","last_clean":"2024-09-19T06:37:14.815206+0000","last_became_active":"2024-09-19T06:37:09.439937+0000","last_became_peered":"2024-09-19T06:37:09.439937+0000","last_unstale":"2024-09-19T06:37:14.815206+0000","last_undegraded":"2024-09-19T06:37:14.815206+0000","last_fullsized":"2024-09-19T06:37:14.815206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:32:46.182979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030922+0000","last_change":"2024-09-19T06:37:09.437080+0000","last_active":"2024-09-19T06:37:15.030922+0000","last_peered":"2024-09-19T06:37:15.030922+0000","last_clean":"2024-09-19T06:37:15.030922+0000","last_became_active":"2024-09-19T06:37:09.436752+0000","last_became_peered":"2024-09-19T06:37:09.436752+0000","last_unstale":"2024-09-19T06:37:15.030922+0000","last_undegraded":"2024-09-19T06:37:15.030922+0000","last_fullsized":"2024-09-19T06:37:15.030922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:31.423640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029549+0000","last_change":"2024-09-19T06:37:09.448942+0000","last_active":"2024-09-19T06:37:15.029549+0000","last_peered":"2024-09-19T06:37:15.029549+0000","last_clean":"2024-09-19T06:37:15.029549+0000","last_became_active":"2024-09-19T06:37:09.448647+0000","last_became_peered":"2024-09-19T06:37:09.448647+0000","last_unstale":"2024-09-19T06:37:15.029549+0000","last_undegraded":"2024-09-19T06:37:15.029549+0000","last_fullsized":"2024-09-19T06:37:15.029549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:49.027909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029809+0000","last_change":"2024-09-19T06:37:09.445015+0000","last_active":"2024-09-19T06:37:15.029809+0000","last_peered":"2024-09-19T06:37:15.029809+0000","last_clean":"2024-09-19T06:37:15.029809+0000","last_became_active":"2024-09-19T06:37:09.444737+0000","last_became_peered":"2024-09-19T06:37:09.444737+0000","last_unstale":"2024-09-19T06:37:15.029809+0000","last_undegraded":"2024-09-19T06:37:15.029809+0000","last_fullsized":"2024-09-19T06:37:15.029809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:16.194580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029853+0000","last_change":"2024-09-19T06:37:09.446025+0000","last_active":"2024-09-19T06:37:15.029853+0000","last_peered":"2024-09-19T06:37:15.029853+0000","last_clean":"2024-09-19T06:37:15.029853+0000","last_became_active":"2024-09-19T06:37:09.445503+0000","last_became_peered":"2024-09-19T06:37:09.445503+0000","last_unstale":"2024-09-19T06:37:15.029853+0000","last_undegraded":"2024-09-19T06:37:15.029853+0000","last_fullsized":"2024-09-19T06:37:15.029853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:30.469995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477784+0000","last_change":"2024-09-19T06:37:09.441302+0000","last_active":"2024-09-19T06:37:14.477784+0000","last_peered":"2024-09-19T06:37:14.477784+0000","last_clean":"2024-09-19T06:37:14.477784+0000","last_became_active":"2024-09-19T06:37:09.439767+0000","last_became_peered":"2024-09-19T06:37:09.439767+0000","last_unstale":"2024-09-19T06:37:14.477784+0000","last_undegraded":"2024-09-19T06:37:14.477784+0000","last_fullsized":"2024-09-19T06:37:14.477784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:01.038823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030560+0000","last_change":"2024-09-19T06:37:09.440976+0000","last_active":"2024-09-19T06:37:15.030560+0000","last_peered":"2024-09-19T06:37:15.030560+0000","last_clean":"2024-09-19T06:37:15.030560+0000","last_became_active":"2024-09-19T06:37:09.440702+0000","last_became_peered":"2024-09-19T06:37:09.440702+0000","last_unstale":"2024-09-19T06:37:15.030560+0000","last_undegraded":"2024-09-19T06:37:15.030560+0000","last_fullsized":"2024-09-19T06:37:15.030560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:21.281400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477942+0000","last_change":"2024-09-19T06:37:09.442301+0000","last_active":"2024-09-19T06:37:14.477942+0000","last_peered":"2024-09-19T06:37:14.477942+0000","last_clean":"2024-09-19T06:37:14.477942+0000","last_became_active":"2024-09-19T06:37:09.442053+0000","last_became_peered":"2024-09-19T06:37:09.442053+0000","last_unstale":"2024-09-19T06:37:14.477942+0000","last_undegraded":"2024-09-19T06:37:14.477942+0000","last_fullsized":"2024-09-19T06:37:14.477942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:26.189384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479335+0000","last_change":"2024-09-19T06:37:09.441525+0000","last_active":"2024-09-19T06:37:14.479335+0000","last_peered":"2024-09-19T06:37:14.479335+0000","last_clean":"2024-09-19T06:37:14.479335+0000","last_became_active":"2024-09-19T06:37:09.441179+0000","last_became_peered":"2024-09-19T06:37:09.441179+0000","last_unstale":"2024-09-19T06:37:14.479335+0000","last_undegraded":"2024-09-19T06:37:14.479335+0000","last_fullsized":"2024-09-19T06:37:14.479335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:47.235113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479743+0000","last_change":"2024-09-19T06:37:09.437163+0000","last_active":"2024-09-19T06:37:14.479743+0000","last_peered":"2024-09-19T06:37:14.479743+0000","last_clean":"2024-09-19T06:37:14.479743+0000","last_became_active":"2024-09-19T06:37:09.436892+0000","last_became_peered":"2024-09-19T06:37:09.436892+0000","last_unstale":"2024-09-19T06:37:14.479743+0000","last_undegraded":"2024-09-19T06:37:14.479743+0000","last_fullsized":"2024-09-19T06:37:14.479743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:47:58.347385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477114+0000","last_change":"2024-09-19T06:37:09.437524+0000","last_active":"2024-09-19T06:37:14.477114+0000","last_peered":"2024-09-19T06:37:14.477114+0000","last_clean":"2024-09-19T06:37:14.477114+0000","last_became_active":"2024-09-19T06:37:09.437023+0000","last_became_peered":"2024-09-19T06:37:09.437023+0000","last_unstale":"2024-09-19T06:37:14.477114+0000","last_undegraded":"2024-09-19T06:37:14.477114+0000","last_fullsized":"2024-09-19T06:37:14.477114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:31.398914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478456+0000","last_change":"2024-09-19T06:37:09.448814+0000","last_active":"2024-09-19T06:37:14.478456+0000","last_peered":"2024-09-19T06:37:14.478456+0000","last_clean":"2024-09-19T06:37:14.478456+0000","last_became_active":"2024-09-19T06:37:09.448547+0000","last_became_peered":"2024-09-19T06:37:09.448547+0000","last_unstale":"2024-09-19T06:37:14.478456+0000","last_undegraded":"2024-09-19T06:37:14.478456+0000","last_fullsized":"2024-09-19T06:37:14.478456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:13.526300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030114+0000","last_change":"2024-09-19T06:37:09.446910+0000","last_active":"2024-09-19T06:37:15.030114+0000","last_peered":"2024-09-19T06:37:15.030114+0000","last_clean":"2024-09-19T06:37:15.030114+0000","last_became_active":"2024-09-19T06:37:09.446603+0000","last_became_peered":"2024-09-19T06:37:09.446603+0000","last_unstale":"2024-09-19T06:37:15.030114+0000","last_undegraded":"2024-09-19T06:37:15.030114+0000","last_fullsized":"2024-09-19T06:37:15.030114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:47.006354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479198+0000","last_change":"2024-09-19T06:37:09.430160+0000","last_active":"2024-09-19T06:37:14.479198+0000","last_peered":"2024-09-19T06:37:14.479198+0000","last_clean":"2024-09-19T06:37:14.479198+0000","last_became_active":"2024-09-19T06:37:09.429813+0000","last_became_peered":"2024-09-19T06:37:09.429813+0000","last_unstale":"2024-09-19T06:37:14.479198+0000","last_undegraded":"2024-09-19T06:37:14.479198+0000","last_fullsized":"2024-09-19T06:37:14.479198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:10.353834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030011+0000","last_change":"2024-09-19T06:37:09.446622+0000","last_active":"2024-09-19T06:37:15.030011+0000","last_peered":"2024-09-19T06:37:15.030011+0000","last_clean":"2024-09-19T06:37:15.030011+0000","last_became_active":"2024-09-19T06:37:09.446349+0000","last_became_peered":"2024-09-19T06:37:09.446349+0000","last_unstale":"2024-09-19T06:37:15.030011+0000","last_undegraded":"2024-09-19T06:37:15.030011+0000","last_fullsized":"2024-09-19T06:37:15.030011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:01.702039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030152+0000","last_change":"2024-09-19T06:37:09.446789+0000","last_active":"2024-09-19T06:37:15.030152+0000","last_peered":"2024-09-19T06:37:15.030152+0000","last_clean":"2024-09-19T06:37:15.030152+0000","last_became_active":"2024-09-19T06:37:09.446557+0000","last_became_peered":"2024-09-19T06:37:09.446557+0000","last_unstale":"2024-09-19T06:37:15.030152+0000","last_undegraded":"2024-09-19T06:37:15.030152+0000","last_fullsized":"2024-09-19T06:37:15.030152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:18.119474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030246+0000","last_change":"2024-09-19T06:37:09.448093+0000","last_active":"2024-09-19T06:37:15.030246+0000","last_peered":"2024-09-19T06:37:15.030246+0000","last_clean":"2024-09-19T06:37:15.030246+0000","last_became_active":"2024-09-19T06:37:09.447753+0000","last_became_peered":"2024-09-19T06:37:09.447753+0000","last_unstale":"2024-09-19T06:37:15.030246+0000","last_undegraded":"2024-09-19T06:37:15.030246+0000","last_fullsized":"2024-09-19T06:37:15.030246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:11.944092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479640+0000","last_change":"2024-09-19T06:37:09.442798+0000","last_active":"2024-09-19T06:37:14.479640+0000","last_peered":"2024-09-19T06:37:14.479640+0000","last_clean":"2024-09-19T06:37:14.479640+0000","last_became_active":"2024-09-19T06:37:09.442047+0000","last_became_peered":"2024-09-19T06:37:09.442047+0000","last_unstale":"2024-09-19T06:37:14.479640+0000","last_undegraded":"2024-09-19T06:37:14.479640+0000","last_fullsized":"2024-09-19T06:37:14.479640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:33.193185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65040,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":348160,"data_stored":698736,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":698680,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":107730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:37:33.700 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:37:33.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.832+0000 7f329f23c640 1 Processor -- start 2024-09-19T06:37:33.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.832+0000 7f329f23c640 1 -- start start 2024-09-19T06:37:33.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.833+0000 7f329f23c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3298153000 0x7f3298159080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:33.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.833+0000 7f329f23c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f32981595c0 0x7f32980c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:33.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.833+0000 7f329f23c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f32980c74d0 0x7f329815c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:33.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.833+0000 7f329f23c640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f329806c600 con 0x7f32980c74d0 2024-09-19T06:37:33.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.833+0000 7f329f23c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f32981533e0 con 0x7f32981595c0 2024-09-19T06:37:33.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.833+0000 7f329f23c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f32980c57d0 con 0x7f3298153000 2024-09-19T06:37:33.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.833+0000 7f329d7d9640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f32980c74d0 0x7f329815c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:33.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.833+0000 7f329d7d9640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f32980c74d0 0x7f329815c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56770/0 (socket says 172.21.15.86:56770) 2024-09-19T06:37:33.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.833+0000 7f329d7d9640 1 -- 172.21.15.86:0/3508100337 learned_addr learned my addr 172.21.15.86:0/3508100337 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:33.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.834+0000 7f3297fff640 1 --2- 172.21.15.86:0/3508100337 >> v2:172.21.15.169:3300/0 conn(0x7f32981595c0 0x7f32980c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:33.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.834+0000 7f329cfd8640 1 --2- 172.21.15.86:0/3508100337 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3298153000 0x7f3298159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:33.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.834+0000 7f329d7d9640 1 -- 172.21.15.86:0/3508100337 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3298153000 msgr2=0x7f3298159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:33.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.834+0000 7f329d7d9640 1 --2- 172.21.15.86:0/3508100337 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3298153000 0x7f3298159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.834+0000 7f329d7d9640 1 -- 172.21.15.86:0/3508100337 >> v2:172.21.15.169:3300/0 conn(0x7f32981595c0 msgr2=0x7f32980c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:33.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.834+0000 7f329d7d9640 1 --2- 172.21.15.86:0/3508100337 >> v2:172.21.15.169:3300/0 conn(0x7f32981595c0 0x7f32980c6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.834+0000 7f329d7d9640 1 -- 172.21.15.86:0/3508100337 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f329806c850 con 0x7f32980c74d0 2024-09-19T06:37:33.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.834+0000 7f329d7d9640 1 --2- 172.21.15.86:0/3508100337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32980c74d0 0x7f329815c2b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f32980ce6e0 tx=0x7f329002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8808eb8fe3c99a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:33.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.835+0000 7f32977fe640 1 -- 172.21.15.86:0/3508100337 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3290037070 con 0x7f32980c74d0 2024-09-19T06:37:33.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.835+0000 7f32977fe640 1 -- 172.21.15.86:0/3508100337 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3290032440 con 0x7f32980c74d0 2024-09-19T06:37:33.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.835+0000 7f32977fe640 1 -- 172.21.15.86:0/3508100337 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3290032810 con 0x7f32980c74d0 2024-09-19T06:37:33.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.835+0000 7f329f23c640 1 -- 172.21.15.86:0/3508100337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32980c74d0 msgr2=0x7f329815c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.835+0000 7f329f23c640 1 --2- 172.21.15.86:0/3508100337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32980c74d0 0x7f329815c2b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f32980ce6e0 tx=0x7f329002a1e0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.835+0000 7f329f23c640 1 -- 172.21.15.86:0/3508100337 shutdown_connections 2024-09-19T06:37:33.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.835+0000 7f329f23c640 1 --2- 172.21.15.86:0/3508100337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32980c74d0 0x7f329815c2b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.835+0000 7f329f23c640 1 --2- 172.21.15.86:0/3508100337 >> v2:172.21.15.169:3300/0 conn(0x7f32981595c0 0x7f32980c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.835+0000 7f329f23c640 1 --2- 172.21.15.86:0/3508100337 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3298153000 0x7f3298159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.835+0000 7f329f23c640 1 -- 172.21.15.86:0/3508100337 >> 172.21.15.86:0/3508100337 conn(0x7f32980cdd80 msgr2=0x7f32980ca220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:33.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.835+0000 7f329f23c640 1 -- 172.21.15.86:0/3508100337 shutdown_connections 2024-09-19T06:37:33.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.835+0000 7f329f23c640 1 -- 172.21.15.86:0/3508100337 wait complete. 2024-09-19T06:37:33.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.836+0000 7f329f23c640 1 Processor -- start 2024-09-19T06:37:33.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.836+0000 7f329f23c640 1 -- start start 2024-09-19T06:37:33.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.837+0000 7f329f23c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32980c74d0 0x7f32981ef2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:33.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.837+0000 7f329f23c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3298153000 0x7f32981f2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:33.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.837+0000 7f329f23c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32981595c0 0x7f32980c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:33.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.837+0000 7f329f23c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f32980c4890 con 0x7f3298153000 2024-09-19T06:37:33.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.837+0000 7f329f23c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f32981599e0 con 0x7f32981595c0 2024-09-19T06:37:33.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.837+0000 7f329f23c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f32980cafa0 con 0x7f32980c74d0 2024-09-19T06:37:33.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.837+0000 7f3297fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3298153000 0x7f32981f2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:33.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.837+0000 7f3297fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3298153000 0x7f32981f2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56776/0 (socket says 172.21.15.86:56776) 2024-09-19T06:37:33.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.837+0000 7f3297fff640 1 -- 172.21.15.86:0/4123553013 learned_addr learned my addr 172.21.15.86:0/4123553013 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:33.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.837+0000 7f329d7d9640 1 --2- 172.21.15.86:0/4123553013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32981595c0 0x7f32980c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:33.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.837+0000 7f329cfd8640 1 --2- 172.21.15.86:0/4123553013 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32980c74d0 0x7f32981ef2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:33.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.838+0000 7f3297fff640 1 -- 172.21.15.86:0/4123553013 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32980c74d0 msgr2=0x7f32981ef2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.838+0000 7f3297fff640 1 --2- 172.21.15.86:0/4123553013 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32980c74d0 0x7f32981ef2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.838+0000 7f3297fff640 1 -- 172.21.15.86:0/4123553013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32981595c0 msgr2=0x7f32980c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.838+0000 7f3297fff640 1 --2- 172.21.15.86:0/4123553013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32981595c0 0x7f32980c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.838+0000 7f3297fff640 1 -- 172.21.15.86:0/4123553013 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32981ef800 con 0x7f3298153000 2024-09-19T06:37:33.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.838+0000 7f3297fff640 1 --2- 172.21.15.86:0/4123553013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3298153000 0x7f32981f2850 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f328c007ef0 tx=0x7f328c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:33.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.838+0000 7f32957fa640 1 -- 172.21.15.86:0/4123553013 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c01a070 con 0x7f3298153000 2024-09-19T06:37:33.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.838+0000 7f32957fa640 1 -- 172.21.15.86:0/4123553013 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f328c003b90 con 0x7f3298153000 2024-09-19T06:37:33.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.838+0000 7f329f23c640 1 -- 172.21.15.86:0/4123553013 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32981f2d90 con 0x7f3298153000 2024-09-19T06:37:33.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.838+0000 7f32957fa640 1 -- 172.21.15.86:0/4123553013 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c004030 con 0x7f3298153000 2024-09-19T06:37:33.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.838+0000 7f329f23c640 1 -- 172.21.15.86:0/4123553013 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32980cd090 con 0x7f3298153000 2024-09-19T06:37:33.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.839+0000 7f329f23c640 1 -- 172.21.15.86:0/4123553013 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f329806bbc0 con 0x7f3298153000 2024-09-19T06:37:33.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.839+0000 7f32957fa640 1 -- 172.21.15.86:0/4123553013 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f328c01d070 con 0x7f3298153000 2024-09-19T06:37:33.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.840+0000 7f32957fa640 1 --2- 172.21.15.86:0/4123553013 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f328406c2e0 0x7f328406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:33.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.840+0000 7f32957fa640 1 -- 172.21.15.86:0/4123553013 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f328c08b990 con 0x7f3298153000 2024-09-19T06:37:33.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.840+0000 7f329cfd8640 1 --2- 172.21.15.86:0/4123553013 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f328406c2e0 0x7f328406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:33.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.840+0000 7f329cfd8640 1 --2- 172.21.15.86:0/4123553013 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f328406c2e0 0x7f328406e7a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3288006fd0 tx=0x7f3288008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:33.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:33.844+0000 7f32957fa640 1 -- 172.21.15.86:0/4123553013 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f328c0596e0 con 0x7f3298153000 2024-09-19T06:37:34.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.006+0000 7f329f23c640 1 -- 172.21.15.86:0/4123553013 --> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f32980c8e60 con 0x7f328406c2e0 2024-09-19T06:37:34.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.013+0000 7f32957fa640 1 -- 172.21.15.86:0/4123553013 <== mgr.4105 v2:172.21.15.86:6816/4165134248 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332611 (secure 0 0 0) 0x7f32980c8e60 con 0x7f328406c2e0 2024-09-19T06:37:34.019 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:34.020 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-09-19T06:37:34.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.017+0000 7f329f23c640 1 -- 172.21.15.86:0/4123553013 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f328406c2e0 msgr2=0x7f328406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:34.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.017+0000 7f329f23c640 1 --2- 172.21.15.86:0/4123553013 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f328406c2e0 0x7f328406e7a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3288006fd0 tx=0x7f3288008040 comp rx=0 tx=0).stop 2024-09-19T06:37:34.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.017+0000 7f329f23c640 1 -- 172.21.15.86:0/4123553013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3298153000 msgr2=0x7f32981f2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:34.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.017+0000 7f329f23c640 1 --2- 172.21.15.86:0/4123553013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3298153000 0x7f32981f2850 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f328c007ef0 tx=0x7f328c00e4b0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.017+0000 7f329f23c640 1 -- 172.21.15.86:0/4123553013 shutdown_connections 2024-09-19T06:37:34.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.017+0000 7f329f23c640 1 --2- 172.21.15.86:0/4123553013 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f328406c2e0 0x7f328406e7a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.017+0000 7f329f23c640 1 --2- 172.21.15.86:0/4123553013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32981595c0 0x7f32980c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.017+0000 7f329f23c640 1 --2- 172.21.15.86:0/4123553013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3298153000 0x7f32981f2850 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.017+0000 7f329f23c640 1 --2- 172.21.15.86:0/4123553013 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32980c74d0 0x7f32981ef2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.017+0000 7f329f23c640 1 -- 172.21.15.86:0/4123553013 >> 172.21.15.86:0/4123553013 conn(0x7f32980cdd80 msgr2=0x7f3298149000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:34.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.017+0000 7f329f23c640 1 -- 172.21.15.86:0/4123553013 shutdown_connections 2024-09-19T06:37:34.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.017+0000 7f329f23c640 1 -- 172.21.15.86:0/4123553013 wait complete. 2024-09-19T06:37:34.029 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-09-19T06:37:33.746546+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218536,"kb_used_data":2304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756184,"statfs":{"total":773094113280,"available":772870332416,"internally_reserved":0,"allocated":2359296,"data_stored":2051860,"data_compressed":65040,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002773"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030305+0000","last_change":"2024-09-19T06:37:08.446272+0000","last_active":"2024-09-19T06:37:15.030305+0000","last_peered":"2024-09-19T06:37:15.030305+0000","last_clean":"2024-09-19T06:37:15.030305+0000","last_became_active":"2024-09-19T06:37:08.446044+0000","last_became_peered":"2024-09-19T06:37:08.446044+0000","last_unstale":"2024-09-19T06:37:15.030305+0000","last_undegraded":"2024-09-19T06:37:15.030305+0000","last_fullsized":"2024-09-19T06:37:15.030305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:37.623543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477629+0000","last_change":"2024-09-19T06:37:09.441539+0000","last_active":"2024-09-19T06:37:14.477629+0000","last_peered":"2024-09-19T06:37:14.477629+0000","last_clean":"2024-09-19T06:37:14.477629+0000","last_became_active":"2024-09-19T06:37:09.440839+0000","last_became_peered":"2024-09-19T06:37:09.440839+0000","last_unstale":"2024-09-19T06:37:14.477629+0000","last_undegraded":"2024-09-19T06:37:14.477629+0000","last_fullsized":"2024-09-19T06:37:14.477629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:49.222252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477205+0000","last_change":"2024-09-19T06:37:13.461355+0000","last_active":"2024-09-19T06:37:14.477205+0000","last_peered":"2024-09-19T06:37:14.477205+0000","last_clean":"2024-09-19T06:37:14.477205+0000","last_became_active":"2024-09-19T06:37:13.460936+0000","last_became_peered":"2024-09-19T06:37:13.460936+0000","last_unstale":"2024-09-19T06:37:14.477205+0000","last_undegraded":"2024-09-19T06:37:14.477205+0000","last_fullsized":"2024-09-19T06:37:14.477205+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:59.860583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477847+0000","last_change":"2024-09-19T06:37:08.438583+0000","last_active":"2024-09-19T06:37:14.477847+0000","last_peered":"2024-09-19T06:37:14.477847+0000","last_clean":"2024-09-19T06:37:14.477847+0000","last_became_active":"2024-09-19T06:37:08.437921+0000","last_became_peered":"2024-09-19T06:37:08.437921+0000","last_unstale":"2024-09-19T06:37:14.477847+0000","last_undegraded":"2024-09-19T06:37:14.477847+0000","last_fullsized":"2024-09-19T06:37:14.477847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:58:23.269120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030018+0000","last_change":"2024-09-19T06:37:09.450731+0000","last_active":"2024-09-19T06:37:15.030018+0000","last_peered":"2024-09-19T06:37:15.030018+0000","last_clean":"2024-09-19T06:37:15.030018+0000","last_became_active":"2024-09-19T06:37:09.450430+0000","last_became_peered":"2024-09-19T06:37:09.450430+0000","last_unstale":"2024-09-19T06:37:15.030018+0000","last_undegraded":"2024-09-19T06:37:15.030018+0000","last_fullsized":"2024-09-19T06:37:15.030018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:21.701872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029552+0000","last_change":"2024-09-19T06:37:13.459445+0000","last_active":"2024-09-19T06:37:15.029552+0000","last_peered":"2024-09-19T06:37:15.029552+0000","last_clean":"2024-09-19T06:37:15.029552+0000","last_became_active":"2024-09-19T06:37:13.459040+0000","last_became_peered":"2024-09-19T06:37:13.459040+0000","last_unstale":"2024-09-19T06:37:15.029552+0000","last_undegraded":"2024-09-19T06:37:15.029552+0000","last_fullsized":"2024-09-19T06:37:15.029552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:37.676097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479475+0000","last_change":"2024-09-19T06:37:08.448303+0000","last_active":"2024-09-19T06:37:14.479475+0000","last_peered":"2024-09-19T06:37:14.479475+0000","last_clean":"2024-09-19T06:37:14.479475+0000","last_became_active":"2024-09-19T06:37:08.447559+0000","last_became_peered":"2024-09-19T06:37:08.447559+0000","last_unstale":"2024-09-19T06:37:14.479475+0000","last_undegraded":"2024-09-19T06:37:14.479475+0000","last_fullsized":"2024-09-19T06:37:14.479475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:43.093216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030079+0000","last_change":"2024-09-19T06:37:09.445971+0000","last_active":"2024-09-19T06:37:15.030079+0000","last_peered":"2024-09-19T06:37:15.030079+0000","last_clean":"2024-09-19T06:37:15.030079+0000","last_became_active":"2024-09-19T06:37:09.444806+0000","last_became_peered":"2024-09-19T06:37:09.444806+0000","last_unstale":"2024-09-19T06:37:15.030079+0000","last_undegraded":"2024-09-19T06:37:15.030079+0000","last_fullsized":"2024-09-19T06:37:15.030079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:15.765835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030528+0000","last_change":"2024-09-19T06:37:13.459035+0000","last_active":"2024-09-19T06:37:15.030528+0000","last_peered":"2024-09-19T06:37:15.030528+0000","last_clean":"2024-09-19T06:37:15.030528+0000","last_became_active":"2024-09-19T06:37:13.458588+0000","last_became_peered":"2024-09-19T06:37:13.458588+0000","last_unstale":"2024-09-19T06:37:15.030528+0000","last_undegraded":"2024-09-19T06:37:15.030528+0000","last_fullsized":"2024-09-19T06:37:15.030528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:27.900054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479040+0000","last_change":"2024-09-19T06:37:08.446363+0000","last_active":"2024-09-19T06:37:14.479040+0000","last_peered":"2024-09-19T06:37:14.479040+0000","last_clean":"2024-09-19T06:37:14.479040+0000","last_became_active":"2024-09-19T06:37:08.446053+0000","last_became_peered":"2024-09-19T06:37:08.446053+0000","last_unstale":"2024-09-19T06:37:14.479040+0000","last_undegraded":"2024-09-19T06:37:14.479040+0000","last_fullsized":"2024-09-19T06:37:14.479040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:22.488347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030495+0000","last_change":"2024-09-19T06:37:09.445124+0000","last_active":"2024-09-19T06:37:15.030495+0000","last_peered":"2024-09-19T06:37:15.030495+0000","last_clean":"2024-09-19T06:37:15.030495+0000","last_became_active":"2024-09-19T06:37:09.444824+0000","last_became_peered":"2024-09-19T06:37:09.444824+0000","last_unstale":"2024-09-19T06:37:15.030495+0000","last_undegraded":"2024-09-19T06:37:15.030495+0000","last_fullsized":"2024-09-19T06:37:15.030495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:40:05.642055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030082+0000","last_change":"2024-09-19T06:37:13.459720+0000","last_active":"2024-09-19T06:37:15.030082+0000","last_peered":"2024-09-19T06:37:15.030082+0000","last_clean":"2024-09-19T06:37:15.030082+0000","last_became_active":"2024-09-19T06:37:13.459350+0000","last_became_peered":"2024-09-19T06:37:13.459350+0000","last_unstale":"2024-09-19T06:37:15.030082+0000","last_undegraded":"2024-09-19T06:37:15.030082+0000","last_fullsized":"2024-09-19T06:37:15.030082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:29.546976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478406+0000","last_change":"2024-09-19T06:37:09.447795+0000","last_active":"2024-09-19T06:37:14.478406+0000","last_peered":"2024-09-19T06:37:14.478406+0000","last_clean":"2024-09-19T06:37:14.478406+0000","last_became_active":"2024-09-19T06:37:09.447502+0000","last_became_peered":"2024-09-19T06:37:09.447502+0000","last_unstale":"2024-09-19T06:37:14.478406+0000","last_undegraded":"2024-09-19T06:37:14.478406+0000","last_fullsized":"2024-09-19T06:37:14.478406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:51.384743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479493+0000","last_change":"2024-09-19T06:37:08.446179+0000","last_active":"2024-09-19T06:37:14.479493+0000","last_peered":"2024-09-19T06:37:14.479493+0000","last_clean":"2024-09-19T06:37:14.479493+0000","last_became_active":"2024-09-19T06:37:08.445834+0000","last_became_peered":"2024-09-19T06:37:08.445834+0000","last_unstale":"2024-09-19T06:37:14.479493+0000","last_undegraded":"2024-09-19T06:37:14.479493+0000","last_fullsized":"2024-09-19T06:37:14.479493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:03.783414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030572+0000","last_change":"2024-09-19T06:37:13.460344+0000","last_active":"2024-09-19T06:37:15.030572+0000","last_peered":"2024-09-19T06:37:15.030572+0000","last_clean":"2024-09-19T06:37:15.030572+0000","last_became_active":"2024-09-19T06:37:13.459967+0000","last_became_peered":"2024-09-19T06:37:13.459967+0000","last_unstale":"2024-09-19T06:37:15.030572+0000","last_undegraded":"2024-09-19T06:37:15.030572+0000","last_fullsized":"2024-09-19T06:37:15.030572+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:59.096218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477943+0000","last_change":"2024-09-19T06:37:09.449884+0000","last_active":"2024-09-19T06:37:14.477943+0000","last_peered":"2024-09-19T06:37:14.477943+0000","last_clean":"2024-09-19T06:37:14.477943+0000","last_became_active":"2024-09-19T06:37:09.449645+0000","last_became_peered":"2024-09-19T06:37:09.449645+0000","last_unstale":"2024-09-19T06:37:14.477943+0000","last_undegraded":"2024-09-19T06:37:14.477943+0000","last_fullsized":"2024-09-19T06:37:14.477943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:07.353098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030475+0000","last_change":"2024-09-19T06:37:08.437022+0000","last_active":"2024-09-19T06:37:15.030475+0000","last_peered":"2024-09-19T06:37:15.030475+0000","last_clean":"2024-09-19T06:37:15.030475+0000","last_became_active":"2024-09-19T06:37:08.436761+0000","last_became_peered":"2024-09-19T06:37:08.436761+0000","last_unstale":"2024-09-19T06:37:15.030475+0000","last_undegraded":"2024-09-19T06:37:15.030475+0000","last_fullsized":"2024-09-19T06:37:15.030475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:04.985581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030395+0000","last_change":"2024-09-19T06:37:13.460470+0000","last_active":"2024-09-19T06:37:15.030395+0000","last_peered":"2024-09-19T06:37:15.030395+0000","last_clean":"2024-09-19T06:37:15.030395+0000","last_became_active":"2024-09-19T06:37:13.460072+0000","last_became_peered":"2024-09-19T06:37:13.460072+0000","last_unstale":"2024-09-19T06:37:15.030395+0000","last_undegraded":"2024-09-19T06:37:15.030395+0000","last_fullsized":"2024-09-19T06:37:15.030395+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:50.835286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477295+0000","last_change":"2024-09-19T06:37:09.433042+0000","last_active":"2024-09-19T06:37:14.477295+0000","last_peered":"2024-09-19T06:37:14.477295+0000","last_clean":"2024-09-19T06:37:14.477295+0000","last_became_active":"2024-09-19T06:37:09.432589+0000","last_became_peered":"2024-09-19T06:37:09.432589+0000","last_unstale":"2024-09-19T06:37:14.477295+0000","last_undegraded":"2024-09-19T06:37:14.477295+0000","last_fullsized":"2024-09-19T06:37:14.477295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:18.661071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029869+0000","last_change":"2024-09-19T06:37:08.444408+0000","last_active":"2024-09-19T06:37:15.029869+0000","last_peered":"2024-09-19T06:37:15.029869+0000","last_clean":"2024-09-19T06:37:15.029869+0000","last_became_active":"2024-09-19T06:37:08.444160+0000","last_became_peered":"2024-09-19T06:37:08.444160+0000","last_unstale":"2024-09-19T06:37:15.029869+0000","last_undegraded":"2024-09-19T06:37:15.029869+0000","last_fullsized":"2024-09-19T06:37:15.029869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:54.304153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030788+0000","last_change":"2024-09-19T06:37:13.466175+0000","last_active":"2024-09-19T06:37:15.030788+0000","last_peered":"2024-09-19T06:37:15.030788+0000","last_clean":"2024-09-19T06:37:15.030788+0000","last_became_active":"2024-09-19T06:37:13.465731+0000","last_became_peered":"2024-09-19T06:37:13.465731+0000","last_unstale":"2024-09-19T06:37:15.030788+0000","last_undegraded":"2024-09-19T06:37:15.030788+0000","last_fullsized":"2024-09-19T06:37:15.030788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:01.100164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029947+0000","last_change":"2024-09-19T06:37:09.437254+0000","last_active":"2024-09-19T06:37:15.029947+0000","last_peered":"2024-09-19T06:37:15.029947+0000","last_clean":"2024-09-19T06:37:15.029947+0000","last_became_active":"2024-09-19T06:37:09.436512+0000","last_became_peered":"2024-09-19T06:37:09.436512+0000","last_unstale":"2024-09-19T06:37:15.029947+0000","last_undegraded":"2024-09-19T06:37:15.029947+0000","last_fullsized":"2024-09-19T06:37:15.029947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:21.893793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478028+0000","last_change":"2024-09-19T06:37:08.446216+0000","last_active":"2024-09-19T06:37:14.478028+0000","last_peered":"2024-09-19T06:37:14.478028+0000","last_clean":"2024-09-19T06:37:14.478028+0000","last_became_active":"2024-09-19T06:37:08.445845+0000","last_became_peered":"2024-09-19T06:37:08.445845+0000","last_unstale":"2024-09-19T06:37:14.478028+0000","last_undegraded":"2024-09-19T06:37:14.478028+0000","last_fullsized":"2024-09-19T06:37:14.478028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:04.033283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030215+0000","last_change":"2024-09-19T06:37:13.462192+0000","last_active":"2024-09-19T06:37:15.030215+0000","last_peered":"2024-09-19T06:37:15.030215+0000","last_clean":"2024-09-19T06:37:15.030215+0000","last_became_active":"2024-09-19T06:37:13.460955+0000","last_became_peered":"2024-09-19T06:37:13.460955+0000","last_unstale":"2024-09-19T06:37:15.030215+0000","last_undegraded":"2024-09-19T06:37:15.030215+0000","last_fullsized":"2024-09-19T06:37:15.030215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:53.583488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030554+0000","last_change":"2024-09-19T06:37:09.445989+0000","last_active":"2024-09-19T06:37:15.030554+0000","last_peered":"2024-09-19T06:37:15.030554+0000","last_clean":"2024-09-19T06:37:15.030554+0000","last_became_active":"2024-09-19T06:37:09.445705+0000","last_became_peered":"2024-09-19T06:37:09.445705+0000","last_unstale":"2024-09-19T06:37:15.030554+0000","last_undegraded":"2024-09-19T06:37:15.030554+0000","last_fullsized":"2024-09-19T06:37:15.030554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:24.592460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478969+0000","last_change":"2024-09-19T06:37:08.446226+0000","last_active":"2024-09-19T06:37:14.478969+0000","last_peered":"2024-09-19T06:37:14.478969+0000","last_clean":"2024-09-19T06:37:14.478969+0000","last_became_active":"2024-09-19T06:37:08.445929+0000","last_became_peered":"2024-09-19T06:37:08.445929+0000","last_unstale":"2024-09-19T06:37:14.478969+0000","last_undegraded":"2024-09-19T06:37:14.478969+0000","last_fullsized":"2024-09-19T06:37:14.478969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:32.233033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029648+0000","last_change":"2024-09-19T06:37:13.462598+0000","last_active":"2024-09-19T06:37:15.029648+0000","last_peered":"2024-09-19T06:37:15.029648+0000","last_clean":"2024-09-19T06:37:15.029648+0000","last_became_active":"2024-09-19T06:37:13.462217+0000","last_became_peered":"2024-09-19T06:37:13.462217+0000","last_unstale":"2024-09-19T06:37:15.029648+0000","last_undegraded":"2024-09-19T06:37:15.029648+0000","last_fullsized":"2024-09-19T06:37:15.029648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:04.109419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477866+0000","last_change":"2024-09-19T06:37:09.434309+0000","last_active":"2024-09-19T06:37:14.477866+0000","last_peered":"2024-09-19T06:37:14.477866+0000","last_clean":"2024-09-19T06:37:14.477866+0000","last_became_active":"2024-09-19T06:37:09.433897+0000","last_became_peered":"2024-09-19T06:37:09.433897+0000","last_unstale":"2024-09-19T06:37:14.477866+0000","last_undegraded":"2024-09-19T06:37:14.477866+0000","last_fullsized":"2024-09-19T06:37:14.477866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:59.054484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030307+0000","last_change":"2024-09-19T06:37:08.441525+0000","last_active":"2024-09-19T06:37:15.030307+0000","last_peered":"2024-09-19T06:37:15.030307+0000","last_clean":"2024-09-19T06:37:15.030307+0000","last_became_active":"2024-09-19T06:37:08.441245+0000","last_became_peered":"2024-09-19T06:37:08.441245+0000","last_unstale":"2024-09-19T06:37:15.030307+0000","last_undegraded":"2024-09-19T06:37:15.030307+0000","last_fullsized":"2024-09-19T06:37:15.030307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:19.820705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477133+0000","last_change":"2024-09-19T06:37:13.468486+0000","last_active":"2024-09-19T06:37:14.477133+0000","last_peered":"2024-09-19T06:37:14.477133+0000","last_clean":"2024-09-19T06:37:14.477133+0000","last_became_active":"2024-09-19T06:37:13.468074+0000","last_became_peered":"2024-09-19T06:37:13.468074+0000","last_unstale":"2024-09-19T06:37:14.477133+0000","last_undegraded":"2024-09-19T06:37:14.477133+0000","last_fullsized":"2024-09-19T06:37:14.477133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:36.783781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030772+0000","last_change":"2024-09-19T06:37:09.435864+0000","last_active":"2024-09-19T06:37:15.030772+0000","last_peered":"2024-09-19T06:37:15.030772+0000","last_clean":"2024-09-19T06:37:15.030772+0000","last_became_active":"2024-09-19T06:37:09.435597+0000","last_became_peered":"2024-09-19T06:37:09.435597+0000","last_unstale":"2024-09-19T06:37:15.030772+0000","last_undegraded":"2024-09-19T06:37:15.030772+0000","last_fullsized":"2024-09-19T06:37:15.030772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:20.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479615+0000","last_change":"2024-09-19T06:37:08.447931+0000","last_active":"2024-09-19T06:37:14.479615+0000","last_peered":"2024-09-19T06:37:14.479615+0000","last_clean":"2024-09-19T06:37:14.479615+0000","last_became_active":"2024-09-19T06:37:08.447630+0000","last_became_peered":"2024-09-19T06:37:08.447630+0000","last_unstale":"2024-09-19T06:37:14.479615+0000","last_undegraded":"2024-09-19T06:37:14.479615+0000","last_fullsized":"2024-09-19T06:37:14.479615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:17.375740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030552+0000","last_change":"2024-09-19T06:37:13.468360+0000","last_active":"2024-09-19T06:37:15.030552+0000","last_peered":"2024-09-19T06:37:15.030552+0000","last_clean":"2024-09-19T06:37:15.030552+0000","last_became_active":"2024-09-19T06:37:13.467926+0000","last_became_peered":"2024-09-19T06:37:13.467926+0000","last_unstale":"2024-09-19T06:37:15.030552+0000","last_undegraded":"2024-09-19T06:37:15.030552+0000","last_fullsized":"2024-09-19T06:37:15.030552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:55.089630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030606+0000","last_change":"2024-09-19T06:37:09.441678+0000","last_active":"2024-09-19T06:37:15.030606+0000","last_peered":"2024-09-19T06:37:15.030606+0000","last_clean":"2024-09-19T06:37:15.030606+0000","last_became_active":"2024-09-19T06:37:09.441406+0000","last_became_peered":"2024-09-19T06:37:09.441406+0000","last_unstale":"2024-09-19T06:37:15.030606+0000","last_undegraded":"2024-09-19T06:37:15.030606+0000","last_fullsized":"2024-09-19T06:37:15.030606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:14.638004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030831+0000","last_change":"2024-09-19T06:37:08.438805+0000","last_active":"2024-09-19T06:37:15.030831+0000","last_peered":"2024-09-19T06:37:15.030831+0000","last_clean":"2024-09-19T06:37:15.030831+0000","last_became_active":"2024-09-19T06:37:08.438528+0000","last_became_peered":"2024-09-19T06:37:08.438528+0000","last_unstale":"2024-09-19T06:37:15.030831+0000","last_undegraded":"2024-09-19T06:37:15.030831+0000","last_fullsized":"2024-09-19T06:37:15.030831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:55.500347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030303+0000","last_change":"2024-09-19T06:37:13.459697+0000","last_active":"2024-09-19T06:37:15.030303+0000","last_peered":"2024-09-19T06:37:15.030303+0000","last_clean":"2024-09-19T06:37:15.030303+0000","last_became_active":"2024-09-19T06:37:13.459303+0000","last_became_peered":"2024-09-19T06:37:13.459303+0000","last_unstale":"2024-09-19T06:37:15.030303+0000","last_undegraded":"2024-09-19T06:37:15.030303+0000","last_fullsized":"2024-09-19T06:37:15.030303+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:01.695905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.031009+0000","last_change":"2024-09-19T06:37:09.449701+0000","last_active":"2024-09-19T06:37:15.031009+0000","last_peered":"2024-09-19T06:37:15.031009+0000","last_clean":"2024-09-19T06:37:15.031009+0000","last_became_active":"2024-09-19T06:37:09.448899+0000","last_became_peered":"2024-09-19T06:37:09.448899+0000","last_unstale":"2024-09-19T06:37:15.031009+0000","last_undegraded":"2024-09-19T06:37:15.031009+0000","last_fullsized":"2024-09-19T06:37:15.031009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:17.448251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030609+0000","last_change":"2024-09-19T06:37:08.434263+0000","last_active":"2024-09-19T06:37:15.030609+0000","last_peered":"2024-09-19T06:37:15.030609+0000","last_clean":"2024-09-19T06:37:15.030609+0000","last_became_active":"2024-09-19T06:37:08.433984+0000","last_became_peered":"2024-09-19T06:37:08.433984+0000","last_unstale":"2024-09-19T06:37:15.030609+0000","last_undegraded":"2024-09-19T06:37:15.030609+0000","last_fullsized":"2024-09-19T06:37:15.030609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:05.599054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030728+0000","last_change":"2024-09-19T06:37:13.464527+0000","last_active":"2024-09-19T06:37:15.030728+0000","last_peered":"2024-09-19T06:37:15.030728+0000","last_clean":"2024-09-19T06:37:15.030728+0000","last_became_active":"2024-09-19T06:37:13.461685+0000","last_became_peered":"2024-09-19T06:37:13.461685+0000","last_unstale":"2024-09-19T06:37:15.030728+0000","last_undegraded":"2024-09-19T06:37:15.030728+0000","last_fullsized":"2024-09-19T06:37:15.030728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:57.229892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030028+0000","last_change":"2024-09-19T06:37:09.434421+0000","last_active":"2024-09-19T06:37:15.030028+0000","last_peered":"2024-09-19T06:37:15.030028+0000","last_clean":"2024-09-19T06:37:15.030028+0000","last_became_active":"2024-09-19T06:37:09.434119+0000","last_became_peered":"2024-09-19T06:37:09.434119+0000","last_unstale":"2024-09-19T06:37:15.030028+0000","last_undegraded":"2024-09-19T06:37:15.030028+0000","last_fullsized":"2024-09-19T06:37:15.030028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:56.984336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.814975+0000","last_change":"2024-09-19T06:37:08.436856+0000","last_active":"2024-09-19T06:37:14.814975+0000","last_peered":"2024-09-19T06:37:14.814975+0000","last_clean":"2024-09-19T06:37:14.814975+0000","last_became_active":"2024-09-19T06:37:08.435718+0000","last_became_peered":"2024-09-19T06:37:08.435718+0000","last_unstale":"2024-09-19T06:37:14.814975+0000","last_undegraded":"2024-09-19T06:37:14.814975+0000","last_fullsized":"2024-09-19T06:37:14.814975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:58.650430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030892+0000","last_change":"2024-09-19T06:37:13.466081+0000","last_active":"2024-09-19T06:37:15.030892+0000","last_peered":"2024-09-19T06:37:15.030892+0000","last_clean":"2024-09-19T06:37:15.030892+0000","last_became_active":"2024-09-19T06:37:13.465348+0000","last_became_peered":"2024-09-19T06:37:13.465348+0000","last_unstale":"2024-09-19T06:37:15.030892+0000","last_undegraded":"2024-09-19T06:37:15.030892+0000","last_fullsized":"2024-09-19T06:37:15.030892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:11.592737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029583+0000","last_change":"2024-09-19T06:37:09.444888+0000","last_active":"2024-09-19T06:37:15.029583+0000","last_peered":"2024-09-19T06:37:15.029583+0000","last_clean":"2024-09-19T06:37:15.029583+0000","last_became_active":"2024-09-19T06:37:09.444605+0000","last_became_peered":"2024-09-19T06:37:09.444605+0000","last_unstale":"2024-09-19T06:37:15.029583+0000","last_undegraded":"2024-09-19T06:37:15.029583+0000","last_fullsized":"2024-09-19T06:37:15.029583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:53.868356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478136+0000","last_change":"2024-09-19T06:37:08.446760+0000","last_active":"2024-09-19T06:37:14.478136+0000","last_peered":"2024-09-19T06:37:14.478136+0000","last_clean":"2024-09-19T06:37:14.478136+0000","last_became_active":"2024-09-19T06:37:08.446474+0000","last_became_peered":"2024-09-19T06:37:08.446474+0000","last_unstale":"2024-09-19T06:37:14.478136+0000","last_undegraded":"2024-09-19T06:37:14.478136+0000","last_fullsized":"2024-09-19T06:37:14.478136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:12.597952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030429+0000","last_change":"2024-09-19T06:37:13.471220+0000","last_active":"2024-09-19T06:37:15.030429+0000","last_peered":"2024-09-19T06:37:15.030429+0000","last_clean":"2024-09-19T06:37:15.030429+0000","last_became_active":"2024-09-19T06:37:13.470860+0000","last_became_peered":"2024-09-19T06:37:13.470860+0000","last_unstale":"2024-09-19T06:37:15.030429+0000","last_undegraded":"2024-09-19T06:37:15.030429+0000","last_fullsized":"2024-09-19T06:37:15.030429+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:07.659583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477346+0000","last_change":"2024-09-19T06:37:09.440366+0000","last_active":"2024-09-19T06:37:14.477346+0000","last_peered":"2024-09-19T06:37:14.477346+0000","last_clean":"2024-09-19T06:37:14.477346+0000","last_became_active":"2024-09-19T06:37:09.439478+0000","last_became_peered":"2024-09-19T06:37:09.439478+0000","last_unstale":"2024-09-19T06:37:14.477346+0000","last_undegraded":"2024-09-19T06:37:14.477346+0000","last_fullsized":"2024-09-19T06:37:14.477346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:21.837351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029827+0000","last_change":"2024-09-19T06:37:08.435473+0000","last_active":"2024-09-19T06:37:15.029827+0000","last_peered":"2024-09-19T06:37:15.029827+0000","last_clean":"2024-09-19T06:37:15.029827+0000","last_became_active":"2024-09-19T06:37:08.435183+0000","last_became_peered":"2024-09-19T06:37:08.435183+0000","last_unstale":"2024-09-19T06:37:15.029827+0000","last_undegraded":"2024-09-19T06:37:15.029827+0000","last_fullsized":"2024-09-19T06:37:15.029827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:53.115010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478240+0000","last_change":"2024-09-19T06:36:58.829099+0000","last_active":"2024-09-19T06:37:14.478240+0000","last_peered":"2024-09-19T06:37:14.478240+0000","last_clean":"2024-09-19T06:37:14.478240+0000","last_became_active":"2024-09-19T06:36:58.828079+0000","last_became_peered":"2024-09-19T06:36:58.828079+0000","last_unstale":"2024-09-19T06:37:14.478240+0000","last_undegraded":"2024-09-19T06:37:14.478240+0000","last_fullsized":"2024-09-19T06:37:14.478240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:36:57.771085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:36:57.771085+0000","last_clean_scrub_stamp":"2024-09-19T06:36:57.771085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:14.663925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477944+0000","last_change":"2024-09-19T06:37:13.464435+0000","last_active":"2024-09-19T06:37:14.477944+0000","last_peered":"2024-09-19T06:37:14.477944+0000","last_clean":"2024-09-19T06:37:14.477944+0000","last_became_active":"2024-09-19T06:37:13.464101+0000","last_became_peered":"2024-09-19T06:37:13.464101+0000","last_unstale":"2024-09-19T06:37:14.477944+0000","last_undegraded":"2024-09-19T06:37:14.477944+0000","last_fullsized":"2024-09-19T06:37:14.477944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:30.073937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479308+0000","last_change":"2024-09-19T06:37:09.442774+0000","last_active":"2024-09-19T06:37:14.479308+0000","last_peered":"2024-09-19T06:37:14.479308+0000","last_clean":"2024-09-19T06:37:14.479308+0000","last_became_active":"2024-09-19T06:37:09.442515+0000","last_became_peered":"2024-09-19T06:37:09.442515+0000","last_unstale":"2024-09-19T06:37:14.479308+0000","last_undegraded":"2024-09-19T06:37:14.479308+0000","last_fullsized":"2024-09-19T06:37:14.479308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:57.376059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815252+0000","last_change":"2024-09-19T06:37:08.438038+0000","last_active":"2024-09-19T06:37:14.815252+0000","last_peered":"2024-09-19T06:37:14.815252+0000","last_clean":"2024-09-19T06:37:14.815252+0000","last_became_active":"2024-09-19T06:37:08.437771+0000","last_became_peered":"2024-09-19T06:37:08.437771+0000","last_unstale":"2024-09-19T06:37:14.815252+0000","last_undegraded":"2024-09-19T06:37:14.815252+0000","last_fullsized":"2024-09-19T06:37:14.815252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:07.210382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477772+0000","last_change":"2024-09-19T06:37:13.470916+0000","last_active":"2024-09-19T06:37:14.477772+0000","last_peered":"2024-09-19T06:37:14.477772+0000","last_clean":"2024-09-19T06:37:14.477772+0000","last_became_active":"2024-09-19T06:37:13.470488+0000","last_became_peered":"2024-09-19T06:37:13.470488+0000","last_unstale":"2024-09-19T06:37:14.477772+0000","last_undegraded":"2024-09-19T06:37:14.477772+0000","last_fullsized":"2024-09-19T06:37:14.477772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:27.884932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030150+0000","last_change":"2024-09-19T06:37:09.442213+0000","last_active":"2024-09-19T06:37:15.030150+0000","last_peered":"2024-09-19T06:37:15.030150+0000","last_clean":"2024-09-19T06:37:15.030150+0000","last_became_active":"2024-09-19T06:37:09.441850+0000","last_became_peered":"2024-09-19T06:37:09.441850+0000","last_unstale":"2024-09-19T06:37:15.030150+0000","last_undegraded":"2024-09-19T06:37:15.030150+0000","last_fullsized":"2024-09-19T06:37:15.030150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:43.728914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030863+0000","last_change":"2024-09-19T06:37:08.431703+0000","last_active":"2024-09-19T06:37:15.030863+0000","last_peered":"2024-09-19T06:37:15.030863+0000","last_clean":"2024-09-19T06:37:15.030863+0000","last_became_active":"2024-09-19T06:37:08.431443+0000","last_became_peered":"2024-09-19T06:37:08.431443+0000","last_unstale":"2024-09-19T06:37:15.030863+0000","last_undegraded":"2024-09-19T06:37:15.030863+0000","last_fullsized":"2024-09-19T06:37:15.030863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:02.007521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030768+0000","last_change":"2024-09-19T06:37:13.469295+0000","last_active":"2024-09-19T06:37:15.030768+0000","last_peered":"2024-09-19T06:37:15.030768+0000","last_clean":"2024-09-19T06:37:15.030768+0000","last_became_active":"2024-09-19T06:37:13.468879+0000","last_became_peered":"2024-09-19T06:37:13.468879+0000","last_unstale":"2024-09-19T06:37:15.030768+0000","last_undegraded":"2024-09-19T06:37:15.030768+0000","last_fullsized":"2024-09-19T06:37:15.030768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:34.380034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479747+0000","last_change":"2024-09-19T06:37:09.439264+0000","last_active":"2024-09-19T06:37:14.479747+0000","last_peered":"2024-09-19T06:37:14.479747+0000","last_clean":"2024-09-19T06:37:14.479747+0000","last_became_active":"2024-09-19T06:37:09.438954+0000","last_became_peered":"2024-09-19T06:37:09.438954+0000","last_unstale":"2024-09-19T06:37:14.479747+0000","last_undegraded":"2024-09-19T06:37:14.479747+0000","last_fullsized":"2024-09-19T06:37:14.479747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:55.094093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815232+0000","last_change":"2024-09-19T06:37:08.437406+0000","last_active":"2024-09-19T06:37:14.815232+0000","last_peered":"2024-09-19T06:37:14.815232+0000","last_clean":"2024-09-19T06:37:14.815232+0000","last_became_active":"2024-09-19T06:37:08.437093+0000","last_became_peered":"2024-09-19T06:37:08.437093+0000","last_unstale":"2024-09-19T06:37:14.815232+0000","last_undegraded":"2024-09-19T06:37:14.815232+0000","last_fullsized":"2024-09-19T06:37:14.815232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:25.158027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029476+0000","last_change":"2024-09-19T06:37:13.460116+0000","last_active":"2024-09-19T06:37:15.029476+0000","last_peered":"2024-09-19T06:37:15.029476+0000","last_clean":"2024-09-19T06:37:15.029476+0000","last_became_active":"2024-09-19T06:37:13.459707+0000","last_became_peered":"2024-09-19T06:37:13.459707+0000","last_unstale":"2024-09-19T06:37:15.029476+0000","last_undegraded":"2024-09-19T06:37:15.029476+0000","last_fullsized":"2024-09-19T06:37:15.029476+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:02.657115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479032+0000","last_change":"2024-09-19T06:37:09.442670+0000","last_active":"2024-09-19T06:37:14.479032+0000","last_peered":"2024-09-19T06:37:14.479032+0000","last_clean":"2024-09-19T06:37:14.479032+0000","last_became_active":"2024-09-19T06:37:09.442390+0000","last_became_peered":"2024-09-19T06:37:09.442390+0000","last_unstale":"2024-09-19T06:37:14.479032+0000","last_undegraded":"2024-09-19T06:37:14.479032+0000","last_fullsized":"2024-09-19T06:37:14.479032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:02:26.726663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030129+0000","last_change":"2024-09-19T06:37:08.437263+0000","last_active":"2024-09-19T06:37:15.030129+0000","last_peered":"2024-09-19T06:37:15.030129+0000","last_clean":"2024-09-19T06:37:15.030129+0000","last_became_active":"2024-09-19T06:37:08.436982+0000","last_became_peered":"2024-09-19T06:37:08.436982+0000","last_unstale":"2024-09-19T06:37:15.030129+0000","last_undegraded":"2024-09-19T06:37:15.030129+0000","last_fullsized":"2024-09-19T06:37:15.030129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:14.895925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029466+0000","last_change":"2024-09-19T06:37:13.459433+0000","last_active":"2024-09-19T06:37:15.029466+0000","last_peered":"2024-09-19T06:37:15.029466+0000","last_clean":"2024-09-19T06:37:15.029466+0000","last_became_active":"2024-09-19T06:37:13.459031+0000","last_became_peered":"2024-09-19T06:37:13.459031+0000","last_unstale":"2024-09-19T06:37:15.029466+0000","last_undegraded":"2024-09-19T06:37:15.029466+0000","last_fullsized":"2024-09-19T06:37:15.029466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:07.294413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478514+0000","last_change":"2024-09-19T06:37:09.439142+0000","last_active":"2024-09-19T06:37:14.478514+0000","last_peered":"2024-09-19T06:37:14.478514+0000","last_clean":"2024-09-19T06:37:14.478514+0000","last_became_active":"2024-09-19T06:37:09.437717+0000","last_became_peered":"2024-09-19T06:37:09.437717+0000","last_unstale":"2024-09-19T06:37:14.478514+0000","last_undegraded":"2024-09-19T06:37:14.478514+0000","last_fullsized":"2024-09-19T06:37:14.478514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:32.934290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.814858+0000","last_change":"2024-09-19T06:37:08.430649+0000","last_active":"2024-09-19T06:37:14.814858+0000","last_peered":"2024-09-19T06:37:14.814858+0000","last_clean":"2024-09-19T06:37:14.814858+0000","last_became_active":"2024-09-19T06:37:08.430324+0000","last_became_peered":"2024-09-19T06:37:08.430324+0000","last_unstale":"2024-09-19T06:37:14.814858+0000","last_undegraded":"2024-09-19T06:37:14.814858+0000","last_fullsized":"2024-09-19T06:37:14.814858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:56.656357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030152+0000","last_change":"2024-09-19T06:37:13.463695+0000","last_active":"2024-09-19T06:37:15.030152+0000","last_peered":"2024-09-19T06:37:15.030152+0000","last_clean":"2024-09-19T06:37:15.030152+0000","last_became_active":"2024-09-19T06:37:13.463334+0000","last_became_peered":"2024-09-19T06:37:13.463334+0000","last_unstale":"2024-09-19T06:37:15.030152+0000","last_undegraded":"2024-09-19T06:37:15.030152+0000","last_fullsized":"2024-09-19T06:37:15.030152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:46.991800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477668+0000","last_change":"2024-09-19T06:37:09.450168+0000","last_active":"2024-09-19T06:37:14.477668+0000","last_peered":"2024-09-19T06:37:14.477668+0000","last_clean":"2024-09-19T06:37:14.477668+0000","last_became_active":"2024-09-19T06:37:09.449872+0000","last_became_peered":"2024-09-19T06:37:09.449872+0000","last_unstale":"2024-09-19T06:37:14.477668+0000","last_undegraded":"2024-09-19T06:37:14.477668+0000","last_fullsized":"2024-09-19T06:37:14.477668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:02:28.282840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478710+0000","last_change":"2024-09-19T06:37:08.442428+0000","last_active":"2024-09-19T06:37:14.478710+0000","last_peered":"2024-09-19T06:37:14.478710+0000","last_clean":"2024-09-19T06:37:14.478710+0000","last_became_active":"2024-09-19T06:37:08.442120+0000","last_became_peered":"2024-09-19T06:37:08.442120+0000","last_unstale":"2024-09-19T06:37:14.478710+0000","last_undegraded":"2024-09-19T06:37:14.478710+0000","last_fullsized":"2024-09-19T06:37:14.478710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:48.816822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477870+0000","last_change":"2024-09-19T06:37:13.471319+0000","last_active":"2024-09-19T06:37:14.477870+0000","last_peered":"2024-09-19T06:37:14.477870+0000","last_clean":"2024-09-19T06:37:14.477870+0000","last_became_active":"2024-09-19T06:37:13.470887+0000","last_became_peered":"2024-09-19T06:37:13.470887+0000","last_unstale":"2024-09-19T06:37:14.477870+0000","last_undegraded":"2024-09-19T06:37:14.477870+0000","last_fullsized":"2024-09-19T06:37:14.477870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:21.884985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479407+0000","last_change":"2024-09-19T06:37:09.439142+0000","last_active":"2024-09-19T06:37:14.479407+0000","last_peered":"2024-09-19T06:37:14.479407+0000","last_clean":"2024-09-19T06:37:14.479407+0000","last_became_active":"2024-09-19T06:37:09.437635+0000","last_became_peered":"2024-09-19T06:37:09.437635+0000","last_unstale":"2024-09-19T06:37:14.479407+0000","last_undegraded":"2024-09-19T06:37:14.479407+0000","last_fullsized":"2024-09-19T06:37:14.479407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:46.773889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030517+0000","last_change":"2024-09-19T06:37:08.438932+0000","last_active":"2024-09-19T06:37:15.030517+0000","last_peered":"2024-09-19T06:37:15.030517+0000","last_clean":"2024-09-19T06:37:15.030517+0000","last_became_active":"2024-09-19T06:37:08.438405+0000","last_became_peered":"2024-09-19T06:37:08.438405+0000","last_unstale":"2024-09-19T06:37:15.030517+0000","last_undegraded":"2024-09-19T06:37:15.030517+0000","last_fullsized":"2024-09-19T06:37:15.030517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:59.606628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477677+0000","last_change":"2024-09-19T06:37:13.459370+0000","last_active":"2024-09-19T06:37:14.477677+0000","last_peered":"2024-09-19T06:37:14.477677+0000","last_clean":"2024-09-19T06:37:14.477677+0000","last_became_active":"2024-09-19T06:37:13.458928+0000","last_became_peered":"2024-09-19T06:37:13.458928+0000","last_unstale":"2024-09-19T06:37:14.477677+0000","last_undegraded":"2024-09-19T06:37:14.477677+0000","last_fullsized":"2024-09-19T06:37:14.477677+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:00.179404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029933+0000","last_change":"2024-09-19T06:37:09.448958+0000","last_active":"2024-09-19T06:37:15.029933+0000","last_peered":"2024-09-19T06:37:15.029933+0000","last_clean":"2024-09-19T06:37:15.029933+0000","last_became_active":"2024-09-19T06:37:09.448697+0000","last_became_peered":"2024-09-19T06:37:09.448697+0000","last_unstale":"2024-09-19T06:37:15.029933+0000","last_undegraded":"2024-09-19T06:37:15.029933+0000","last_fullsized":"2024-09-19T06:37:15.029933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:16.306915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030900+0000","last_change":"2024-09-19T06:37:08.442685+0000","last_active":"2024-09-19T06:37:15.030900+0000","last_peered":"2024-09-19T06:37:15.030900+0000","last_clean":"2024-09-19T06:37:15.030900+0000","last_became_active":"2024-09-19T06:37:08.442436+0000","last_became_peered":"2024-09-19T06:37:08.442436+0000","last_unstale":"2024-09-19T06:37:15.030900+0000","last_undegraded":"2024-09-19T06:37:15.030900+0000","last_fullsized":"2024-09-19T06:37:15.030900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:09.952733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030332+0000","last_change":"2024-09-19T06:37:13.457651+0000","last_active":"2024-09-19T06:37:15.030332+0000","last_peered":"2024-09-19T06:37:15.030332+0000","last_clean":"2024-09-19T06:37:15.030332+0000","last_became_active":"2024-09-19T06:37:13.457246+0000","last_became_peered":"2024-09-19T06:37:13.457246+0000","last_unstale":"2024-09-19T06:37:15.030332+0000","last_undegraded":"2024-09-19T06:37:15.030332+0000","last_fullsized":"2024-09-19T06:37:15.030332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:18.553158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479228+0000","last_change":"2024-09-19T06:37:09.441212+0000","last_active":"2024-09-19T06:37:14.479228+0000","last_peered":"2024-09-19T06:37:14.479228+0000","last_clean":"2024-09-19T06:37:14.479228+0000","last_became_active":"2024-09-19T06:37:09.440209+0000","last_became_peered":"2024-09-19T06:37:09.440209+0000","last_unstale":"2024-09-19T06:37:14.479228+0000","last_undegraded":"2024-09-19T06:37:14.479228+0000","last_fullsized":"2024-09-19T06:37:14.479228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:52.173784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:24.168847+0000","last_change":"2024-09-19T06:37:08.442615+0000","last_active":"2024-09-19T06:37:24.168847+0000","last_peered":"2024-09-19T06:37:24.168847+0000","last_clean":"2024-09-19T06:37:24.168847+0000","last_became_active":"2024-09-19T06:37:08.442242+0000","last_became_peered":"2024-09-19T06:37:08.442242+0000","last_unstale":"2024-09-19T06:37:24.168847+0000","last_undegraded":"2024-09-19T06:37:24.168847+0000","last_fullsized":"2024-09-19T06:37:24.168847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:23.813400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030495+0000","last_change":"2024-09-19T06:37:13.464688+0000","last_active":"2024-09-19T06:37:15.030495+0000","last_peered":"2024-09-19T06:37:15.030495+0000","last_clean":"2024-09-19T06:37:15.030495+0000","last_became_active":"2024-09-19T06:37:13.461620+0000","last_became_peered":"2024-09-19T06:37:13.461620+0000","last_unstale":"2024-09-19T06:37:15.030495+0000","last_undegraded":"2024-09-19T06:37:15.030495+0000","last_fullsized":"2024-09-19T06:37:15.030495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:02.928332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030727+0000","last_change":"2024-09-19T06:37:09.440021+0000","last_active":"2024-09-19T06:37:15.030727+0000","last_peered":"2024-09-19T06:37:15.030727+0000","last_clean":"2024-09-19T06:37:15.030727+0000","last_became_active":"2024-09-19T06:37:09.437800+0000","last_became_peered":"2024-09-19T06:37:09.437800+0000","last_unstale":"2024-09-19T06:37:15.030727+0000","last_undegraded":"2024-09-19T06:37:15.030727+0000","last_fullsized":"2024-09-19T06:37:15.030727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:51.963097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030761+0000","last_change":"2024-09-19T06:37:08.434422+0000","last_active":"2024-09-19T06:37:15.030761+0000","last_peered":"2024-09-19T06:37:15.030761+0000","last_clean":"2024-09-19T06:37:15.030761+0000","last_became_active":"2024-09-19T06:37:08.434151+0000","last_became_peered":"2024-09-19T06:37:08.434151+0000","last_unstale":"2024-09-19T06:37:15.030761+0000","last_undegraded":"2024-09-19T06:37:15.030761+0000","last_fullsized":"2024-09-19T06:37:15.030761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:49.540748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030746+0000","last_change":"2024-09-19T06:37:13.459321+0000","last_active":"2024-09-19T06:37:15.030746+0000","last_peered":"2024-09-19T06:37:15.030746+0000","last_clean":"2024-09-19T06:37:15.030746+0000","last_became_active":"2024-09-19T06:37:13.458924+0000","last_became_peered":"2024-09-19T06:37:13.458924+0000","last_unstale":"2024-09-19T06:37:15.030746+0000","last_undegraded":"2024-09-19T06:37:15.030746+0000","last_fullsized":"2024-09-19T06:37:15.030746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:11.428574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030167+0000","last_change":"2024-09-19T06:37:09.448450+0000","last_active":"2024-09-19T06:37:15.030167+0000","last_peered":"2024-09-19T06:37:15.030167+0000","last_clean":"2024-09-19T06:37:15.030167+0000","last_became_active":"2024-09-19T06:37:09.448173+0000","last_became_peered":"2024-09-19T06:37:09.448173+0000","last_unstale":"2024-09-19T06:37:15.030167+0000","last_undegraded":"2024-09-19T06:37:15.030167+0000","last_fullsized":"2024-09-19T06:37:15.030167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:22.442374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030854+0000","last_change":"2024-09-19T06:37:08.442796+0000","last_active":"2024-09-19T06:37:15.030854+0000","last_peered":"2024-09-19T06:37:15.030854+0000","last_clean":"2024-09-19T06:37:15.030854+0000","last_became_active":"2024-09-19T06:37:08.442126+0000","last_became_peered":"2024-09-19T06:37:08.442126+0000","last_unstale":"2024-09-19T06:37:15.030854+0000","last_undegraded":"2024-09-19T06:37:15.030854+0000","last_fullsized":"2024-09-19T06:37:15.030854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:27.716141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477293+0000","last_change":"2024-09-19T06:37:13.464100+0000","last_active":"2024-09-19T06:37:14.477293+0000","last_peered":"2024-09-19T06:37:14.477293+0000","last_clean":"2024-09-19T06:37:14.477293+0000","last_became_active":"2024-09-19T06:37:13.462750+0000","last_became_peered":"2024-09-19T06:37:13.462750+0000","last_unstale":"2024-09-19T06:37:14.477293+0000","last_undegraded":"2024-09-19T06:37:14.477293+0000","last_fullsized":"2024-09-19T06:37:14.477293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:49.139841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030752+0000","last_change":"2024-09-19T06:37:09.448328+0000","last_active":"2024-09-19T06:37:15.030752+0000","last_peered":"2024-09-19T06:37:15.030752+0000","last_clean":"2024-09-19T06:37:15.030752+0000","last_became_active":"2024-09-19T06:37:09.448056+0000","last_became_peered":"2024-09-19T06:37:09.448056+0000","last_unstale":"2024-09-19T06:37:15.030752+0000","last_undegraded":"2024-09-19T06:37:15.030752+0000","last_fullsized":"2024-09-19T06:37:15.030752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:53.451104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478778+0000","last_change":"2024-09-19T06:37:08.439543+0000","last_active":"2024-09-19T06:37:14.478778+0000","last_peered":"2024-09-19T06:37:14.478778+0000","last_clean":"2024-09-19T06:37:14.478778+0000","last_became_active":"2024-09-19T06:37:08.438785+0000","last_became_peered":"2024-09-19T06:37:08.438785+0000","last_unstale":"2024-09-19T06:37:14.478778+0000","last_undegraded":"2024-09-19T06:37:14.478778+0000","last_fullsized":"2024-09-19T06:37:14.478778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:51.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477286+0000","last_change":"2024-09-19T06:37:13.462327+0000","last_active":"2024-09-19T06:37:14.477286+0000","last_peered":"2024-09-19T06:37:14.477286+0000","last_clean":"2024-09-19T06:37:14.477286+0000","last_became_active":"2024-09-19T06:37:13.461762+0000","last_became_peered":"2024-09-19T06:37:13.461762+0000","last_unstale":"2024-09-19T06:37:14.477286+0000","last_undegraded":"2024-09-19T06:37:14.477286+0000","last_fullsized":"2024-09-19T06:37:14.477286+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:26.931537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029982+0000","last_change":"2024-09-19T06:37:13.471309+0000","last_active":"2024-09-19T06:37:15.029982+0000","last_peered":"2024-09-19T06:37:15.029982+0000","last_clean":"2024-09-19T06:37:15.029982+0000","last_became_active":"2024-09-19T06:37:13.470969+0000","last_became_peered":"2024-09-19T06:37:13.470969+0000","last_unstale":"2024-09-19T06:37:15.029982+0000","last_undegraded":"2024-09-19T06:37:15.029982+0000","last_fullsized":"2024-09-19T06:37:15.029982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:30.990159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029769+0000","last_change":"2024-09-19T06:37:09.443308+0000","last_active":"2024-09-19T06:37:15.029769+0000","last_peered":"2024-09-19T06:37:15.029769+0000","last_clean":"2024-09-19T06:37:15.029769+0000","last_became_active":"2024-09-19T06:37:09.443069+0000","last_became_peered":"2024-09-19T06:37:09.443069+0000","last_unstale":"2024-09-19T06:37:15.029769+0000","last_undegraded":"2024-09-19T06:37:15.029769+0000","last_fullsized":"2024-09-19T06:37:15.029769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:31:33.708578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029646+0000","last_change":"2024-09-19T06:37:08.441967+0000","last_active":"2024-09-19T06:37:15.029646+0000","last_peered":"2024-09-19T06:37:15.029646+0000","last_clean":"2024-09-19T06:37:15.029646+0000","last_became_active":"2024-09-19T06:37:08.441698+0000","last_became_peered":"2024-09-19T06:37:08.441698+0000","last_unstale":"2024-09-19T06:37:15.029646+0000","last_undegraded":"2024-09-19T06:37:15.029646+0000","last_fullsized":"2024-09-19T06:37:15.029646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:56.933775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478180+0000","last_change":"2024-09-19T06:37:13.470903+0000","last_active":"2024-09-19T06:37:14.478180+0000","last_peered":"2024-09-19T06:37:14.478180+0000","last_clean":"2024-09-19T06:37:14.478180+0000","last_became_active":"2024-09-19T06:37:13.470528+0000","last_became_peered":"2024-09-19T06:37:13.470528+0000","last_unstale":"2024-09-19T06:37:14.478180+0000","last_undegraded":"2024-09-19T06:37:14.478180+0000","last_fullsized":"2024-09-19T06:37:14.478180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:45.999436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477209+0000","last_change":"2024-09-19T06:37:09.448953+0000","last_active":"2024-09-19T06:37:14.477209+0000","last_peered":"2024-09-19T06:37:14.477209+0000","last_clean":"2024-09-19T06:37:14.477209+0000","last_became_active":"2024-09-19T06:37:09.448658+0000","last_became_peered":"2024-09-19T06:37:09.448658+0000","last_unstale":"2024-09-19T06:37:14.477209+0000","last_undegraded":"2024-09-19T06:37:14.477209+0000","last_fullsized":"2024-09-19T06:37:14.477209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:07.333392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477562+0000","last_change":"2024-09-19T06:37:08.440800+0000","last_active":"2024-09-19T06:37:14.477562+0000","last_peered":"2024-09-19T06:37:14.477562+0000","last_clean":"2024-09-19T06:37:14.477562+0000","last_became_active":"2024-09-19T06:37:08.440591+0000","last_became_peered":"2024-09-19T06:37:08.440591+0000","last_unstale":"2024-09-19T06:37:14.477562+0000","last_undegraded":"2024-09-19T06:37:14.477562+0000","last_fullsized":"2024-09-19T06:37:14.477562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:05.540261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478578+0000","last_change":"2024-09-19T06:37:08.441268+0000","last_active":"2024-09-19T06:37:14.478578+0000","last_peered":"2024-09-19T06:37:14.478578+0000","last_clean":"2024-09-19T06:37:14.478578+0000","last_became_active":"2024-09-19T06:37:08.440969+0000","last_became_peered":"2024-09-19T06:37:08.440969+0000","last_unstale":"2024-09-19T06:37:14.478578+0000","last_undegraded":"2024-09-19T06:37:14.478578+0000","last_fullsized":"2024-09-19T06:37:14.478578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:59.426336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030814+0000","last_change":"2024-09-19T06:37:09.444857+0000","last_active":"2024-09-19T06:37:15.030814+0000","last_peered":"2024-09-19T06:37:15.030814+0000","last_clean":"2024-09-19T06:37:15.030814+0000","last_became_active":"2024-09-19T06:37:09.444562+0000","last_became_peered":"2024-09-19T06:37:09.444562+0000","last_unstale":"2024-09-19T06:37:15.030814+0000","last_undegraded":"2024-09-19T06:37:15.030814+0000","last_fullsized":"2024-09-19T06:37:15.030814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:02.470787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815254+0000","last_change":"2024-09-19T06:37:13.467183+0000","last_active":"2024-09-19T06:37:14.815254+0000","last_peered":"2024-09-19T06:37:14.815254+0000","last_clean":"2024-09-19T06:37:14.815254+0000","last_became_active":"2024-09-19T06:37:13.466765+0000","last_became_peered":"2024-09-19T06:37:13.466765+0000","last_unstale":"2024-09-19T06:37:14.815254+0000","last_undegraded":"2024-09-19T06:37:14.815254+0000","last_fullsized":"2024-09-19T06:37:14.815254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:35.184815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477901+0000","last_change":"2024-09-19T06:37:08.443993+0000","last_active":"2024-09-19T06:37:14.477901+0000","last_peered":"2024-09-19T06:37:14.477901+0000","last_clean":"2024-09-19T06:37:14.477901+0000","last_became_active":"2024-09-19T06:37:08.443774+0000","last_became_peered":"2024-09-19T06:37:08.443774+0000","last_unstale":"2024-09-19T06:37:14.477901+0000","last_undegraded":"2024-09-19T06:37:14.477901+0000","last_fullsized":"2024-09-19T06:37:14.477901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:16.005073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029942+0000","last_change":"2024-09-19T06:37:09.440258+0000","last_active":"2024-09-19T06:37:15.029942+0000","last_peered":"2024-09-19T06:37:15.029942+0000","last_clean":"2024-09-19T06:37:15.029942+0000","last_became_active":"2024-09-19T06:37:09.438457+0000","last_became_peered":"2024-09-19T06:37:09.438457+0000","last_unstale":"2024-09-19T06:37:15.029942+0000","last_undegraded":"2024-09-19T06:37:15.029942+0000","last_fullsized":"2024-09-19T06:37:15.029942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:24.636340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477624+0000","last_change":"2024-09-19T06:37:13.462800+0000","last_active":"2024-09-19T06:37:14.477624+0000","last_peered":"2024-09-19T06:37:14.477624+0000","last_clean":"2024-09-19T06:37:14.477624+0000","last_became_active":"2024-09-19T06:37:13.462393+0000","last_became_peered":"2024-09-19T06:37:13.462393+0000","last_unstale":"2024-09-19T06:37:14.477624+0000","last_undegraded":"2024-09-19T06:37:14.477624+0000","last_fullsized":"2024-09-19T06:37:14.477624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:35.901637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477580+0000","last_change":"2024-09-19T06:37:09.450421+0000","last_active":"2024-09-19T06:37:14.477580+0000","last_peered":"2024-09-19T06:37:14.477580+0000","last_clean":"2024-09-19T06:37:14.477580+0000","last_became_active":"2024-09-19T06:37:09.450147+0000","last_became_peered":"2024-09-19T06:37:09.450147+0000","last_unstale":"2024-09-19T06:37:14.477580+0000","last_undegraded":"2024-09-19T06:37:14.477580+0000","last_fullsized":"2024-09-19T06:37:14.477580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:42.949759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.814967+0000","last_change":"2024-09-19T06:37:09.435131+0000","last_active":"2024-09-19T06:37:14.814967+0000","last_peered":"2024-09-19T06:37:14.814967+0000","last_clean":"2024-09-19T06:37:14.814967+0000","last_became_active":"2024-09-19T06:37:09.434840+0000","last_became_peered":"2024-09-19T06:37:09.434840+0000","last_unstale":"2024-09-19T06:37:14.814967+0000","last_undegraded":"2024-09-19T06:37:14.814967+0000","last_fullsized":"2024-09-19T06:37:14.814967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:20.484554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030415+0000","last_change":"2024-09-19T06:37:09.445196+0000","last_active":"2024-09-19T06:37:15.030415+0000","last_peered":"2024-09-19T06:37:15.030415+0000","last_clean":"2024-09-19T06:37:15.030415+0000","last_became_active":"2024-09-19T06:37:09.444907+0000","last_became_peered":"2024-09-19T06:37:09.444907+0000","last_unstale":"2024-09-19T06:37:15.030415+0000","last_undegraded":"2024-09-19T06:37:15.030415+0000","last_fullsized":"2024-09-19T06:37:15.030415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:17.605675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030729+0000","last_change":"2024-09-19T06:37:09.447966+0000","last_active":"2024-09-19T06:37:15.030729+0000","last_peered":"2024-09-19T06:37:15.030729+0000","last_clean":"2024-09-19T06:37:15.030729+0000","last_became_active":"2024-09-19T06:37:09.447692+0000","last_became_peered":"2024-09-19T06:37:09.447692+0000","last_unstale":"2024-09-19T06:37:15.030729+0000","last_undegraded":"2024-09-19T06:37:15.030729+0000","last_fullsized":"2024-09-19T06:37:15.030729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:01.517824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477900+0000","last_change":"2024-09-19T06:37:09.442651+0000","last_active":"2024-09-19T06:37:14.477900+0000","last_peered":"2024-09-19T06:37:14.477900+0000","last_clean":"2024-09-19T06:37:14.477900+0000","last_became_active":"2024-09-19T06:37:09.442195+0000","last_became_peered":"2024-09-19T06:37:09.442195+0000","last_unstale":"2024-09-19T06:37:14.477900+0000","last_undegraded":"2024-09-19T06:37:14.477900+0000","last_fullsized":"2024-09-19T06:37:14.477900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:15.658285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030600+0000","last_change":"2024-09-19T06:37:09.441782+0000","last_active":"2024-09-19T06:37:15.030600+0000","last_peered":"2024-09-19T06:37:15.030600+0000","last_clean":"2024-09-19T06:37:15.030600+0000","last_became_active":"2024-09-19T06:37:09.441456+0000","last_became_peered":"2024-09-19T06:37:09.441456+0000","last_unstale":"2024-09-19T06:37:15.030600+0000","last_undegraded":"2024-09-19T06:37:15.030600+0000","last_fullsized":"2024-09-19T06:37:15.030600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:04:28.458974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479237+0000","last_change":"2024-09-19T06:37:09.449856+0000","last_active":"2024-09-19T06:37:14.479237+0000","last_peered":"2024-09-19T06:37:14.479237+0000","last_clean":"2024-09-19T06:37:14.479237+0000","last_became_active":"2024-09-19T06:37:09.449562+0000","last_became_peered":"2024-09-19T06:37:09.449562+0000","last_unstale":"2024-09-19T06:37:14.479237+0000","last_undegraded":"2024-09-19T06:37:14.479237+0000","last_fullsized":"2024-09-19T06:37:14.479237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:49.182126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477764+0000","last_change":"2024-09-19T06:37:09.438551+0000","last_active":"2024-09-19T06:37:14.477764+0000","last_peered":"2024-09-19T06:37:14.477764+0000","last_clean":"2024-09-19T06:37:14.477764+0000","last_became_active":"2024-09-19T06:37:09.437624+0000","last_became_peered":"2024-09-19T06:37:09.437624+0000","last_unstale":"2024-09-19T06:37:14.477764+0000","last_undegraded":"2024-09-19T06:37:14.477764+0000","last_fullsized":"2024-09-19T06:37:14.477764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:46.565780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029601+0000","last_change":"2024-09-19T06:37:09.438737+0000","last_active":"2024-09-19T06:37:15.029601+0000","last_peered":"2024-09-19T06:37:15.029601+0000","last_clean":"2024-09-19T06:37:15.029601+0000","last_became_active":"2024-09-19T06:37:09.438453+0000","last_became_peered":"2024-09-19T06:37:09.438453+0000","last_unstale":"2024-09-19T06:37:15.029601+0000","last_undegraded":"2024-09-19T06:37:15.029601+0000","last_fullsized":"2024-09-19T06:37:15.029601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.982275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477390+0000","last_change":"2024-09-19T06:37:09.442093+0000","last_active":"2024-09-19T06:37:14.477390+0000","last_peered":"2024-09-19T06:37:14.477390+0000","last_clean":"2024-09-19T06:37:14.477390+0000","last_became_active":"2024-09-19T06:37:09.439710+0000","last_became_peered":"2024-09-19T06:37:09.439710+0000","last_unstale":"2024-09-19T06:37:14.477390+0000","last_undegraded":"2024-09-19T06:37:14.477390+0000","last_fullsized":"2024-09-19T06:37:14.477390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:02.626854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030310+0000","last_change":"2024-09-19T06:37:09.438271+0000","last_active":"2024-09-19T06:37:15.030310+0000","last_peered":"2024-09-19T06:37:15.030310+0000","last_clean":"2024-09-19T06:37:15.030310+0000","last_became_active":"2024-09-19T06:37:09.438009+0000","last_became_peered":"2024-09-19T06:37:09.438009+0000","last_unstale":"2024-09-19T06:37:15.030310+0000","last_undegraded":"2024-09-19T06:37:15.030310+0000","last_fullsized":"2024-09-19T06:37:15.030310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:26.395210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030632+0000","last_change":"2024-09-19T06:37:09.449633+0000","last_active":"2024-09-19T06:37:15.030632+0000","last_peered":"2024-09-19T06:37:15.030632+0000","last_clean":"2024-09-19T06:37:15.030632+0000","last_became_active":"2024-09-19T06:37:09.449379+0000","last_became_peered":"2024-09-19T06:37:09.449379+0000","last_unstale":"2024-09-19T06:37:15.030632+0000","last_undegraded":"2024-09-19T06:37:15.030632+0000","last_fullsized":"2024-09-19T06:37:15.030632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:29.565038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478253+0000","last_change":"2024-09-19T06:37:09.447808+0000","last_active":"2024-09-19T06:37:14.478253+0000","last_peered":"2024-09-19T06:37:14.478253+0000","last_clean":"2024-09-19T06:37:14.478253+0000","last_became_active":"2024-09-19T06:37:09.447514+0000","last_became_peered":"2024-09-19T06:37:09.447514+0000","last_unstale":"2024-09-19T06:37:14.478253+0000","last_undegraded":"2024-09-19T06:37:14.478253+0000","last_fullsized":"2024-09-19T06:37:14.478253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:04.653997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479576+0000","last_change":"2024-09-19T06:37:09.439605+0000","last_active":"2024-09-19T06:37:14.479576+0000","last_peered":"2024-09-19T06:37:14.479576+0000","last_clean":"2024-09-19T06:37:14.479576+0000","last_became_active":"2024-09-19T06:37:09.432601+0000","last_became_peered":"2024-09-19T06:37:09.432601+0000","last_unstale":"2024-09-19T06:37:14.479576+0000","last_undegraded":"2024-09-19T06:37:14.479576+0000","last_fullsized":"2024-09-19T06:37:14.479576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:50.640062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815206+0000","last_change":"2024-09-19T06:37:09.440268+0000","last_active":"2024-09-19T06:37:14.815206+0000","last_peered":"2024-09-19T06:37:14.815206+0000","last_clean":"2024-09-19T06:37:14.815206+0000","last_became_active":"2024-09-19T06:37:09.439937+0000","last_became_peered":"2024-09-19T06:37:09.439937+0000","last_unstale":"2024-09-19T06:37:14.815206+0000","last_undegraded":"2024-09-19T06:37:14.815206+0000","last_fullsized":"2024-09-19T06:37:14.815206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:32:46.182979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030922+0000","last_change":"2024-09-19T06:37:09.437080+0000","last_active":"2024-09-19T06:37:15.030922+0000","last_peered":"2024-09-19T06:37:15.030922+0000","last_clean":"2024-09-19T06:37:15.030922+0000","last_became_active":"2024-09-19T06:37:09.436752+0000","last_became_peered":"2024-09-19T06:37:09.436752+0000","last_unstale":"2024-09-19T06:37:15.030922+0000","last_undegraded":"2024-09-19T06:37:15.030922+0000","last_fullsized":"2024-09-19T06:37:15.030922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:31.423640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029549+0000","last_change":"2024-09-19T06:37:09.448942+0000","last_active":"2024-09-19T06:37:15.029549+0000","last_peered":"2024-09-19T06:37:15.029549+0000","last_clean":"2024-09-19T06:37:15.029549+0000","last_became_active":"2024-09-19T06:37:09.448647+0000","last_became_peered":"2024-09-19T06:37:09.448647+0000","last_unstale":"2024-09-19T06:37:15.029549+0000","last_undegraded":"2024-09-19T06:37:15.029549+0000","last_fullsized":"2024-09-19T06:37:15.029549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:49.027909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029809+0000","last_change":"2024-09-19T06:37:09.445015+0000","last_active":"2024-09-19T06:37:15.029809+0000","last_peered":"2024-09-19T06:37:15.029809+0000","last_clean":"2024-09-19T06:37:15.029809+0000","last_became_active":"2024-09-19T06:37:09.444737+0000","last_became_peered":"2024-09-19T06:37:09.444737+0000","last_unstale":"2024-09-19T06:37:15.029809+0000","last_undegraded":"2024-09-19T06:37:15.029809+0000","last_fullsized":"2024-09-19T06:37:15.029809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:16.194580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029853+0000","last_change":"2024-09-19T06:37:09.446025+0000","last_active":"2024-09-19T06:37:15.029853+0000","last_peered":"2024-09-19T06:37:15.029853+0000","last_clean":"2024-09-19T06:37:15.029853+0000","last_became_active":"2024-09-19T06:37:09.445503+0000","last_became_peered":"2024-09-19T06:37:09.445503+0000","last_unstale":"2024-09-19T06:37:15.029853+0000","last_undegraded":"2024-09-19T06:37:15.029853+0000","last_fullsized":"2024-09-19T06:37:15.029853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:30.469995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477784+0000","last_change":"2024-09-19T06:37:09.441302+0000","last_active":"2024-09-19T06:37:14.477784+0000","last_peered":"2024-09-19T06:37:14.477784+0000","last_clean":"2024-09-19T06:37:14.477784+0000","last_became_active":"2024-09-19T06:37:09.439767+0000","last_became_peered":"2024-09-19T06:37:09.439767+0000","last_unstale":"2024-09-19T06:37:14.477784+0000","last_undegraded":"2024-09-19T06:37:14.477784+0000","last_fullsized":"2024-09-19T06:37:14.477784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:01.038823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030560+0000","last_change":"2024-09-19T06:37:09.440976+0000","last_active":"2024-09-19T06:37:15.030560+0000","last_peered":"2024-09-19T06:37:15.030560+0000","last_clean":"2024-09-19T06:37:15.030560+0000","last_became_active":"2024-09-19T06:37:09.440702+0000","last_became_peered":"2024-09-19T06:37:09.440702+0000","last_unstale":"2024-09-19T06:37:15.030560+0000","last_undegraded":"2024-09-19T06:37:15.030560+0000","last_fullsized":"2024-09-19T06:37:15.030560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:21.281400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477942+0000","last_change":"2024-09-19T06:37:09.442301+0000","last_active":"2024-09-19T06:37:14.477942+0000","last_peered":"2024-09-19T06:37:14.477942+0000","last_clean":"2024-09-19T06:37:14.477942+0000","last_became_active":"2024-09-19T06:37:09.442053+0000","last_became_peered":"2024-09-19T06:37:09.442053+0000","last_unstale":"2024-09-19T06:37:14.477942+0000","last_undegraded":"2024-09-19T06:37:14.477942+0000","last_fullsized":"2024-09-19T06:37:14.477942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:26.189384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479335+0000","last_change":"2024-09-19T06:37:09.441525+0000","last_active":"2024-09-19T06:37:14.479335+0000","last_peered":"2024-09-19T06:37:14.479335+0000","last_clean":"2024-09-19T06:37:14.479335+0000","last_became_active":"2024-09-19T06:37:09.441179+0000","last_became_peered":"2024-09-19T06:37:09.441179+0000","last_unstale":"2024-09-19T06:37:14.479335+0000","last_undegraded":"2024-09-19T06:37:14.479335+0000","last_fullsized":"2024-09-19T06:37:14.479335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:47.235113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479743+0000","last_change":"2024-09-19T06:37:09.437163+0000","last_active":"2024-09-19T06:37:14.479743+0000","last_peered":"2024-09-19T06:37:14.479743+0000","last_clean":"2024-09-19T06:37:14.479743+0000","last_became_active":"2024-09-19T06:37:09.436892+0000","last_became_peered":"2024-09-19T06:37:09.436892+0000","last_unstale":"2024-09-19T06:37:14.479743+0000","last_undegraded":"2024-09-19T06:37:14.479743+0000","last_fullsized":"2024-09-19T06:37:14.479743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:47:58.347385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477114+0000","last_change":"2024-09-19T06:37:09.437524+0000","last_active":"2024-09-19T06:37:14.477114+0000","last_peered":"2024-09-19T06:37:14.477114+0000","last_clean":"2024-09-19T06:37:14.477114+0000","last_became_active":"2024-09-19T06:37:09.437023+0000","last_became_peered":"2024-09-19T06:37:09.437023+0000","last_unstale":"2024-09-19T06:37:14.477114+0000","last_undegraded":"2024-09-19T06:37:14.477114+0000","last_fullsized":"2024-09-19T06:37:14.477114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:31.398914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478456+0000","last_change":"2024-09-19T06:37:09.448814+0000","last_active":"2024-09-19T06:37:14.478456+0000","last_peered":"2024-09-19T06:37:14.478456+0000","last_clean":"2024-09-19T06:37:14.478456+0000","last_became_active":"2024-09-19T06:37:09.448547+0000","last_became_peered":"2024-09-19T06:37:09.448547+0000","last_unstale":"2024-09-19T06:37:14.478456+0000","last_undegraded":"2024-09-19T06:37:14.478456+0000","last_fullsized":"2024-09-19T06:37:14.478456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:13.526300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030114+0000","last_change":"2024-09-19T06:37:09.446910+0000","last_active":"2024-09-19T06:37:15.030114+0000","last_peered":"2024-09-19T06:37:15.030114+0000","last_clean":"2024-09-19T06:37:15.030114+0000","last_became_active":"2024-09-19T06:37:09.446603+0000","last_became_peered":"2024-09-19T06:37:09.446603+0000","last_unstale":"2024-09-19T06:37:15.030114+0000","last_undegraded":"2024-09-19T06:37:15.030114+0000","last_fullsized":"2024-09-19T06:37:15.030114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:47.006354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479198+0000","last_change":"2024-09-19T06:37:09.430160+0000","last_active":"2024-09-19T06:37:14.479198+0000","last_peered":"2024-09-19T06:37:14.479198+0000","last_clean":"2024-09-19T06:37:14.479198+0000","last_became_active":"2024-09-19T06:37:09.429813+0000","last_became_peered":"2024-09-19T06:37:09.429813+0000","last_unstale":"2024-09-19T06:37:14.479198+0000","last_undegraded":"2024-09-19T06:37:14.479198+0000","last_fullsized":"2024-09-19T06:37:14.479198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:10.353834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030011+0000","last_change":"2024-09-19T06:37:09.446622+0000","last_active":"2024-09-19T06:37:15.030011+0000","last_peered":"2024-09-19T06:37:15.030011+0000","last_clean":"2024-09-19T06:37:15.030011+0000","last_became_active":"2024-09-19T06:37:09.446349+0000","last_became_peered":"2024-09-19T06:37:09.446349+0000","last_unstale":"2024-09-19T06:37:15.030011+0000","last_undegraded":"2024-09-19T06:37:15.030011+0000","last_fullsized":"2024-09-19T06:37:15.030011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:01.702039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030152+0000","last_change":"2024-09-19T06:37:09.446789+0000","last_active":"2024-09-19T06:37:15.030152+0000","last_peered":"2024-09-19T06:37:15.030152+0000","last_clean":"2024-09-19T06:37:15.030152+0000","last_became_active":"2024-09-19T06:37:09.446557+0000","last_became_peered":"2024-09-19T06:37:09.446557+0000","last_unstale":"2024-09-19T06:37:15.030152+0000","last_undegraded":"2024-09-19T06:37:15.030152+0000","last_fullsized":"2024-09-19T06:37:15.030152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:18.119474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030246+0000","last_change":"2024-09-19T06:37:09.448093+0000","last_active":"2024-09-19T06:37:15.030246+0000","last_peered":"2024-09-19T06:37:15.030246+0000","last_clean":"2024-09-19T06:37:15.030246+0000","last_became_active":"2024-09-19T06:37:09.447753+0000","last_became_peered":"2024-09-19T06:37:09.447753+0000","last_unstale":"2024-09-19T06:37:15.030246+0000","last_undegraded":"2024-09-19T06:37:15.030246+0000","last_fullsized":"2024-09-19T06:37:15.030246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:11.944092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479640+0000","last_change":"2024-09-19T06:37:09.442798+0000","last_active":"2024-09-19T06:37:14.479640+0000","last_peered":"2024-09-19T06:37:14.479640+0000","last_clean":"2024-09-19T06:37:14.479640+0000","last_became_active":"2024-09-19T06:37:09.442047+0000","last_became_peered":"2024-09-19T06:37:09.442047+0000","last_unstale":"2024-09-19T06:37:14.479640+0000","last_undegraded":"2024-09-19T06:37:14.479640+0000","last_fullsized":"2024-09-19T06:37:14.479640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:33.193185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65040,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":348160,"data_stored":698736,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":698680,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":107730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:37:34.034 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T06:37:34.034 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T06:37:34.034 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-19T06:37:34.034 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-19T06:37:34.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.164+0000 7f9aa0531640 1 Processor -- start 2024-09-19T06:37:34.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.164+0000 7f9aa0531640 1 -- start start 2024-09-19T06:37:34.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.165+0000 7f9aa0531640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a980733b0 0x7f9a980cf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:34.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.165+0000 7f9aa0531640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a98071790 con 0x7f9a980712f0 2024-09-19T06:37:34.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.165+0000 7f9aa0531640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a98071a30 con 0x7f9a981556c0 2024-09-19T06:37:34.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.165+0000 7f9aa0531640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9a980cf7b0 con 0x7f9a980733b0 2024-09-19T06:37:34.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.165+0000 7f9a9dacc640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f9a980712f0 0x7f9a98154fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:35200/0 (socket says 172.21.15.86:35200) 2024-09-19T06:37:34.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.165+0000 7f9a9dacc640 1 -- 172.21.15.86:0/1339376786 learned_addr learned my addr 172.21.15.86:0/1339376786 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:34.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.165+0000 7f9a9e2cd640 1 --2- 172.21.15.86:0/1339376786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a980733b0 0x7f9a980cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:34.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.165+0000 7f9a9d2cb640 1 -- 172.21.15.86:0/1339376786 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2101170822 0 0) 0x7f9a98071790 con 0x7f9a980712f0 2024-09-19T06:37:34.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.165+0000 7f9a9d2cb640 1 -- 172.21.15.86:0/1339376786 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a84003520 con 0x7f9a980712f0 2024-09-19T06:37:34.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.166+0000 7f9a9d2cb640 1 -- 172.21.15.86:0/1339376786 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 612189485 0 0) 0x7f9a98071a30 con 0x7f9a981556c0 2024-09-19T06:37:34.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.166+0000 7f9a9d2cb640 1 -- 172.21.15.86:0/1339376786 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a98071790 con 0x7f9a981556c0 2024-09-19T06:37:34.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.166+0000 7f9a9e2cd640 1 -- 172.21.15.86:0/1339376786 >> v1:172.21.15.169:6789/0 conn(0x7f9a981556c0 legacy=0x7f9a9815e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:34.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.166+0000 7f9a9d2cb640 1 -- 172.21.15.86:0/1339376786 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3817309116 0 0) 0x7f9a84003520 con 0x7f9a980712f0 2024-09-19T06:37:34.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.166+0000 7f9a9e2cd640 1 -- 172.21.15.86:0/1339376786 >> v1:172.21.15.86:6789/0 conn(0x7f9a980712f0 legacy=0x7f9a98154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:34.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.166+0000 7f9a9e2cd640 1 -- 172.21.15.86:0/1339376786 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a9815b4f0 con 0x7f9a980733b0 2024-09-19T06:37:34.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.166+0000 7f9a9e2cd640 1 --2- 172.21.15.86:0/1339376786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a980733b0 0x7f9a980cf270 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9a940097d0 tx=0x7f9a9402a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a24ee04b47b21fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:34.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.167+0000 7f9a9d2cb640 1 -- 172.21.15.86:0/1339376786 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a94037070 con 0x7f9a980733b0 2024-09-19T06:37:34.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.167+0000 7f9a9d2cb640 1 -- 172.21.15.86:0/1339376786 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a9402acc0 con 0x7f9a980733b0 2024-09-19T06:37:34.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.167+0000 7f9a9d2cb640 1 -- 172.21.15.86:0/1339376786 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a88001670 con 0x7f9a980733b0 2024-09-19T06:37:34.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.167+0000 7f9aa0531640 1 -- 172.21.15.86:0/1339376786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a980733b0 msgr2=0x7f9a980cf270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:34.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.167+0000 7f9aa0531640 1 --2- 172.21.15.86:0/1339376786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a980733b0 0x7f9a980cf270 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9a940097d0 tx=0x7f9a9402a230 comp rx=0 tx=0).stop 2024-09-19T06:37:34.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.167+0000 7f9aa0531640 1 -- 172.21.15.86:0/1339376786 shutdown_connections 2024-09-19T06:37:34.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.167+0000 7f9aa0531640 1 --2- 172.21.15.86:0/1339376786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a980733b0 0x7f9a980cf270 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.167+0000 7f9aa0531640 1 -- 172.21.15.86:0/1339376786 >> 172.21.15.86:0/1339376786 conn(0x7f9a98067890 msgr2=0x7f9a98067c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:34.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.167+0000 7f9aa0531640 1 -- 172.21.15.86:0/1339376786 shutdown_connections 2024-09-19T06:37:34.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.167+0000 7f9aa0531640 1 -- 172.21.15.86:0/1339376786 wait complete. 2024-09-19T06:37:34.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.168+0000 7f9aa0531640 1 Processor -- start 2024-09-19T06:37:34.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.168+0000 7f9aa0531640 1 -- start start 2024-09-19T06:37:34.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.169+0000 7f9aa0531640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a980712f0 0x7f9a981f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:34.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.169+0000 7f9aa0531640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a980733b0 0x7f9a980cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:34.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.169+0000 7f9aa0531640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a981556c0 0x7f9a9814e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:34.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.169+0000 7f9aa0531640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9815bd90 con 0x7f9a980712f0 2024-09-19T06:37:34.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.169+0000 7f9aa0531640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9815bab0 con 0x7f9a981556c0 2024-09-19T06:37:34.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.169+0000 7f9aa0531640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9a9815b1a0 con 0x7f9a980733b0 2024-09-19T06:37:34.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.169+0000 7f9a9e2cd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a980712f0 0x7f9a981f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:34.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.169+0000 7f9a9e2cd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a980712f0 0x7f9a981f4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56782/0 (socket says 172.21.15.86:56782) 2024-09-19T06:37:34.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.169+0000 7f9a9e2cd640 1 -- 172.21.15.86:0/842771666 learned_addr learned my addr 172.21.15.86:0/842771666 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:34.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.169+0000 7f9a9e2cd640 1 -- 172.21.15.86:0/842771666 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a980733b0 msgr2=0x7f9a980cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:34.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.169+0000 7f9a9e2cd640 1 --2- 172.21.15.86:0/842771666 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a980733b0 0x7f9a980cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.169+0000 7f9a9e2cd640 1 -- 172.21.15.86:0/842771666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a981556c0 msgr2=0x7f9a9814e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:34.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.169+0000 7f9a9e2cd640 1 --2- 172.21.15.86:0/842771666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a981556c0 0x7f9a9814e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.169+0000 7f9a9e2cd640 1 -- 172.21.15.86:0/842771666 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a981f4b50 con 0x7f9a980712f0 2024-09-19T06:37:34.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.170+0000 7f9a9e2cd640 1 --2- 172.21.15.86:0/842771666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a980712f0 0x7f9a981f4610 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9a940098f0 tx=0x7f9a940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:34.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.170+0000 7f9a8effd640 1 -- 172.21.15.86:0/842771666 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a94037050 con 0x7f9a980712f0 2024-09-19T06:37:34.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.170+0000 7f9a8effd640 1 -- 172.21.15.86:0/842771666 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a94043070 con 0x7f9a980712f0 2024-09-19T06:37:34.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.170+0000 7f9aa0531640 1 -- 172.21.15.86:0/842771666 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a9815f340 con 0x7f9a980712f0 2024-09-19T06:37:34.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.170+0000 7f9a8effd640 1 -- 172.21.15.86:0/842771666 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a94006e10 con 0x7f9a980712f0 2024-09-19T06:37:34.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.170+0000 7f9aa0531640 1 -- 172.21.15.86:0/842771666 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a9815d710 con 0x7f9a980712f0 2024-09-19T06:37:34.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.171+0000 7f9aa0531640 1 -- 172.21.15.86:0/842771666 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a980c9610 con 0x7f9a980712f0 2024-09-19T06:37:34.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.171+0000 7f9a8effd640 1 -- 172.21.15.86:0/842771666 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9a9403ca10 con 0x7f9a980712f0 2024-09-19T06:37:34.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.172+0000 7f9a8effd640 1 --2- 172.21.15.86:0/842771666 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9a7c06c2b0 0x7f9a7c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:34.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.172+0000 7f9a9dacc640 1 --2- 172.21.15.86:0/842771666 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9a7c06c2b0 0x7f9a7c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:34.175 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.172+0000 7f9a8effd640 1 -- 172.21.15.86:0/842771666 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9a940ac300 con 0x7f9a980712f0 2024-09-19T06:37:34.175 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.172+0000 7f9a9dacc640 1 --2- 172.21.15.86:0/842771666 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9a7c06c2b0 0x7f9a7c06e770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9a88005880 tx=0x7f9a88001230 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:34.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.176+0000 7f9a8effd640 1 -- 172.21.15.86:0/842771666 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9a9407a8e0 con 0x7f9a980712f0 2024-09-19T06:37:34.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.376+0000 7f9aa0531640 1 -- 172.21.15.86:0/842771666 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9a980cf150 con 0x7f9a980712f0 2024-09-19T06:37:34.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.376+0000 7f9a8effd640 1 -- 172.21.15.86:0/842771666 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f9a9407a1e0 con 0x7f9a980712f0 2024-09-19T06:37:34.378 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:34.378 INFO:teuthology.orchestra.run.smithi086.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T06:37:34.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.378+0000 7f9aa0531640 1 -- 172.21.15.86:0/842771666 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9a7c06c2b0 msgr2=0x7f9a7c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:34.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.378+0000 7f9aa0531640 1 --2- 172.21.15.86:0/842771666 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9a7c06c2b0 0x7f9a7c06e770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9a88005880 tx=0x7f9a88001230 comp rx=0 tx=0).stop 2024-09-19T06:37:34.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.378+0000 7f9aa0531640 1 -- 172.21.15.86:0/842771666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a980712f0 msgr2=0x7f9a981f4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:34.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.378+0000 7f9aa0531640 1 --2- 172.21.15.86:0/842771666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a980712f0 0x7f9a981f4610 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9a940098f0 tx=0x7f9a940046c0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.378+0000 7f9aa0531640 1 -- 172.21.15.86:0/842771666 shutdown_connections 2024-09-19T06:37:34.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.378+0000 7f9aa0531640 1 --2- 172.21.15.86:0/842771666 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9a7c06c2b0 0x7f9a7c06e770 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.378+0000 7f9aa0531640 1 --2- 172.21.15.86:0/842771666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a981556c0 0x7f9a9814e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.378+0000 7f9aa0531640 1 --2- 172.21.15.86:0/842771666 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a980733b0 0x7f9a980cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.378+0000 7f9aa0531640 1 --2- 172.21.15.86:0/842771666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a980712f0 0x7f9a981f4610 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.378+0000 7f9aa0531640 1 -- 172.21.15.86:0/842771666 >> 172.21.15.86:0/842771666 conn(0x7f9a98067890 msgr2=0x7f9a98159990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:34.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.378+0000 7f9aa0531640 1 -- 172.21.15.86:0/842771666 shutdown_connections 2024-09-19T06:37:34.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.378+0000 7f9aa0531640 1 -- 172.21.15.86:0/842771666 wait complete. 2024-09-19T06:37:34.390 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-19T06:37:34.390 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:37:34.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.486+0000 7f20ddbd6640 1 Processor -- start 2024-09-19T06:37:34.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.486+0000 7f20ddbd6640 1 -- start start 2024-09-19T06:37:34.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.487+0000 7f20ddbd6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20d8154eb0 0x7f20d80cb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:34.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.487+0000 7f20ddbd6640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f20d815e690 0x7f20d815eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:34.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.487+0000 7f20ddbd6640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d80cbe70 con 0x7f20d806d690 2024-09-19T06:37:34.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.487+0000 7f20ddbd6640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f20d815f040 con 0x7f20d815e690 2024-09-19T06:37:34.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.487+0000 7f20ddbd6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f20d815b190 con 0x7f20d8154eb0 2024-09-19T06:37:34.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.487+0000 7f20d7fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f20d815e690 0x7f20d815eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:34.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.487+0000 7f20d7fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f20d815e690 0x7f20d815eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56790/0 (socket says 172.21.15.86:56790) 2024-09-19T06:37:34.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.487+0000 7f20d7fff640 1 -- 172.21.15.86:0/1932245531 learned_addr learned my addr 172.21.15.86:0/1932245531 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:34.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.487+0000 7f20d77fe640 1 --2- 172.21.15.86:0/1932245531 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20d8154eb0 0x7f20d80cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:34.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.487+0000 7f20d7fff640 1 -- 172.21.15.86:0/1932245531 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20d8154eb0 msgr2=0x7f20d80cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:34.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.487+0000 7f20d7fff640 1 --2- 172.21.15.86:0/1932245531 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20d8154eb0 0x7f20d80cb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.487+0000 7f20d7fff640 1 -- 172.21.15.86:0/1932245531 >> v1:172.21.15.169:6789/0 conn(0x7f20d806d690 legacy=0x7f20d8073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:34.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.488+0000 7f20d7fff640 1 -- 172.21.15.86:0/1932245531 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d815b470 con 0x7f20d815e690 2024-09-19T06:37:34.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.488+0000 7f20d7fff640 1 --2- 172.21.15.86:0/1932245531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20d815e690 0x7f20d815eb00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009e50 tx=0x7f20d002a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de19e5c17417c8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:34.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.488+0000 7f20d67fc640 1 -- 172.21.15.86:0/1932245531 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d0036070 con 0x7f20d815e690 2024-09-19T06:37:34.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.488+0000 7f20d67fc640 1 -- 172.21.15.86:0/1932245531 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20d0031600 con 0x7f20d815e690 2024-09-19T06:37:34.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.488+0000 7f20d67fc640 1 -- 172.21.15.86:0/1932245531 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d00319d0 con 0x7f20d815e690 2024-09-19T06:37:34.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.489+0000 7f20ddbd6640 1 -- 172.21.15.86:0/1932245531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20d815e690 msgr2=0x7f20d815eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:34.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.489+0000 7f20ddbd6640 1 --2- 172.21.15.86:0/1932245531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20d815e690 0x7f20d815eb00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009e50 tx=0x7f20d002a750 comp rx=0 tx=0).stop 2024-09-19T06:37:34.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.489+0000 7f20ddbd6640 1 -- 172.21.15.86:0/1932245531 shutdown_connections 2024-09-19T06:37:34.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.489+0000 7f20ddbd6640 1 --2- 172.21.15.86:0/1932245531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20d815e690 0x7f20d815eb00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.489+0000 7f20ddbd6640 1 --2- 172.21.15.86:0/1932245531 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20d8154eb0 0x7f20d80cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.489+0000 7f20ddbd6640 1 -- 172.21.15.86:0/1932245531 >> 172.21.15.86:0/1932245531 conn(0x7f20d8070d10 msgr2=0x7f20d80710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:34.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.489+0000 7f20ddbd6640 1 -- 172.21.15.86:0/1932245531 shutdown_connections 2024-09-19T06:37:34.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.489+0000 7f20ddbd6640 1 -- 172.21.15.86:0/1932245531 wait complete. 2024-09-19T06:37:34.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.490+0000 7f20ddbd6640 1 Processor -- start 2024-09-19T06:37:34.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.490+0000 7f20ddbd6640 1 -- start start 2024-09-19T06:37:34.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.491+0000 7f20ddbd6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20d806d690 0x7f20d80c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:34.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.491+0000 7f20ddbd6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20d8154eb0 0x7f20d81e4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:34.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.491+0000 7f20ddbd6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20d815e690 0x7f20d80c7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:34.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.491+0000 7f20ddbd6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f20d815bd10 con 0x7f20d815e690 2024-09-19T06:37:34.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.491+0000 7f20ddbd6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f20d815ba30 con 0x7f20d806d690 2024-09-19T06:37:34.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.491+0000 7f20ddbd6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f20d80c91a0 con 0x7f20d8154eb0 2024-09-19T06:37:34.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.491+0000 7f20d7fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20d815e690 0x7f20d80c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:34.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.491+0000 7f20d7fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20d815e690 0x7f20d80c7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56798/0 (socket says 172.21.15.86:56798) 2024-09-19T06:37:34.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.491+0000 7f20d7fff640 1 -- 172.21.15.86:0/1502185263 learned_addr learned my addr 172.21.15.86:0/1502185263 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:34.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.491+0000 7f20d77fe640 1 --2- 172.21.15.86:0/1502185263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20d806d690 0x7f20d80c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:34.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.491+0000 7f20d6ffd640 1 --2- 172.21.15.86:0/1502185263 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20d8154eb0 0x7f20d81e4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:34.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.491+0000 7f20d7fff640 1 -- 172.21.15.86:0/1502185263 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20d8154eb0 msgr2=0x7f20d81e4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:34.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.491+0000 7f20d7fff640 1 --2- 172.21.15.86:0/1502185263 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20d8154eb0 0x7f20d81e4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.491+0000 7f20d7fff640 1 -- 172.21.15.86:0/1502185263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20d806d690 msgr2=0x7f20d80c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:34.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.491+0000 7f20d7fff640 1 --2- 172.21.15.86:0/1502185263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20d806d690 0x7f20d80c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.491+0000 7f20d7fff640 1 -- 172.21.15.86:0/1502185263 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d815c550 con 0x7f20d815e690 2024-09-19T06:37:34.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.491+0000 7f20d7fff640 1 --2- 172.21.15.86:0/1502185263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20d815e690 0x7f20d80c7940 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009f70 tx=0x7f20d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:34.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.492+0000 7f20bffff640 1 -- 172.21.15.86:0/1502185263 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d0041020 con 0x7f20d815e690 2024-09-19T06:37:34.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.492+0000 7f20bffff640 1 -- 172.21.15.86:0/1502185263 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20d0007780 con 0x7f20d815e690 2024-09-19T06:37:34.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.492+0000 7f20ddbd6640 1 -- 172.21.15.86:0/1502185263 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d80c9c50 con 0x7f20d815e690 2024-09-19T06:37:34.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.492+0000 7f20bffff640 1 -- 172.21.15.86:0/1502185263 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d0036040 con 0x7f20d815e690 2024-09-19T06:37:34.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.492+0000 7f20ddbd6640 1 -- 172.21.15.86:0/1502185263 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d80ceeb0 con 0x7f20d815e690 2024-09-19T06:37:34.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.493+0000 7f20ddbd6640 1 -- 172.21.15.86:0/1502185263 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20d8155290 con 0x7f20d815e690 2024-09-19T06:37:34.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.493+0000 7f20bffff640 1 -- 172.21.15.86:0/1502185263 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f20d0044020 con 0x7f20d815e690 2024-09-19T06:37:34.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.493+0000 7f20bffff640 1 --2- 172.21.15.86:0/1502185263 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f20c406c2e0 0x7f20c406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:34.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.494+0000 7f20bffff640 1 -- 172.21.15.86:0/1502185263 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f20d00ac320 con 0x7f20d815e690 2024-09-19T06:37:34.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.494+0000 7f20d77fe640 1 --2- 172.21.15.86:0/1502185263 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f20c406c2e0 0x7f20c406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:34.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.494+0000 7f20d77fe640 1 --2- 172.21.15.86:0/1502185263 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f20c406c2e0 0x7f20c406e7a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f20c800aac0 tx=0x7f20c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:34.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.498+0000 7f20bffff640 1 -- 172.21.15.86:0/1502185263 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f20d004b030 con 0x7f20d815e690 2024-09-19T06:37:34.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.697+0000 7f20ddbd6640 1 -- 172.21.15.86:0/1502185263 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20d80c8f80 con 0x7f20d815e690 2024-09-19T06:37:34.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.697+0000 7f20bffff640 1 -- 172.21.15.86:0/1502185263 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6871 (secure 0 0 0) 0x7f20d007a190 con 0x7f20d815e690 2024-09-19T06:37:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:34.700 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":9,"btime":"2024-09-19T06:37:28:505383+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:37:27.843067+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6837/201961024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":201961024},{"type":"v1","addr":"172.21.15.169:6837","nonce":201961024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-09-19T06:37:34.701 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 9 2024-09-19T06:37:34.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.700+0000 7f20ddbd6640 1 -- 172.21.15.86:0/1502185263 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f20c406c2e0 msgr2=0x7f20c406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:34.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.700+0000 7f20ddbd6640 1 --2- 172.21.15.86:0/1502185263 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f20c406c2e0 0x7f20c406e7a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f20c800aac0 tx=0x7f20c8008040 comp rx=0 tx=0).stop 2024-09-19T06:37:34.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.700+0000 7f20ddbd6640 1 -- 172.21.15.86:0/1502185263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20d815e690 msgr2=0x7f20d80c7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:34.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.700+0000 7f20ddbd6640 1 --2- 172.21.15.86:0/1502185263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20d815e690 0x7f20d80c7940 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009f70 tx=0x7f20d0004a40 comp rx=0 tx=0).stop 2024-09-19T06:37:34.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.700+0000 7f20ddbd6640 1 -- 172.21.15.86:0/1502185263 shutdown_connections 2024-09-19T06:37:34.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.700+0000 7f20ddbd6640 1 --2- 172.21.15.86:0/1502185263 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f20c406c2e0 0x7f20c406e7a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.700+0000 7f20ddbd6640 1 --2- 172.21.15.86:0/1502185263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20d815e690 0x7f20d80c7940 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.700+0000 7f20ddbd6640 1 --2- 172.21.15.86:0/1502185263 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20d8154eb0 0x7f20d81e4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.700+0000 7f20ddbd6640 1 --2- 172.21.15.86:0/1502185263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20d806d690 0x7f20d80c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.700+0000 7f20ddbd6640 1 -- 172.21.15.86:0/1502185263 >> 172.21.15.86:0/1502185263 conn(0x7f20d8070d10 msgr2=0x7f20d80710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:34.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.700+0000 7f20ddbd6640 1 -- 172.21.15.86:0/1502185263 shutdown_connections 2024-09-19T06:37:34.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.700+0000 7f20ddbd6640 1 -- 172.21.15.86:0/1502185263 wait complete. 2024-09-19T06:37:34.713 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:37:34.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.810+0000 7f5dddaaf640 1 Processor -- start 2024-09-19T06:37:34.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.811+0000 7f5dddaaf640 1 -- start start 2024-09-19T06:37:34.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.811+0000 7f5dddaaf640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5dd80c4040 0x7f5dd806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:34.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.811+0000 7f5dddaaf640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dd815af10 con 0x7f5dd815c400 2024-09-19T06:37:34.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.811+0000 7f5dddaaf640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dd80af8a0 con 0x7f5dd806cf60 2024-09-19T06:37:34.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.811+0000 7f5dddaaf640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f5dd80c3c90 con 0x7f5dd80c4040 2024-09-19T06:37:34.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.811+0000 7f5dd6ffd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5dd80c4040 0x7f5dd806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:34.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.811+0000 7f5dd6ffd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5dd80c4040 0x7f5dd806e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56806/0 (socket says 172.21.15.86:56806) 2024-09-19T06:37:34.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.811+0000 7f5dd6ffd640 1 -- 172.21.15.86:0/1679224749 learned_addr learned my addr 172.21.15.86:0/1679224749 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:34.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.811+0000 7f5dd7fff640 1 --1- 172.21.15.86:0/1679224749 >> v1:172.21.15.86:6789/0 conn(0x7f5dd815c400 0x7f5dd8165890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:35202/0 (socket says 172.21.15.86:35202) 2024-09-19T06:37:34.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.812+0000 7f5dd6ffd640 1 -- 172.21.15.86:0/1679224749 >> v1:172.21.15.169:6789/0 conn(0x7f5dd806cf60 legacy=0x7f5dd8154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:34.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.812+0000 7f5dd6ffd640 1 -- 172.21.15.86:0/1679224749 >> v1:172.21.15.86:6789/0 conn(0x7f5dd815c400 legacy=0x7f5dd8165890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:34.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.812+0000 7f5dd6ffd640 1 -- 172.21.15.86:0/1679224749 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd80afb80 con 0x7f5dd80c4040 2024-09-19T06:37:34.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.812+0000 7f5dd67fc640 1 -- 172.21.15.86:0/1679224749 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3553082142 0 0) 0x7f5dd815af10 con 0x7f5dd815c400 2024-09-19T06:37:34.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.812+0000 7f5dd6ffd640 1 --2- 172.21.15.86:0/1679224749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dd80c4040 0x7f5dd806e000 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc009870 tx=0x7f5dcc02a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5951149c50935f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:34.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.813+0000 7f5dd67fc640 1 -- 172.21.15.86:0/1679224749 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc037070 con 0x7f5dd80c4040 2024-09-19T06:37:34.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.813+0000 7f5dd67fc640 1 -- 172.21.15.86:0/1679224749 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dcc032640 con 0x7f5dd80c4040 2024-09-19T06:37:34.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.813+0000 7f5dd67fc640 1 -- 172.21.15.86:0/1679224749 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc032a10 con 0x7f5dd80c4040 2024-09-19T06:37:34.819 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.813+0000 7f5dddaaf640 1 -- 172.21.15.86:0/1679224749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dd80c4040 msgr2=0x7f5dd806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:34.820 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.813+0000 7f5dddaaf640 1 --2- 172.21.15.86:0/1679224749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dd80c4040 0x7f5dd806e000 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc009870 tx=0x7f5dcc02a330 comp rx=0 tx=0).stop 2024-09-19T06:37:34.820 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.813+0000 7f5dddaaf640 1 -- 172.21.15.86:0/1679224749 shutdown_connections 2024-09-19T06:37:34.820 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.813+0000 7f5dddaaf640 1 --2- 172.21.15.86:0/1679224749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dd80c4040 0x7f5dd806e000 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.820 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.813+0000 7f5dddaaf640 1 -- 172.21.15.86:0/1679224749 >> 172.21.15.86:0/1679224749 conn(0x7f5dd806bbc0 msgr2=0x7f5dd806bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:34.820 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.813+0000 7f5dddaaf640 1 -- 172.21.15.86:0/1679224749 shutdown_connections 2024-09-19T06:37:34.820 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.813+0000 7f5dddaaf640 1 -- 172.21.15.86:0/1679224749 wait complete. 2024-09-19T06:37:34.820 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.814+0000 7f5dddaaf640 1 Processor -- start 2024-09-19T06:37:34.820 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.815+0000 7f5dddaaf640 1 -- start start 2024-09-19T06:37:34.820 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.815+0000 7f5dddaaf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dd806cf60 0x7f5dd8158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:34.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.815+0000 7f5dddaaf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5dd80c4040 0x7f5dd8071c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:34.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.815+0000 7f5dddaaf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5dd815c400 0x7f5dd81f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:34.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.815+0000 7f5dddaaf640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd815b1d0 con 0x7f5dd806cf60 2024-09-19T06:37:34.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.815+0000 7f5dddaaf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd815b540 con 0x7f5dd815c400 2024-09-19T06:37:34.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.815+0000 7f5dddaaf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5dd8067e60 con 0x7f5dd80c4040 2024-09-19T06:37:34.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.815+0000 7f5dd77fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dd806cf60 0x7f5dd8158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:34.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.815+0000 7f5dd77fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dd806cf60 0x7f5dd8158d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56816/0 (socket says 172.21.15.86:56816) 2024-09-19T06:37:34.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.815+0000 7f5dd77fe640 1 -- 172.21.15.86:0/417385481 learned_addr learned my addr 172.21.15.86:0/417385481 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:34.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.815+0000 7f5dd7fff640 1 --2- 172.21.15.86:0/417385481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5dd815c400 0x7f5dd81f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:34.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.815+0000 7f5dd6ffd640 1 --2- 172.21.15.86:0/417385481 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5dd80c4040 0x7f5dd8071c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:34.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.816+0000 7f5dd77fe640 1 -- 172.21.15.86:0/417385481 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5dd80c4040 msgr2=0x7f5dd8071c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:34.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.816+0000 7f5dd77fe640 1 --2- 172.21.15.86:0/417385481 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5dd80c4040 0x7f5dd8071c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.816+0000 7f5dd77fe640 1 -- 172.21.15.86:0/417385481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5dd815c400 msgr2=0x7f5dd81f4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:34.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.816+0000 7f5dd77fe640 1 --2- 172.21.15.86:0/417385481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5dd815c400 0x7f5dd81f4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.816+0000 7f5dd77fe640 1 -- 172.21.15.86:0/417385481 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd81f4dc0 con 0x7f5dd806cf60 2024-09-19T06:37:34.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.816+0000 7f5dd7fff640 1 --2- 172.21.15.86:0/417385481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5dd815c400 0x7f5dd81f4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:34.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.816+0000 7f5dd77fe640 1 --2- 172.21.15.86:0/417385481 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dd806cf60 0x7f5dd8158d80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800c440 tx=0x7f5dc800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:34.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.816+0000 7f5dbffff640 1 -- 172.21.15.86:0/417385481 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8017070 con 0x7f5dd806cf60 2024-09-19T06:37:34.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.816+0000 7f5dbffff640 1 -- 172.21.15.86:0/417385481 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dc80035f0 con 0x7f5dd806cf60 2024-09-19T06:37:34.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.816+0000 7f5dbffff640 1 -- 172.21.15.86:0/417385481 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc80039e0 con 0x7f5dd806cf60 2024-09-19T06:37:34.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.816+0000 7f5dddaaf640 1 -- 172.21.15.86:0/417385481 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd81f50a0 con 0x7f5dd806cf60 2024-09-19T06:37:34.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.816+0000 7f5dddaaf640 1 -- 172.21.15.86:0/417385481 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dd80c8d30 con 0x7f5dd806cf60 2024-09-19T06:37:34.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.817+0000 7f5dddaaf640 1 -- 172.21.15.86:0/417385481 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dd806e000 con 0x7f5dd806cf60 2024-09-19T06:37:34.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.818+0000 7f5dbffff640 1 -- 172.21.15.86:0/417385481 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5dc801a070 con 0x7f5dd806cf60 2024-09-19T06:37:34.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.819+0000 7f5dbffff640 1 --2- 172.21.15.86:0/417385481 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5dc406c2b0 0x7f5dc406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:34.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.819+0000 7f5dd6ffd640 1 --2- 172.21.15.86:0/417385481 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5dc406c2b0 0x7f5dc406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:34.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.819+0000 7f5dbffff640 1 -- 172.21.15.86:0/417385481 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5dc808aaf0 con 0x7f5dd806cf60 2024-09-19T06:37:34.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.819+0000 7f5dd6ffd640 1 --2- 172.21.15.86:0/417385481 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5dc406c2b0 0x7f5dc406e770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc034000 tx=0x7f5dcc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:34.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:34.822+0000 7f5dbffff640 1 -- 172.21.15.86:0/417385481 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5dc80010c0 con 0x7f5dd806cf60 2024-09-19T06:37:35.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.021+0000 7f5dddaaf640 1 -- 172.21.15.86:0/417385481 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5dd806db20 con 0x7f5dd806cf60 2024-09-19T06:37:35.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.022+0000 7f5dbffff640 1 -- 172.21.15.86:0/417385481 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6871 (secure 0 0 0) 0x7f5dc8058840 con 0x7f5dd806cf60 2024-09-19T06:37:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:35.024 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":9,"btime":"2024-09-19T06:37:28:505383+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:37:27.843067+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6837/201961024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":201961024},{"type":"v1","addr":"172.21.15.169:6837","nonce":201961024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-09-19T06:37:35.024 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 9 2024-09-19T06:37:35.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.024+0000 7f5dddaaf640 1 -- 172.21.15.86:0/417385481 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5dc406c2b0 msgr2=0x7f5dc406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:35.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.024+0000 7f5dddaaf640 1 --2- 172.21.15.86:0/417385481 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5dc406c2b0 0x7f5dc406e770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc034000 tx=0x7f5dcc02e000 comp rx=0 tx=0).stop 2024-09-19T06:37:35.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.024+0000 7f5dddaaf640 1 -- 172.21.15.86:0/417385481 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dd806cf60 msgr2=0x7f5dd8158d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:35.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.024+0000 7f5dddaaf640 1 --2- 172.21.15.86:0/417385481 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dd806cf60 0x7f5dd8158d80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800c440 tx=0x7f5dc800c900 comp rx=0 tx=0).stop 2024-09-19T06:37:35.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.024+0000 7f5dddaaf640 1 -- 172.21.15.86:0/417385481 shutdown_connections 2024-09-19T06:37:35.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.024+0000 7f5dddaaf640 1 --2- 172.21.15.86:0/417385481 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5dc406c2b0 0x7f5dc406e770 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.024+0000 7f5dddaaf640 1 --2- 172.21.15.86:0/417385481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5dd815c400 0x7f5dd81f4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.024+0000 7f5dddaaf640 1 --2- 172.21.15.86:0/417385481 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5dd80c4040 0x7f5dd8071c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.024+0000 7f5dddaaf640 1 --2- 172.21.15.86:0/417385481 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dd806cf60 0x7f5dd8158d80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.024+0000 7f5dddaaf640 1 -- 172.21.15.86:0/417385481 >> 172.21.15.86:0/417385481 conn(0x7f5dd806bbc0 msgr2=0x7f5dd815b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:35.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.024+0000 7f5dddaaf640 1 -- 172.21.15.86:0/417385481 shutdown_connections 2024-09-19T06:37:35.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.024+0000 7f5dddaaf640 1 -- 172.21.15.86:0/417385481 wait complete. 2024-09-19T06:37:35.036 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T06:37:35.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.133+0000 7f7706111640 1 Processor -- start 2024-09-19T06:37:35.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.133+0000 7f7706111640 1 -- start start 2024-09-19T06:37:35.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.134+0000 7f7706111640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7700153050 0x7f77000cb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:35.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.134+0000 7f7706111640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7700073120 0x7f7700073540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:35.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.134+0000 7f7706111640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77000c5da0 con 0x7f77000c8b20 2024-09-19T06:37:35.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.134+0000 7f7706111640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f7700153430 con 0x7f7700073120 2024-09-19T06:37:35.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.134+0000 7f7706111640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f77000c6040 con 0x7f7700153050 2024-09-19T06:37:35.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.134+0000 7f76fffff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7700073120 0x7f7700073540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:35.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.134+0000 7f76ff7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7700153050 0x7f77000cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:35.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.134+0000 7f76feffd640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f77000c8b20 0x7f770015ca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:38386/0 (socket says 172.21.15.86:38386) 2024-09-19T06:37:35.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.134+0000 7f76ff7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7700153050 0x7f77000cb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:58596/0 (socket says 172.21.15.86:58596) 2024-09-19T06:37:35.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.134+0000 7f76feffd640 1 -- 172.21.15.86:0/1562279187 learned_addr learned my addr 172.21.15.86:0/1562279187 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:35.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.134+0000 7f76fffff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7700073120 0x7f7700073540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:41130/0 (socket says 172.21.15.86:41130) 2024-09-19T06:37:35.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.134+0000 7f76fffff640 1 -- 172.21.15.86:0/1562279187 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7700153050 msgr2=0x7f77000cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:35.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.134+0000 7f76fffff640 1 --2- 172.21.15.86:0/1562279187 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7700153050 0x7f77000cb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.134+0000 7f76fffff640 1 -- 172.21.15.86:0/1562279187 >> v1:172.21.15.169:6789/0 conn(0x7f77000c8b20 legacy=0x7f770015ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:35.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.134+0000 7f76fffff640 1 -- 172.21.15.86:0/1562279187 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77000c6320 con 0x7f7700073120 2024-09-19T06:37:35.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.134+0000 7f76fe7fc640 1 -- 172.21.15.86:0/1562279187 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 186269276 0 0) 0x7f77000c5da0 con 0x7f77000c8b20 2024-09-19T06:37:35.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.134+0000 7f76ff7fe640 1 --2- 172.21.15.86:0/1562279187 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7700153050 0x7f77000cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:37:35.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.135+0000 7f76fffff640 1 --2- 172.21.15.86:0/1562279187 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7700073120 0x7f7700073540 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f76f8009d90 tx=0x7f76f802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a107cf1b0b3f612c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:35.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.135+0000 7f76fe7fc640 1 -- 172.21.15.86:0/1562279187 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f8007740 con 0x7f7700073120 2024-09-19T06:37:35.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.135+0000 7f76fe7fc640 1 -- 172.21.15.86:0/1562279187 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76f80078e0 con 0x7f7700073120 2024-09-19T06:37:35.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.135+0000 7f76fe7fc640 1 -- 172.21.15.86:0/1562279187 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f8007cb0 con 0x7f7700073120 2024-09-19T06:37:35.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.136+0000 7f7706111640 1 -- 172.21.15.86:0/1562279187 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7700073120 msgr2=0x7f7700073540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:35.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.136+0000 7f7706111640 1 --2- 172.21.15.86:0/1562279187 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7700073120 0x7f7700073540 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f76f8009d90 tx=0x7f76f802a660 comp rx=0 tx=0).stop 2024-09-19T06:37:35.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.136+0000 7f7706111640 1 -- 172.21.15.86:0/1562279187 shutdown_connections 2024-09-19T06:37:35.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.136+0000 7f7706111640 1 --2- 172.21.15.86:0/1562279187 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7700073120 0x7f7700073540 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.136+0000 7f7706111640 1 --2- 172.21.15.86:0/1562279187 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7700153050 0x7f77000cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.136+0000 7f7706111640 1 -- 172.21.15.86:0/1562279187 >> 172.21.15.86:0/1562279187 conn(0x7f7700070d10 msgr2=0x7f77000710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:35.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.136+0000 7f7706111640 1 -- 172.21.15.86:0/1562279187 shutdown_connections 2024-09-19T06:37:35.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.136+0000 7f7706111640 1 -- 172.21.15.86:0/1562279187 wait complete. 2024-09-19T06:37:35.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.137+0000 7f7706111640 1 Processor -- start 2024-09-19T06:37:35.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.137+0000 7f7706111640 1 -- start start 2024-09-19T06:37:35.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.138+0000 7f7706111640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7700073120 0x7f77001f1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:35.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.138+0000 7f7706111640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77000c8b20 0x7f770014b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:35.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.138+0000 7f7706111640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7700153050 0x7f770014b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:35.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.138+0000 7f7706111640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f770015c500 con 0x7f7700073120 2024-09-19T06:37:35.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.138+0000 7f7706111640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f77000c68e0 con 0x7f77000c8b20 2024-09-19T06:37:35.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.138+0000 7f7706111640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f770015d130 con 0x7f7700153050 2024-09-19T06:37:35.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.138+0000 7f76ff7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7700073120 0x7f77001f1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:35.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.138+0000 7f76ff7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7700073120 0x7f77001f1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56820/0 (socket says 172.21.15.86:56820) 2024-09-19T06:37:35.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.138+0000 7f76ff7fe640 1 -- 172.21.15.86:0/2570210105 learned_addr learned my addr 172.21.15.86:0/2570210105 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:35.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.138+0000 7f76feffd640 1 --2- 172.21.15.86:0/2570210105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77000c8b20 0x7f770014b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:35.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.138+0000 7f76fffff640 1 --2- 172.21.15.86:0/2570210105 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7700153050 0x7f770014b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:35.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.138+0000 7f76ff7fe640 1 -- 172.21.15.86:0/2570210105 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7700153050 msgr2=0x7f770014b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:35.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.138+0000 7f76ff7fe640 1 --2- 172.21.15.86:0/2570210105 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7700153050 0x7f770014b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.138+0000 7f76ff7fe640 1 -- 172.21.15.86:0/2570210105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77000c8b20 msgr2=0x7f770014b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:35.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.138+0000 7f76ff7fe640 1 --2- 172.21.15.86:0/2570210105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77000c8b20 0x7f770014b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.138+0000 7f76ff7fe640 1 -- 172.21.15.86:0/2570210105 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7700156420 con 0x7f7700073120 2024-09-19T06:37:35.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.138+0000 7f76feffd640 1 --2- 172.21.15.86:0/2570210105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77000c8b20 0x7f770014b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:35.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.138+0000 7f76ff7fe640 1 --2- 172.21.15.86:0/2570210105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7700073120 0x7f77001f1280 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f76e800e960 tx=0x7f76e800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:35.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.138+0000 7f76f7fff640 1 -- 172.21.15.86:0/2570210105 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e8017070 con 0x7f7700073120 2024-09-19T06:37:35.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.139+0000 7f76f7fff640 1 -- 172.21.15.86:0/2570210105 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e800ca00 con 0x7f7700073120 2024-09-19T06:37:35.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.139+0000 7f7706111640 1 -- 172.21.15.86:0/2570210105 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f770015c0a0 con 0x7f7700073120 2024-09-19T06:37:35.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.139+0000 7f76f7fff640 1 -- 172.21.15.86:0/2570210105 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e800cdd0 con 0x7f7700073120 2024-09-19T06:37:35.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.139+0000 7f7706111640 1 -- 172.21.15.86:0/2570210105 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f770014e6a0 con 0x7f7700073120 2024-09-19T06:37:35.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.139+0000 7f7706111640 1 -- 172.21.15.86:0/2570210105 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7700151fe0 con 0x7f7700073120 2024-09-19T06:37:35.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.140+0000 7f76f7fff640 1 -- 172.21.15.86:0/2570210105 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f76e801a070 con 0x7f7700073120 2024-09-19T06:37:35.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.140+0000 7f76f7fff640 1 --2- 172.21.15.86:0/2570210105 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f76e006c2e0 0x7f76e006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:35.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.140+0000 7f76f7fff640 1 -- 172.21.15.86:0/2570210105 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f76e808b6d0 con 0x7f7700073120 2024-09-19T06:37:35.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.140+0000 7f76feffd640 1 --2- 172.21.15.86:0/2570210105 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f76e006c2e0 0x7f76e006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:35.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.141+0000 7f76feffd640 1 --2- 172.21.15.86:0/2570210105 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f76e006c2e0 0x7f76e006e7a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f770006eeb0 tx=0x7f76f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:35.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.145+0000 7f76f7fff640 1 -- 172.21.15.86:0/2570210105 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7700151fe0 con 0x7f7700073120 2024-09-19T06:37:35.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.313+0000 7f7706111640 1 -- 172.21.15.86:0/2570210105 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f77001565f0 con 0x7f7700073120 2024-09-19T06:37:35.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.314+0000 7f76f7fff640 1 -- 172.21.15.86:0/2570210105 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18586 (secure 0 0 0) 0x7f76e8059a70 con 0x7f7700073120 2024-09-19T06:37:35.316 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:35.316 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":26,"fsid":"1785f09f-0959-457d-8c4a-6cce2e655a37","created":"2024-09-19T06:36:45.671544+0000","modified":"2024-09-19T06:37:13.796252+0000","last_up_change":"2024-09-19T06:36:56.765680+0000","last_in_change":"2024-09-19T06:36:47.816681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:36:57.770634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:37:06.588120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:37:07.739726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T06:37:11.457476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bd3ce3f2-2a37-40ec-8dc3-69246437277c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6827","nonce":1588074611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6829","nonce":1588074611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6833","nonce":1588074611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6831","nonce":1588074611}]},"public_addr":"172.21.15.86:6827/1588074611","cluster_addr":"172.21.15.86:6829/1588074611","heartbeat_back_addr":"172.21.15.86:6833/1588074611","heartbeat_front_addr":"172.21.15.86:6831/1588074611","state":["exists","up"]},{"osd":1,"uuid":"871d7d23-ed03-4629-bca9-5b71ad0d926a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6819","nonce":1785682938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6821","nonce":1785682938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6825","nonce":1785682938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6823","nonce":1785682938}]},"public_addr":"172.21.15.86:6819/1785682938","cluster_addr":"172.21.15.86:6821/1785682938","heartbeat_back_addr":"172.21.15.86:6825/1785682938","heartbeat_front_addr":"172.21.15.86:6823/1785682938","state":["exists","up"]},{"osd":2,"uuid":"39d3562d-8c52-4af9-935a-2d90abb8b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6801","nonce":3306127846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6803","nonce":3306127846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6807","nonce":3306127846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6805","nonce":3306127846}]},"public_addr":"172.21.15.86:6801/3306127846","cluster_addr":"172.21.15.86:6803/3306127846","heartbeat_back_addr":"172.21.15.86:6807/3306127846","heartbeat_front_addr":"172.21.15.86:6805/3306127846","state":["exists","up"]},{"osd":3,"uuid":"7f88c5b1-042c-4a9f-a674-32456e0644a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6809","nonce":694275178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6811","nonce":694275178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6815","nonce":694275178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6813","nonce":694275178}]},"public_addr":"172.21.15.86:6809/694275178","cluster_addr":"172.21.15.86:6811/694275178","heartbeat_back_addr":"172.21.15.86:6815/694275178","heartbeat_front_addr":"172.21.15.86:6813/694275178","state":["exists","up"]},{"osd":4,"uuid":"18aa391b-0863-48bf-bff6-107e22ee9752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6811","nonce":1326795640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6815","nonce":1326795640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6823","nonce":1326795640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6819","nonce":1326795640}]},"public_addr":"172.21.15.169:6811/1326795640","cluster_addr":"172.21.15.169:6815/1326795640","heartbeat_back_addr":"172.21.15.169:6823/1326795640","heartbeat_front_addr":"172.21.15.169:6819/1326795640","state":["exists","up"]},{"osd":5,"uuid":"90fa5ca6-1815-4af1-a664-b45a9e19dd56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6825","nonce":3538913242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6827","nonce":3538913242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6831","nonce":3538913242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6829","nonce":3538913242}]},"public_addr":"172.21.15.169:6825/3538913242","cluster_addr":"172.21.15.169:6827/3538913242","heartbeat_back_addr":"172.21.15.169:6831/3538913242","heartbeat_front_addr":"172.21.15.169:6829/3538913242","state":["exists","up"]},{"osd":6,"uuid":"8b2019fc-6cc2-4394-9a7c-7951544f7cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6810","nonce":494424253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6814","nonce":494424253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6822","nonce":494424253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6818","nonce":494424253}]},"public_addr":"172.21.15.169:6810/494424253","cluster_addr":"172.21.15.169:6814/494424253","heartbeat_back_addr":"172.21.15.169:6822/494424253","heartbeat_front_addr":"172.21.15.169:6818/494424253","state":["exists","up"]},{"osd":7,"uuid":"622e3b2c-5302-4b0a-b7f2-f4050801401e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6801","nonce":797235989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6803","nonce":797235989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6807","nonce":797235989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6805","nonce":797235989}]},"public_addr":"172.21.15.169:6801/797235989","cluster_addr":"172.21.15.169:6803/797235989","heartbeat_back_addr":"172.21.15.169:6807/797235989","heartbeat_front_addr":"172.21.15.169:6805/797235989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.130643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.611572+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:53.419992+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.560112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.112065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.774642+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.341946+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.117884+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:37:35.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.316+0000 7f7706111640 1 -- 172.21.15.86:0/2570210105 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f76e006c2e0 msgr2=0x7f76e006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:35.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.316+0000 7f7706111640 1 --2- 172.21.15.86:0/2570210105 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f76e006c2e0 0x7f76e006e7a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f770006eeb0 tx=0x7f76f0009040 comp rx=0 tx=0).stop 2024-09-19T06:37:35.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.316+0000 7f7706111640 1 -- 172.21.15.86:0/2570210105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7700073120 msgr2=0x7f77001f1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:35.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.316+0000 7f7706111640 1 --2- 172.21.15.86:0/2570210105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7700073120 0x7f77001f1280 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f76e800e960 tx=0x7f76e800ee20 comp rx=0 tx=0).stop 2024-09-19T06:37:35.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.316+0000 7f7706111640 1 -- 172.21.15.86:0/2570210105 shutdown_connections 2024-09-19T06:37:35.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.316+0000 7f7706111640 1 --2- 172.21.15.86:0/2570210105 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f76e006c2e0 0x7f76e006e7a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.316+0000 7f7706111640 1 --2- 172.21.15.86:0/2570210105 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7700153050 0x7f770014b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.316+0000 7f7706111640 1 --2- 172.21.15.86:0/2570210105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77000c8b20 0x7f770014b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.316+0000 7f7706111640 1 --2- 172.21.15.86:0/2570210105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7700073120 0x7f77001f1280 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.316+0000 7f7706111640 1 -- 172.21.15.86:0/2570210105 >> 172.21.15.86:0/2570210105 conn(0x7f7700070d10 msgr2=0x7f77000cb680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:35.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.316+0000 7f7706111640 1 -- 172.21.15.86:0/2570210105 shutdown_connections 2024-09-19T06:37:35.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.317+0000 7f7706111640 1 -- 172.21.15.86:0/2570210105 wait complete. 2024-09-19T06:37:35.329 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:37:35.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.426+0000 7f668dbb7640 1 Processor -- start 2024-09-19T06:37:35.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.426+0000 7f668dbb7640 1 -- start start 2024-09-19T06:37:35.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.427+0000 7f668dbb7640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f668815e170 0x7f66880b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:35.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.427+0000 7f668dbb7640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f668815c9c0 con 0x7f66880d1120 2024-09-19T06:37:35.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.427+0000 7f668dbb7640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f668815cca0 con 0x7f66880d0d40 2024-09-19T06:37:35.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.427+0000 7f668dbb7640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f668815c770 con 0x7f668815e170 2024-09-19T06:37:35.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.427+0000 7f667effd640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f66880d1120 0x7f668815da60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:35212/0 (socket says 172.21.15.86:35212) 2024-09-19T06:37:35.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.427+0000 7f667effd640 1 -- 172.21.15.86:0/2890266917 learned_addr learned my addr 172.21.15.86:0/2890266917 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:35.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.428+0000 7f6686ffd640 1 -- 172.21.15.86:0/2890266917 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2560812380 0 0) 0x7f668815c9c0 con 0x7f66880d1120 2024-09-19T06:37:35.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.428+0000 7f6687fff640 1 --2- 172.21.15.86:0/2890266917 >> v2:172.21.15.169:3300/0 conn(0x7f668815e170 0x7f66880b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:35.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.428+0000 7f6686ffd640 1 -- 172.21.15.86:0/2890266917 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6674003520 con 0x7f66880d1120 2024-09-19T06:37:35.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.428+0000 7f6686ffd640 1 -- 172.21.15.86:0/2890266917 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3017842426 0 0) 0x7f6674003520 con 0x7f66880d1120 2024-09-19T06:37:35.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.428+0000 7f6686ffd640 1 -- 172.21.15.86:0/2890266917 >> v2:172.21.15.169:3300/0 conn(0x7f668815e170 msgr2=0x7f66880b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:35.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.428+0000 7f6686ffd640 1 --2- 172.21.15.86:0/2890266917 >> v2:172.21.15.169:3300/0 conn(0x7f668815e170 0x7f66880b4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.428+0000 7f6686ffd640 1 -- 172.21.15.86:0/2890266917 >> v1:172.21.15.169:6789/0 conn(0x7f66880d0d40 legacy=0x7f66880ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:35.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.428+0000 7f6686ffd640 1 -- 172.21.15.86:0/2890266917 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f668815cf80 con 0x7f66880d1120 2024-09-19T06:37:35.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.428+0000 7f6686ffd640 1 -- 172.21.15.86:0/2890266917 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f6670001670 con 0x7f66880d1120 2024-09-19T06:37:35.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.428+0000 7f6686ffd640 1 -- 172.21.15.86:0/2890266917 >> v1:172.21.15.86:6789/0 conn(0x7f66880d1120 legacy=0x7f668815da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:35.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.428+0000 7f6686ffd640 1 --2- 172.21.15.86:0/2890266917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66740039b0 0x7f6674003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:35.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.428+0000 7f6686ffd640 1 --2- 172.21.15.86:0/2890266917 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6674004800 0x7f6674004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:35.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.428+0000 7f6686ffd640 1 --2- 172.21.15.86:0/2890266917 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66740051c0 0x7f667400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:35.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.428+0000 7f6686ffd640 1 -- 172.21.15.86:0/2890266917 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f668815c770 con 0x7f66740039b0 2024-09-19T06:37:35.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.428+0000 7f6686ffd640 1 -- 172.21.15.86:0/2890266917 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f667400c060 con 0x7f6674004800 2024-09-19T06:37:35.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.428+0000 7f6686ffd640 1 -- 172.21.15.86:0/2890266917 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f667400c260 con 0x7f66740051c0 2024-09-19T06:37:35.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.428+0000 7f66877fe640 1 --2- 172.21.15.86:0/2890266917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66740039b0 0x7f6674003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:35.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.428+0000 7f667effd640 1 --2- 172.21.15.86:0/2890266917 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6674004800 0x7f6674004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:35.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.428+0000 7f6687fff640 1 --2- 172.21.15.86:0/2890266917 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66740051c0 0x7f667400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:35.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.428+0000 7f66877fe640 1 -- 172.21.15.86:0/2890266917 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66740051c0 msgr2=0x7f667400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:35.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.428+0000 7f66877fe640 1 --2- 172.21.15.86:0/2890266917 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66740051c0 0x7f667400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.428+0000 7f66877fe640 1 -- 172.21.15.86:0/2890266917 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6674004800 msgr2=0x7f6674004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:35.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.428+0000 7f66877fe640 1 --2- 172.21.15.86:0/2890266917 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6674004800 0x7f6674004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.428+0000 7f66877fe640 1 -- 172.21.15.86:0/2890266917 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6674003520 con 0x7f66740039b0 2024-09-19T06:37:35.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.428+0000 7f6687fff640 1 -- 172.21.15.86:0/2890266917 reap_dead start 2024-09-19T06:37:35.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.429+0000 7f66877fe640 1 --2- 172.21.15.86:0/2890266917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66740039b0 0x7f6674003dd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6678001750 tx=0x7f6674005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709a0633ddb422c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:35.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.429+0000 7f6686ffd640 1 -- 172.21.15.86:0/2890266917 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6678001370 con 0x7f66740039b0 2024-09-19T06:37:35.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.429+0000 7f6686ffd640 1 -- 172.21.15.86:0/2890266917 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66780052d0 con 0x7f66740039b0 2024-09-19T06:37:35.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.429+0000 7f6686ffd640 1 -- 172.21.15.86:0/2890266917 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f667802abc0 con 0x7f66740039b0 2024-09-19T06:37:35.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.430+0000 7f668dbb7640 1 -- 172.21.15.86:0/2890266917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66740039b0 msgr2=0x7f6674003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:35.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.430+0000 7f668dbb7640 1 --2- 172.21.15.86:0/2890266917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66740039b0 0x7f6674003dd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6678001750 tx=0x7f6674005830 comp rx=0 tx=0).stop 2024-09-19T06:37:35.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.430+0000 7f668dbb7640 1 -- 172.21.15.86:0/2890266917 shutdown_connections 2024-09-19T06:37:35.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.430+0000 7f668dbb7640 1 --2- 172.21.15.86:0/2890266917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66740039b0 0x7f6674003dd0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.430+0000 7f668dbb7640 1 -- 172.21.15.86:0/2890266917 >> 172.21.15.86:0/2890266917 conn(0x7f668806d910 msgr2=0x7f668806dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:35.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.430+0000 7f668dbb7640 1 -- 172.21.15.86:0/2890266917 shutdown_connections 2024-09-19T06:37:35.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.430+0000 7f668dbb7640 1 -- 172.21.15.86:0/2890266917 wait complete. 2024-09-19T06:37:35.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.431+0000 7f668dbb7640 1 Processor -- start 2024-09-19T06:37:35.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.431+0000 7f668dbb7640 1 -- start start 2024-09-19T06:37:35.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.432+0000 7f668dbb7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66740039b0 0x7f66881f0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:35.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.432+0000 7f668dbb7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66880ccc30 0x7f6688157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:35.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.432+0000 7f668dbb7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66880cd070 0x7f668815baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:35.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.432+0000 7f668dbb7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f668815da60 con 0x7f66880cd070 2024-09-19T06:37:35.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.432+0000 7f668dbb7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f66880b3f20 con 0x7f66880ccc30 2024-09-19T06:37:35.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.432+0000 7f668dbb7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f668815dbe0 con 0x7f66740039b0 2024-09-19T06:37:35.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.432+0000 7f6687fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66880cd070 0x7f668815baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:35.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.432+0000 7f6687fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66880cd070 0x7f668815baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56838/0 (socket says 172.21.15.86:56838) 2024-09-19T06:37:35.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.432+0000 7f6687fff640 1 -- 172.21.15.86:0/9852194 learned_addr learned my addr 172.21.15.86:0/9852194 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:35.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.432+0000 7f667effd640 1 --2- 172.21.15.86:0/9852194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66880ccc30 0x7f6688157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:35.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.432+0000 7f66877fe640 1 --2- 172.21.15.86:0/9852194 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66740039b0 0x7f66881f0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:35.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.432+0000 7f6687fff640 1 -- 172.21.15.86:0/9852194 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66740039b0 msgr2=0x7f66881f0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:35.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.432+0000 7f6687fff640 1 --2- 172.21.15.86:0/9852194 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66740039b0 0x7f66881f0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.432+0000 7f6687fff640 1 -- 172.21.15.86:0/9852194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66880ccc30 msgr2=0x7f6688157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:35.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.432+0000 7f6687fff640 1 --2- 172.21.15.86:0/9852194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66880ccc30 0x7f6688157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.432+0000 7f6687fff640 1 -- 172.21.15.86:0/9852194 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66881f3b90 con 0x7f66880cd070 2024-09-19T06:37:35.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.432+0000 7f667effd640 1 --2- 172.21.15.86:0/9852194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66880ccc30 0x7f6688157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:35.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.432+0000 7f66877fe640 1 --2- 172.21.15.86:0/9852194 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66740039b0 0x7f66881f0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:35.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.432+0000 7f6687fff640 1 --2- 172.21.15.86:0/9852194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66880cd070 0x7f668815baf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f66880c7a70 tx=0x7f668000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:35.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.432+0000 7f6684ff9640 1 -- 172.21.15.86:0/9852194 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668000fc80 con 0x7f66880cd070 2024-09-19T06:37:35.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.432+0000 7f6684ff9640 1 -- 172.21.15.86:0/9852194 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f668001d070 con 0x7f66880cd070 2024-09-19T06:37:35.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.432+0000 7f668dbb7640 1 -- 172.21.15.86:0/9852194 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66881f3e70 con 0x7f66880cd070 2024-09-19T06:37:35.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.432+0000 7f6684ff9640 1 -- 172.21.15.86:0/9852194 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6680015430 con 0x7f66880cd070 2024-09-19T06:37:35.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.433+0000 7f668dbb7640 1 -- 172.21.15.86:0/9852194 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66881f4430 con 0x7f66880cd070 2024-09-19T06:37:35.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.433+0000 7f668dbb7640 1 -- 172.21.15.86:0/9852194 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66880c5890 con 0x7f66880cd070 2024-09-19T06:37:35.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.434+0000 7f6684ff9640 1 -- 172.21.15.86:0/9852194 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f66800155d0 con 0x7f66880cd070 2024-09-19T06:37:35.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.434+0000 7f6684ff9640 1 --2- 172.21.15.86:0/9852194 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f666806c2b0 0x7f666806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:35.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.434+0000 7f6684ff9640 1 -- 172.21.15.86:0/9852194 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f668008bfc0 con 0x7f66880cd070 2024-09-19T06:37:35.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.434+0000 7f66877fe640 1 --2- 172.21.15.86:0/9852194 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f666806c2b0 0x7f666806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:35.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.435+0000 7f66877fe640 1 --2- 172.21.15.86:0/9852194 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f666806c2b0 0x7f666806e770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6678032000 tx=0x7f667802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:35.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.439+0000 7f6684ff9640 1 -- 172.21.15.86:0/9852194 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f66880c5890 con 0x7f66880cd070 2024-09-19T06:37:35.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.640+0000 7f668dbb7640 1 -- 172.21.15.86:0/9852194 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6688154e50 con 0x7f66880cd070 2024-09-19T06:37:35.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.641+0000 7f6684ff9640 1 -- 172.21.15.86:0/9852194 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6871 (secure 0 0 0) 0x7f6680010040 con 0x7f66880cd070 2024-09-19T06:37:35.642 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:35.642 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":9,"btime":"2024-09-19T06:37:28:505383+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:37:27.843067+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6837/201961024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":201961024},{"type":"v1","addr":"172.21.15.169:6837","nonce":201961024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-09-19T06:37:35.643 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 9 2024-09-19T06:37:35.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.643+0000 7f668dbb7640 1 -- 172.21.15.86:0/9852194 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f666806c2b0 msgr2=0x7f666806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:35.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.643+0000 7f668dbb7640 1 --2- 172.21.15.86:0/9852194 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f666806c2b0 0x7f666806e770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6678032000 tx=0x7f667802e000 comp rx=0 tx=0).stop 2024-09-19T06:37:35.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.643+0000 7f668dbb7640 1 -- 172.21.15.86:0/9852194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66880cd070 msgr2=0x7f668815baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:35.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.643+0000 7f668dbb7640 1 --2- 172.21.15.86:0/9852194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66880cd070 0x7f668815baf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f66880c7a70 tx=0x7f668000f1b0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.643+0000 7f668dbb7640 1 -- 172.21.15.86:0/9852194 shutdown_connections 2024-09-19T06:37:35.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.643+0000 7f668dbb7640 1 --2- 172.21.15.86:0/9852194 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f666806c2b0 0x7f666806e770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.643+0000 7f668dbb7640 1 --2- 172.21.15.86:0/9852194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66880cd070 0x7f668815baf0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.643+0000 7f668dbb7640 1 --2- 172.21.15.86:0/9852194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66880ccc30 0x7f6688157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.643+0000 7f668dbb7640 1 --2- 172.21.15.86:0/9852194 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66740039b0 0x7f66881f0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.643+0000 7f668dbb7640 1 -- 172.21.15.86:0/9852194 >> 172.21.15.86:0/9852194 conn(0x7f668806d910 msgr2=0x7f668815e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:35.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.643+0000 7f668dbb7640 1 -- 172.21.15.86:0/9852194 shutdown_connections 2024-09-19T06:37:35.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:35.643+0000 7f668dbb7640 1 -- 172.21.15.86:0/9852194 wait complete. 2024-09-19T06:37:36.258 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T06:37:08.763572+0000', 'modified': '2024-09-19T06:37:27.843067+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.169:6837/201961024', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6836', 'nonce': 201961024}, {'type': 'v1', 'addr': '172.21.15.169:6837', 'nonce': 201961024}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4285, 'qdb_cluster': [4285]} 2024-09-19T06:37:36.259 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T06:37:36.259 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-19T06:37:36.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.364+0000 7f8f7c7fd640 1 Processor -- start 2024-09-19T06:37:36.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.364+0000 7f8f7c7fd640 1 -- start start 2024-09-19T06:37:36.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.365+0000 7f8f7c7fd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f74073120 0x7f8f74073590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.365+0000 7f8f7c7fd640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f740cc040 con 0x7f8f740c8b20 2024-09-19T06:37:36.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.365+0000 7f8f7c7fd640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f740c5da0 con 0x7f8f74153050 2024-09-19T06:37:36.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.365+0000 7f8f7c7fd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8f74153430 con 0x7f8f74073120 2024-09-19T06:37:36.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.365+0000 7f8f79d98640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f8f740c8b20 0x7f8f7415ca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:35218/0 (socket says 172.21.15.86:35218) 2024-09-19T06:37:36.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.365+0000 7f8f79d98640 1 -- 172.21.15.86:0/491136256 learned_addr learned my addr 172.21.15.86:0/491136256 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:36.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.365+0000 7f8f79597640 1 -- 172.21.15.86:0/491136256 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2392513707 0 0) 0x7f8f64001110 con 0x7f8f740c8b20 2024-09-19T06:37:36.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.365+0000 7f8f79597640 1 -- 172.21.15.86:0/491136256 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f60003520 con 0x7f8f740c8b20 2024-09-19T06:37:36.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.365+0000 7f8f7ad9a640 1 --2- 172.21.15.86:0/491136256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f74073120 0x7f8f74073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.366+0000 7f8f79597640 1 -- 172.21.15.86:0/491136256 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1363656077 0 0) 0x7f8f60003520 con 0x7f8f740c8b20 2024-09-19T06:37:36.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.366+0000 7f8f79597640 1 -- 172.21.15.86:0/491136256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f74073120 msgr2=0x7f8f74073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:36.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.366+0000 7f8f79597640 1 --2- 172.21.15.86:0/491136256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f74073120 0x7f8f74073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.366+0000 7f8f79597640 1 -- 172.21.15.86:0/491136256 >> v1:172.21.15.169:6789/0 conn(0x7f8f74153050 legacy=0x7f8f740cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:36.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.366+0000 7f8f79597640 1 -- 172.21.15.86:0/491136256 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f740c6040 con 0x7f8f740c8b20 2024-09-19T06:37:36.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.366+0000 7f8f79597640 1 -- 172.21.15.86:0/491136256 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f8f64001840 con 0x7f8f740c8b20 2024-09-19T06:37:36.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.366+0000 7f8f79597640 1 -- 172.21.15.86:0/491136256 >> v1:172.21.15.86:6789/0 conn(0x7f8f740c8b20 legacy=0x7f8f7415ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:36.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.366+0000 7f8f79597640 1 --2- 172.21.15.86:0/491136256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f74073120 0x7f8f600039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.366+0000 7f8f79597640 1 --2- 172.21.15.86:0/491136256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f60003f60 0x7f8f60004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.366+0000 7f8f79597640 1 --2- 172.21.15.86:0/491136256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f60004d40 0x7f8f600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.366+0000 7f8f79597640 1 -- 172.21.15.86:0/491136256 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8f74153430 con 0x7f8f60003f60 2024-09-19T06:37:36.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.366+0000 7f8f79597640 1 -- 172.21.15.86:0/491136256 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8f6000baa0 con 0x7f8f60004d40 2024-09-19T06:37:36.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.366+0000 7f8f79597640 1 -- 172.21.15.86:0/491136256 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8f6000bca0 con 0x7f8f74073120 2024-09-19T06:37:36.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.366+0000 7f8f79d98640 1 --2- 172.21.15.86:0/491136256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f60003f60 0x7f8f60004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.366+0000 7f8f7a599640 1 --2- 172.21.15.86:0/491136256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f74073120 0x7f8f600039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.366+0000 7f8f7ad9a640 1 --2- 172.21.15.86:0/491136256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f60004d40 0x7f8f600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.366+0000 7f8f79d98640 1 -- 172.21.15.86:0/491136256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f74073120 msgr2=0x7f8f600039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:36.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.366+0000 7f8f79d98640 1 --2- 172.21.15.86:0/491136256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f74073120 0x7f8f600039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.366+0000 7f8f79d98640 1 -- 172.21.15.86:0/491136256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f60004d40 msgr2=0x7f8f600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:36.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.366+0000 7f8f79d98640 1 --2- 172.21.15.86:0/491136256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f60004d40 0x7f8f600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.366+0000 7f8f79d98640 1 -- 172.21.15.86:0/491136256 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f60003520 con 0x7f8f60003f60 2024-09-19T06:37:36.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.367+0000 7f8f79d98640 1 --2- 172.21.15.86:0/491136256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f60003f60 0x7f8f60004800 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8f6400c4c0 tx=0x7f8f60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df9fb4455d878c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:36.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.367+0000 7f8f79597640 1 -- 172.21.15.86:0/491136256 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6400c0e0 con 0x7f8f60003f60 2024-09-19T06:37:36.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.367+0000 7f8f79597640 1 -- 172.21.15.86:0/491136256 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f64034070 con 0x7f8f60003f60 2024-09-19T06:37:36.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.367+0000 7f8f79597640 1 -- 172.21.15.86:0/491136256 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f64005d70 con 0x7f8f60003f60 2024-09-19T06:37:36.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.367+0000 7f8f7c7fd640 1 -- 172.21.15.86:0/491136256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f60003f60 msgr2=0x7f8f60004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:36.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.367+0000 7f8f7c7fd640 1 --2- 172.21.15.86:0/491136256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f60003f60 0x7f8f60004800 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8f6400c4c0 tx=0x7f8f60005830 comp rx=0 tx=0).stop 2024-09-19T06:37:36.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.367+0000 7f8f7ad9a640 1 -- 172.21.15.86:0/491136256 reap_dead start 2024-09-19T06:37:36.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.367+0000 7f8f7c7fd640 1 -- 172.21.15.86:0/491136256 shutdown_connections 2024-09-19T06:37:36.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.368+0000 7f8f7c7fd640 1 -- 172.21.15.86:0/491136256 >> 172.21.15.86:0/491136256 conn(0x7f8f74070d10 msgr2=0x7f8f740710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:36.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.368+0000 7f8f7c7fd640 1 -- 172.21.15.86:0/491136256 shutdown_connections 2024-09-19T06:37:36.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.368+0000 7f8f7c7fd640 1 -- 172.21.15.86:0/491136256 wait complete. 2024-09-19T06:37:36.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.369+0000 7f8f7c7fd640 1 Processor -- start 2024-09-19T06:37:36.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.369+0000 7f8f7c7fd640 1 -- start start 2024-09-19T06:37:36.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.369+0000 7f8f7c7fd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f60003f60 0x7f8f74154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.369+0000 7f8f7c7fd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f74155490 0x7f8f74153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.369+0000 7f8f7c7fd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f741540c0 0x7f8f74155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.369+0000 7f8f7c7fd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8f740c68e0 con 0x7f8f741540c0 2024-09-19T06:37:36.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.369+0000 7f8f7c7fd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8f740c6600 con 0x7f8f74155490 2024-09-19T06:37:36.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.369+0000 7f8f7c7fd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8f7415c500 con 0x7f8f60003f60 2024-09-19T06:37:36.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.370+0000 7f8f7ad9a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f741540c0 0x7f8f74155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.370+0000 7f8f7ad9a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f741540c0 0x7f8f74155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56858/0 (socket says 172.21.15.86:56858) 2024-09-19T06:37:36.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.370+0000 7f8f7ad9a640 1 -- 172.21.15.86:0/2530843225 learned_addr learned my addr 172.21.15.86:0/2530843225 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:36.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.370+0000 7f8f7a599640 1 --2- 172.21.15.86:0/2530843225 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f60003f60 0x7f8f74154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.370+0000 7f8f79d98640 1 --2- 172.21.15.86:0/2530843225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f74155490 0x7f8f74153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.370+0000 7f8f7ad9a640 1 -- 172.21.15.86:0/2530843225 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f60003f60 msgr2=0x7f8f74154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:36.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.370+0000 7f8f7ad9a640 1 --2- 172.21.15.86:0/2530843225 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f60003f60 0x7f8f74154f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.370+0000 7f8f7ad9a640 1 -- 172.21.15.86:0/2530843225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f74155490 msgr2=0x7f8f74153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:36.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.370+0000 7f8f7ad9a640 1 --2- 172.21.15.86:0/2530843225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f74155490 0x7f8f74153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.370+0000 7f8f7ad9a640 1 -- 172.21.15.86:0/2530843225 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f74154540 con 0x7f8f741540c0 2024-09-19T06:37:36.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.370+0000 7f8f7ad9a640 1 --2- 172.21.15.86:0/2530843225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f741540c0 0x7f8f74155dd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8f740c9450 tx=0x7f8f6c011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:36.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.370+0000 7f8f6affd640 1 -- 172.21.15.86:0/2530843225 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c004240 con 0x7f8f741540c0 2024-09-19T06:37:36.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.370+0000 7f8f6affd640 1 -- 172.21.15.86:0/2530843225 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f6c01b070 con 0x7f8f741540c0 2024-09-19T06:37:36.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.370+0000 7f8f7c7fd640 1 -- 172.21.15.86:0/2530843225 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f740c3220 con 0x7f8f741540c0 2024-09-19T06:37:36.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.370+0000 7f8f6affd640 1 -- 172.21.15.86:0/2530843225 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c00f770 con 0x7f8f741540c0 2024-09-19T06:37:36.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.370+0000 7f8f7c7fd640 1 -- 172.21.15.86:0/2530843225 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f740c2f40 con 0x7f8f741540c0 2024-09-19T06:37:36.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.372+0000 7f8f6affd640 1 -- 172.21.15.86:0/2530843225 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8f6c012040 con 0x7f8f741540c0 2024-09-19T06:37:36.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.372+0000 7f8f6affd640 1 --2- 172.21.15.86:0/2530843225 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8f5806c2e0 0x7f8f5806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.372+0000 7f8f6affd640 1 -- 172.21.15.86:0/2530843225 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8f6c08b450 con 0x7f8f741540c0 2024-09-19T06:37:36.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.372+0000 7f8f7a599640 1 --2- 172.21.15.86:0/2530843225 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8f5806c2e0 0x7f8f5806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.373+0000 7f8f7a599640 1 --2- 172.21.15.86:0/2530843225 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8f5806c2e0 0x7f8f5806e7a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8f70001ee0 tx=0x7f8f70009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:36.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.373+0000 7f8f7f680740 1 Processor -- start 2024-09-19T06:37:36.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.373+0000 7f8f7f680740 1 -- start start 2024-09-19T06:37:36.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.374+0000 7f8f7f680740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba5b21b750 0x55ba5b2539e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.374+0000 7f8f7f680740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ba5b218f80 0x55ba5b253f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.374+0000 7f8f7f680740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b21bb30 0x55ba5b217a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.374+0000 7f8f7f680740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ba5b17c520 con 0x55ba5b21bb30 2024-09-19T06:37:36.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.374+0000 7f8f7f680740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ba5b1243e0 con 0x55ba5b21b750 2024-09-19T06:37:36.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.374+0000 7f8f7f680740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55ba5b1784e0 con 0x55ba5b218f80 2024-09-19T06:37:36.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.374+0000 7f8f7ad9a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b21bb30 0x55ba5b217a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.374+0000 7f8f7ad9a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b21bb30 0x55ba5b217a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56874/0 (socket says 172.21.15.86:56874) 2024-09-19T06:37:36.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.374+0000 7f8f7ad9a640 1 -- 172.21.15.86:0/2332451567 learned_addr learned my addr 172.21.15.86:0/2332451567 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:36.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.374+0000 7f8f79d98640 1 --2- 172.21.15.86:0/2332451567 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ba5b218f80 0x55ba5b253f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.374+0000 7f8f7a599640 1 --2- 172.21.15.86:0/2332451567 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba5b21b750 0x55ba5b2539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.374+0000 7f8f7ad9a640 1 -- 172.21.15.86:0/2332451567 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ba5b218f80 msgr2=0x55ba5b253f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:36.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.374+0000 7f8f7ad9a640 1 --2- 172.21.15.86:0/2332451567 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ba5b218f80 0x55ba5b253f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.374+0000 7f8f7ad9a640 1 -- 172.21.15.86:0/2332451567 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba5b21b750 msgr2=0x55ba5b2539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:36.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.374+0000 7f8f7ad9a640 1 --2- 172.21.15.86:0/2332451567 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba5b21b750 0x55ba5b2539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.374+0000 7f8f7ad9a640 1 -- 172.21.15.86:0/2332451567 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba5b13f2f0 con 0x55ba5b21bb30 2024-09-19T06:37:36.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.375+0000 7f8f7ad9a640 1 --2- 172.21.15.86:0/2332451567 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b21bb30 0x55ba5b217a60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c0895b0 tx=0x7f8f6c059230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77702e14ee03d3d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:36.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.375+0000 7f8f57fff640 1 -- 172.21.15.86:0/2332451567 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c000e60 con 0x55ba5b21bb30 2024-09-19T06:37:36.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.375+0000 7f8f57fff640 1 -- 172.21.15.86:0/2332451567 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f6c061d60 con 0x55ba5b21bb30 2024-09-19T06:37:36.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.375+0000 7f8f57fff640 1 -- 172.21.15.86:0/2332451567 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c057530 con 0x55ba5b21bb30 2024-09-19T06:37:36.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.375+0000 7f8f7f680740 1 -- 172.21.15.86:0/2332451567 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b21bb30 msgr2=0x55ba5b217a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:36.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.375+0000 7f8f7f680740 1 --2- 172.21.15.86:0/2332451567 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b21bb30 0x55ba5b217a60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c0895b0 tx=0x7f8f6c059230 comp rx=0 tx=0).stop 2024-09-19T06:37:36.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.375+0000 7f8f7f680740 1 -- 172.21.15.86:0/2332451567 shutdown_connections 2024-09-19T06:37:36.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.375+0000 7f8f7f680740 1 --2- 172.21.15.86:0/2332451567 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b21bb30 0x55ba5b217a60 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.375+0000 7f8f7f680740 1 --2- 172.21.15.86:0/2332451567 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ba5b218f80 0x55ba5b253f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.375+0000 7f8f7f680740 1 --2- 172.21.15.86:0/2332451567 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba5b21b750 0x55ba5b2539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.375+0000 7f8f7f680740 1 -- 172.21.15.86:0/2332451567 >> 172.21.15.86:0/2332451567 conn(0x55ba5b219e70 msgr2=0x55ba5b21a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:36.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.375+0000 7f8f7f680740 1 -- 172.21.15.86:0/2332451567 shutdown_connections 2024-09-19T06:37:36.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.375+0000 7f8f7f680740 1 -- 172.21.15.86:0/2332451567 wait complete. 2024-09-19T06:37:36.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.376+0000 7f8f7f680740 1 -- start start 2024-09-19T06:37:36.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.376+0000 7f8f7f680740 1 Processor -- start 2024-09-19T06:37:36.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.377+0000 7f8f7f680740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba5b218f80 0x55ba5b26e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.377+0000 7f8f7f680740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b21b750 0x55ba5b24ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.377+0000 7f8f7f680740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ba5b21bb30 0x55ba5b2179c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.377+0000 7f8f7f680740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ba5b21afe0 con 0x55ba5b21b750 2024-09-19T06:37:36.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.377+0000 7f8f7f680740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ba5b105450 con 0x55ba5b218f80 2024-09-19T06:37:36.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.377+0000 7f8f7f680740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55ba5b253550 con 0x55ba5b21bb30 2024-09-19T06:37:36.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.377+0000 7f8f7f680740 10 client.0 _ll_register_callbacks cb 0x55ba5ae8eac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:37:36.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.377+0000 7f8f79d98640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b21b750 0x55ba5b24ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.377+0000 7f8f79d98640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b21b750 0x55ba5b24ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56884/0 (socket says 172.21.15.86:56884) 2024-09-19T06:37:36.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.377+0000 7f8f79d98640 1 -- 172.21.15.86:0/2644179250 learned_addr learned my addr 172.21.15.86:0/2644179250 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:36.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.377+0000 7f8f7ad9a640 1 --2- 172.21.15.86:0/2644179250 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ba5b21bb30 0x55ba5b2179c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.377+0000 7f8f7a599640 1 --2- 172.21.15.86:0/2644179250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba5b218f80 0x55ba5b26e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.377+0000 7f8f79d98640 1 -- 172.21.15.86:0/2644179250 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ba5b21bb30 msgr2=0x55ba5b2179c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:36.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.377+0000 7f8f79d98640 1 --2- 172.21.15.86:0/2644179250 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ba5b21bb30 0x55ba5b2179c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.377+0000 7f8f79d98640 1 -- 172.21.15.86:0/2644179250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba5b218f80 msgr2=0x55ba5b26e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:36.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.377+0000 7f8f79d98640 1 --2- 172.21.15.86:0/2644179250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba5b218f80 0x55ba5b26e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.377+0000 7f8f79d98640 1 -- 172.21.15.86:0/2644179250 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba5ae8f2d0 con 0x55ba5b21b750 2024-09-19T06:37:36.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.377+0000 7f8f7ad9a640 1 --2- 172.21.15.86:0/2644179250 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ba5b21bb30 0x55ba5b2179c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:36.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.377+0000 7f8f79d98640 1 --2- 172.21.15.86:0/2644179250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b21b750 0x55ba5b24ba90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8f6400c5e0 tx=0x7f8f6402d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e6c3f8e0fed122 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:36.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.377+0000 7f8f557fa640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T06:37:36.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.378+0000 7f8f557fa640 1 -- 172.21.15.86:0/2644179250 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f64004bf0 con 0x55ba5b21b750 2024-09-19T06:37:36.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.378+0000 7f8f557fa640 1 -- 172.21.15.86:0/2644179250 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8f64004d90 con 0x55ba5b21b750 2024-09-19T06:37:36.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.378+0000 7f8f7f680740 1 -- 172.21.15.86:0/2644179250 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f6c061d60 con 0x55ba5b21b750 2024-09-19T06:37:36.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.378+0000 7f8f557fa640 1 -- 172.21.15.86:0/2644179250 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f8f64007070 con 0x55ba5b21b750 2024-09-19T06:37:36.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.378+0000 7f8f7f680740 10 client.4707 fetch_fsmap learned FSMap version 9 2024-09-19T06:37:36.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.378+0000 7f8f7f680740 1 -- 172.21.15.86:0/2644179250 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55ba5af596b0 con 0x55ba5b21b750 2024-09-19T06:37:36.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.378+0000 7f8f557fa640 1 -- 172.21.15.86:0/2644179250 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f6c061d60 con 0x55ba5b21b750 2024-09-19T06:37:36.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.378+0000 7f8f557fa640 1 -- 172.21.15.86:0/2644179250 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f8f64043070 con 0x55ba5b21b750 2024-09-19T06:37:36.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.378+0000 7f8f7f680740 10 client.4707 fetch_fsmap finished waiting for FSMap version 9 2024-09-19T06:37:36.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.378+0000 7f8f7f680740 10 client.4707 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-19T06:37:36.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.378+0000 7f8f7f680740 20 client.4707 populate_metadata read hostname 'smithi086' 2024-09-19T06:37:36.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.378+0000 7f8f7f680740 1 --2- 172.21.15.86:0/2644179250 >> [v2:172.21.15.169:6836/201961024,v1:172.21.15.169:6837/201961024] conn(0x55ba5b23c0f0 0x55ba5b279700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.378+0000 7f8f7f680740 4 client.4707 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:37:36.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.378+0000 7f8f7f680740 1 -- 172.21.15.86:0/2644179250 --> [v2:172.21.15.169:6836/201961024,v1:172.21.15.169:6837/201961024] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba5b189c50 con 0x55ba5b23c0f0 2024-09-19T06:37:36.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.378+0000 7f8f7a599640 1 --2- 172.21.15.86:0/2644179250 >> [v2:172.21.15.169:6836/201961024,v1:172.21.15.169:6837/201961024] conn(0x55ba5b23c0f0 0x55ba5b279700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.379+0000 7f8f557fa640 10 client.4707 ms_handle_connect on v2:172.21.15.169:6836/201961024 2024-09-19T06:37:36.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.379+0000 7f8f7a599640 1 --2- 172.21.15.86:0/2644179250 >> [v2:172.21.15.169:6836/201961024,v1:172.21.15.169:6837/201961024] conn(0x55ba5b23c0f0 0x55ba5b279700 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84b8ee9e7f926900 server_cookie=72b0896cfd5c3e65 in_seq=0 out_seq=0 2024-09-19T06:37:36.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.379+0000 7f8f557fa640 1 -- 172.21.15.86:0/2644179250 <== mds.0 v2:172.21.15.169:6836/201961024 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ba5b189c50 con 0x55ba5b23c0f0 2024-09-19T06:37:36.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.379+0000 7f8f557fa640 10 client.4707 handle_command_reply: tid=0 2024-09-19T06:37:36.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.379+0000 7f8f7f680740 1 client.4707 shutdown 2024-09-19T06:37:36.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.380+0000 7f8f7f680740 1 -- 172.21.15.86:0/2644179250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b21b750 msgr2=0x55ba5b24ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:36.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.380+0000 7f8f7f680740 1 --2- 172.21.15.86:0/2644179250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b21b750 0x55ba5b24ba90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8f6400c5e0 tx=0x7f8f6402d000 comp rx=0 tx=0).stop 2024-09-19T06:37:36.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.380+0000 7f8f7f680740 1 -- 172.21.15.86:0/2644179250 shutdown_connections 2024-09-19T06:37:36.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.380+0000 7f8f7f680740 1 --2- 172.21.15.86:0/2644179250 >> [v2:172.21.15.169:6836/201961024,v1:172.21.15.169:6837/201961024] conn(0x55ba5b23c0f0 0x55ba5b279700 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.380+0000 7f8f7f680740 1 --2- 172.21.15.86:0/2644179250 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ba5b21bb30 0x55ba5b2179c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.380+0000 7f8f7f680740 1 --2- 172.21.15.86:0/2644179250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b21b750 0x55ba5b24ba90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.380+0000 7f8f7f680740 1 --2- 172.21.15.86:0/2644179250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba5b218f80 0x55ba5b26e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.380+0000 7f8f7f680740 1 -- 172.21.15.86:0/2644179250 >> 172.21.15.86:0/2644179250 conn(0x55ba5b219e70 msgr2=0x55ba5b25da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:36.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.380+0000 7f8f557fa640 0 client.4707 ms_handle_reset on v2:172.21.15.169:6836/201961024 2024-09-19T06:37:36.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.380+0000 7f8f7f680740 1 -- 172.21.15.86:0/2644179250 shutdown_connections 2024-09-19T06:37:36.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.380+0000 7f8f7f680740 1 -- 172.21.15.86:0/2644179250 wait complete. 2024-09-19T06:37:36.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.380+0000 7f8f7f680740 20 client.4707 trim_cache size 0 max 16384 2024-09-19T06:37:36.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.397+0000 7f8f7f680740 1 Processor -- start 2024-09-19T06:37:36.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.397+0000 7f8f7f680740 1 -- start start 2024-09-19T06:37:36.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.398+0000 7f8f7f680740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b218f80 0x55ba5b23da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.398+0000 7f8f7f680740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba5b21b750 0x55ba5b24a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.398+0000 7f8f7f680740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ba5b21bb30 0x55ba5b24ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.398+0000 7f8f7f680740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8f741fc040 con 0x55ba5b218f80 2024-09-19T06:37:36.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.398+0000 7f8f7f680740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ba5b24c790 con 0x55ba5b21b750 2024-09-19T06:37:36.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.398+0000 7f8f7f680740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55ba5b24c020 con 0x55ba5b21bb30 2024-09-19T06:37:36.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.398+0000 7f8f7a599640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b218f80 0x55ba5b23da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.398+0000 7f8f7a599640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b218f80 0x55ba5b23da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56888/0 (socket says 172.21.15.86:56888) 2024-09-19T06:37:36.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.398+0000 7f8f7a599640 1 -- 172.21.15.86:0/151198848 learned_addr learned my addr 172.21.15.86:0/151198848 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:36.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.398+0000 7f8f7a599640 1 -- 172.21.15.86:0/151198848 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ba5b21bb30 msgr2=0x55ba5b24ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:36.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.398+0000 7f8f7a599640 1 --2- 172.21.15.86:0/151198848 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ba5b21bb30 0x55ba5b24ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.398+0000 7f8f7a599640 1 -- 172.21.15.86:0/151198848 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba5b21b750 msgr2=0x55ba5b24a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:36.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.398+0000 7f8f7a599640 1 --2- 172.21.15.86:0/151198848 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba5b21b750 0x55ba5b24a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.398+0000 7f8f7a599640 1 -- 172.21.15.86:0/151198848 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba5b216760 con 0x55ba5b218f80 2024-09-19T06:37:36.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.399+0000 7f8f7a599640 1 --2- 172.21.15.86:0/151198848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b218f80 0x55ba5b23da70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8f70002230 tx=0x7f8f70015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588bf246356f7d4e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:36.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.399+0000 7f8f577fe640 1 -- 172.21.15.86:0/151198848 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f700075b0 con 0x55ba5b218f80 2024-09-19T06:37:36.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.399+0000 7f8f577fe640 1 -- 172.21.15.86:0/151198848 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f70007750 con 0x55ba5b218f80 2024-09-19T06:37:36.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.399+0000 7f8f577fe640 1 -- 172.21.15.86:0/151198848 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f70015440 con 0x55ba5b218f80 2024-09-19T06:37:36.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.399+0000 7f8f7f680740 1 -- 172.21.15.86:0/151198848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b218f80 msgr2=0x55ba5b23da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:36.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.399+0000 7f8f7f680740 1 --2- 172.21.15.86:0/151198848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b218f80 0x55ba5b23da70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8f70002230 tx=0x7f8f70015000 comp rx=0 tx=0).stop 2024-09-19T06:37:36.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.399+0000 7f8f7f680740 1 -- 172.21.15.86:0/151198848 shutdown_connections 2024-09-19T06:37:36.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.399+0000 7f8f7f680740 1 --2- 172.21.15.86:0/151198848 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ba5b21bb30 0x55ba5b24ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.399+0000 7f8f7f680740 1 --2- 172.21.15.86:0/151198848 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba5b21b750 0x55ba5b24a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.399+0000 7f8f7f680740 1 --2- 172.21.15.86:0/151198848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b218f80 0x55ba5b23da70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.399+0000 7f8f7f680740 1 -- 172.21.15.86:0/151198848 >> 172.21.15.86:0/151198848 conn(0x55ba5b219e70 msgr2=0x55ba5b23c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:36.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.399+0000 7f8f7f680740 1 -- 172.21.15.86:0/151198848 shutdown_connections 2024-09-19T06:37:36.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.399+0000 7f8f7f680740 1 -- 172.21.15.86:0/151198848 wait complete. 2024-09-19T06:37:36.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.400+0000 7f8f7f680740 1 -- start start 2024-09-19T06:37:36.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.400+0000 7f8f7f680740 1 Processor -- start 2024-09-19T06:37:36.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.401+0000 7f8f7f680740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba5b218f80 0x55ba5b2dcb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.401+0000 7f8f7f680740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b21b750 0x55ba5b234e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.401+0000 7f8f7f680740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ba5b21bb30 0x55ba5b2d2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.401+0000 7f8f7f680740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ba5b23cc30 con 0x55ba5b21b750 2024-09-19T06:37:36.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.401+0000 7f8f7f680740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ba5b241e00 con 0x55ba5b218f80 2024-09-19T06:37:36.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.401+0000 7f8f7f680740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55ba5b2184e0 con 0x55ba5b21bb30 2024-09-19T06:37:36.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.401+0000 7f8f7f680740 10 client.0 _ll_register_callbacks cb 0x7f8f6c009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:37:36.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.401+0000 7f8f79d98640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b21b750 0x55ba5b234e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.401+0000 7f8f79d98640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b21b750 0x55ba5b234e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56896/0 (socket says 172.21.15.86:56896) 2024-09-19T06:37:36.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.401+0000 7f8f79d98640 1 -- 172.21.15.86:0/1619111091 learned_addr learned my addr 172.21.15.86:0/1619111091 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:36.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.401+0000 7f8f79d98640 1 -- 172.21.15.86:0/1619111091 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ba5b21bb30 msgr2=0x55ba5b2d2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:36.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.401+0000 7f8f79d98640 1 --2- 172.21.15.86:0/1619111091 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ba5b21bb30 0x55ba5b2d2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.401+0000 7f8f79d98640 1 -- 172.21.15.86:0/1619111091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba5b218f80 msgr2=0x55ba5b2dcb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:36.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.401+0000 7f8f79d98640 1 --2- 172.21.15.86:0/1619111091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba5b218f80 0x55ba5b2dcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.401+0000 7f8f79d98640 1 -- 172.21.15.86:0/1619111091 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba5b2dd0d0 con 0x55ba5b21b750 2024-09-19T06:37:36.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.401+0000 7f8f79d98640 1 --2- 172.21.15.86:0/1619111091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b21b750 0x55ba5b234e20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8f64007470 tx=0x7f8f740c7470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aab04f798fc6fd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:36.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.401+0000 7f8f557fa640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T06:37:36.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.401+0000 7f8f557fa640 1 -- 172.21.15.86:0/1619111091 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f64004bf0 con 0x55ba5b21b750 2024-09-19T06:37:36.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.401+0000 7f8f557fa640 1 -- 172.21.15.86:0/1619111091 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8f64004d90 con 0x55ba5b21b750 2024-09-19T06:37:36.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.401+0000 7f8f7f680740 1 -- 172.21.15.86:0/1619111091 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f70007750 con 0x55ba5b21b750 2024-09-19T06:37:36.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.402+0000 7f8f557fa640 1 -- 172.21.15.86:0/1619111091 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f8f64058050 con 0x55ba5b21b750 2024-09-19T06:37:36.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.402+0000 7f8f7f680740 10 client.4713 fetch_fsmap learned FSMap version 9 2024-09-19T06:37:36.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.402+0000 7f8f7f680740 1 -- 172.21.15.86:0/1619111091 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55ba5b2dc670 con 0x55ba5b21b750 2024-09-19T06:37:36.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.402+0000 7f8f557fa640 1 -- 172.21.15.86:0/1619111091 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f70007750 con 0x55ba5b21b750 2024-09-19T06:37:36.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.402+0000 7f8f557fa640 1 -- 172.21.15.86:0/1619111091 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f8f6405b020 con 0x55ba5b21b750 2024-09-19T06:37:36.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.402+0000 7f8f7f680740 10 client.4713 fetch_fsmap finished waiting for FSMap version 9 2024-09-19T06:37:36.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.402+0000 7f8f7f680740 10 client.4713 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-19T06:37:36.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.402+0000 7f8f7f680740 20 client.4713 populate_metadata read hostname 'smithi086' 2024-09-19T06:37:36.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.402+0000 7f8f7f680740 1 --2- 172.21.15.86:0/1619111091 >> [v2:172.21.15.169:6836/201961024,v1:172.21.15.169:6837/201961024] conn(0x55ba5b24ea20 0x55ba5b2e5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.402+0000 7f8f7f680740 4 client.4713 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:37:36.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.402+0000 7f8f7f680740 1 -- 172.21.15.86:0/1619111091 --> [v2:172.21.15.169:6836/201961024,v1:172.21.15.169:6837/201961024] -- command(tid 0: {"prefix": "status"}) -- 0x55ba5b183fa0 con 0x55ba5b24ea20 2024-09-19T06:37:36.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.402+0000 7f8f7a599640 1 --2- 172.21.15.86:0/1619111091 >> [v2:172.21.15.169:6836/201961024,v1:172.21.15.169:6837/201961024] conn(0x55ba5b24ea20 0x55ba5b2e5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.403+0000 7f8f557fa640 10 client.4713 ms_handle_connect on v2:172.21.15.169:6836/201961024 2024-09-19T06:37:36.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.403+0000 7f8f7a599640 1 --2- 172.21.15.86:0/1619111091 >> [v2:172.21.15.169:6836/201961024,v1:172.21.15.169:6837/201961024] conn(0x55ba5b24ea20 0x55ba5b2e5630 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa249aca89ce30c1 server_cookie=b958e3d6904b6ad0 in_seq=0 out_seq=0 2024-09-19T06:37:36.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.403+0000 7f8f557fa640 1 -- 172.21.15.86:0/1619111091 <== mds.0 v2:172.21.15.169:6836/201961024 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55ba5b183fa0 con 0x55ba5b24ea20 2024-09-19T06:37:36.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.403+0000 7f8f557fa640 10 client.4713 handle_command_reply: tid=0 2024-09-19T06:37:36.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.403+0000 7f8f7f680740 1 client.4713 shutdown 2024-09-19T06:37:36.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.403+0000 7f8f7f680740 1 -- 172.21.15.86:0/1619111091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b21b750 msgr2=0x55ba5b234e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:36.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.403+0000 7f8f7f680740 1 --2- 172.21.15.86:0/1619111091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b21b750 0x55ba5b234e20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8f64007470 tx=0x7f8f740c7470 comp rx=0 tx=0).stop 2024-09-19T06:37:36.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.403+0000 7f8f7f680740 1 -- 172.21.15.86:0/1619111091 shutdown_connections 2024-09-19T06:37:36.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.403+0000 7f8f7f680740 1 --2- 172.21.15.86:0/1619111091 >> [v2:172.21.15.169:6836/201961024,v1:172.21.15.169:6837/201961024] conn(0x55ba5b24ea20 0x55ba5b2e5630 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.403+0000 7f8f7f680740 1 --2- 172.21.15.86:0/1619111091 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ba5b21bb30 0x55ba5b2d2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.403+0000 7f8f7f680740 1 --2- 172.21.15.86:0/1619111091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba5b21b750 0x55ba5b234e20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.403+0000 7f8f7f680740 1 --2- 172.21.15.86:0/1619111091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba5b218f80 0x55ba5b2dcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.403+0000 7f8f557fa640 0 client.4713 ms_handle_reset on v2:172.21.15.169:6836/201961024 2024-09-19T06:37:36.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.403+0000 7f8f7f680740 1 -- 172.21.15.86:0/1619111091 >> 172.21.15.86:0/1619111091 conn(0x55ba5b219e70 msgr2=0x55ba5b214b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:36.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.403+0000 7f8f7f680740 1 -- 172.21.15.86:0/1619111091 shutdown_connections 2024-09-19T06:37:36.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.403+0000 7f8f7f680740 1 -- 172.21.15.86:0/1619111091 wait complete. 2024-09-19T06:37:36.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.403+0000 7f8f7f680740 20 client.4713 trim_cache size 0 max 16384 2024-09-19T06:37:36.411 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-19T06:37:36.411 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "1785f09f-0959-457d-8c4a-6cce2e655a37", 2024-09-19T06:37:36.412 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2024-09-19T06:37:36.412 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 4285, 2024-09-19T06:37:36.412 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-09-19T06:37:36.412 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-09-19T06:37:36.412 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-09-19T06:37:36.412 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 26.981360089999999, 2024-09-19T06:37:36.412 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 9, 2024-09-19T06:37:36.412 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 26, 2024-09-19T06:37:36.412 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 26, 2024-09-19T06:37:36.412 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 32.993504647000002 2024-09-19T06:37:36.412 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-19T06:37:36.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.403+0000 7f8f7c7fd640 1 -- 172.21.15.86:0/2530843225 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8f5806c2e0 msgr2=0x7f8f5806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:36.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.403+0000 7f8f7c7fd640 1 --2- 172.21.15.86:0/2530843225 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8f5806c2e0 0x7f8f5806e7a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8f70001ee0 tx=0x7f8f70009040 comp rx=0 tx=0).stop 2024-09-19T06:37:36.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.404+0000 7f8f7c7fd640 1 -- 172.21.15.86:0/2530843225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f741540c0 msgr2=0x7f8f74155dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:36.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.404+0000 7f8f7c7fd640 1 --2- 172.21.15.86:0/2530843225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f741540c0 0x7f8f74155dd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8f740c9450 tx=0x7f8f6c011cf0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.404+0000 7f8f7c7fd640 1 -- 172.21.15.86:0/2530843225 shutdown_connections 2024-09-19T06:37:36.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.404+0000 7f8f7c7fd640 1 --2- 172.21.15.86:0/2530843225 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8f5806c2e0 0x7f8f5806e7a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.404+0000 7f8f7c7fd640 1 --2- 172.21.15.86:0/2530843225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f741540c0 0x7f8f74155dd0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.404+0000 7f8f7c7fd640 1 --2- 172.21.15.86:0/2530843225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f74155490 0x7f8f74153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.404+0000 7f8f7c7fd640 1 --2- 172.21.15.86:0/2530843225 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f60003f60 0x7f8f74154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.404+0000 7f8f7c7fd640 1 -- 172.21.15.86:0/2530843225 >> 172.21.15.86:0/2530843225 conn(0x7f8f74070d10 msgr2=0x7f8f7414c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:36.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.404+0000 7f8f7c7fd640 1 -- 172.21.15.86:0/2530843225 shutdown_connections 2024-09-19T06:37:36.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.404+0000 7f8f7c7fd640 1 -- 172.21.15.86:0/2530843225 wait complete. 2024-09-19T06:37:36.416 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T06:37:36.425 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T06:37:36.425 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T06:37:36.426 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T06:37:36.426 INFO:teuthology.run_tasks:Running task kclient... 2024-09-19T06:37:36.472 INFO:tasks.kclient:Mounting kernel clients... 2024-09-19T06:37:36.472 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-19T06:37:36.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:37:36.472 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2024-09-19T06:37:36.488 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-19T06:37:36.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:37:36.489 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T06:37:36.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:37:36.554 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link delete ceph-brx 2024-09-19T06:37:36.659 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-09-19T06:37:36.659 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T06:37:36.659 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T06:37:36.659 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T06:37:36.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.758+0000 7f626b4b7640 1 Processor -- start 2024-09-19T06:37:36.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.758+0000 7f626b4b7640 1 -- start start 2024-09-19T06:37:36.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.759+0000 7f626b4b7640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6264152060 0x7f6264072d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.759+0000 7f626b4b7640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6264158710 con 0x7f62640c3680 2024-09-19T06:37:36.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.759+0000 7f626b4b7640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62641589b0 con 0x7f626406bd10 2024-09-19T06:37:36.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.759+0000 7f626b4b7640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f62640716c0 con 0x7f6264152060 2024-09-19T06:37:36.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.759+0000 7f6269a54640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f62640c3680 0x7f62640720d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:35230/0 (socket says 172.21.15.86:35230) 2024-09-19T06:37:36.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.759+0000 7f6269a54640 1 -- 172.21.15.86:0/1395240920 learned_addr learned my addr 172.21.15.86:0/1395240920 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:36.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.759+0000 7f6269253640 1 --2- 172.21.15.86:0/1395240920 >> v2:172.21.15.169:3300/0 conn(0x7f6264152060 0x7f6264072d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.759+0000 7f625bfff640 1 -- 172.21.15.86:0/1395240920 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1236519013 0 0) 0x7f6264158710 con 0x7f62640c3680 2024-09-19T06:37:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.759+0000 7f625bfff640 1 -- 172.21.15.86:0/1395240920 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6250003520 con 0x7f62640c3680 2024-09-19T06:37:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.759+0000 7f625bfff640 1 -- 172.21.15.86:0/1395240920 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1487678315 0 0) 0x7f62641589b0 con 0x7f626406bd10 2024-09-19T06:37:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.759+0000 7f625bfff640 1 -- 172.21.15.86:0/1395240920 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6264158710 con 0x7f626406bd10 2024-09-19T06:37:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.759+0000 7f625bfff640 1 -- 172.21.15.86:0/1395240920 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2295618605 0 0) 0x7f6250003520 con 0x7f62640c3680 2024-09-19T06:37:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.759+0000 7f625bfff640 1 -- 172.21.15.86:0/1395240920 >> v2:172.21.15.169:3300/0 conn(0x7f6264152060 msgr2=0x7f6264072d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.759+0000 7f625bfff640 1 --2- 172.21.15.86:0/1395240920 >> v2:172.21.15.169:3300/0 conn(0x7f6264152060 0x7f6264072d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.759+0000 7f625bfff640 1 -- 172.21.15.86:0/1395240920 >> v1:172.21.15.169:6789/0 conn(0x7f626406bd10 legacy=0x7f62640719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.759+0000 7f625bfff640 1 -- 172.21.15.86:0/1395240920 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6264071070 con 0x7f62640c3680 2024-09-19T06:37:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.759+0000 7f625bfff640 1 -- 172.21.15.86:0/1395240920 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f625c0019f0 con 0x7f62640c3680 2024-09-19T06:37:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.759+0000 7f625bfff640 1 -- 172.21.15.86:0/1395240920 >> v1:172.21.15.86:6789/0 conn(0x7f62640c3680 legacy=0x7f62640720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.759+0000 7f625bfff640 1 --2- 172.21.15.86:0/1395240920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6250003b40 0x7f6250003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.760+0000 7f625bfff640 1 --2- 172.21.15.86:0/1395240920 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6250004800 0x7f6250004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.760+0000 7f625bfff640 1 --2- 172.21.15.86:0/1395240920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62500051c0 0x7f625000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.760+0000 7f625bfff640 1 -- 172.21.15.86:0/1395240920 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f62640716c0 con 0x7f6250003b40 2024-09-19T06:37:36.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.760+0000 7f625bfff640 1 -- 172.21.15.86:0/1395240920 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f625000bfb0 con 0x7f62500051c0 2024-09-19T06:37:36.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.760+0000 7f625bfff640 1 -- 172.21.15.86:0/1395240920 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f625000c1b0 con 0x7f6250004800 2024-09-19T06:37:36.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.760+0000 7f6269253640 1 --2- 172.21.15.86:0/1395240920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6250003b40 0x7f6250003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.760+0000 7f6268a52640 1 --2- 172.21.15.86:0/1395240920 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6250004800 0x7f6250004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.760+0000 7f6269a54640 1 --2- 172.21.15.86:0/1395240920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62500051c0 0x7f625000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.760+0000 7f6269253640 1 -- 172.21.15.86:0/1395240920 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6250004800 msgr2=0x7f6250004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:36.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.760+0000 7f6269253640 1 --2- 172.21.15.86:0/1395240920 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6250004800 0x7f6250004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.760+0000 7f6269253640 1 -- 172.21.15.86:0/1395240920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62500051c0 msgr2=0x7f625000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:36.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.760+0000 7f6269253640 1 --2- 172.21.15.86:0/1395240920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62500051c0 0x7f625000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.760+0000 7f6269253640 1 -- 172.21.15.86:0/1395240920 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6250003520 con 0x7f6250003b40 2024-09-19T06:37:36.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.760+0000 7f6269a54640 1 -- 172.21.15.86:0/1395240920 reap_dead start 2024-09-19T06:37:36.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.760+0000 7f6268a52640 1 --2- 172.21.15.86:0/1395240920 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6250004800 0x7f6250004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:36.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.761+0000 7f6269253640 1 --2- 172.21.15.86:0/1395240920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6250003b40 0x7f6250003f40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6260009a90 tx=0x7f6250005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a537f93fe6bc4184 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:36.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.761+0000 7f625bfff640 1 -- 172.21.15.86:0/1395240920 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6260036070 con 0x7f6250003b40 2024-09-19T06:37:36.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.761+0000 7f625bfff640 1 -- 172.21.15.86:0/1395240920 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6260031400 con 0x7f6250003b40 2024-09-19T06:37:36.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.761+0000 7f625bfff640 1 -- 172.21.15.86:0/1395240920 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6260009690 con 0x7f6250003b40 2024-09-19T06:37:36.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.761+0000 7f626b4b7640 1 -- 172.21.15.86:0/1395240920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6250003b40 msgr2=0x7f6250003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:36.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.761+0000 7f626b4b7640 1 --2- 172.21.15.86:0/1395240920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6250003b40 0x7f6250003f40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6260009a90 tx=0x7f6250005830 comp rx=0 tx=0).stop 2024-09-19T06:37:36.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.761+0000 7f626b4b7640 1 -- 172.21.15.86:0/1395240920 shutdown_connections 2024-09-19T06:37:36.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.761+0000 7f626b4b7640 1 --2- 172.21.15.86:0/1395240920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6250003b40 0x7f6250003f40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.761+0000 7f626b4b7640 1 -- 172.21.15.86:0/1395240920 >> 172.21.15.86:0/1395240920 conn(0x7f62640c9280 msgr2=0x7f62640c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:36.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.761+0000 7f626b4b7640 1 -- 172.21.15.86:0/1395240920 shutdown_connections 2024-09-19T06:37:36.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.761+0000 7f626b4b7640 1 -- 172.21.15.86:0/1395240920 wait complete. 2024-09-19T06:37:36.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.762+0000 7f626b4b7640 1 Processor -- start 2024-09-19T06:37:36.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.763+0000 7f626b4b7640 1 -- start start 2024-09-19T06:37:36.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.763+0000 7f626b4b7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6250003b40 0x7f626414fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.763+0000 7f626b4b7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6264155af0 0x7f6264147fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.763+0000 7f626b4b7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62641ee670 0x7f6264148520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.763+0000 7f626b4b7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f62640c9e10 con 0x7f6250003b40 2024-09-19T06:37:36.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.763+0000 7f626b4b7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6264152440 con 0x7f62641ee670 2024-09-19T06:37:36.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.763+0000 7f626b4b7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6264072d90 con 0x7f6264155af0 2024-09-19T06:37:36.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.763+0000 7f6269253640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6250003b40 0x7f626414fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.763+0000 7f6269253640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6250003b40 0x7f626414fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56910/0 (socket says 172.21.15.86:56910) 2024-09-19T06:37:36.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.763+0000 7f6269253640 1 -- 172.21.15.86:0/730662765 learned_addr learned my addr 172.21.15.86:0/730662765 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:36.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.763+0000 7f6268a52640 1 --2- 172.21.15.86:0/730662765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6264155af0 0x7f6264147fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.763+0000 7f6269a54640 1 --2- 172.21.15.86:0/730662765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62641ee670 0x7f6264148520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.764+0000 7f6269253640 1 -- 172.21.15.86:0/730662765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6264155af0 msgr2=0x7f6264147fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:36.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.764+0000 7f6269253640 1 --2- 172.21.15.86:0/730662765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6264155af0 0x7f6264147fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.764+0000 7f6269253640 1 -- 172.21.15.86:0/730662765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62641ee670 msgr2=0x7f6264148520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:36.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.764+0000 7f6269253640 1 --2- 172.21.15.86:0/730662765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62641ee670 0x7f6264148520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.764+0000 7f6269253640 1 -- 172.21.15.86:0/730662765 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62641eebb0 con 0x7f6250003b40 2024-09-19T06:37:36.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.764+0000 7f6269253640 1 --2- 172.21.15.86:0/730662765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6250003b40 0x7f626414fbb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6260009bb0 tx=0x7f6260004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:36.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.764+0000 7f6259ffb640 1 -- 172.21.15.86:0/730662765 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6260041020 con 0x7f6250003b40 2024-09-19T06:37:36.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.764+0000 7f6259ffb640 1 -- 172.21.15.86:0/730662765 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6260003be0 con 0x7f6250003b40 2024-09-19T06:37:36.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.764+0000 7f626b4b7640 1 -- 172.21.15.86:0/730662765 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62641f12e0 con 0x7f6250003b40 2024-09-19T06:37:36.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.764+0000 7f6259ffb640 1 -- 172.21.15.86:0/730662765 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6260036040 con 0x7f6250003b40 2024-09-19T06:37:36.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.764+0000 7f626b4b7640 1 -- 172.21.15.86:0/730662765 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62641f1860 con 0x7f6250003b40 2024-09-19T06:37:36.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.765+0000 7f626b4b7640 1 -- 172.21.15.86:0/730662765 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62640c49a0 con 0x7f6250003b40 2024-09-19T06:37:36.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.766+0000 7f6259ffb640 1 -- 172.21.15.86:0/730662765 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6260044020 con 0x7f6250003b40 2024-09-19T06:37:36.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.766+0000 7f6259ffb640 1 --2- 172.21.15.86:0/730662765 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f624806c2e0 0x7f624806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.766+0000 7f6259ffb640 1 -- 172.21.15.86:0/730662765 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f62600ac090 con 0x7f6250003b40 2024-09-19T06:37:36.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.766+0000 7f6268a52640 1 --2- 172.21.15.86:0/730662765 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f624806c2e0 0x7f624806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.766+0000 7f6268a52640 1 --2- 172.21.15.86:0/730662765 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f624806c2e0 0x7f624806e7a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f62640c7a60 tx=0x7f6254009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:36.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.770+0000 7f6259ffb640 1 -- 172.21.15.86:0/730662765 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f62640c49a0 con 0x7f6250003b40 2024-09-19T06:37:36.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.969+0000 7f626b4b7640 1 -- 172.21.15.86:0/730662765 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f62641589b0 con 0x7f6250003b40 2024-09-19T06:37:36.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.970+0000 7f6259ffb640 1 -- 172.21.15.86:0/730662765 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f62641589b0 con 0x7f6250003b40 2024-09-19T06:37:36.972 INFO:teuthology.orchestra.run.smithi086.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-19T06:37:36.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.972+0000 7f626b4b7640 1 -- 172.21.15.86:0/730662765 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f624806c2e0 msgr2=0x7f624806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:36.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.972+0000 7f626b4b7640 1 --2- 172.21.15.86:0/730662765 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f624806c2e0 0x7f624806e7a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f62640c7a60 tx=0x7f6254009040 comp rx=0 tx=0).stop 2024-09-19T06:37:36.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.972+0000 7f626b4b7640 1 -- 172.21.15.86:0/730662765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6250003b40 msgr2=0x7f626414fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:36.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.972+0000 7f626b4b7640 1 --2- 172.21.15.86:0/730662765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6250003b40 0x7f626414fbb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6260009bb0 tx=0x7f6260004730 comp rx=0 tx=0).stop 2024-09-19T06:37:36.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.972+0000 7f626b4b7640 1 -- 172.21.15.86:0/730662765 shutdown_connections 2024-09-19T06:37:36.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.972+0000 7f626b4b7640 1 --2- 172.21.15.86:0/730662765 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f624806c2e0 0x7f624806e7a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.972+0000 7f626b4b7640 1 --2- 172.21.15.86:0/730662765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62641ee670 0x7f6264148520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.972+0000 7f626b4b7640 1 --2- 172.21.15.86:0/730662765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6264155af0 0x7f6264147fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.972+0000 7f626b4b7640 1 --2- 172.21.15.86:0/730662765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6250003b40 0x7f626414fbb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.972+0000 7f626b4b7640 1 -- 172.21.15.86:0/730662765 >> 172.21.15.86:0/730662765 conn(0x7f62640c9280 msgr2=0x7f62640c5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:36.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.972+0000 7f626b4b7640 1 -- 172.21.15.86:0/730662765 shutdown_connections 2024-09-19T06:37:36.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:36.972+0000 7f626b4b7640 1 -- 172.21.15.86:0/730662765 wait complete. 2024-09-19T06:37:36.984 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T06:37:36.985 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T06:37:36.985 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2024-09-19T06:37:36.985 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T06:37:36.985 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T06:37:36.985 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T06:37:36.985 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T06:37:36.986 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T06:37:36.986 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T06:37:36.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:37:36.986 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2024-09-19T06:37:37.002 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T06:37:37.002 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T06:37:37.002 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T06:37:37.002 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:37:37.002 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2024-09-19T06:37:37.002 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:37:37.002 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:37:37.002 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:37:37.002 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f0 2024-09-19T06:37:37.003 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:37:37.003 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:37:37.003 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f1 2024-09-19T06:37:37.003 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:37:37.003 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:37:37.003 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T06:37:37.003 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:37:37.003 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T06:37:37.003 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42752sec preferred_lft 42752sec 2024-09-19T06:37:37.003 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link noprefixroute 2024-09-19T06:37:37.003 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:37:37.004 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T06:37:37.004 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:37:37.004 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-19T06:37:37.004 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add name ceph-brx type bridge 2024-09-19T06:37:37.004 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip addr flush dev ceph-brx 2024-09-19T06:37:37.004 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set ceph-brx up 2024-09-19T06:37:37.004 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T06:37:37.004 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-19T06:37:37.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:37:37.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:37:37.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:37:37.141 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T06:37:37.164 INFO:teuthology.orchestra.run.smithi086.stdout:1 2024-09-19T06:37:37.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:37:37.165 DEBUG:teuthology.orchestra.run.smithi086:> route 2024-09-19T06:37:37.222 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2024-09-19T06:37:37.222 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T06:37:37.223 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T06:37:37.223 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T06:37:37.223 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T06:37:37.223 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:37:37.223 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-19T06:37:37.223 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T06:37:37.223 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T06:37:37.223 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T06:37:37.223 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-19T06:37:37.261 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:37:37.265 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:37:37.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:37:37.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:37:37.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:37:37.349 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2024-09-19T06:37:37.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:37:37.405 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list-id 2024-09-19T06:37:37.461 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:37:37.461 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-19T06:37:37.461 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:37:37.461 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T06:37:37.461 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-19T06:37:37.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:37:37.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:37:37.578 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T06:37:37.579 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:37:37.579 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-19T06:37:37.579 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T06:37:37.579 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T06:37:37.579 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T06:37:37.579 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T06:37:37.579 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T06:37:37.579 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-19T06:37:37.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:37:37.685 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:37:37.692 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:37:37.692 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-19T06:37:37.692 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2024-09-19T06:37:37.692 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T06:37:37.692 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-19T06:37:37.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:37:37.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:37:37.768 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T06:37:37.768 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T06:37:37.783 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T06:37:37.783 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T06:37:37.783 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T06:37:37.839 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-19T06:37:37.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:37:37.840 DEBUG:teuthology.orchestra.run.smithi086:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-19T06:37:37.923 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-19T06:37:37.924 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-19T06:37:38.060 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-19T06:37:38.060 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-19T06:37:38.060 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.86:3300,172.21.15.169:3300,172.21.15.169:3301" 2024-09-19T06:37:38.060 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 0@1785f09f-0959-457d-8c4a-6cce2e655a37.cephfs=/ 2024-09-19T06:37:38.060 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.86:3300/172.21.15.169:3300/172.21.15.169:3301" will pass to kernel 2024-09-19T06:37:38.061 INFO:teuthology.orchestra.run.smithi086.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T06:37:38.061 INFO:teuthology.orchestra.run.smithi086.stdout: You just mounted a file system that supports labels which does not 2024-09-19T06:37:38.061 INFO:teuthology.orchestra.run.smithi086.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T06:37:38.061 INFO:teuthology.orchestra.run.smithi086.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T06:37:38.061 INFO:teuthology.orchestra.run.smithi086.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T06:37:38.062 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T06:37:38.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:37:38.063 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T06:37:38.088 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T06:37:38.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T06:37:38.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:37:38.185 INFO:teuthology.orchestra.run.smithi086.stdout:client4722 2024-09-19T06:37:38.185 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:37:38.185 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T06:37:38.201 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T06:37:38.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T06:37:38.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:37:38.297 INFO:teuthology.orchestra.run.smithi086.stdout:client4722 2024-09-19T06:37:38.297 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T06:37:38.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T06:37:38.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:37:38.354 INFO:teuthology.orchestra.run.smithi086.stdout:client4722 2024-09-19T06:37:38.355 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/1785f09f-0959-457d-8c4a-6cce2e655a37.client4722/status') 2024-09-19T06:37:38.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:37:38.414 INFO:teuthology.orchestra.run.smithi086.stdout:instance: client.4722 (3)192.168.0.1:0/2381636635 2024-09-19T06:37:38.414 INFO:teuthology.orchestra.run.smithi086.stdout:blocklisted: false 2024-09-19T06:37:38.414 INFO:teuthology.orchestra.run.smithi086.stderr:0+1 records in 2024-09-19T06:37:38.414 INFO:teuthology.orchestra.run.smithi086.stderr:0+1 records out 2024-09-19T06:37:38.414 INFO:teuthology.orchestra.run.smithi086.stderr:69 bytes copied, 2.5859e-05 s, 2.7 MB/s 2024-09-19T06:37:38.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:37:38.421 INFO:teuthology.run_tasks:Running task mds_thrash... 2024-09-19T06:37:38.436 INFO:tasks.mds_thrash:mds thrasher using random seed: 1726727858 2024-09-19T06:37:38.436 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T06:37:38.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.537+0000 7f43b9111640 1 Processor -- start 2024-09-19T06:37:38.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.537+0000 7f43b9111640 1 -- start start 2024-09-19T06:37:38.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.538+0000 7f43b9111640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f43b4152060 0x7f43b4072d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:38.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.538+0000 7f43b9111640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43b40c3680 0x7f43b40732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:38.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.538+0000 7f43b9111640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43b4158710 con 0x7f43b406bd10 2024-09-19T06:37:38.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.538+0000 7f43b9111640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f43b40716c0 con 0x7f43b4152060 2024-09-19T06:37:38.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.538+0000 7f43b9111640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f43b4152440 con 0x7f43b40c3680 2024-09-19T06:37:38.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.538+0000 7f43b2d9d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f43b4152060 0x7f43b4072d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:38.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.538+0000 7f43abfff640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f43b406bd10 0x7f43b40719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:35232/0 (socket says 172.21.15.86:35232) 2024-09-19T06:37:38.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.538+0000 7f43abfff640 1 -- 172.21.15.86:0/1642040858 learned_addr learned my addr 172.21.15.86:0/1642040858 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:38.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.538+0000 7f43b2d9d640 1 -- 172.21.15.86:0/1642040858 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43b40c3680 msgr2=0x7f43b40732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:38.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.538+0000 7f43b2d9d640 1 --2- 172.21.15.86:0/1642040858 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43b40c3680 0x7f43b40732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:38.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.538+0000 7f43b2d9d640 1 -- 172.21.15.86:0/1642040858 >> v1:172.21.15.86:6789/0 conn(0x7f43b406bd10 legacy=0x7f43b40719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:38.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.538+0000 7f43b2d9d640 1 -- 172.21.15.86:0/1642040858 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b41589b0 con 0x7f43b4152060 2024-09-19T06:37:38.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.539+0000 7f43b2d9d640 1 --2- 172.21.15.86:0/1642040858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b4152060 0x7f43b4072d90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f43b4071840 tx=0x7f43a402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80cb56ecc8447584 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:38.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.539+0000 7f43b259c640 1 -- 172.21.15.86:0/1642040858 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4037070 con 0x7f43b4152060 2024-09-19T06:37:38.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.539+0000 7f43b259c640 1 -- 172.21.15.86:0/1642040858 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a4032440 con 0x7f43b4152060 2024-09-19T06:37:38.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.539+0000 7f43b259c640 1 -- 172.21.15.86:0/1642040858 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4032810 con 0x7f43b4152060 2024-09-19T06:37:38.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.540+0000 7f43b9111640 1 -- 172.21.15.86:0/1642040858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b4152060 msgr2=0x7f43b4072d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:38.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.540+0000 7f43b9111640 1 --2- 172.21.15.86:0/1642040858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b4152060 0x7f43b4072d90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f43b4071840 tx=0x7f43a402a210 comp rx=0 tx=0).stop 2024-09-19T06:37:38.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.540+0000 7f43b9111640 1 -- 172.21.15.86:0/1642040858 shutdown_connections 2024-09-19T06:37:38.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.540+0000 7f43b9111640 1 --2- 172.21.15.86:0/1642040858 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43b40c3680 0x7f43b40732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:38.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.540+0000 7f43b9111640 1 --2- 172.21.15.86:0/1642040858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b4152060 0x7f43b4072d90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:38.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.540+0000 7f43b9111640 1 -- 172.21.15.86:0/1642040858 >> 172.21.15.86:0/1642040858 conn(0x7f43b40c9280 msgr2=0x7f43b40c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:38.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.540+0000 7f43b9111640 1 -- 172.21.15.86:0/1642040858 shutdown_connections 2024-09-19T06:37:38.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.540+0000 7f43b9111640 1 -- 172.21.15.86:0/1642040858 wait complete. 2024-09-19T06:37:38.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.542+0000 7f43b9111640 1 Processor -- start 2024-09-19T06:37:38.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.542+0000 7f43b9111640 1 -- start start 2024-09-19T06:37:38.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.543+0000 7f43b9111640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43b406bd10 0x7f43b4150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:38.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.543+0000 7f43b9111640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43b40c3680 0x7f43b41e1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:38.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.543+0000 7f43b9111640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b4152060 0x7f43b41e1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:38.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.543+0000 7f43b9111640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f43b40c9e10 con 0x7f43b4152060 2024-09-19T06:37:38.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.543+0000 7f43b9111640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f43b4071350 con 0x7f43b40c3680 2024-09-19T06:37:38.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.543+0000 7f43b9111640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f43b40720d0 con 0x7f43b406bd10 2024-09-19T06:37:38.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.543+0000 7f43b359e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b4152060 0x7f43b41e1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:38.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.543+0000 7f43b359e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b4152060 0x7f43b41e1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56938/0 (socket says 172.21.15.86:56938) 2024-09-19T06:37:38.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.543+0000 7f43b359e640 1 -- 172.21.15.86:0/2694748952 learned_addr learned my addr 172.21.15.86:0/2694748952 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:38.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.543+0000 7f43abfff640 1 --2- 172.21.15.86:0/2694748952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43b40c3680 0x7f43b41e1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:38.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.543+0000 7f43b2d9d640 1 --2- 172.21.15.86:0/2694748952 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43b406bd10 0x7f43b4150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:38.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.544+0000 7f43b359e640 1 -- 172.21.15.86:0/2694748952 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43b406bd10 msgr2=0x7f43b4150eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:38.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.544+0000 7f43b359e640 1 --2- 172.21.15.86:0/2694748952 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43b406bd10 0x7f43b4150eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:38.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.544+0000 7f43b359e640 1 -- 172.21.15.86:0/2694748952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43b40c3680 msgr2=0x7f43b41e1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:38.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.544+0000 7f43b359e640 1 --2- 172.21.15.86:0/2694748952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43b40c3680 0x7f43b41e1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:38.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.544+0000 7f43b359e640 1 -- 172.21.15.86:0/2694748952 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b41e1130 con 0x7f43b4152060 2024-09-19T06:37:38.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.544+0000 7f43b359e640 1 --2- 172.21.15.86:0/2694748952 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b4152060 0x7f43b41e1b50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00dbc0 tx=0x7f43ac00dcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:38.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.544+0000 7f43ab7fe640 1 -- 172.21.15.86:0/2694748952 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac00e980 con 0x7f43b4152060 2024-09-19T06:37:38.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.544+0000 7f43ab7fe640 1 -- 172.21.15.86:0/2694748952 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ac00eb40 con 0x7f43b4152060 2024-09-19T06:37:38.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.544+0000 7f43b9111640 1 -- 172.21.15.86:0/2694748952 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b41e3280 con 0x7f43b4152060 2024-09-19T06:37:38.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.544+0000 7f43ab7fe640 1 -- 172.21.15.86:0/2694748952 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac009580 con 0x7f43b4152060 2024-09-19T06:37:38.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.544+0000 7f43b9111640 1 -- 172.21.15.86:0/2694748952 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b4156680 con 0x7f43b4152060 2024-09-19T06:37:38.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.545+0000 7f43b9111640 1 -- 172.21.15.86:0/2694748952 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43b4072460 con 0x7f43b4152060 2024-09-19T06:37:38.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.545+0000 7f43ab7fe640 1 -- 172.21.15.86:0/2694748952 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f43ac009720 con 0x7f43b4152060 2024-09-19T06:37:38.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.546+0000 7f43ab7fe640 1 --2- 172.21.15.86:0/2694748952 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f439406c2b0 0x7f439406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:38.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.546+0000 7f43ab7fe640 1 -- 172.21.15.86:0/2694748952 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f43ac08d3a0 con 0x7f43b4152060 2024-09-19T06:37:38.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.546+0000 7f43b2d9d640 1 --2- 172.21.15.86:0/2694748952 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f439406c2b0 0x7f439406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:38.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.546+0000 7f43b2d9d640 1 --2- 172.21.15.86:0/2694748952 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f439406c2b0 0x7f439406e770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f43a4034000 tx=0x7f43a402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:38.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.550+0000 7f43ab7fe640 1 -- 172.21.15.86:0/2694748952 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f43ac05b180 con 0x7f43b4152060 2024-09-19T06:37:38.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.720+0000 7f43b9111640 1 -- 172.21.15.86:0/2694748952 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f43b41e1300 con 0x7f43b4152060 2024-09-19T06:37:38.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.722+0000 7f43ab7fe640 1 -- 172.21.15.86:0/2694748952 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18586 (secure 0 0 0) 0x7f43ac05f480 con 0x7f43b4152060 2024-09-19T06:37:38.724 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:38.724 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":26,"fsid":"1785f09f-0959-457d-8c4a-6cce2e655a37","created":"2024-09-19T06:36:45.671544+0000","modified":"2024-09-19T06:37:13.796252+0000","last_up_change":"2024-09-19T06:36:56.765680+0000","last_in_change":"2024-09-19T06:36:47.816681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:36:57.770634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:37:06.588120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:37:07.739726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T06:37:11.457476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bd3ce3f2-2a37-40ec-8dc3-69246437277c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6827","nonce":1588074611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6829","nonce":1588074611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6833","nonce":1588074611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6831","nonce":1588074611}]},"public_addr":"172.21.15.86:6827/1588074611","cluster_addr":"172.21.15.86:6829/1588074611","heartbeat_back_addr":"172.21.15.86:6833/1588074611","heartbeat_front_addr":"172.21.15.86:6831/1588074611","state":["exists","up"]},{"osd":1,"uuid":"871d7d23-ed03-4629-bca9-5b71ad0d926a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6819","nonce":1785682938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6821","nonce":1785682938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6825","nonce":1785682938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6823","nonce":1785682938}]},"public_addr":"172.21.15.86:6819/1785682938","cluster_addr":"172.21.15.86:6821/1785682938","heartbeat_back_addr":"172.21.15.86:6825/1785682938","heartbeat_front_addr":"172.21.15.86:6823/1785682938","state":["exists","up"]},{"osd":2,"uuid":"39d3562d-8c52-4af9-935a-2d90abb8b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6801","nonce":3306127846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6803","nonce":3306127846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6807","nonce":3306127846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6805","nonce":3306127846}]},"public_addr":"172.21.15.86:6801/3306127846","cluster_addr":"172.21.15.86:6803/3306127846","heartbeat_back_addr":"172.21.15.86:6807/3306127846","heartbeat_front_addr":"172.21.15.86:6805/3306127846","state":["exists","up"]},{"osd":3,"uuid":"7f88c5b1-042c-4a9f-a674-32456e0644a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6809","nonce":694275178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6811","nonce":694275178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6815","nonce":694275178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6813","nonce":694275178}]},"public_addr":"172.21.15.86:6809/694275178","cluster_addr":"172.21.15.86:6811/694275178","heartbeat_back_addr":"172.21.15.86:6815/694275178","heartbeat_front_addr":"172.21.15.86:6813/694275178","state":["exists","up"]},{"osd":4,"uuid":"18aa391b-0863-48bf-bff6-107e22ee9752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6811","nonce":1326795640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6815","nonce":1326795640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6823","nonce":1326795640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6819","nonce":1326795640}]},"public_addr":"172.21.15.169:6811/1326795640","cluster_addr":"172.21.15.169:6815/1326795640","heartbeat_back_addr":"172.21.15.169:6823/1326795640","heartbeat_front_addr":"172.21.15.169:6819/1326795640","state":["exists","up"]},{"osd":5,"uuid":"90fa5ca6-1815-4af1-a664-b45a9e19dd56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6825","nonce":3538913242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6827","nonce":3538913242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6831","nonce":3538913242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6829","nonce":3538913242}]},"public_addr":"172.21.15.169:6825/3538913242","cluster_addr":"172.21.15.169:6827/3538913242","heartbeat_back_addr":"172.21.15.169:6831/3538913242","heartbeat_front_addr":"172.21.15.169:6829/3538913242","state":["exists","up"]},{"osd":6,"uuid":"8b2019fc-6cc2-4394-9a7c-7951544f7cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6810","nonce":494424253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6814","nonce":494424253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6822","nonce":494424253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6818","nonce":494424253}]},"public_addr":"172.21.15.169:6810/494424253","cluster_addr":"172.21.15.169:6814/494424253","heartbeat_back_addr":"172.21.15.169:6822/494424253","heartbeat_front_addr":"172.21.15.169:6818/494424253","state":["exists","up"]},{"osd":7,"uuid":"622e3b2c-5302-4b0a-b7f2-f4050801401e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6801","nonce":797235989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6803","nonce":797235989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6807","nonce":797235989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6805","nonce":797235989}]},"public_addr":"172.21.15.169:6801/797235989","cluster_addr":"172.21.15.169:6803/797235989","heartbeat_back_addr":"172.21.15.169:6807/797235989","heartbeat_front_addr":"172.21.15.169:6805/797235989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.130643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.611572+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:53.419992+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.560112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.112065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.774642+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.341946+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.117884+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:37:38.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.724+0000 7f43b9111640 1 -- 172.21.15.86:0/2694748952 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f439406c2b0 msgr2=0x7f439406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:38.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.724+0000 7f43b9111640 1 --2- 172.21.15.86:0/2694748952 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f439406c2b0 0x7f439406e770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f43a4034000 tx=0x7f43a402e000 comp rx=0 tx=0).stop 2024-09-19T06:37:38.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.724+0000 7f43b9111640 1 -- 172.21.15.86:0/2694748952 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b4152060 msgr2=0x7f43b41e1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:38.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.724+0000 7f43b9111640 1 --2- 172.21.15.86:0/2694748952 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b4152060 0x7f43b41e1b50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00dbc0 tx=0x7f43ac00dcb0 comp rx=0 tx=0).stop 2024-09-19T06:37:38.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.724+0000 7f43b9111640 1 -- 172.21.15.86:0/2694748952 shutdown_connections 2024-09-19T06:37:38.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.724+0000 7f43b9111640 1 --2- 172.21.15.86:0/2694748952 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f439406c2b0 0x7f439406e770 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:38.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.724+0000 7f43b9111640 1 --2- 172.21.15.86:0/2694748952 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b4152060 0x7f43b41e1b50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:38.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.724+0000 7f43b9111640 1 --2- 172.21.15.86:0/2694748952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43b40c3680 0x7f43b41e1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:38.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.724+0000 7f43b9111640 1 --2- 172.21.15.86:0/2694748952 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43b406bd10 0x7f43b4150eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:38.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.724+0000 7f43b9111640 1 -- 172.21.15.86:0/2694748952 >> 172.21.15.86:0/2694748952 conn(0x7f43b40c9280 msgr2=0x7f43b41e3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:38.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.724+0000 7f43b9111640 1 -- 172.21.15.86:0/2694748952 shutdown_connections 2024-09-19T06:37:38.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.725+0000 7f43b9111640 1 -- 172.21.15.86:0/2694748952 wait complete. 2024-09-19T06:37:38.737 INFO:tasks.mds_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T06:36:57.770634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T06:37:06.588120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T06:37:07.739726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-19T06:37:11.457476+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-19T06:37:38.738 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T06:37:38.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.839+0000 7fb648f0c640 1 Processor -- start 2024-09-19T06:37:38.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.839+0000 7fb648f0c640 1 -- start start 2024-09-19T06:37:38.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.840+0000 7fb648f0c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb644151d70 0x7fb6440c7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:38.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.840+0000 7fb648f0c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb644152150 0x7fb64415be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:38.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.840+0000 7fb648f0c640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb64406ea00 con 0x7fb644071240 2024-09-19T06:37:38.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.840+0000 7fb648f0c640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fb64406eca0 con 0x7fb644151d70 2024-09-19T06:37:38.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.840+0000 7fb648f0c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb64406ef60 con 0x7fb644152150 2024-09-19T06:37:38.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.840+0000 7fb64259c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb644151d70 0x7fb6440c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:38.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.840+0000 7fb642d9d640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb644071240 0x7fb644071ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:35236/0 (socket says 172.21.15.86:35236) 2024-09-19T06:37:38.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.840+0000 7fb642d9d640 1 -- 172.21.15.86:0/1555479182 learned_addr learned my addr 172.21.15.86:0/1555479182 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:38.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.840+0000 7fb64259c640 1 -- 172.21.15.86:0/1555479182 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb644152150 msgr2=0x7fb64415be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:38.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.840+0000 7fb64259c640 1 --2- 172.21.15.86:0/1555479182 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb644152150 0x7fb64415be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:38.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.840+0000 7fb64259c640 1 -- 172.21.15.86:0/1555479182 >> v1:172.21.15.86:6789/0 conn(0x7fb644071240 legacy=0x7fb644071ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:38.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.840+0000 7fb64259c640 1 -- 172.21.15.86:0/1555479182 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb64406f240 con 0x7fb644151d70 2024-09-19T06:37:38.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.841+0000 7fb64259c640 1 --2- 172.21.15.86:0/1555479182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb644151d70 0x7fb6440c7290 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb64406ebd0 tx=0x7fb63c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c42c955b05541705 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:38.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.841+0000 7fb64159a640 1 -- 172.21.15.86:0/1555479182 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c037070 con 0x7fb644151d70 2024-09-19T06:37:38.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.841+0000 7fb64159a640 1 -- 172.21.15.86:0/1555479182 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb63c032440 con 0x7fb644151d70 2024-09-19T06:37:38.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.841+0000 7fb64159a640 1 -- 172.21.15.86:0/1555479182 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c032810 con 0x7fb644151d70 2024-09-19T06:37:38.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.842+0000 7fb648f0c640 1 -- 172.21.15.86:0/1555479182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb644151d70 msgr2=0x7fb6440c7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:38.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.842+0000 7fb648f0c640 1 --2- 172.21.15.86:0/1555479182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb644151d70 0x7fb6440c7290 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb64406ebd0 tx=0x7fb63c02a180 comp rx=0 tx=0).stop 2024-09-19T06:37:38.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.842+0000 7fb648f0c640 1 -- 172.21.15.86:0/1555479182 shutdown_connections 2024-09-19T06:37:38.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.842+0000 7fb648f0c640 1 --2- 172.21.15.86:0/1555479182 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb644152150 0x7fb64415be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:38.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.842+0000 7fb648f0c640 1 --2- 172.21.15.86:0/1555479182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb644151d70 0x7fb6440c7290 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:38.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.842+0000 7fb648f0c640 1 -- 172.21.15.86:0/1555479182 >> 172.21.15.86:0/1555479182 conn(0x7fb6440c9390 msgr2=0x7fb6440c9770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:38.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.842+0000 7fb648f0c640 1 -- 172.21.15.86:0/1555479182 shutdown_connections 2024-09-19T06:37:38.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.842+0000 7fb648f0c640 1 -- 172.21.15.86:0/1555479182 wait complete. 2024-09-19T06:37:38.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.843+0000 7fb648f0c640 1 Processor -- start 2024-09-19T06:37:38.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.843+0000 7fb648f0c640 1 -- start start 2024-09-19T06:37:38.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.844+0000 7fb648f0c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb644071240 0x7fb6441f0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:38.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.844+0000 7fb648f0c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb644151d70 0x7fb6441e14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:38.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.844+0000 7fb648f0c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb644152150 0x7fb6441e41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:38.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.844+0000 7fb648f0c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb64415b940 con 0x7fb644071240 2024-09-19T06:37:38.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.844+0000 7fb648f0c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb64415b660 con 0x7fb644152150 2024-09-19T06:37:38.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.844+0000 7fb648f0c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb6440c3940 con 0x7fb644151d70 2024-09-19T06:37:38.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.844+0000 7fb64259c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb644071240 0x7fb6441f0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:38.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.844+0000 7fb64259c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb644071240 0x7fb6441f0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56950/0 (socket says 172.21.15.86:56950) 2024-09-19T06:37:38.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.844+0000 7fb64259c640 1 -- 172.21.15.86:0/2514957161 learned_addr learned my addr 172.21.15.86:0/2514957161 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:38.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.844+0000 7fb64259c640 1 -- 172.21.15.86:0/2514957161 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb644151d70 msgr2=0x7fb6441e14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:38.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.844+0000 7fb64259c640 1 --2- 172.21.15.86:0/2514957161 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb644151d70 0x7fb6441e14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:38.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.844+0000 7fb64259c640 1 -- 172.21.15.86:0/2514957161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb644152150 msgr2=0x7fb6441e41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:38.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.844+0000 7fb64259c640 1 --2- 172.21.15.86:0/2514957161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb644152150 0x7fb6441e41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:38.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.844+0000 7fb64259c640 1 -- 172.21.15.86:0/2514957161 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6440cd170 con 0x7fb644071240 2024-09-19T06:37:38.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.844+0000 7fb64259c640 1 --2- 172.21.15.86:0/2514957161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb644071240 0x7fb6441f0a40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb63c000c00 tx=0x7fb63c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:38.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.845+0000 7fb632ffd640 1 -- 172.21.15.86:0/2514957161 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c037040 con 0x7fb644071240 2024-09-19T06:37:38.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.845+0000 7fb632ffd640 1 -- 172.21.15.86:0/2514957161 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb63c042070 con 0x7fb644071240 2024-09-19T06:37:38.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.845+0000 7fb648f0c640 1 -- 172.21.15.86:0/2514957161 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6440cd430 con 0x7fb644071240 2024-09-19T06:37:38.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.845+0000 7fb632ffd640 1 -- 172.21.15.86:0/2514957161 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c030bd0 con 0x7fb644071240 2024-09-19T06:37:38.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.845+0000 7fb648f0c640 1 -- 172.21.15.86:0/2514957161 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6441f4d40 con 0x7fb644071240 2024-09-19T06:37:38.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.846+0000 7fb648f0c640 1 -- 172.21.15.86:0/2514957161 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb64406f520 con 0x7fb644071240 2024-09-19T06:37:38.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.846+0000 7fb632ffd640 1 -- 172.21.15.86:0/2514957161 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb63c047460 con 0x7fb644071240 2024-09-19T06:37:38.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.847+0000 7fb632ffd640 1 --2- 172.21.15.86:0/2514957161 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb62406c2b0 0x7fb62406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:38.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.847+0000 7fb632ffd640 1 -- 172.21.15.86:0/2514957161 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb63c0ac400 con 0x7fb644071240 2024-09-19T06:37:38.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.847+0000 7fb641d9b640 1 --2- 172.21.15.86:0/2514957161 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb62406c2b0 0x7fb62406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:38.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.847+0000 7fb641d9b640 1 --2- 172.21.15.86:0/2514957161 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb62406c2b0 0x7fb62406e770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb644072f30 tx=0x7fb638006c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:38.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:38.851+0000 7fb632ffd640 1 -- 172.21.15.86:0/2514957161 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb63c032e20 con 0x7fb644071240 2024-09-19T06:37:39.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.018+0000 7fb648f0c640 1 -- 172.21.15.86:0/2514957161 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb644072c80 con 0x7fb644071240 2024-09-19T06:37:39.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.018+0000 7fb632ffd640 1 -- 172.21.15.86:0/2514957161 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fb63c045360 con 0x7fb644071240 2024-09-19T06:37:39.020 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2024-09-19T06:37:39.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.020+0000 7fb648f0c640 1 -- 172.21.15.86:0/2514957161 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb62406c2b0 msgr2=0x7fb62406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:39.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.020+0000 7fb648f0c640 1 --2- 172.21.15.86:0/2514957161 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb62406c2b0 0x7fb62406e770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb644072f30 tx=0x7fb638006c90 comp rx=0 tx=0).stop 2024-09-19T06:37:39.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.020+0000 7fb648f0c640 1 -- 172.21.15.86:0/2514957161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb644071240 msgr2=0x7fb6441f0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:39.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.020+0000 7fb648f0c640 1 --2- 172.21.15.86:0/2514957161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb644071240 0x7fb6441f0a40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb63c000c00 tx=0x7fb63c0046c0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.020+0000 7fb648f0c640 1 -- 172.21.15.86:0/2514957161 shutdown_connections 2024-09-19T06:37:39.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.020+0000 7fb648f0c640 1 --2- 172.21.15.86:0/2514957161 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb62406c2b0 0x7fb62406e770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.020+0000 7fb648f0c640 1 --2- 172.21.15.86:0/2514957161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb644152150 0x7fb6441e41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.020+0000 7fb648f0c640 1 --2- 172.21.15.86:0/2514957161 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb644151d70 0x7fb6441e14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.020+0000 7fb648f0c640 1 --2- 172.21.15.86:0/2514957161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb644071240 0x7fb6441f0a40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.020+0000 7fb648f0c640 1 -- 172.21.15.86:0/2514957161 >> 172.21.15.86:0/2514957161 conn(0x7fb6440c9390 msgr2=0x7fb6440c7550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:39.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.020+0000 7fb648f0c640 1 -- 172.21.15.86:0/2514957161 shutdown_connections 2024-09-19T06:37:39.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.020+0000 7fb648f0c640 1 -- 172.21.15.86:0/2514957161 wait complete. 2024-09-19T06:37:39.033 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T06:37:39.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.133+0000 7f553095b640 1 Processor -- start 2024-09-19T06:37:39.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.133+0000 7f553095b640 1 -- start start 2024-09-19T06:37:39.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.134+0000 7f553095b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f552c152160 0x7f552c158980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:39.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.134+0000 7f553095b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f552c072900 0x7f552c072e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:39.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.134+0000 7f553095b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f552c0ca160 0x7f552c0ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:39.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.134+0000 7f553095b640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f552c158ec0 con 0x7f552c0ca160 2024-09-19T06:37:39.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.134+0000 7f553095b640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f552c15be40 con 0x7f552c152160 2024-09-19T06:37:39.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.134+0000 7f553095b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f552c0726b0 con 0x7f552c072900 2024-09-19T06:37:39.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.134+0000 7f552ad9d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f552c0ca160 0x7f552c0ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:39.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.134+0000 7f552ad9d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f552c0ca160 0x7f552c0ca5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56958/0 (socket says 172.21.15.86:56958) 2024-09-19T06:37:39.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.134+0000 7f552ad9d640 1 -- 172.21.15.86:0/850216628 learned_addr learned my addr 172.21.15.86:0/850216628 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:39.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.134+0000 7f552a59c640 1 --2- 172.21.15.86:0/850216628 >> v2:172.21.15.169:3300/0 conn(0x7f552c152160 0x7f552c158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:39.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.134+0000 7f5529d9b640 1 --2- 172.21.15.86:0/850216628 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f552c072900 0x7f552c072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:39.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.134+0000 7f552ad9d640 1 -- 172.21.15.86:0/850216628 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f552c072900 msgr2=0x7f552c072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:39.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.134+0000 7f552ad9d640 1 --2- 172.21.15.86:0/850216628 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f552c072900 0x7f552c072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.134+0000 7f552ad9d640 1 -- 172.21.15.86:0/850216628 >> v2:172.21.15.169:3300/0 conn(0x7f552c152160 msgr2=0x7f552c158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:39.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.134+0000 7f552ad9d640 1 --2- 172.21.15.86:0/850216628 >> v2:172.21.15.169:3300/0 conn(0x7f552c152160 0x7f552c158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.134+0000 7f552ad9d640 1 -- 172.21.15.86:0/850216628 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f552c0723d0 con 0x7f552c0ca160 2024-09-19T06:37:39.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.134+0000 7f5529d9b640 1 --2- 172.21.15.86:0/850216628 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f552c072900 0x7f552c072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:39.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.135+0000 7f552ad9d640 1 --2- 172.21.15.86:0/850216628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f552c0ca160 0x7f552c0ca5a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f552c06eea0 tx=0x7f552402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e982beace76166ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:39.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.135+0000 7f552959a640 1 -- 172.21.15.86:0/850216628 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524036070 con 0x7f552c0ca160 2024-09-19T06:37:39.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.135+0000 7f552959a640 1 -- 172.21.15.86:0/850216628 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5524031600 con 0x7f552c0ca160 2024-09-19T06:37:39.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.135+0000 7f552959a640 1 -- 172.21.15.86:0/850216628 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55240319d0 con 0x7f552c0ca160 2024-09-19T06:37:39.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.136+0000 7f553095b640 1 -- 172.21.15.86:0/850216628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f552c0ca160 msgr2=0x7f552c0ca5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:39.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.136+0000 7f553095b640 1 --2- 172.21.15.86:0/850216628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f552c0ca160 0x7f552c0ca5a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f552c06eea0 tx=0x7f552402a6a0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.136+0000 7f553095b640 1 -- 172.21.15.86:0/850216628 shutdown_connections 2024-09-19T06:37:39.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.136+0000 7f553095b640 1 --2- 172.21.15.86:0/850216628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f552c0ca160 0x7f552c0ca5a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.136+0000 7f553095b640 1 --2- 172.21.15.86:0/850216628 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f552c072900 0x7f552c072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.136+0000 7f553095b640 1 --2- 172.21.15.86:0/850216628 >> v2:172.21.15.169:3300/0 conn(0x7f552c152160 0x7f552c158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.136+0000 7f553095b640 1 -- 172.21.15.86:0/850216628 >> 172.21.15.86:0/850216628 conn(0x7f552c06fb80 msgr2=0x7f552c06ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:39.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.136+0000 7f553095b640 1 -- 172.21.15.86:0/850216628 shutdown_connections 2024-09-19T06:37:39.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.136+0000 7f553095b640 1 -- 172.21.15.86:0/850216628 wait complete. 2024-09-19T06:37:39.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.137+0000 7f553095b640 1 Processor -- start 2024-09-19T06:37:39.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.137+0000 7f553095b640 1 -- start start 2024-09-19T06:37:39.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.138+0000 7f553095b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f552c072900 0x7f552c1f2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:39.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.138+0000 7f553095b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f552c0ca160 0x7f552c154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:39.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.138+0000 7f553095b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f552c152160 0x7f552c1e4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:39.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.138+0000 7f553095b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f552c15bad0 con 0x7f552c152160 2024-09-19T06:37:39.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.138+0000 7f553095b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f552c15b7f0 con 0x7f552c072900 2024-09-19T06:37:39.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.138+0000 7f553095b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f552c15c2d0 con 0x7f552c0ca160 2024-09-19T06:37:39.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.138+0000 7f552ad9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f552c152160 0x7f552c1e4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:39.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.138+0000 7f552ad9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f552c152160 0x7f552c1e4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56966/0 (socket says 172.21.15.86:56966) 2024-09-19T06:37:39.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.138+0000 7f552ad9d640 1 -- 172.21.15.86:0/3488166427 learned_addr learned my addr 172.21.15.86:0/3488166427 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:39.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.138+0000 7f552a59c640 1 --2- 172.21.15.86:0/3488166427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f552c072900 0x7f552c1f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:39.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.138+0000 7f5529d9b640 1 --2- 172.21.15.86:0/3488166427 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f552c0ca160 0x7f552c154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:39.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.138+0000 7f552ad9d640 1 -- 172.21.15.86:0/3488166427 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f552c0ca160 msgr2=0x7f552c154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:39.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.138+0000 7f552ad9d640 1 --2- 172.21.15.86:0/3488166427 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f552c0ca160 0x7f552c154cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.138+0000 7f552ad9d640 1 -- 172.21.15.86:0/3488166427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f552c072900 msgr2=0x7f552c1f2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:39.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.138+0000 7f552ad9d640 1 --2- 172.21.15.86:0/3488166427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f552c072900 0x7f552c1f2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.138+0000 7f552ad9d640 1 -- 172.21.15.86:0/3488166427 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f552c14fe30 con 0x7f552c152160 2024-09-19T06:37:39.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.139+0000 7f552ad9d640 1 --2- 172.21.15.86:0/3488166427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f552c152160 0x7f552c1e4660 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f552402ac90 tx=0x7f5524004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:39.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.139+0000 7f5522ffd640 1 -- 172.21.15.86:0/3488166427 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552403f020 con 0x7f552c152160 2024-09-19T06:37:39.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.139+0000 7f5522ffd640 1 -- 172.21.15.86:0/3488166427 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5524037040 con 0x7f552c152160 2024-09-19T06:37:39.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.139+0000 7f553095b640 1 -- 172.21.15.86:0/3488166427 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f552c1500b0 con 0x7f552c152160 2024-09-19T06:37:39.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.139+0000 7f5522ffd640 1 -- 172.21.15.86:0/3488166427 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524036070 con 0x7f552c152160 2024-09-19T06:37:39.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.139+0000 7f553095b640 1 -- 172.21.15.86:0/3488166427 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f552c06c100 con 0x7f552c152160 2024-09-19T06:37:39.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.140+0000 7f553095b640 1 -- 172.21.15.86:0/3488166427 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f552c06bef0 con 0x7f552c152160 2024-09-19T06:37:39.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.140+0000 7f5522ffd640 1 -- 172.21.15.86:0/3488166427 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5524042020 con 0x7f552c152160 2024-09-19T06:37:39.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.141+0000 7f5522ffd640 1 --2- 172.21.15.86:0/3488166427 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f550c06c2e0 0x7f550c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:39.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.141+0000 7f5522ffd640 1 -- 172.21.15.86:0/3488166427 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f55240aba80 con 0x7f552c152160 2024-09-19T06:37:39.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.141+0000 7f552a59c640 1 --2- 172.21.15.86:0/3488166427 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f550c06c2e0 0x7f550c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:39.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.141+0000 7f552a59c640 1 --2- 172.21.15.86:0/3488166427 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f550c06c2e0 0x7f550c06e7a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f55140079a0 tx=0x7f5514008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:39.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.145+0000 7f5522ffd640 1 -- 172.21.15.86:0/3488166427 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5524049030 con 0x7f552c152160 2024-09-19T06:37:39.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.313+0000 7f553095b640 1 -- 172.21.15.86:0/3488166427 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f552c152540 con 0x7f552c152160 2024-09-19T06:37:39.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.314+0000 7f5522ffd640 1 -- 172.21.15.86:0/3488166427 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f552c14fe30 con 0x7f552c152160 2024-09-19T06:37:39.315 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-09-19T06:37:39.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.316+0000 7f553095b640 1 -- 172.21.15.86:0/3488166427 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f550c06c2e0 msgr2=0x7f550c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:39.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.316+0000 7f553095b640 1 --2- 172.21.15.86:0/3488166427 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f550c06c2e0 0x7f550c06e7a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f55140079a0 tx=0x7f5514008040 comp rx=0 tx=0).stop 2024-09-19T06:37:39.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.316+0000 7f553095b640 1 -- 172.21.15.86:0/3488166427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f552c152160 msgr2=0x7f552c1e4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:39.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.316+0000 7f553095b640 1 --2- 172.21.15.86:0/3488166427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f552c152160 0x7f552c1e4660 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f552402ac90 tx=0x7f5524004a40 comp rx=0 tx=0).stop 2024-09-19T06:37:39.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.316+0000 7f553095b640 1 -- 172.21.15.86:0/3488166427 shutdown_connections 2024-09-19T06:37:39.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.316+0000 7f553095b640 1 --2- 172.21.15.86:0/3488166427 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f550c06c2e0 0x7f550c06e7a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.316+0000 7f553095b640 1 --2- 172.21.15.86:0/3488166427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f552c152160 0x7f552c1e4660 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.316+0000 7f553095b640 1 --2- 172.21.15.86:0/3488166427 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f552c0ca160 0x7f552c154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.316+0000 7f553095b640 1 --2- 172.21.15.86:0/3488166427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f552c072900 0x7f552c1f2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.316+0000 7f553095b640 1 -- 172.21.15.86:0/3488166427 >> 172.21.15.86:0/3488166427 conn(0x7f552c06fb80 msgr2=0x7f552c159060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:39.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.316+0000 7f553095b640 1 -- 172.21.15.86:0/3488166427 shutdown_connections 2024-09-19T06:37:39.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.316+0000 7f553095b640 1 -- 172.21.15.86:0/3488166427 wait complete. 2024-09-19T06:37:39.329 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T06:37:39.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.430+0000 7f5c50131640 1 Processor -- start 2024-09-19T06:37:39.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.430+0000 7f5c50131640 1 -- start start 2024-09-19T06:37:39.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.431+0000 7f5c50131640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5c480c9310 0x7f5c4815e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:39.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.431+0000 7f5c50131640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5c48071510 0x7f5c4815eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:39.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.431+0000 7f5c50131640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c4815b390 con 0x7f5c48144460 2024-09-19T06:37:39.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.431+0000 7f5c50131640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f5c48070970 con 0x7f5c48071510 2024-09-19T06:37:39.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.431+0000 7f5c50131640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f5c4815b670 con 0x7f5c480c9310 2024-09-19T06:37:39.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.431+0000 7f5c4e6ce640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5c48071510 0x7f5c4815eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:39.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.431+0000 7f5c4decd640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f5c48144460 0x7f5c48070e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:35242/0 (socket says 172.21.15.86:35242) 2024-09-19T06:37:39.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.431+0000 7f5c4decd640 1 -- 172.21.15.86:0/915066840 learned_addr learned my addr 172.21.15.86:0/915066840 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:39.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.431+0000 7f5c4e6ce640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5c48071510 0x7f5c4815eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56976/0 (socket says 172.21.15.86:56976) 2024-09-19T06:37:39.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.431+0000 7f5c4e6ce640 1 -- 172.21.15.86:0/915066840 >> v2:172.21.15.169:3300/0 conn(0x7f5c480c9310 msgr2=0x7f5c4815e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:39.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.431+0000 7f5c4d6cc640 1 --2- 172.21.15.86:0/915066840 >> v2:172.21.15.169:3300/0 conn(0x7f5c480c9310 0x7f5c4815e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:39.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.431+0000 7f5c4e6ce640 1 --2- 172.21.15.86:0/915066840 >> v2:172.21.15.169:3300/0 conn(0x7f5c480c9310 0x7f5c4815e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.431+0000 7f5c4cecb640 1 -- 172.21.15.86:0/915066840 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2604545657 0 0) 0x7f5c4815b390 con 0x7f5c48144460 2024-09-19T06:37:39.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.431+0000 7f5c4e6ce640 1 -- 172.21.15.86:0/915066840 >> v1:172.21.15.86:6789/0 conn(0x7f5c48144460 legacy=0x7f5c48070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:39.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.431+0000 7f5c4e6ce640 1 -- 172.21.15.86:0/915066840 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c4815b950 con 0x7f5c48071510 2024-09-19T06:37:39.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.431+0000 7f5c4d6cc640 1 --2- 172.21.15.86:0/915066840 >> v2:172.21.15.169:3300/0 conn(0x7f5c480c9310 0x7f5c4815e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:39.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.432+0000 7f5c4e6ce640 1 --2- 172.21.15.86:0/915066840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c48071510 0x7f5c4815eb90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5c480cb120 tx=0x7f5c4002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4547626e0e020b75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:39.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.432+0000 7f5c4cecb640 1 -- 172.21.15.86:0/915066840 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c40007740 con 0x7f5c48071510 2024-09-19T06:37:39.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.432+0000 7f5c4cecb640 1 -- 172.21.15.86:0/915066840 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c400078e0 con 0x7f5c48071510 2024-09-19T06:37:39.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.432+0000 7f5c4cecb640 1 -- 172.21.15.86:0/915066840 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c40007cb0 con 0x7f5c48071510 2024-09-19T06:37:39.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.433+0000 7f5c50131640 1 -- 172.21.15.86:0/915066840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c48071510 msgr2=0x7f5c4815eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:39.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.433+0000 7f5c50131640 1 --2- 172.21.15.86:0/915066840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c48071510 0x7f5c4815eb90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5c480cb120 tx=0x7f5c4002a710 comp rx=0 tx=0).stop 2024-09-19T06:37:39.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.433+0000 7f5c50131640 1 -- 172.21.15.86:0/915066840 shutdown_connections 2024-09-19T06:37:39.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.433+0000 7f5c50131640 1 --2- 172.21.15.86:0/915066840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c48071510 0x7f5c4815eb90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.433+0000 7f5c50131640 1 --2- 172.21.15.86:0/915066840 >> v2:172.21.15.169:3300/0 conn(0x7f5c480c9310 0x7f5c4815e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.433+0000 7f5c50131640 1 -- 172.21.15.86:0/915066840 >> 172.21.15.86:0/915066840 conn(0x7f5c48073160 msgr2=0x7f5c48073570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:39.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.433+0000 7f5c50131640 1 -- 172.21.15.86:0/915066840 shutdown_connections 2024-09-19T06:37:39.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.433+0000 7f5c50131640 1 -- 172.21.15.86:0/915066840 wait complete. 2024-09-19T06:37:39.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.434+0000 7f5c50131640 1 Processor -- start 2024-09-19T06:37:39.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.434+0000 7f5c50131640 1 -- start start 2024-09-19T06:37:39.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.435+0000 7f5c50131640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c48071510 0x7f5c481e45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:39.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.435+0000 7f5c50131640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c480c9310 0x7f5c4815eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:39.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.435+0000 7f5c50131640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c48144460 0x7f5c4815d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:39.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.435+0000 7f5c50131640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4815b060 con 0x7f5c480c9310 2024-09-19T06:37:39.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.435+0000 7f5c50131640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4815bf10 con 0x7f5c48071510 2024-09-19T06:37:39.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.435+0000 7f5c50131640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5c48144840 con 0x7f5c48144460 2024-09-19T06:37:39.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.435+0000 7f5c4d6cc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c480c9310 0x7f5c4815eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:39.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.435+0000 7f5c4d6cc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c480c9310 0x7f5c4815eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56992/0 (socket says 172.21.15.86:56992) 2024-09-19T06:37:39.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.435+0000 7f5c4d6cc640 1 -- 172.21.15.86:0/2531783728 learned_addr learned my addr 172.21.15.86:0/2531783728 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:39.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.435+0000 7f5c4decd640 1 --2- 172.21.15.86:0/2531783728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c48071510 0x7f5c481e45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:39.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.435+0000 7f5c4e6ce640 1 --2- 172.21.15.86:0/2531783728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c48144460 0x7f5c4815d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:39.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.435+0000 7f5c4d6cc640 1 -- 172.21.15.86:0/2531783728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c48144460 msgr2=0x7f5c4815d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:39.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.435+0000 7f5c4d6cc640 1 --2- 172.21.15.86:0/2531783728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c48144460 0x7f5c4815d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.435+0000 7f5c4d6cc640 1 -- 172.21.15.86:0/2531783728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c48071510 msgr2=0x7f5c481e45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:39.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.435+0000 7f5c4d6cc640 1 --2- 172.21.15.86:0/2531783728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c48071510 0x7f5c481e45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.435+0000 7f5c4d6cc640 1 -- 172.21.15.86:0/2531783728 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c481eea50 con 0x7f5c480c9310 2024-09-19T06:37:39.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.435+0000 7f5c4e6ce640 1 --2- 172.21.15.86:0/2531783728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c48144460 0x7f5c4815d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:39.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.435+0000 7f5c4d6cc640 1 --2- 172.21.15.86:0/2531783728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c480c9310 0x7f5c4815eda0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00c820 tx=0x7f5c3c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:39.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.435+0000 7f5c467fc640 1 -- 172.21.15.86:0/2531783728 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c015070 con 0x7f5c480c9310 2024-09-19T06:37:39.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.435+0000 7f5c467fc640 1 -- 172.21.15.86:0/2531783728 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c3c007a30 con 0x7f5c480c9310 2024-09-19T06:37:39.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.435+0000 7f5c50131640 1 -- 172.21.15.86:0/2531783728 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c481e8250 con 0x7f5c480c9310 2024-09-19T06:37:39.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.435+0000 7f5c467fc640 1 -- 172.21.15.86:0/2531783728 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c007e00 con 0x7f5c480c9310 2024-09-19T06:37:39.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.436+0000 7f5c50131640 1 -- 172.21.15.86:0/2531783728 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c4815c470 con 0x7f5c480c9310 2024-09-19T06:37:39.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.436+0000 7f5c50131640 1 -- 172.21.15.86:0/2531783728 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c4815b390 con 0x7f5c480c9310 2024-09-19T06:37:39.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.437+0000 7f5c467fc640 1 -- 172.21.15.86:0/2531783728 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5c3c018070 con 0x7f5c480c9310 2024-09-19T06:37:39.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.437+0000 7f5c467fc640 1 --2- 172.21.15.86:0/2531783728 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5c3406c2e0 0x7f5c3406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:39.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.437+0000 7f5c467fc640 1 -- 172.21.15.86:0/2531783728 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5c3c08b600 con 0x7f5c480c9310 2024-09-19T06:37:39.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.437+0000 7f5c4decd640 1 --2- 172.21.15.86:0/2531783728 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5c3406c2e0 0x7f5c3406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:39.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.438+0000 7f5c4decd640 1 --2- 172.21.15.86:0/2531783728 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5c3406c2e0 0x7f5c3406e7a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5c38000f60 tx=0x7f5c38007c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:39.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.442+0000 7f5c467fc640 1 -- 172.21.15.86:0/2531783728 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5c4815b390 con 0x7f5c480c9310 2024-09-19T06:37:39.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.606+0000 7f5c50131640 1 -- 172.21.15.86:0/2531783728 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5c4815ae40 con 0x7f5c480c9310 2024-09-19T06:37:39.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.607+0000 7f5c467fc640 1 -- 172.21.15.86:0/2531783728 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f5c4815ae40 con 0x7f5c480c9310 2024-09-19T06:37:39.608 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2024-09-19T06:37:39.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.609+0000 7f5c50131640 1 -- 172.21.15.86:0/2531783728 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5c3406c2e0 msgr2=0x7f5c3406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:39.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.609+0000 7f5c50131640 1 --2- 172.21.15.86:0/2531783728 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5c3406c2e0 0x7f5c3406e7a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5c38000f60 tx=0x7f5c38007c00 comp rx=0 tx=0).stop 2024-09-19T06:37:39.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.609+0000 7f5c50131640 1 -- 172.21.15.86:0/2531783728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c480c9310 msgr2=0x7f5c4815eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:39.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.609+0000 7f5c50131640 1 --2- 172.21.15.86:0/2531783728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c480c9310 0x7f5c4815eda0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00c820 tx=0x7f5c3c00cc20 comp rx=0 tx=0).stop 2024-09-19T06:37:39.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.609+0000 7f5c50131640 1 -- 172.21.15.86:0/2531783728 shutdown_connections 2024-09-19T06:37:39.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.609+0000 7f5c50131640 1 --2- 172.21.15.86:0/2531783728 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5c3406c2e0 0x7f5c3406e7a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.609+0000 7f5c50131640 1 --2- 172.21.15.86:0/2531783728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c48144460 0x7f5c4815d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.609+0000 7f5c50131640 1 --2- 172.21.15.86:0/2531783728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c480c9310 0x7f5c4815eda0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.609+0000 7f5c50131640 1 --2- 172.21.15.86:0/2531783728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c48071510 0x7f5c481e45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.609+0000 7f5c50131640 1 -- 172.21.15.86:0/2531783728 >> 172.21.15.86:0/2531783728 conn(0x7f5c48073160 msgr2=0x7f5c480cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:39.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.609+0000 7f5c50131640 1 -- 172.21.15.86:0/2531783728 shutdown_connections 2024-09-19T06:37:39.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.609+0000 7f5c50131640 1 -- 172.21.15.86:0/2531783728 wait complete. 2024-09-19T06:37:39.621 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-19T06:37:39.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.721+0000 7f37d665e640 1 Processor -- start 2024-09-19T06:37:39.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.721+0000 7f37d665e640 1 -- start start 2024-09-19T06:37:39.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.722+0000 7f37d665e640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f37d0155520 0x7f37d015b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:39.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.722+0000 7f37d665e640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37d00c5e70 con 0x7f37d00cb800 2024-09-19T06:37:39.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.722+0000 7f37d665e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37d00cd140 con 0x7f37d00cc610 2024-09-19T06:37:39.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.722+0000 7f37d665e640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f37d0155900 con 0x7f37d0155520 2024-09-19T06:37:39.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.722+0000 7f37cffff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f37d0155520 0x7f37d015b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:39.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.722+0000 7f37d4bfb640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f37d00cb800 0x7f37d0165a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:35256/0 (socket says 172.21.15.86:35256) 2024-09-19T06:37:39.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.722+0000 7f37d4bfb640 1 -- 172.21.15.86:0/1743596249 learned_addr learned my addr 172.21.15.86:0/1743596249 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:39.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.722+0000 7f37cffff640 1 -- 172.21.15.86:0/1743596249 >> v1:172.21.15.169:6789/0 conn(0x7f37d00cc610 legacy=0x7f37d00cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:39.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.722+0000 7f37cffff640 1 -- 172.21.15.86:0/1743596249 >> v1:172.21.15.86:6789/0 conn(0x7f37d00cb800 legacy=0x7f37d0165a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:39.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.722+0000 7f37cffff640 1 -- 172.21.15.86:0/1743596249 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d015bae0 con 0x7f37d0155520 2024-09-19T06:37:39.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.722+0000 7f37ceffd640 1 -- 172.21.15.86:0/1743596249 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2352642229 0 0) 0x7f37d00c5e70 con 0x7f37d00cb800 2024-09-19T06:37:39.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.723+0000 7f37cffff640 1 --2- 172.21.15.86:0/1743596249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37d0155520 0x7f37d015b1c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f37c00097a0 tx=0x7f37c002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e9d31e94a058d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:39.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.723+0000 7f37ceffd640 1 -- 172.21.15.86:0/1743596249 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c0037070 con 0x7f37d0155520 2024-09-19T06:37:39.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.723+0000 7f37ceffd640 1 -- 172.21.15.86:0/1743596249 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c0032440 con 0x7f37d0155520 2024-09-19T06:37:39.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.723+0000 7f37ceffd640 1 -- 172.21.15.86:0/1743596249 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c0032810 con 0x7f37d0155520 2024-09-19T06:37:39.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.723+0000 7f37d665e640 1 -- 172.21.15.86:0/1743596249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37d0155520 msgr2=0x7f37d015b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:39.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.723+0000 7f37d665e640 1 --2- 172.21.15.86:0/1743596249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37d0155520 0x7f37d015b1c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f37c00097a0 tx=0x7f37c002a1e0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.723+0000 7f37d665e640 1 -- 172.21.15.86:0/1743596249 shutdown_connections 2024-09-19T06:37:39.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.723+0000 7f37d665e640 1 --2- 172.21.15.86:0/1743596249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37d0155520 0x7f37d015b1c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.723+0000 7f37d665e640 1 -- 172.21.15.86:0/1743596249 >> 172.21.15.86:0/1743596249 conn(0x7f37d0067a70 msgr2=0x7f37d0067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:39.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.724+0000 7f37d665e640 1 -- 172.21.15.86:0/1743596249 shutdown_connections 2024-09-19T06:37:39.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.724+0000 7f37d665e640 1 -- 172.21.15.86:0/1743596249 wait complete. 2024-09-19T06:37:39.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.725+0000 7f37d665e640 1 Processor -- start 2024-09-19T06:37:39.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.725+0000 7f37d665e640 1 -- start start 2024-09-19T06:37:39.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.725+0000 7f37d665e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37d00cb800 0x7f37d01f0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:39.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.725+0000 7f37d665e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37d00cc610 0x7f37d01f1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:39.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.725+0000 7f37d665e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37d0155520 0x7f37d014b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:39.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.726+0000 7f37d665e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f37d00cd6c0 con 0x7f37d00cb800 2024-09-19T06:37:39.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.726+0000 7f37d665e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f37d00cd3e0 con 0x7f37d0155520 2024-09-19T06:37:39.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.726+0000 7f37d665e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f37d015c0a0 con 0x7f37d00cc610 2024-09-19T06:37:39.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.726+0000 7f37cffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37d00cb800 0x7f37d01f0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:39.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.726+0000 7f37cffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37d00cb800 0x7f37d01f0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57016/0 (socket says 172.21.15.86:57016) 2024-09-19T06:37:39.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.726+0000 7f37cffff640 1 -- 172.21.15.86:0/3037139630 learned_addr learned my addr 172.21.15.86:0/3037139630 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:39.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.726+0000 7f37d4bfb640 1 --2- 172.21.15.86:0/3037139630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37d0155520 0x7f37d014b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:39.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.726+0000 7f37cf7fe640 1 --2- 172.21.15.86:0/3037139630 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37d00cc610 0x7f37d01f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:39.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.726+0000 7f37cffff640 1 -- 172.21.15.86:0/3037139630 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37d00cc610 msgr2=0x7f37d01f1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:39.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.726+0000 7f37cffff640 1 --2- 172.21.15.86:0/3037139630 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37d00cc610 0x7f37d01f1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.726+0000 7f37cffff640 1 -- 172.21.15.86:0/3037139630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37d0155520 msgr2=0x7f37d014b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:39.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.726+0000 7f37cffff640 1 --2- 172.21.15.86:0/3037139630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37d0155520 0x7f37d014b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.726+0000 7f37cffff640 1 -- 172.21.15.86:0/3037139630 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d01f51a0 con 0x7f37d00cb800 2024-09-19T06:37:39.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.726+0000 7f37cffff640 1 --2- 172.21.15.86:0/3037139630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37d00cb800 0x7f37d01f0e30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f37c00097a0 tx=0x7f37c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:39.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.726+0000 7f37ccff9640 1 -- 172.21.15.86:0/3037139630 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c0037040 con 0x7f37d00cb800 2024-09-19T06:37:39.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.726+0000 7f37ccff9640 1 -- 172.21.15.86:0/3037139630 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c0004250 con 0x7f37d00cb800 2024-09-19T06:37:39.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.726+0000 7f37d665e640 1 -- 172.21.15.86:0/3037139630 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37d0155e70 con 0x7f37d00cb800 2024-09-19T06:37:39.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.726+0000 7f37ccff9640 1 -- 172.21.15.86:0/3037139630 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c0032e20 con 0x7f37d00cb800 2024-09-19T06:37:39.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.726+0000 7f37d665e640 1 -- 172.21.15.86:0/3037139630 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37d01f4ec0 con 0x7f37d00cb800 2024-09-19T06:37:39.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.727+0000 7f37d665e640 1 -- 172.21.15.86:0/3037139630 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37d00cccb0 con 0x7f37d00cb800 2024-09-19T06:37:39.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.728+0000 7f37ccff9640 1 -- 172.21.15.86:0/3037139630 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f37c0030770 con 0x7f37d00cb800 2024-09-19T06:37:39.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.728+0000 7f37ccff9640 1 --2- 172.21.15.86:0/3037139630 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f37bc06c2b0 0x7f37bc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:39.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.728+0000 7f37ccff9640 1 -- 172.21.15.86:0/3037139630 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f37c00ac980 con 0x7f37d00cb800 2024-09-19T06:37:39.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.728+0000 7f37cf7fe640 1 --2- 172.21.15.86:0/3037139630 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f37bc06c2b0 0x7f37bc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:39.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.729+0000 7f37cf7fe640 1 --2- 172.21.15.86:0/3037139630 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f37bc06c2b0 0x7f37bc06e770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f37d0156d20 tx=0x7f37c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:39.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.732+0000 7f37ccff9640 1 -- 172.21.15.86:0/3037139630 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f37c007ae40 con 0x7f37d00cb800 2024-09-19T06:37:39.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.898+0000 7f37d665e640 1 -- 172.21.15.86:0/3037139630 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f37d00cccb0 con 0x7f37d00cb800 2024-09-19T06:37:39.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.898+0000 7f37ccff9640 1 -- 172.21.15.86:0/3037139630 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f37c007a740 con 0x7f37d00cb800 2024-09-19T06:37:39.900 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-09-19T06:37:39.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.900+0000 7f37d665e640 1 -- 172.21.15.86:0/3037139630 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f37bc06c2b0 msgr2=0x7f37bc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:39.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.900+0000 7f37d665e640 1 --2- 172.21.15.86:0/3037139630 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f37bc06c2b0 0x7f37bc06e770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f37d0156d20 tx=0x7f37c4009040 comp rx=0 tx=0).stop 2024-09-19T06:37:39.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.900+0000 7f37d665e640 1 -- 172.21.15.86:0/3037139630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37d00cb800 msgr2=0x7f37d01f0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:39.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.900+0000 7f37d665e640 1 --2- 172.21.15.86:0/3037139630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37d00cb800 0x7f37d01f0e30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f37c00097a0 tx=0x7f37c00046c0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.900+0000 7f37d665e640 1 -- 172.21.15.86:0/3037139630 shutdown_connections 2024-09-19T06:37:39.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.900+0000 7f37d665e640 1 --2- 172.21.15.86:0/3037139630 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f37bc06c2b0 0x7f37bc06e770 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.900+0000 7f37d665e640 1 --2- 172.21.15.86:0/3037139630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37d0155520 0x7f37d014b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.900+0000 7f37d665e640 1 --2- 172.21.15.86:0/3037139630 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37d00cc610 0x7f37d01f1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.900+0000 7f37d665e640 1 --2- 172.21.15.86:0/3037139630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37d00cb800 0x7f37d01f0e30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.900+0000 7f37d665e640 1 -- 172.21.15.86:0/3037139630 >> 172.21.15.86:0/3037139630 conn(0x7f37d0067a70 msgr2=0x7f37d00d0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:39.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.900+0000 7f37d665e640 1 -- 172.21.15.86:0/3037139630 shutdown_connections 2024-09-19T06:37:39.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:39.900+0000 7f37d665e640 1 -- 172.21.15.86:0/3037139630 wait complete. 2024-09-19T06:37:39.912 INFO:tasks.mds_thrash:Wait for all MDSs to reach steady state... 2024-09-19T06:37:39.913 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:37:40.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.009+0000 7efdf8f66640 1 Processor -- start 2024-09-19T06:37:40.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.009+0000 7efdf8f66640 1 -- start start 2024-09-19T06:37:40.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.010+0000 7efdf8f66640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efdf40cb660 0x7efdf40cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:40.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.010+0000 7efdf8f66640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7efdf40cba40 0x7efdf4158360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:40.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.010+0000 7efdf8f66640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdf40ccb90 con 0x7efdf40c6df0 2024-09-19T06:37:40.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.010+0000 7efdf8f66640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7efdf40cce20 con 0x7efdf40cb660 2024-09-19T06:37:40.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.010+0000 7efdf8f66640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7efdf40cd100 con 0x7efdf40cba40 2024-09-19T06:37:40.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.010+0000 7efdf259c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efdf40cb660 0x7efdf40cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:40.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.010+0000 7efdf259c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efdf40cb660 0x7efdf40cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57018/0 (socket says 172.21.15.86:57018) 2024-09-19T06:37:40.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.010+0000 7efdf259c640 1 -- 172.21.15.86:0/3563871196 learned_addr learned my addr 172.21.15.86:0/3563871196 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:40.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.010+0000 7efdf2d9d640 1 --2- 172.21.15.86:0/3563871196 >> v2:172.21.15.169:3300/0 conn(0x7efdf40cba40 0x7efdf4158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:40.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.010+0000 7efdf259c640 1 -- 172.21.15.86:0/3563871196 >> v2:172.21.15.169:3300/0 conn(0x7efdf40cba40 msgr2=0x7efdf4158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:40.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.010+0000 7efdf259c640 1 --2- 172.21.15.86:0/3563871196 >> v2:172.21.15.169:3300/0 conn(0x7efdf40cba40 0x7efdf4158360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.010+0000 7efdf259c640 1 -- 172.21.15.86:0/3563871196 >> v1:172.21.15.169:6789/0 conn(0x7efdf40c6df0 legacy=0x7efdf415e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:40.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.010+0000 7efdf259c640 1 -- 172.21.15.86:0/3563871196 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf40c6310 con 0x7efdf40cb660 2024-09-19T06:37:40.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.011+0000 7efdf259c640 1 --2- 172.21.15.86:0/3563871196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdf40cb660 0x7efdf40cc650 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efde4009e50 tx=0x7efde402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9487058a070cff9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:40.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.011+0000 7efdf159a640 1 -- 172.21.15.86:0/3563871196 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde4036070 con 0x7efdf40cb660 2024-09-19T06:37:40.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.011+0000 7efdf159a640 1 -- 172.21.15.86:0/3563871196 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efde4031600 con 0x7efdf40cb660 2024-09-19T06:37:40.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.011+0000 7efdf159a640 1 -- 172.21.15.86:0/3563871196 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde40319d0 con 0x7efdf40cb660 2024-09-19T06:37:40.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.012+0000 7efdf8f66640 1 -- 172.21.15.86:0/3563871196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdf40cb660 msgr2=0x7efdf40cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:40.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.012+0000 7efdf8f66640 1 --2- 172.21.15.86:0/3563871196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdf40cb660 0x7efdf40cc650 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efde4009e50 tx=0x7efde402a710 comp rx=0 tx=0).stop 2024-09-19T06:37:40.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.012+0000 7efdf8f66640 1 -- 172.21.15.86:0/3563871196 shutdown_connections 2024-09-19T06:37:40.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.012+0000 7efdf8f66640 1 --2- 172.21.15.86:0/3563871196 >> v2:172.21.15.169:3300/0 conn(0x7efdf40cba40 0x7efdf4158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.012+0000 7efdf8f66640 1 --2- 172.21.15.86:0/3563871196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdf40cb660 0x7efdf40cc650 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.012+0000 7efdf8f66640 1 -- 172.21.15.86:0/3563871196 >> 172.21.15.86:0/3563871196 conn(0x7efdf406bcc0 msgr2=0x7efdf406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:40.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.012+0000 7efdf8f66640 1 -- 172.21.15.86:0/3563871196 shutdown_connections 2024-09-19T06:37:40.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.012+0000 7efdf8f66640 1 -- 172.21.15.86:0/3563871196 wait complete. 2024-09-19T06:37:40.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.013+0000 7efdf8f66640 1 Processor -- start 2024-09-19T06:37:40.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.013+0000 7efdf8f66640 1 -- start start 2024-09-19T06:37:40.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.014+0000 7efdf8f66640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdf40c6df0 0x7efdf41f0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:40.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.014+0000 7efdf8f66640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdf40cb660 0x7efdf41538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:40.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.014+0000 7efdf8f66640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdf40cba40 0x7efdf414a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:40.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.014+0000 7efdf8f66640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efdf40c7e70 con 0x7efdf40cb660 2024-09-19T06:37:40.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.014+0000 7efdf8f66640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efdf40c68d0 con 0x7efdf40cba40 2024-09-19T06:37:40.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.014+0000 7efdf8f66640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7efdf40c58f0 con 0x7efdf40c6df0 2024-09-19T06:37:40.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.014+0000 7efdf1d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdf40cb660 0x7efdf41538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:40.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.014+0000 7efdf1d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdf40cb660 0x7efdf41538b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57032/0 (socket says 172.21.15.86:57032) 2024-09-19T06:37:40.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.014+0000 7efdf1d9b640 1 -- 172.21.15.86:0/103857563 learned_addr learned my addr 172.21.15.86:0/103857563 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:40.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.014+0000 7efdf2d9d640 1 --2- 172.21.15.86:0/103857563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdf40cba40 0x7efdf414a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:40.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.014+0000 7efdf259c640 1 --2- 172.21.15.86:0/103857563 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdf40c6df0 0x7efdf41f0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:40.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.014+0000 7efdf1d9b640 1 -- 172.21.15.86:0/103857563 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdf40c6df0 msgr2=0x7efdf41f0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:40.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.014+0000 7efdf1d9b640 1 --2- 172.21.15.86:0/103857563 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdf40c6df0 0x7efdf41f0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.014+0000 7efdf1d9b640 1 -- 172.21.15.86:0/103857563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdf40cba40 msgr2=0x7efdf414a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:40.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.014+0000 7efdf1d9b640 1 --2- 172.21.15.86:0/103857563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdf40cba40 0x7efdf414a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.014+0000 7efdf1d9b640 1 -- 172.21.15.86:0/103857563 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf41f4280 con 0x7efdf40cb660 2024-09-19T06:37:40.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.014+0000 7efdf259c640 1 --2- 172.21.15.86:0/103857563 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdf40c6df0 0x7efdf41f0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:40.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.014+0000 7efdf2d9d640 1 --2- 172.21.15.86:0/103857563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdf40cba40 0x7efdf414a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:40.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.014+0000 7efdf1d9b640 1 --2- 172.21.15.86:0/103857563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdf40cb660 0x7efdf41538b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efde800c410 tx=0x7efde800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:40.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.015+0000 7efde2ffd640 1 -- 172.21.15.86:0/103857563 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde8017070 con 0x7efdf40cb660 2024-09-19T06:37:40.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.015+0000 7efde2ffd640 1 -- 172.21.15.86:0/103857563 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efde80035f0 con 0x7efdf40cb660 2024-09-19T06:37:40.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.015+0000 7efdf8f66640 1 -- 172.21.15.86:0/103857563 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdf41f4540 con 0x7efdf40cb660 2024-09-19T06:37:40.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.015+0000 7efde2ffd640 1 -- 172.21.15.86:0/103857563 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde8003a20 con 0x7efdf40cb660 2024-09-19T06:37:40.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.015+0000 7efdf8f66640 1 -- 172.21.15.86:0/103857563 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdf41f4b00 con 0x7efdf40cb660 2024-09-19T06:37:40.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.015+0000 7efdf8f66640 1 -- 172.21.15.86:0/103857563 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdf40cc650 con 0x7efdf40cb660 2024-09-19T06:37:40.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.016+0000 7efde2ffd640 1 -- 172.21.15.86:0/103857563 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efde801a070 con 0x7efdf40cb660 2024-09-19T06:37:40.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.016+0000 7efde2ffd640 1 --2- 172.21.15.86:0/103857563 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7efdd406c2b0 0x7efdd406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:40.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.017+0000 7efdf259c640 1 --2- 172.21.15.86:0/103857563 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7efdd406c2b0 0x7efdd406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:40.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.017+0000 7efde2ffd640 1 -- 172.21.15.86:0/103857563 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7efde808aca0 con 0x7efdf40cb660 2024-09-19T06:37:40.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.017+0000 7efdf259c640 1 --2- 172.21.15.86:0/103857563 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7efdd406c2b0 0x7efdd406e770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efde4033000 tx=0x7efde4009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:40.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.021+0000 7efde2ffd640 1 -- 172.21.15.86:0/103857563 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7efde8059040 con 0x7efdf40cb660 2024-09-19T06:37:40.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.221+0000 7efdf8f66640 1 -- 172.21.15.86:0/103857563 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efdf40ca8f0 con 0x7efdf40cb660 2024-09-19T06:37:40.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.222+0000 7efde2ffd640 1 -- 172.21.15.86:0/103857563 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6871 (secure 0 0 0) 0x7efde8058940 con 0x7efdf40cb660 2024-09-19T06:37:40.223 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:40.224 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":9,"btime":"2024-09-19T06:37:28:505383+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:37:27.843067+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6837/201961024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":201961024},{"type":"v1","addr":"172.21.15.169:6837","nonce":201961024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-09-19T06:37:40.224 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 9 2024-09-19T06:37:40.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.224+0000 7efdf8f66640 1 -- 172.21.15.86:0/103857563 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7efdd406c2b0 msgr2=0x7efdd406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:40.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.224+0000 7efdf8f66640 1 --2- 172.21.15.86:0/103857563 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7efdd406c2b0 0x7efdd406e770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efde4033000 tx=0x7efde4009000 comp rx=0 tx=0).stop 2024-09-19T06:37:40.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.224+0000 7efdf8f66640 1 -- 172.21.15.86:0/103857563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdf40cb660 msgr2=0x7efdf41538b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:40.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.224+0000 7efdf8f66640 1 --2- 172.21.15.86:0/103857563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdf40cb660 0x7efdf41538b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efde800c410 tx=0x7efde800c8d0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.224+0000 7efdf8f66640 1 -- 172.21.15.86:0/103857563 shutdown_connections 2024-09-19T06:37:40.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.224+0000 7efdf8f66640 1 --2- 172.21.15.86:0/103857563 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7efdd406c2b0 0x7efdd406e770 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.224+0000 7efdf8f66640 1 --2- 172.21.15.86:0/103857563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdf40cba40 0x7efdf414a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.224+0000 7efdf8f66640 1 --2- 172.21.15.86:0/103857563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdf40cb660 0x7efdf41538b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.224+0000 7efdf8f66640 1 --2- 172.21.15.86:0/103857563 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdf40c6df0 0x7efdf41f0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.224+0000 7efdf8f66640 1 -- 172.21.15.86:0/103857563 >> 172.21.15.86:0/103857563 conn(0x7efdf406bcc0 msgr2=0x7efdf40c9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:40.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.224+0000 7efdf8f66640 1 -- 172.21.15.86:0/103857563 shutdown_connections 2024-09-19T06:37:40.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.224+0000 7efdf8f66640 1 -- 172.21.15.86:0/103857563 wait complete. 2024-09-19T06:37:40.236 INFO:tasks.mds_thrash:Ready to start thrashing 2024-09-19T06:37:40.236 INFO:tasks.mds_thrash.ceph_manager:waiting for clean 2024-09-19T06:37:40.236 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:37:40.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.333+0000 7fd65afc0640 1 Processor -- start 2024-09-19T06:37:40.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.333+0000 7fd65afc0640 1 -- start start 2024-09-19T06:37:40.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.334+0000 7fd65afc0640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd654151750 0x7fd654157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:40.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.334+0000 7fd65afc0640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd6540c85c0 0x7fd654070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:40.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.334+0000 7fd65afc0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6540723e0 con 0x7fd6540c89e0 2024-09-19T06:37:40.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.334+0000 7fd65afc0640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fd6540c8ea0 con 0x7fd6540c85c0 2024-09-19T06:37:40.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.334+0000 7fd65afc0640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fd654158420 con 0x7fd654151750 2024-09-19T06:37:40.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.334+0000 7fd653fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd6540c85c0 0x7fd654070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:40.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.334+0000 7fd653fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd6540c85c0 0x7fd654070ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57040/0 (socket says 172.21.15.86:57040) 2024-09-19T06:37:40.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.334+0000 7fd653fff640 1 -- 172.21.15.86:0/728681119 learned_addr learned my addr 172.21.15.86:0/728681119 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:40.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.334+0000 7fd658d5c640 1 --2- 172.21.15.86:0/728681119 >> v2:172.21.15.169:3300/0 conn(0x7fd654151750 0x7fd654157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:40.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.334+0000 7fd653fff640 1 -- 172.21.15.86:0/728681119 >> v2:172.21.15.169:3300/0 conn(0x7fd654151750 msgr2=0x7fd654157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:40.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.334+0000 7fd653fff640 1 --2- 172.21.15.86:0/728681119 >> v2:172.21.15.169:3300/0 conn(0x7fd654151750 0x7fd654157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.334+0000 7fd653fff640 1 -- 172.21.15.86:0/728681119 >> v1:172.21.15.169:6789/0 conn(0x7fd6540c89e0 legacy=0x7fd65406c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:40.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.334+0000 7fd653fff640 1 -- 172.21.15.86:0/728681119 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd654072680 con 0x7fd6540c85c0 2024-09-19T06:37:40.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.334+0000 7fd658d5c640 1 --2- 172.21.15.86:0/728681119 >> v2:172.21.15.169:3300/0 conn(0x7fd654151750 0x7fd654157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:40.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.335+0000 7fd653fff640 1 --2- 172.21.15.86:0/728681119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6540c85c0 0x7fd654070ed0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd65406f970 tx=0x7fd64002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=137c1526a0b12644 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:40.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.335+0000 7fd6537fe640 1 -- 172.21.15.86:0/728681119 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd640037070 con 0x7fd6540c85c0 2024-09-19T06:37:40.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.335+0000 7fd6537fe640 1 -- 172.21.15.86:0/728681119 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd640032440 con 0x7fd6540c85c0 2024-09-19T06:37:40.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.335+0000 7fd6537fe640 1 -- 172.21.15.86:0/728681119 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd640032810 con 0x7fd6540c85c0 2024-09-19T06:37:40.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.335+0000 7fd65afc0640 1 -- 172.21.15.86:0/728681119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6540c85c0 msgr2=0x7fd654070ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:40.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.335+0000 7fd65afc0640 1 --2- 172.21.15.86:0/728681119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6540c85c0 0x7fd654070ed0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd65406f970 tx=0x7fd64002a2c0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.335+0000 7fd65afc0640 1 -- 172.21.15.86:0/728681119 shutdown_connections 2024-09-19T06:37:40.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.335+0000 7fd65afc0640 1 --2- 172.21.15.86:0/728681119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6540c85c0 0x7fd654070ed0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.335+0000 7fd65afc0640 1 --2- 172.21.15.86:0/728681119 >> v2:172.21.15.169:3300/0 conn(0x7fd654151750 0x7fd654157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.335+0000 7fd65afc0640 1 -- 172.21.15.86:0/728681119 >> 172.21.15.86:0/728681119 conn(0x7fd6540c9280 msgr2=0x7fd6540c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:40.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.336+0000 7fd65afc0640 1 -- 172.21.15.86:0/728681119 shutdown_connections 2024-09-19T06:37:40.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.336+0000 7fd65afc0640 1 -- 172.21.15.86:0/728681119 wait complete. 2024-09-19T06:37:40.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.337+0000 7fd65afc0640 1 Processor -- start 2024-09-19T06:37:40.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.337+0000 7fd65afc0640 1 -- start start 2024-09-19T06:37:40.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.338+0000 7fd65afc0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6540c85c0 0x7fd654145c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:40.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.338+0000 7fd65afc0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6540c89e0 0x7fd6541e3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:40.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.338+0000 7fd65afc0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd654151750 0x7fd654148a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:40.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.338+0000 7fd65afc0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd654072c40 con 0x7fd6540c85c0 2024-09-19T06:37:40.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.338+0000 7fd65afc0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd654072fb0 con 0x7fd654151750 2024-09-19T06:37:40.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.338+0000 7fd65afc0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd654151b30 con 0x7fd6540c89e0 2024-09-19T06:37:40.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.338+0000 7fd658d5c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6540c85c0 0x7fd654145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:40.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.338+0000 7fd658d5c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6540c85c0 0x7fd654145c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57046/0 (socket says 172.21.15.86:57046) 2024-09-19T06:37:40.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.338+0000 7fd658d5c640 1 -- 172.21.15.86:0/1713829497 learned_addr learned my addr 172.21.15.86:0/1713829497 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:40.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.338+0000 7fd653fff640 1 --2- 172.21.15.86:0/1713829497 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6540c89e0 0x7fd6541e3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:40.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.338+0000 7fd65955d640 1 --2- 172.21.15.86:0/1713829497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd654151750 0x7fd654148a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:40.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.338+0000 7fd658d5c640 1 -- 172.21.15.86:0/1713829497 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6540c89e0 msgr2=0x7fd6541e3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:40.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.338+0000 7fd658d5c640 1 --2- 172.21.15.86:0/1713829497 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6540c89e0 0x7fd6541e3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.338+0000 7fd658d5c640 1 -- 172.21.15.86:0/1713829497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd654151750 msgr2=0x7fd654148a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:40.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.338+0000 7fd658d5c640 1 --2- 172.21.15.86:0/1713829497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd654151750 0x7fd654148a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.338+0000 7fd658d5c640 1 -- 172.21.15.86:0/1713829497 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6541f0ed0 con 0x7fd6540c85c0 2024-09-19T06:37:40.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.338+0000 7fd658d5c640 1 --2- 172.21.15.86:0/1713829497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6540c85c0 0x7fd654145c20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd64800c7f0 tx=0x7fd64800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:40.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.338+0000 7fd6517fa640 1 -- 172.21.15.86:0/1713829497 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd648015070 con 0x7fd6540c85c0 2024-09-19T06:37:40.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.338+0000 7fd6517fa640 1 -- 172.21.15.86:0/1713829497 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd648007820 con 0x7fd6540c85c0 2024-09-19T06:37:40.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.338+0000 7fd6517fa640 1 -- 172.21.15.86:0/1713829497 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd648007bd0 con 0x7fd6540c85c0 2024-09-19T06:37:40.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.338+0000 7fd65afc0640 1 -- 172.21.15.86:0/1713829497 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6541f11b0 con 0x7fd6540c85c0 2024-09-19T06:37:40.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.338+0000 7fd65afc0640 1 -- 172.21.15.86:0/1713829497 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6541f1770 con 0x7fd6540c85c0 2024-09-19T06:37:40.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.339+0000 7fd65afc0640 1 -- 172.21.15.86:0/1713829497 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6541512b0 con 0x7fd6540c85c0 2024-09-19T06:37:40.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.340+0000 7fd6517fa640 1 -- 172.21.15.86:0/1713829497 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd648018070 con 0x7fd6540c85c0 2024-09-19T06:37:40.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.340+0000 7fd6517fa640 1 --2- 172.21.15.86:0/1713829497 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd63806c2e0 0x7fd63806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:40.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.340+0000 7fd6517fa640 1 -- 172.21.15.86:0/1713829497 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd64808b7e0 con 0x7fd6540c85c0 2024-09-19T06:37:40.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.340+0000 7fd653fff640 1 --2- 172.21.15.86:0/1713829497 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd63806c2e0 0x7fd63806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:40.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.341+0000 7fd653fff640 1 --2- 172.21.15.86:0/1713829497 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd63806c2e0 0x7fd63806e7a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd640034000 tx=0x7fd64002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:40.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.344+0000 7fd6517fa640 1 -- 172.21.15.86:0/1713829497 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd6541512b0 con 0x7fd6540c85c0 2024-09-19T06:37:40.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.509+0000 7fd65afc0640 1 -- 172.21.15.86:0/1713829497 --> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd654140c40 con 0x7fd63806c2e0 2024-09-19T06:37:40.518 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.516+0000 7fd6517fa640 1 -- 172.21.15.86:0/1713829497 <== mgr.4105 v2:172.21.15.86:6816/4165134248 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332608 (secure 0 0 0) 0x7fd64003c460 con 0x7fd63806c2e0 2024-09-19T06:37:40.521 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:40.523 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-09-19T06:37:40.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.520+0000 7fd65afc0640 1 -- 172.21.15.86:0/1713829497 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd63806c2e0 msgr2=0x7fd63806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:40.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.520+0000 7fd65afc0640 1 --2- 172.21.15.86:0/1713829497 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd63806c2e0 0x7fd63806e7a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd640034000 tx=0x7fd64002e000 comp rx=0 tx=0).stop 2024-09-19T06:37:40.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.520+0000 7fd65afc0640 1 -- 172.21.15.86:0/1713829497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6540c85c0 msgr2=0x7fd654145c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:40.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.520+0000 7fd65afc0640 1 --2- 172.21.15.86:0/1713829497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6540c85c0 0x7fd654145c20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd64800c7f0 tx=0x7fd64800ccb0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.520+0000 7fd65afc0640 1 -- 172.21.15.86:0/1713829497 shutdown_connections 2024-09-19T06:37:40.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.520+0000 7fd65afc0640 1 --2- 172.21.15.86:0/1713829497 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd63806c2e0 0x7fd63806e7a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.520+0000 7fd65afc0640 1 --2- 172.21.15.86:0/1713829497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd654151750 0x7fd654148a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.520+0000 7fd65afc0640 1 --2- 172.21.15.86:0/1713829497 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6540c89e0 0x7fd6541e3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.520+0000 7fd65afc0640 1 --2- 172.21.15.86:0/1713829497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6540c85c0 0x7fd654145c20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.520+0000 7fd65afc0640 1 -- 172.21.15.86:0/1713829497 >> 172.21.15.86:0/1713829497 conn(0x7fd6540c9280 msgr2=0x7fd6540c7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:40.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.520+0000 7fd65afc0640 1 -- 172.21.15.86:0/1713829497 shutdown_connections 2024-09-19T06:37:40.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.520+0000 7fd65afc0640 1 -- 172.21.15.86:0/1713829497 wait complete. 2024-09-19T06:37:40.532 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-09-19T06:37:39.747744+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218536,"kb_used_data":2304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756184,"statfs":{"total":773094113280,"available":772870332416,"internally_reserved":0,"allocated":2359296,"data_stored":2051860,"data_compressed":65040,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002648"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030305+0000","last_change":"2024-09-19T06:37:08.446272+0000","last_active":"2024-09-19T06:37:15.030305+0000","last_peered":"2024-09-19T06:37:15.030305+0000","last_clean":"2024-09-19T06:37:15.030305+0000","last_became_active":"2024-09-19T06:37:08.446044+0000","last_became_peered":"2024-09-19T06:37:08.446044+0000","last_unstale":"2024-09-19T06:37:15.030305+0000","last_undegraded":"2024-09-19T06:37:15.030305+0000","last_fullsized":"2024-09-19T06:37:15.030305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:37.623543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477629+0000","last_change":"2024-09-19T06:37:09.441539+0000","last_active":"2024-09-19T06:37:14.477629+0000","last_peered":"2024-09-19T06:37:14.477629+0000","last_clean":"2024-09-19T06:37:14.477629+0000","last_became_active":"2024-09-19T06:37:09.440839+0000","last_became_peered":"2024-09-19T06:37:09.440839+0000","last_unstale":"2024-09-19T06:37:14.477629+0000","last_undegraded":"2024-09-19T06:37:14.477629+0000","last_fullsized":"2024-09-19T06:37:14.477629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:49.222252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477205+0000","last_change":"2024-09-19T06:37:13.461355+0000","last_active":"2024-09-19T06:37:14.477205+0000","last_peered":"2024-09-19T06:37:14.477205+0000","last_clean":"2024-09-19T06:37:14.477205+0000","last_became_active":"2024-09-19T06:37:13.460936+0000","last_became_peered":"2024-09-19T06:37:13.460936+0000","last_unstale":"2024-09-19T06:37:14.477205+0000","last_undegraded":"2024-09-19T06:37:14.477205+0000","last_fullsized":"2024-09-19T06:37:14.477205+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:59.860583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477847+0000","last_change":"2024-09-19T06:37:08.438583+0000","last_active":"2024-09-19T06:37:14.477847+0000","last_peered":"2024-09-19T06:37:14.477847+0000","last_clean":"2024-09-19T06:37:14.477847+0000","last_became_active":"2024-09-19T06:37:08.437921+0000","last_became_peered":"2024-09-19T06:37:08.437921+0000","last_unstale":"2024-09-19T06:37:14.477847+0000","last_undegraded":"2024-09-19T06:37:14.477847+0000","last_fullsized":"2024-09-19T06:37:14.477847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:58:23.269120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030018+0000","last_change":"2024-09-19T06:37:09.450731+0000","last_active":"2024-09-19T06:37:15.030018+0000","last_peered":"2024-09-19T06:37:15.030018+0000","last_clean":"2024-09-19T06:37:15.030018+0000","last_became_active":"2024-09-19T06:37:09.450430+0000","last_became_peered":"2024-09-19T06:37:09.450430+0000","last_unstale":"2024-09-19T06:37:15.030018+0000","last_undegraded":"2024-09-19T06:37:15.030018+0000","last_fullsized":"2024-09-19T06:37:15.030018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:21.701872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029552+0000","last_change":"2024-09-19T06:37:13.459445+0000","last_active":"2024-09-19T06:37:15.029552+0000","last_peered":"2024-09-19T06:37:15.029552+0000","last_clean":"2024-09-19T06:37:15.029552+0000","last_became_active":"2024-09-19T06:37:13.459040+0000","last_became_peered":"2024-09-19T06:37:13.459040+0000","last_unstale":"2024-09-19T06:37:15.029552+0000","last_undegraded":"2024-09-19T06:37:15.029552+0000","last_fullsized":"2024-09-19T06:37:15.029552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:37.676097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479475+0000","last_change":"2024-09-19T06:37:08.448303+0000","last_active":"2024-09-19T06:37:14.479475+0000","last_peered":"2024-09-19T06:37:14.479475+0000","last_clean":"2024-09-19T06:37:14.479475+0000","last_became_active":"2024-09-19T06:37:08.447559+0000","last_became_peered":"2024-09-19T06:37:08.447559+0000","last_unstale":"2024-09-19T06:37:14.479475+0000","last_undegraded":"2024-09-19T06:37:14.479475+0000","last_fullsized":"2024-09-19T06:37:14.479475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:43.093216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030079+0000","last_change":"2024-09-19T06:37:09.445971+0000","last_active":"2024-09-19T06:37:15.030079+0000","last_peered":"2024-09-19T06:37:15.030079+0000","last_clean":"2024-09-19T06:37:15.030079+0000","last_became_active":"2024-09-19T06:37:09.444806+0000","last_became_peered":"2024-09-19T06:37:09.444806+0000","last_unstale":"2024-09-19T06:37:15.030079+0000","last_undegraded":"2024-09-19T06:37:15.030079+0000","last_fullsized":"2024-09-19T06:37:15.030079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:15.765835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030528+0000","last_change":"2024-09-19T06:37:13.459035+0000","last_active":"2024-09-19T06:37:15.030528+0000","last_peered":"2024-09-19T06:37:15.030528+0000","last_clean":"2024-09-19T06:37:15.030528+0000","last_became_active":"2024-09-19T06:37:13.458588+0000","last_became_peered":"2024-09-19T06:37:13.458588+0000","last_unstale":"2024-09-19T06:37:15.030528+0000","last_undegraded":"2024-09-19T06:37:15.030528+0000","last_fullsized":"2024-09-19T06:37:15.030528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:27.900054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479040+0000","last_change":"2024-09-19T06:37:08.446363+0000","last_active":"2024-09-19T06:37:14.479040+0000","last_peered":"2024-09-19T06:37:14.479040+0000","last_clean":"2024-09-19T06:37:14.479040+0000","last_became_active":"2024-09-19T06:37:08.446053+0000","last_became_peered":"2024-09-19T06:37:08.446053+0000","last_unstale":"2024-09-19T06:37:14.479040+0000","last_undegraded":"2024-09-19T06:37:14.479040+0000","last_fullsized":"2024-09-19T06:37:14.479040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:22.488347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030495+0000","last_change":"2024-09-19T06:37:09.445124+0000","last_active":"2024-09-19T06:37:15.030495+0000","last_peered":"2024-09-19T06:37:15.030495+0000","last_clean":"2024-09-19T06:37:15.030495+0000","last_became_active":"2024-09-19T06:37:09.444824+0000","last_became_peered":"2024-09-19T06:37:09.444824+0000","last_unstale":"2024-09-19T06:37:15.030495+0000","last_undegraded":"2024-09-19T06:37:15.030495+0000","last_fullsized":"2024-09-19T06:37:15.030495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:40:05.642055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030082+0000","last_change":"2024-09-19T06:37:13.459720+0000","last_active":"2024-09-19T06:37:15.030082+0000","last_peered":"2024-09-19T06:37:15.030082+0000","last_clean":"2024-09-19T06:37:15.030082+0000","last_became_active":"2024-09-19T06:37:13.459350+0000","last_became_peered":"2024-09-19T06:37:13.459350+0000","last_unstale":"2024-09-19T06:37:15.030082+0000","last_undegraded":"2024-09-19T06:37:15.030082+0000","last_fullsized":"2024-09-19T06:37:15.030082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:29.546976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478406+0000","last_change":"2024-09-19T06:37:09.447795+0000","last_active":"2024-09-19T06:37:14.478406+0000","last_peered":"2024-09-19T06:37:14.478406+0000","last_clean":"2024-09-19T06:37:14.478406+0000","last_became_active":"2024-09-19T06:37:09.447502+0000","last_became_peered":"2024-09-19T06:37:09.447502+0000","last_unstale":"2024-09-19T06:37:14.478406+0000","last_undegraded":"2024-09-19T06:37:14.478406+0000","last_fullsized":"2024-09-19T06:37:14.478406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:51.384743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479493+0000","last_change":"2024-09-19T06:37:08.446179+0000","last_active":"2024-09-19T06:37:14.479493+0000","last_peered":"2024-09-19T06:37:14.479493+0000","last_clean":"2024-09-19T06:37:14.479493+0000","last_became_active":"2024-09-19T06:37:08.445834+0000","last_became_peered":"2024-09-19T06:37:08.445834+0000","last_unstale":"2024-09-19T06:37:14.479493+0000","last_undegraded":"2024-09-19T06:37:14.479493+0000","last_fullsized":"2024-09-19T06:37:14.479493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:03.783414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030572+0000","last_change":"2024-09-19T06:37:13.460344+0000","last_active":"2024-09-19T06:37:15.030572+0000","last_peered":"2024-09-19T06:37:15.030572+0000","last_clean":"2024-09-19T06:37:15.030572+0000","last_became_active":"2024-09-19T06:37:13.459967+0000","last_became_peered":"2024-09-19T06:37:13.459967+0000","last_unstale":"2024-09-19T06:37:15.030572+0000","last_undegraded":"2024-09-19T06:37:15.030572+0000","last_fullsized":"2024-09-19T06:37:15.030572+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:59.096218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477943+0000","last_change":"2024-09-19T06:37:09.449884+0000","last_active":"2024-09-19T06:37:14.477943+0000","last_peered":"2024-09-19T06:37:14.477943+0000","last_clean":"2024-09-19T06:37:14.477943+0000","last_became_active":"2024-09-19T06:37:09.449645+0000","last_became_peered":"2024-09-19T06:37:09.449645+0000","last_unstale":"2024-09-19T06:37:14.477943+0000","last_undegraded":"2024-09-19T06:37:14.477943+0000","last_fullsized":"2024-09-19T06:37:14.477943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:07.353098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030475+0000","last_change":"2024-09-19T06:37:08.437022+0000","last_active":"2024-09-19T06:37:15.030475+0000","last_peered":"2024-09-19T06:37:15.030475+0000","last_clean":"2024-09-19T06:37:15.030475+0000","last_became_active":"2024-09-19T06:37:08.436761+0000","last_became_peered":"2024-09-19T06:37:08.436761+0000","last_unstale":"2024-09-19T06:37:15.030475+0000","last_undegraded":"2024-09-19T06:37:15.030475+0000","last_fullsized":"2024-09-19T06:37:15.030475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:04.985581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030395+0000","last_change":"2024-09-19T06:37:13.460470+0000","last_active":"2024-09-19T06:37:15.030395+0000","last_peered":"2024-09-19T06:37:15.030395+0000","last_clean":"2024-09-19T06:37:15.030395+0000","last_became_active":"2024-09-19T06:37:13.460072+0000","last_became_peered":"2024-09-19T06:37:13.460072+0000","last_unstale":"2024-09-19T06:37:15.030395+0000","last_undegraded":"2024-09-19T06:37:15.030395+0000","last_fullsized":"2024-09-19T06:37:15.030395+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:50.835286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477295+0000","last_change":"2024-09-19T06:37:09.433042+0000","last_active":"2024-09-19T06:37:14.477295+0000","last_peered":"2024-09-19T06:37:14.477295+0000","last_clean":"2024-09-19T06:37:14.477295+0000","last_became_active":"2024-09-19T06:37:09.432589+0000","last_became_peered":"2024-09-19T06:37:09.432589+0000","last_unstale":"2024-09-19T06:37:14.477295+0000","last_undegraded":"2024-09-19T06:37:14.477295+0000","last_fullsized":"2024-09-19T06:37:14.477295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:18.661071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029869+0000","last_change":"2024-09-19T06:37:08.444408+0000","last_active":"2024-09-19T06:37:15.029869+0000","last_peered":"2024-09-19T06:37:15.029869+0000","last_clean":"2024-09-19T06:37:15.029869+0000","last_became_active":"2024-09-19T06:37:08.444160+0000","last_became_peered":"2024-09-19T06:37:08.444160+0000","last_unstale":"2024-09-19T06:37:15.029869+0000","last_undegraded":"2024-09-19T06:37:15.029869+0000","last_fullsized":"2024-09-19T06:37:15.029869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:54.304153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030788+0000","last_change":"2024-09-19T06:37:13.466175+0000","last_active":"2024-09-19T06:37:15.030788+0000","last_peered":"2024-09-19T06:37:15.030788+0000","last_clean":"2024-09-19T06:37:15.030788+0000","last_became_active":"2024-09-19T06:37:13.465731+0000","last_became_peered":"2024-09-19T06:37:13.465731+0000","last_unstale":"2024-09-19T06:37:15.030788+0000","last_undegraded":"2024-09-19T06:37:15.030788+0000","last_fullsized":"2024-09-19T06:37:15.030788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:01.100164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029947+0000","last_change":"2024-09-19T06:37:09.437254+0000","last_active":"2024-09-19T06:37:15.029947+0000","last_peered":"2024-09-19T06:37:15.029947+0000","last_clean":"2024-09-19T06:37:15.029947+0000","last_became_active":"2024-09-19T06:37:09.436512+0000","last_became_peered":"2024-09-19T06:37:09.436512+0000","last_unstale":"2024-09-19T06:37:15.029947+0000","last_undegraded":"2024-09-19T06:37:15.029947+0000","last_fullsized":"2024-09-19T06:37:15.029947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:21.893793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478028+0000","last_change":"2024-09-19T06:37:08.446216+0000","last_active":"2024-09-19T06:37:14.478028+0000","last_peered":"2024-09-19T06:37:14.478028+0000","last_clean":"2024-09-19T06:37:14.478028+0000","last_became_active":"2024-09-19T06:37:08.445845+0000","last_became_peered":"2024-09-19T06:37:08.445845+0000","last_unstale":"2024-09-19T06:37:14.478028+0000","last_undegraded":"2024-09-19T06:37:14.478028+0000","last_fullsized":"2024-09-19T06:37:14.478028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:04.033283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030215+0000","last_change":"2024-09-19T06:37:13.462192+0000","last_active":"2024-09-19T06:37:15.030215+0000","last_peered":"2024-09-19T06:37:15.030215+0000","last_clean":"2024-09-19T06:37:15.030215+0000","last_became_active":"2024-09-19T06:37:13.460955+0000","last_became_peered":"2024-09-19T06:37:13.460955+0000","last_unstale":"2024-09-19T06:37:15.030215+0000","last_undegraded":"2024-09-19T06:37:15.030215+0000","last_fullsized":"2024-09-19T06:37:15.030215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:53.583488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030554+0000","last_change":"2024-09-19T06:37:09.445989+0000","last_active":"2024-09-19T06:37:15.030554+0000","last_peered":"2024-09-19T06:37:15.030554+0000","last_clean":"2024-09-19T06:37:15.030554+0000","last_became_active":"2024-09-19T06:37:09.445705+0000","last_became_peered":"2024-09-19T06:37:09.445705+0000","last_unstale":"2024-09-19T06:37:15.030554+0000","last_undegraded":"2024-09-19T06:37:15.030554+0000","last_fullsized":"2024-09-19T06:37:15.030554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:24.592460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478969+0000","last_change":"2024-09-19T06:37:08.446226+0000","last_active":"2024-09-19T06:37:14.478969+0000","last_peered":"2024-09-19T06:37:14.478969+0000","last_clean":"2024-09-19T06:37:14.478969+0000","last_became_active":"2024-09-19T06:37:08.445929+0000","last_became_peered":"2024-09-19T06:37:08.445929+0000","last_unstale":"2024-09-19T06:37:14.478969+0000","last_undegraded":"2024-09-19T06:37:14.478969+0000","last_fullsized":"2024-09-19T06:37:14.478969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:32.233033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029648+0000","last_change":"2024-09-19T06:37:13.462598+0000","last_active":"2024-09-19T06:37:15.029648+0000","last_peered":"2024-09-19T06:37:15.029648+0000","last_clean":"2024-09-19T06:37:15.029648+0000","last_became_active":"2024-09-19T06:37:13.462217+0000","last_became_peered":"2024-09-19T06:37:13.462217+0000","last_unstale":"2024-09-19T06:37:15.029648+0000","last_undegraded":"2024-09-19T06:37:15.029648+0000","last_fullsized":"2024-09-19T06:37:15.029648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:04.109419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477866+0000","last_change":"2024-09-19T06:37:09.434309+0000","last_active":"2024-09-19T06:37:14.477866+0000","last_peered":"2024-09-19T06:37:14.477866+0000","last_clean":"2024-09-19T06:37:14.477866+0000","last_became_active":"2024-09-19T06:37:09.433897+0000","last_became_peered":"2024-09-19T06:37:09.433897+0000","last_unstale":"2024-09-19T06:37:14.477866+0000","last_undegraded":"2024-09-19T06:37:14.477866+0000","last_fullsized":"2024-09-19T06:37:14.477866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:59.054484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030307+0000","last_change":"2024-09-19T06:37:08.441525+0000","last_active":"2024-09-19T06:37:15.030307+0000","last_peered":"2024-09-19T06:37:15.030307+0000","last_clean":"2024-09-19T06:37:15.030307+0000","last_became_active":"2024-09-19T06:37:08.441245+0000","last_became_peered":"2024-09-19T06:37:08.441245+0000","last_unstale":"2024-09-19T06:37:15.030307+0000","last_undegraded":"2024-09-19T06:37:15.030307+0000","last_fullsized":"2024-09-19T06:37:15.030307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:19.820705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477133+0000","last_change":"2024-09-19T06:37:13.468486+0000","last_active":"2024-09-19T06:37:14.477133+0000","last_peered":"2024-09-19T06:37:14.477133+0000","last_clean":"2024-09-19T06:37:14.477133+0000","last_became_active":"2024-09-19T06:37:13.468074+0000","last_became_peered":"2024-09-19T06:37:13.468074+0000","last_unstale":"2024-09-19T06:37:14.477133+0000","last_undegraded":"2024-09-19T06:37:14.477133+0000","last_fullsized":"2024-09-19T06:37:14.477133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:36.783781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030772+0000","last_change":"2024-09-19T06:37:09.435864+0000","last_active":"2024-09-19T06:37:15.030772+0000","last_peered":"2024-09-19T06:37:15.030772+0000","last_clean":"2024-09-19T06:37:15.030772+0000","last_became_active":"2024-09-19T06:37:09.435597+0000","last_became_peered":"2024-09-19T06:37:09.435597+0000","last_unstale":"2024-09-19T06:37:15.030772+0000","last_undegraded":"2024-09-19T06:37:15.030772+0000","last_fullsized":"2024-09-19T06:37:15.030772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:20.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479615+0000","last_change":"2024-09-19T06:37:08.447931+0000","last_active":"2024-09-19T06:37:14.479615+0000","last_peered":"2024-09-19T06:37:14.479615+0000","last_clean":"2024-09-19T06:37:14.479615+0000","last_became_active":"2024-09-19T06:37:08.447630+0000","last_became_peered":"2024-09-19T06:37:08.447630+0000","last_unstale":"2024-09-19T06:37:14.479615+0000","last_undegraded":"2024-09-19T06:37:14.479615+0000","last_fullsized":"2024-09-19T06:37:14.479615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:17.375740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030552+0000","last_change":"2024-09-19T06:37:13.468360+0000","last_active":"2024-09-19T06:37:15.030552+0000","last_peered":"2024-09-19T06:37:15.030552+0000","last_clean":"2024-09-19T06:37:15.030552+0000","last_became_active":"2024-09-19T06:37:13.467926+0000","last_became_peered":"2024-09-19T06:37:13.467926+0000","last_unstale":"2024-09-19T06:37:15.030552+0000","last_undegraded":"2024-09-19T06:37:15.030552+0000","last_fullsized":"2024-09-19T06:37:15.030552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:55.089630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030606+0000","last_change":"2024-09-19T06:37:09.441678+0000","last_active":"2024-09-19T06:37:15.030606+0000","last_peered":"2024-09-19T06:37:15.030606+0000","last_clean":"2024-09-19T06:37:15.030606+0000","last_became_active":"2024-09-19T06:37:09.441406+0000","last_became_peered":"2024-09-19T06:37:09.441406+0000","last_unstale":"2024-09-19T06:37:15.030606+0000","last_undegraded":"2024-09-19T06:37:15.030606+0000","last_fullsized":"2024-09-19T06:37:15.030606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:14.638004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030831+0000","last_change":"2024-09-19T06:37:08.438805+0000","last_active":"2024-09-19T06:37:15.030831+0000","last_peered":"2024-09-19T06:37:15.030831+0000","last_clean":"2024-09-19T06:37:15.030831+0000","last_became_active":"2024-09-19T06:37:08.438528+0000","last_became_peered":"2024-09-19T06:37:08.438528+0000","last_unstale":"2024-09-19T06:37:15.030831+0000","last_undegraded":"2024-09-19T06:37:15.030831+0000","last_fullsized":"2024-09-19T06:37:15.030831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:55.500347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030303+0000","last_change":"2024-09-19T06:37:13.459697+0000","last_active":"2024-09-19T06:37:15.030303+0000","last_peered":"2024-09-19T06:37:15.030303+0000","last_clean":"2024-09-19T06:37:15.030303+0000","last_became_active":"2024-09-19T06:37:13.459303+0000","last_became_peered":"2024-09-19T06:37:13.459303+0000","last_unstale":"2024-09-19T06:37:15.030303+0000","last_undegraded":"2024-09-19T06:37:15.030303+0000","last_fullsized":"2024-09-19T06:37:15.030303+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:01.695905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.031009+0000","last_change":"2024-09-19T06:37:09.449701+0000","last_active":"2024-09-19T06:37:15.031009+0000","last_peered":"2024-09-19T06:37:15.031009+0000","last_clean":"2024-09-19T06:37:15.031009+0000","last_became_active":"2024-09-19T06:37:09.448899+0000","last_became_peered":"2024-09-19T06:37:09.448899+0000","last_unstale":"2024-09-19T06:37:15.031009+0000","last_undegraded":"2024-09-19T06:37:15.031009+0000","last_fullsized":"2024-09-19T06:37:15.031009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:17.448251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030609+0000","last_change":"2024-09-19T06:37:08.434263+0000","last_active":"2024-09-19T06:37:15.030609+0000","last_peered":"2024-09-19T06:37:15.030609+0000","last_clean":"2024-09-19T06:37:15.030609+0000","last_became_active":"2024-09-19T06:37:08.433984+0000","last_became_peered":"2024-09-19T06:37:08.433984+0000","last_unstale":"2024-09-19T06:37:15.030609+0000","last_undegraded":"2024-09-19T06:37:15.030609+0000","last_fullsized":"2024-09-19T06:37:15.030609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:05.599054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030728+0000","last_change":"2024-09-19T06:37:13.464527+0000","last_active":"2024-09-19T06:37:15.030728+0000","last_peered":"2024-09-19T06:37:15.030728+0000","last_clean":"2024-09-19T06:37:15.030728+0000","last_became_active":"2024-09-19T06:37:13.461685+0000","last_became_peered":"2024-09-19T06:37:13.461685+0000","last_unstale":"2024-09-19T06:37:15.030728+0000","last_undegraded":"2024-09-19T06:37:15.030728+0000","last_fullsized":"2024-09-19T06:37:15.030728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:57.229892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030028+0000","last_change":"2024-09-19T06:37:09.434421+0000","last_active":"2024-09-19T06:37:15.030028+0000","last_peered":"2024-09-19T06:37:15.030028+0000","last_clean":"2024-09-19T06:37:15.030028+0000","last_became_active":"2024-09-19T06:37:09.434119+0000","last_became_peered":"2024-09-19T06:37:09.434119+0000","last_unstale":"2024-09-19T06:37:15.030028+0000","last_undegraded":"2024-09-19T06:37:15.030028+0000","last_fullsized":"2024-09-19T06:37:15.030028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:56.984336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.814975+0000","last_change":"2024-09-19T06:37:08.436856+0000","last_active":"2024-09-19T06:37:14.814975+0000","last_peered":"2024-09-19T06:37:14.814975+0000","last_clean":"2024-09-19T06:37:14.814975+0000","last_became_active":"2024-09-19T06:37:08.435718+0000","last_became_peered":"2024-09-19T06:37:08.435718+0000","last_unstale":"2024-09-19T06:37:14.814975+0000","last_undegraded":"2024-09-19T06:37:14.814975+0000","last_fullsized":"2024-09-19T06:37:14.814975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:58.650430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030892+0000","last_change":"2024-09-19T06:37:13.466081+0000","last_active":"2024-09-19T06:37:15.030892+0000","last_peered":"2024-09-19T06:37:15.030892+0000","last_clean":"2024-09-19T06:37:15.030892+0000","last_became_active":"2024-09-19T06:37:13.465348+0000","last_became_peered":"2024-09-19T06:37:13.465348+0000","last_unstale":"2024-09-19T06:37:15.030892+0000","last_undegraded":"2024-09-19T06:37:15.030892+0000","last_fullsized":"2024-09-19T06:37:15.030892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:11.592737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029583+0000","last_change":"2024-09-19T06:37:09.444888+0000","last_active":"2024-09-19T06:37:15.029583+0000","last_peered":"2024-09-19T06:37:15.029583+0000","last_clean":"2024-09-19T06:37:15.029583+0000","last_became_active":"2024-09-19T06:37:09.444605+0000","last_became_peered":"2024-09-19T06:37:09.444605+0000","last_unstale":"2024-09-19T06:37:15.029583+0000","last_undegraded":"2024-09-19T06:37:15.029583+0000","last_fullsized":"2024-09-19T06:37:15.029583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:53.868356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478136+0000","last_change":"2024-09-19T06:37:08.446760+0000","last_active":"2024-09-19T06:37:14.478136+0000","last_peered":"2024-09-19T06:37:14.478136+0000","last_clean":"2024-09-19T06:37:14.478136+0000","last_became_active":"2024-09-19T06:37:08.446474+0000","last_became_peered":"2024-09-19T06:37:08.446474+0000","last_unstale":"2024-09-19T06:37:14.478136+0000","last_undegraded":"2024-09-19T06:37:14.478136+0000","last_fullsized":"2024-09-19T06:37:14.478136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:12.597952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030429+0000","last_change":"2024-09-19T06:37:13.471220+0000","last_active":"2024-09-19T06:37:15.030429+0000","last_peered":"2024-09-19T06:37:15.030429+0000","last_clean":"2024-09-19T06:37:15.030429+0000","last_became_active":"2024-09-19T06:37:13.470860+0000","last_became_peered":"2024-09-19T06:37:13.470860+0000","last_unstale":"2024-09-19T06:37:15.030429+0000","last_undegraded":"2024-09-19T06:37:15.030429+0000","last_fullsized":"2024-09-19T06:37:15.030429+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:07.659583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477346+0000","last_change":"2024-09-19T06:37:09.440366+0000","last_active":"2024-09-19T06:37:14.477346+0000","last_peered":"2024-09-19T06:37:14.477346+0000","last_clean":"2024-09-19T06:37:14.477346+0000","last_became_active":"2024-09-19T06:37:09.439478+0000","last_became_peered":"2024-09-19T06:37:09.439478+0000","last_unstale":"2024-09-19T06:37:14.477346+0000","last_undegraded":"2024-09-19T06:37:14.477346+0000","last_fullsized":"2024-09-19T06:37:14.477346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:21.837351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029827+0000","last_change":"2024-09-19T06:37:08.435473+0000","last_active":"2024-09-19T06:37:15.029827+0000","last_peered":"2024-09-19T06:37:15.029827+0000","last_clean":"2024-09-19T06:37:15.029827+0000","last_became_active":"2024-09-19T06:37:08.435183+0000","last_became_peered":"2024-09-19T06:37:08.435183+0000","last_unstale":"2024-09-19T06:37:15.029827+0000","last_undegraded":"2024-09-19T06:37:15.029827+0000","last_fullsized":"2024-09-19T06:37:15.029827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:53.115010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478240+0000","last_change":"2024-09-19T06:36:58.829099+0000","last_active":"2024-09-19T06:37:14.478240+0000","last_peered":"2024-09-19T06:37:14.478240+0000","last_clean":"2024-09-19T06:37:14.478240+0000","last_became_active":"2024-09-19T06:36:58.828079+0000","last_became_peered":"2024-09-19T06:36:58.828079+0000","last_unstale":"2024-09-19T06:37:14.478240+0000","last_undegraded":"2024-09-19T06:37:14.478240+0000","last_fullsized":"2024-09-19T06:37:14.478240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:36:57.771085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:36:57.771085+0000","last_clean_scrub_stamp":"2024-09-19T06:36:57.771085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:14.663925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477944+0000","last_change":"2024-09-19T06:37:13.464435+0000","last_active":"2024-09-19T06:37:14.477944+0000","last_peered":"2024-09-19T06:37:14.477944+0000","last_clean":"2024-09-19T06:37:14.477944+0000","last_became_active":"2024-09-19T06:37:13.464101+0000","last_became_peered":"2024-09-19T06:37:13.464101+0000","last_unstale":"2024-09-19T06:37:14.477944+0000","last_undegraded":"2024-09-19T06:37:14.477944+0000","last_fullsized":"2024-09-19T06:37:14.477944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:30.073937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479308+0000","last_change":"2024-09-19T06:37:09.442774+0000","last_active":"2024-09-19T06:37:14.479308+0000","last_peered":"2024-09-19T06:37:14.479308+0000","last_clean":"2024-09-19T06:37:14.479308+0000","last_became_active":"2024-09-19T06:37:09.442515+0000","last_became_peered":"2024-09-19T06:37:09.442515+0000","last_unstale":"2024-09-19T06:37:14.479308+0000","last_undegraded":"2024-09-19T06:37:14.479308+0000","last_fullsized":"2024-09-19T06:37:14.479308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:57.376059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815252+0000","last_change":"2024-09-19T06:37:08.438038+0000","last_active":"2024-09-19T06:37:14.815252+0000","last_peered":"2024-09-19T06:37:14.815252+0000","last_clean":"2024-09-19T06:37:14.815252+0000","last_became_active":"2024-09-19T06:37:08.437771+0000","last_became_peered":"2024-09-19T06:37:08.437771+0000","last_unstale":"2024-09-19T06:37:14.815252+0000","last_undegraded":"2024-09-19T06:37:14.815252+0000","last_fullsized":"2024-09-19T06:37:14.815252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:07.210382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477772+0000","last_change":"2024-09-19T06:37:13.470916+0000","last_active":"2024-09-19T06:37:14.477772+0000","last_peered":"2024-09-19T06:37:14.477772+0000","last_clean":"2024-09-19T06:37:14.477772+0000","last_became_active":"2024-09-19T06:37:13.470488+0000","last_became_peered":"2024-09-19T06:37:13.470488+0000","last_unstale":"2024-09-19T06:37:14.477772+0000","last_undegraded":"2024-09-19T06:37:14.477772+0000","last_fullsized":"2024-09-19T06:37:14.477772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:27.884932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030150+0000","last_change":"2024-09-19T06:37:09.442213+0000","last_active":"2024-09-19T06:37:15.030150+0000","last_peered":"2024-09-19T06:37:15.030150+0000","last_clean":"2024-09-19T06:37:15.030150+0000","last_became_active":"2024-09-19T06:37:09.441850+0000","last_became_peered":"2024-09-19T06:37:09.441850+0000","last_unstale":"2024-09-19T06:37:15.030150+0000","last_undegraded":"2024-09-19T06:37:15.030150+0000","last_fullsized":"2024-09-19T06:37:15.030150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:43.728914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030863+0000","last_change":"2024-09-19T06:37:08.431703+0000","last_active":"2024-09-19T06:37:15.030863+0000","last_peered":"2024-09-19T06:37:15.030863+0000","last_clean":"2024-09-19T06:37:15.030863+0000","last_became_active":"2024-09-19T06:37:08.431443+0000","last_became_peered":"2024-09-19T06:37:08.431443+0000","last_unstale":"2024-09-19T06:37:15.030863+0000","last_undegraded":"2024-09-19T06:37:15.030863+0000","last_fullsized":"2024-09-19T06:37:15.030863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:02.007521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030768+0000","last_change":"2024-09-19T06:37:13.469295+0000","last_active":"2024-09-19T06:37:15.030768+0000","last_peered":"2024-09-19T06:37:15.030768+0000","last_clean":"2024-09-19T06:37:15.030768+0000","last_became_active":"2024-09-19T06:37:13.468879+0000","last_became_peered":"2024-09-19T06:37:13.468879+0000","last_unstale":"2024-09-19T06:37:15.030768+0000","last_undegraded":"2024-09-19T06:37:15.030768+0000","last_fullsized":"2024-09-19T06:37:15.030768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:34.380034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479747+0000","last_change":"2024-09-19T06:37:09.439264+0000","last_active":"2024-09-19T06:37:14.479747+0000","last_peered":"2024-09-19T06:37:14.479747+0000","last_clean":"2024-09-19T06:37:14.479747+0000","last_became_active":"2024-09-19T06:37:09.438954+0000","last_became_peered":"2024-09-19T06:37:09.438954+0000","last_unstale":"2024-09-19T06:37:14.479747+0000","last_undegraded":"2024-09-19T06:37:14.479747+0000","last_fullsized":"2024-09-19T06:37:14.479747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:55.094093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815232+0000","last_change":"2024-09-19T06:37:08.437406+0000","last_active":"2024-09-19T06:37:14.815232+0000","last_peered":"2024-09-19T06:37:14.815232+0000","last_clean":"2024-09-19T06:37:14.815232+0000","last_became_active":"2024-09-19T06:37:08.437093+0000","last_became_peered":"2024-09-19T06:37:08.437093+0000","last_unstale":"2024-09-19T06:37:14.815232+0000","last_undegraded":"2024-09-19T06:37:14.815232+0000","last_fullsized":"2024-09-19T06:37:14.815232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:25.158027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029476+0000","last_change":"2024-09-19T06:37:13.460116+0000","last_active":"2024-09-19T06:37:15.029476+0000","last_peered":"2024-09-19T06:37:15.029476+0000","last_clean":"2024-09-19T06:37:15.029476+0000","last_became_active":"2024-09-19T06:37:13.459707+0000","last_became_peered":"2024-09-19T06:37:13.459707+0000","last_unstale":"2024-09-19T06:37:15.029476+0000","last_undegraded":"2024-09-19T06:37:15.029476+0000","last_fullsized":"2024-09-19T06:37:15.029476+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:02.657115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479032+0000","last_change":"2024-09-19T06:37:09.442670+0000","last_active":"2024-09-19T06:37:14.479032+0000","last_peered":"2024-09-19T06:37:14.479032+0000","last_clean":"2024-09-19T06:37:14.479032+0000","last_became_active":"2024-09-19T06:37:09.442390+0000","last_became_peered":"2024-09-19T06:37:09.442390+0000","last_unstale":"2024-09-19T06:37:14.479032+0000","last_undegraded":"2024-09-19T06:37:14.479032+0000","last_fullsized":"2024-09-19T06:37:14.479032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:02:26.726663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030129+0000","last_change":"2024-09-19T06:37:08.437263+0000","last_active":"2024-09-19T06:37:15.030129+0000","last_peered":"2024-09-19T06:37:15.030129+0000","last_clean":"2024-09-19T06:37:15.030129+0000","last_became_active":"2024-09-19T06:37:08.436982+0000","last_became_peered":"2024-09-19T06:37:08.436982+0000","last_unstale":"2024-09-19T06:37:15.030129+0000","last_undegraded":"2024-09-19T06:37:15.030129+0000","last_fullsized":"2024-09-19T06:37:15.030129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:14.895925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029466+0000","last_change":"2024-09-19T06:37:13.459433+0000","last_active":"2024-09-19T06:37:15.029466+0000","last_peered":"2024-09-19T06:37:15.029466+0000","last_clean":"2024-09-19T06:37:15.029466+0000","last_became_active":"2024-09-19T06:37:13.459031+0000","last_became_peered":"2024-09-19T06:37:13.459031+0000","last_unstale":"2024-09-19T06:37:15.029466+0000","last_undegraded":"2024-09-19T06:37:15.029466+0000","last_fullsized":"2024-09-19T06:37:15.029466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:07.294413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478514+0000","last_change":"2024-09-19T06:37:09.439142+0000","last_active":"2024-09-19T06:37:14.478514+0000","last_peered":"2024-09-19T06:37:14.478514+0000","last_clean":"2024-09-19T06:37:14.478514+0000","last_became_active":"2024-09-19T06:37:09.437717+0000","last_became_peered":"2024-09-19T06:37:09.437717+0000","last_unstale":"2024-09-19T06:37:14.478514+0000","last_undegraded":"2024-09-19T06:37:14.478514+0000","last_fullsized":"2024-09-19T06:37:14.478514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:32.934290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.814858+0000","last_change":"2024-09-19T06:37:08.430649+0000","last_active":"2024-09-19T06:37:14.814858+0000","last_peered":"2024-09-19T06:37:14.814858+0000","last_clean":"2024-09-19T06:37:14.814858+0000","last_became_active":"2024-09-19T06:37:08.430324+0000","last_became_peered":"2024-09-19T06:37:08.430324+0000","last_unstale":"2024-09-19T06:37:14.814858+0000","last_undegraded":"2024-09-19T06:37:14.814858+0000","last_fullsized":"2024-09-19T06:37:14.814858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:56.656357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030152+0000","last_change":"2024-09-19T06:37:13.463695+0000","last_active":"2024-09-19T06:37:15.030152+0000","last_peered":"2024-09-19T06:37:15.030152+0000","last_clean":"2024-09-19T06:37:15.030152+0000","last_became_active":"2024-09-19T06:37:13.463334+0000","last_became_peered":"2024-09-19T06:37:13.463334+0000","last_unstale":"2024-09-19T06:37:15.030152+0000","last_undegraded":"2024-09-19T06:37:15.030152+0000","last_fullsized":"2024-09-19T06:37:15.030152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:46.991800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477668+0000","last_change":"2024-09-19T06:37:09.450168+0000","last_active":"2024-09-19T06:37:14.477668+0000","last_peered":"2024-09-19T06:37:14.477668+0000","last_clean":"2024-09-19T06:37:14.477668+0000","last_became_active":"2024-09-19T06:37:09.449872+0000","last_became_peered":"2024-09-19T06:37:09.449872+0000","last_unstale":"2024-09-19T06:37:14.477668+0000","last_undegraded":"2024-09-19T06:37:14.477668+0000","last_fullsized":"2024-09-19T06:37:14.477668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:02:28.282840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478710+0000","last_change":"2024-09-19T06:37:08.442428+0000","last_active":"2024-09-19T06:37:14.478710+0000","last_peered":"2024-09-19T06:37:14.478710+0000","last_clean":"2024-09-19T06:37:14.478710+0000","last_became_active":"2024-09-19T06:37:08.442120+0000","last_became_peered":"2024-09-19T06:37:08.442120+0000","last_unstale":"2024-09-19T06:37:14.478710+0000","last_undegraded":"2024-09-19T06:37:14.478710+0000","last_fullsized":"2024-09-19T06:37:14.478710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:48.816822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477870+0000","last_change":"2024-09-19T06:37:13.471319+0000","last_active":"2024-09-19T06:37:14.477870+0000","last_peered":"2024-09-19T06:37:14.477870+0000","last_clean":"2024-09-19T06:37:14.477870+0000","last_became_active":"2024-09-19T06:37:13.470887+0000","last_became_peered":"2024-09-19T06:37:13.470887+0000","last_unstale":"2024-09-19T06:37:14.477870+0000","last_undegraded":"2024-09-19T06:37:14.477870+0000","last_fullsized":"2024-09-19T06:37:14.477870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:21.884985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479407+0000","last_change":"2024-09-19T06:37:09.439142+0000","last_active":"2024-09-19T06:37:14.479407+0000","last_peered":"2024-09-19T06:37:14.479407+0000","last_clean":"2024-09-19T06:37:14.479407+0000","last_became_active":"2024-09-19T06:37:09.437635+0000","last_became_peered":"2024-09-19T06:37:09.437635+0000","last_unstale":"2024-09-19T06:37:14.479407+0000","last_undegraded":"2024-09-19T06:37:14.479407+0000","last_fullsized":"2024-09-19T06:37:14.479407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:46.773889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030517+0000","last_change":"2024-09-19T06:37:08.438932+0000","last_active":"2024-09-19T06:37:15.030517+0000","last_peered":"2024-09-19T06:37:15.030517+0000","last_clean":"2024-09-19T06:37:15.030517+0000","last_became_active":"2024-09-19T06:37:08.438405+0000","last_became_peered":"2024-09-19T06:37:08.438405+0000","last_unstale":"2024-09-19T06:37:15.030517+0000","last_undegraded":"2024-09-19T06:37:15.030517+0000","last_fullsized":"2024-09-19T06:37:15.030517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:59.606628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477677+0000","last_change":"2024-09-19T06:37:13.459370+0000","last_active":"2024-09-19T06:37:14.477677+0000","last_peered":"2024-09-19T06:37:14.477677+0000","last_clean":"2024-09-19T06:37:14.477677+0000","last_became_active":"2024-09-19T06:37:13.458928+0000","last_became_peered":"2024-09-19T06:37:13.458928+0000","last_unstale":"2024-09-19T06:37:14.477677+0000","last_undegraded":"2024-09-19T06:37:14.477677+0000","last_fullsized":"2024-09-19T06:37:14.477677+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:00.179404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029933+0000","last_change":"2024-09-19T06:37:09.448958+0000","last_active":"2024-09-19T06:37:15.029933+0000","last_peered":"2024-09-19T06:37:15.029933+0000","last_clean":"2024-09-19T06:37:15.029933+0000","last_became_active":"2024-09-19T06:37:09.448697+0000","last_became_peered":"2024-09-19T06:37:09.448697+0000","last_unstale":"2024-09-19T06:37:15.029933+0000","last_undegraded":"2024-09-19T06:37:15.029933+0000","last_fullsized":"2024-09-19T06:37:15.029933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:16.306915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030900+0000","last_change":"2024-09-19T06:37:08.442685+0000","last_active":"2024-09-19T06:37:15.030900+0000","last_peered":"2024-09-19T06:37:15.030900+0000","last_clean":"2024-09-19T06:37:15.030900+0000","last_became_active":"2024-09-19T06:37:08.442436+0000","last_became_peered":"2024-09-19T06:37:08.442436+0000","last_unstale":"2024-09-19T06:37:15.030900+0000","last_undegraded":"2024-09-19T06:37:15.030900+0000","last_fullsized":"2024-09-19T06:37:15.030900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:09.952733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030332+0000","last_change":"2024-09-19T06:37:13.457651+0000","last_active":"2024-09-19T06:37:15.030332+0000","last_peered":"2024-09-19T06:37:15.030332+0000","last_clean":"2024-09-19T06:37:15.030332+0000","last_became_active":"2024-09-19T06:37:13.457246+0000","last_became_peered":"2024-09-19T06:37:13.457246+0000","last_unstale":"2024-09-19T06:37:15.030332+0000","last_undegraded":"2024-09-19T06:37:15.030332+0000","last_fullsized":"2024-09-19T06:37:15.030332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:18.553158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479228+0000","last_change":"2024-09-19T06:37:09.441212+0000","last_active":"2024-09-19T06:37:14.479228+0000","last_peered":"2024-09-19T06:37:14.479228+0000","last_clean":"2024-09-19T06:37:14.479228+0000","last_became_active":"2024-09-19T06:37:09.440209+0000","last_became_peered":"2024-09-19T06:37:09.440209+0000","last_unstale":"2024-09-19T06:37:14.479228+0000","last_undegraded":"2024-09-19T06:37:14.479228+0000","last_fullsized":"2024-09-19T06:37:14.479228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:52.173784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:24.168847+0000","last_change":"2024-09-19T06:37:08.442615+0000","last_active":"2024-09-19T06:37:24.168847+0000","last_peered":"2024-09-19T06:37:24.168847+0000","last_clean":"2024-09-19T06:37:24.168847+0000","last_became_active":"2024-09-19T06:37:08.442242+0000","last_became_peered":"2024-09-19T06:37:08.442242+0000","last_unstale":"2024-09-19T06:37:24.168847+0000","last_undegraded":"2024-09-19T06:37:24.168847+0000","last_fullsized":"2024-09-19T06:37:24.168847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:23.813400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030495+0000","last_change":"2024-09-19T06:37:13.464688+0000","last_active":"2024-09-19T06:37:15.030495+0000","last_peered":"2024-09-19T06:37:15.030495+0000","last_clean":"2024-09-19T06:37:15.030495+0000","last_became_active":"2024-09-19T06:37:13.461620+0000","last_became_peered":"2024-09-19T06:37:13.461620+0000","last_unstale":"2024-09-19T06:37:15.030495+0000","last_undegraded":"2024-09-19T06:37:15.030495+0000","last_fullsized":"2024-09-19T06:37:15.030495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:02.928332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030727+0000","last_change":"2024-09-19T06:37:09.440021+0000","last_active":"2024-09-19T06:37:15.030727+0000","last_peered":"2024-09-19T06:37:15.030727+0000","last_clean":"2024-09-19T06:37:15.030727+0000","last_became_active":"2024-09-19T06:37:09.437800+0000","last_became_peered":"2024-09-19T06:37:09.437800+0000","last_unstale":"2024-09-19T06:37:15.030727+0000","last_undegraded":"2024-09-19T06:37:15.030727+0000","last_fullsized":"2024-09-19T06:37:15.030727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:51.963097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030761+0000","last_change":"2024-09-19T06:37:08.434422+0000","last_active":"2024-09-19T06:37:15.030761+0000","last_peered":"2024-09-19T06:37:15.030761+0000","last_clean":"2024-09-19T06:37:15.030761+0000","last_became_active":"2024-09-19T06:37:08.434151+0000","last_became_peered":"2024-09-19T06:37:08.434151+0000","last_unstale":"2024-09-19T06:37:15.030761+0000","last_undegraded":"2024-09-19T06:37:15.030761+0000","last_fullsized":"2024-09-19T06:37:15.030761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:49.540748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030746+0000","last_change":"2024-09-19T06:37:13.459321+0000","last_active":"2024-09-19T06:37:15.030746+0000","last_peered":"2024-09-19T06:37:15.030746+0000","last_clean":"2024-09-19T06:37:15.030746+0000","last_became_active":"2024-09-19T06:37:13.458924+0000","last_became_peered":"2024-09-19T06:37:13.458924+0000","last_unstale":"2024-09-19T06:37:15.030746+0000","last_undegraded":"2024-09-19T06:37:15.030746+0000","last_fullsized":"2024-09-19T06:37:15.030746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:11.428574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030167+0000","last_change":"2024-09-19T06:37:09.448450+0000","last_active":"2024-09-19T06:37:15.030167+0000","last_peered":"2024-09-19T06:37:15.030167+0000","last_clean":"2024-09-19T06:37:15.030167+0000","last_became_active":"2024-09-19T06:37:09.448173+0000","last_became_peered":"2024-09-19T06:37:09.448173+0000","last_unstale":"2024-09-19T06:37:15.030167+0000","last_undegraded":"2024-09-19T06:37:15.030167+0000","last_fullsized":"2024-09-19T06:37:15.030167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:22.442374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030854+0000","last_change":"2024-09-19T06:37:08.442796+0000","last_active":"2024-09-19T06:37:15.030854+0000","last_peered":"2024-09-19T06:37:15.030854+0000","last_clean":"2024-09-19T06:37:15.030854+0000","last_became_active":"2024-09-19T06:37:08.442126+0000","last_became_peered":"2024-09-19T06:37:08.442126+0000","last_unstale":"2024-09-19T06:37:15.030854+0000","last_undegraded":"2024-09-19T06:37:15.030854+0000","last_fullsized":"2024-09-19T06:37:15.030854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:27.716141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477293+0000","last_change":"2024-09-19T06:37:13.464100+0000","last_active":"2024-09-19T06:37:14.477293+0000","last_peered":"2024-09-19T06:37:14.477293+0000","last_clean":"2024-09-19T06:37:14.477293+0000","last_became_active":"2024-09-19T06:37:13.462750+0000","last_became_peered":"2024-09-19T06:37:13.462750+0000","last_unstale":"2024-09-19T06:37:14.477293+0000","last_undegraded":"2024-09-19T06:37:14.477293+0000","last_fullsized":"2024-09-19T06:37:14.477293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:49.139841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030752+0000","last_change":"2024-09-19T06:37:09.448328+0000","last_active":"2024-09-19T06:37:15.030752+0000","last_peered":"2024-09-19T06:37:15.030752+0000","last_clean":"2024-09-19T06:37:15.030752+0000","last_became_active":"2024-09-19T06:37:09.448056+0000","last_became_peered":"2024-09-19T06:37:09.448056+0000","last_unstale":"2024-09-19T06:37:15.030752+0000","last_undegraded":"2024-09-19T06:37:15.030752+0000","last_fullsized":"2024-09-19T06:37:15.030752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:53.451104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478778+0000","last_change":"2024-09-19T06:37:08.439543+0000","last_active":"2024-09-19T06:37:14.478778+0000","last_peered":"2024-09-19T06:37:14.478778+0000","last_clean":"2024-09-19T06:37:14.478778+0000","last_became_active":"2024-09-19T06:37:08.438785+0000","last_became_peered":"2024-09-19T06:37:08.438785+0000","last_unstale":"2024-09-19T06:37:14.478778+0000","last_undegraded":"2024-09-19T06:37:14.478778+0000","last_fullsized":"2024-09-19T06:37:14.478778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:51.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477286+0000","last_change":"2024-09-19T06:37:13.462327+0000","last_active":"2024-09-19T06:37:14.477286+0000","last_peered":"2024-09-19T06:37:14.477286+0000","last_clean":"2024-09-19T06:37:14.477286+0000","last_became_active":"2024-09-19T06:37:13.461762+0000","last_became_peered":"2024-09-19T06:37:13.461762+0000","last_unstale":"2024-09-19T06:37:14.477286+0000","last_undegraded":"2024-09-19T06:37:14.477286+0000","last_fullsized":"2024-09-19T06:37:14.477286+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:26.931537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029982+0000","last_change":"2024-09-19T06:37:13.471309+0000","last_active":"2024-09-19T06:37:15.029982+0000","last_peered":"2024-09-19T06:37:15.029982+0000","last_clean":"2024-09-19T06:37:15.029982+0000","last_became_active":"2024-09-19T06:37:13.470969+0000","last_became_peered":"2024-09-19T06:37:13.470969+0000","last_unstale":"2024-09-19T06:37:15.029982+0000","last_undegraded":"2024-09-19T06:37:15.029982+0000","last_fullsized":"2024-09-19T06:37:15.029982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:30.990159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029769+0000","last_change":"2024-09-19T06:37:09.443308+0000","last_active":"2024-09-19T06:37:15.029769+0000","last_peered":"2024-09-19T06:37:15.029769+0000","last_clean":"2024-09-19T06:37:15.029769+0000","last_became_active":"2024-09-19T06:37:09.443069+0000","last_became_peered":"2024-09-19T06:37:09.443069+0000","last_unstale":"2024-09-19T06:37:15.029769+0000","last_undegraded":"2024-09-19T06:37:15.029769+0000","last_fullsized":"2024-09-19T06:37:15.029769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:31:33.708578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029646+0000","last_change":"2024-09-19T06:37:08.441967+0000","last_active":"2024-09-19T06:37:15.029646+0000","last_peered":"2024-09-19T06:37:15.029646+0000","last_clean":"2024-09-19T06:37:15.029646+0000","last_became_active":"2024-09-19T06:37:08.441698+0000","last_became_peered":"2024-09-19T06:37:08.441698+0000","last_unstale":"2024-09-19T06:37:15.029646+0000","last_undegraded":"2024-09-19T06:37:15.029646+0000","last_fullsized":"2024-09-19T06:37:15.029646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:56.933775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478180+0000","last_change":"2024-09-19T06:37:13.470903+0000","last_active":"2024-09-19T06:37:14.478180+0000","last_peered":"2024-09-19T06:37:14.478180+0000","last_clean":"2024-09-19T06:37:14.478180+0000","last_became_active":"2024-09-19T06:37:13.470528+0000","last_became_peered":"2024-09-19T06:37:13.470528+0000","last_unstale":"2024-09-19T06:37:14.478180+0000","last_undegraded":"2024-09-19T06:37:14.478180+0000","last_fullsized":"2024-09-19T06:37:14.478180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:45.999436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477209+0000","last_change":"2024-09-19T06:37:09.448953+0000","last_active":"2024-09-19T06:37:14.477209+0000","last_peered":"2024-09-19T06:37:14.477209+0000","last_clean":"2024-09-19T06:37:14.477209+0000","last_became_active":"2024-09-19T06:37:09.448658+0000","last_became_peered":"2024-09-19T06:37:09.448658+0000","last_unstale":"2024-09-19T06:37:14.477209+0000","last_undegraded":"2024-09-19T06:37:14.477209+0000","last_fullsized":"2024-09-19T06:37:14.477209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:07.333392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477562+0000","last_change":"2024-09-19T06:37:08.440800+0000","last_active":"2024-09-19T06:37:14.477562+0000","last_peered":"2024-09-19T06:37:14.477562+0000","last_clean":"2024-09-19T06:37:14.477562+0000","last_became_active":"2024-09-19T06:37:08.440591+0000","last_became_peered":"2024-09-19T06:37:08.440591+0000","last_unstale":"2024-09-19T06:37:14.477562+0000","last_undegraded":"2024-09-19T06:37:14.477562+0000","last_fullsized":"2024-09-19T06:37:14.477562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:05.540261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478578+0000","last_change":"2024-09-19T06:37:08.441268+0000","last_active":"2024-09-19T06:37:14.478578+0000","last_peered":"2024-09-19T06:37:14.478578+0000","last_clean":"2024-09-19T06:37:14.478578+0000","last_became_active":"2024-09-19T06:37:08.440969+0000","last_became_peered":"2024-09-19T06:37:08.440969+0000","last_unstale":"2024-09-19T06:37:14.478578+0000","last_undegraded":"2024-09-19T06:37:14.478578+0000","last_fullsized":"2024-09-19T06:37:14.478578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:59.426336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030814+0000","last_change":"2024-09-19T06:37:09.444857+0000","last_active":"2024-09-19T06:37:15.030814+0000","last_peered":"2024-09-19T06:37:15.030814+0000","last_clean":"2024-09-19T06:37:15.030814+0000","last_became_active":"2024-09-19T06:37:09.444562+0000","last_became_peered":"2024-09-19T06:37:09.444562+0000","last_unstale":"2024-09-19T06:37:15.030814+0000","last_undegraded":"2024-09-19T06:37:15.030814+0000","last_fullsized":"2024-09-19T06:37:15.030814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:02.470787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815254+0000","last_change":"2024-09-19T06:37:13.467183+0000","last_active":"2024-09-19T06:37:14.815254+0000","last_peered":"2024-09-19T06:37:14.815254+0000","last_clean":"2024-09-19T06:37:14.815254+0000","last_became_active":"2024-09-19T06:37:13.466765+0000","last_became_peered":"2024-09-19T06:37:13.466765+0000","last_unstale":"2024-09-19T06:37:14.815254+0000","last_undegraded":"2024-09-19T06:37:14.815254+0000","last_fullsized":"2024-09-19T06:37:14.815254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:35.184815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477901+0000","last_change":"2024-09-19T06:37:08.443993+0000","last_active":"2024-09-19T06:37:14.477901+0000","last_peered":"2024-09-19T06:37:14.477901+0000","last_clean":"2024-09-19T06:37:14.477901+0000","last_became_active":"2024-09-19T06:37:08.443774+0000","last_became_peered":"2024-09-19T06:37:08.443774+0000","last_unstale":"2024-09-19T06:37:14.477901+0000","last_undegraded":"2024-09-19T06:37:14.477901+0000","last_fullsized":"2024-09-19T06:37:14.477901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:16.005073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029942+0000","last_change":"2024-09-19T06:37:09.440258+0000","last_active":"2024-09-19T06:37:15.029942+0000","last_peered":"2024-09-19T06:37:15.029942+0000","last_clean":"2024-09-19T06:37:15.029942+0000","last_became_active":"2024-09-19T06:37:09.438457+0000","last_became_peered":"2024-09-19T06:37:09.438457+0000","last_unstale":"2024-09-19T06:37:15.029942+0000","last_undegraded":"2024-09-19T06:37:15.029942+0000","last_fullsized":"2024-09-19T06:37:15.029942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:24.636340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477624+0000","last_change":"2024-09-19T06:37:13.462800+0000","last_active":"2024-09-19T06:37:14.477624+0000","last_peered":"2024-09-19T06:37:14.477624+0000","last_clean":"2024-09-19T06:37:14.477624+0000","last_became_active":"2024-09-19T06:37:13.462393+0000","last_became_peered":"2024-09-19T06:37:13.462393+0000","last_unstale":"2024-09-19T06:37:14.477624+0000","last_undegraded":"2024-09-19T06:37:14.477624+0000","last_fullsized":"2024-09-19T06:37:14.477624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:35.901637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477580+0000","last_change":"2024-09-19T06:37:09.450421+0000","last_active":"2024-09-19T06:37:14.477580+0000","last_peered":"2024-09-19T06:37:14.477580+0000","last_clean":"2024-09-19T06:37:14.477580+0000","last_became_active":"2024-09-19T06:37:09.450147+0000","last_became_peered":"2024-09-19T06:37:09.450147+0000","last_unstale":"2024-09-19T06:37:14.477580+0000","last_undegraded":"2024-09-19T06:37:14.477580+0000","last_fullsized":"2024-09-19T06:37:14.477580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:42.949759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.814967+0000","last_change":"2024-09-19T06:37:09.435131+0000","last_active":"2024-09-19T06:37:14.814967+0000","last_peered":"2024-09-19T06:37:14.814967+0000","last_clean":"2024-09-19T06:37:14.814967+0000","last_became_active":"2024-09-19T06:37:09.434840+0000","last_became_peered":"2024-09-19T06:37:09.434840+0000","last_unstale":"2024-09-19T06:37:14.814967+0000","last_undegraded":"2024-09-19T06:37:14.814967+0000","last_fullsized":"2024-09-19T06:37:14.814967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:20.484554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030415+0000","last_change":"2024-09-19T06:37:09.445196+0000","last_active":"2024-09-19T06:37:15.030415+0000","last_peered":"2024-09-19T06:37:15.030415+0000","last_clean":"2024-09-19T06:37:15.030415+0000","last_became_active":"2024-09-19T06:37:09.444907+0000","last_became_peered":"2024-09-19T06:37:09.444907+0000","last_unstale":"2024-09-19T06:37:15.030415+0000","last_undegraded":"2024-09-19T06:37:15.030415+0000","last_fullsized":"2024-09-19T06:37:15.030415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:17.605675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030729+0000","last_change":"2024-09-19T06:37:09.447966+0000","last_active":"2024-09-19T06:37:15.030729+0000","last_peered":"2024-09-19T06:37:15.030729+0000","last_clean":"2024-09-19T06:37:15.030729+0000","last_became_active":"2024-09-19T06:37:09.447692+0000","last_became_peered":"2024-09-19T06:37:09.447692+0000","last_unstale":"2024-09-19T06:37:15.030729+0000","last_undegraded":"2024-09-19T06:37:15.030729+0000","last_fullsized":"2024-09-19T06:37:15.030729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:01.517824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477900+0000","last_change":"2024-09-19T06:37:09.442651+0000","last_active":"2024-09-19T06:37:14.477900+0000","last_peered":"2024-09-19T06:37:14.477900+0000","last_clean":"2024-09-19T06:37:14.477900+0000","last_became_active":"2024-09-19T06:37:09.442195+0000","last_became_peered":"2024-09-19T06:37:09.442195+0000","last_unstale":"2024-09-19T06:37:14.477900+0000","last_undegraded":"2024-09-19T06:37:14.477900+0000","last_fullsized":"2024-09-19T06:37:14.477900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:15.658285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030600+0000","last_change":"2024-09-19T06:37:09.441782+0000","last_active":"2024-09-19T06:37:15.030600+0000","last_peered":"2024-09-19T06:37:15.030600+0000","last_clean":"2024-09-19T06:37:15.030600+0000","last_became_active":"2024-09-19T06:37:09.441456+0000","last_became_peered":"2024-09-19T06:37:09.441456+0000","last_unstale":"2024-09-19T06:37:15.030600+0000","last_undegraded":"2024-09-19T06:37:15.030600+0000","last_fullsized":"2024-09-19T06:37:15.030600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:04:28.458974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479237+0000","last_change":"2024-09-19T06:37:09.449856+0000","last_active":"2024-09-19T06:37:14.479237+0000","last_peered":"2024-09-19T06:37:14.479237+0000","last_clean":"2024-09-19T06:37:14.479237+0000","last_became_active":"2024-09-19T06:37:09.449562+0000","last_became_peered":"2024-09-19T06:37:09.449562+0000","last_unstale":"2024-09-19T06:37:14.479237+0000","last_undegraded":"2024-09-19T06:37:14.479237+0000","last_fullsized":"2024-09-19T06:37:14.479237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:49.182126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477764+0000","last_change":"2024-09-19T06:37:09.438551+0000","last_active":"2024-09-19T06:37:14.477764+0000","last_peered":"2024-09-19T06:37:14.477764+0000","last_clean":"2024-09-19T06:37:14.477764+0000","last_became_active":"2024-09-19T06:37:09.437624+0000","last_became_peered":"2024-09-19T06:37:09.437624+0000","last_unstale":"2024-09-19T06:37:14.477764+0000","last_undegraded":"2024-09-19T06:37:14.477764+0000","last_fullsized":"2024-09-19T06:37:14.477764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:46.565780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029601+0000","last_change":"2024-09-19T06:37:09.438737+0000","last_active":"2024-09-19T06:37:15.029601+0000","last_peered":"2024-09-19T06:37:15.029601+0000","last_clean":"2024-09-19T06:37:15.029601+0000","last_became_active":"2024-09-19T06:37:09.438453+0000","last_became_peered":"2024-09-19T06:37:09.438453+0000","last_unstale":"2024-09-19T06:37:15.029601+0000","last_undegraded":"2024-09-19T06:37:15.029601+0000","last_fullsized":"2024-09-19T06:37:15.029601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.982275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477390+0000","last_change":"2024-09-19T06:37:09.442093+0000","last_active":"2024-09-19T06:37:14.477390+0000","last_peered":"2024-09-19T06:37:14.477390+0000","last_clean":"2024-09-19T06:37:14.477390+0000","last_became_active":"2024-09-19T06:37:09.439710+0000","last_became_peered":"2024-09-19T06:37:09.439710+0000","last_unstale":"2024-09-19T06:37:14.477390+0000","last_undegraded":"2024-09-19T06:37:14.477390+0000","last_fullsized":"2024-09-19T06:37:14.477390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:02.626854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030310+0000","last_change":"2024-09-19T06:37:09.438271+0000","last_active":"2024-09-19T06:37:15.030310+0000","last_peered":"2024-09-19T06:37:15.030310+0000","last_clean":"2024-09-19T06:37:15.030310+0000","last_became_active":"2024-09-19T06:37:09.438009+0000","last_became_peered":"2024-09-19T06:37:09.438009+0000","last_unstale":"2024-09-19T06:37:15.030310+0000","last_undegraded":"2024-09-19T06:37:15.030310+0000","last_fullsized":"2024-09-19T06:37:15.030310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:26.395210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030632+0000","last_change":"2024-09-19T06:37:09.449633+0000","last_active":"2024-09-19T06:37:15.030632+0000","last_peered":"2024-09-19T06:37:15.030632+0000","last_clean":"2024-09-19T06:37:15.030632+0000","last_became_active":"2024-09-19T06:37:09.449379+0000","last_became_peered":"2024-09-19T06:37:09.449379+0000","last_unstale":"2024-09-19T06:37:15.030632+0000","last_undegraded":"2024-09-19T06:37:15.030632+0000","last_fullsized":"2024-09-19T06:37:15.030632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:29.565038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478253+0000","last_change":"2024-09-19T06:37:09.447808+0000","last_active":"2024-09-19T06:37:14.478253+0000","last_peered":"2024-09-19T06:37:14.478253+0000","last_clean":"2024-09-19T06:37:14.478253+0000","last_became_active":"2024-09-19T06:37:09.447514+0000","last_became_peered":"2024-09-19T06:37:09.447514+0000","last_unstale":"2024-09-19T06:37:14.478253+0000","last_undegraded":"2024-09-19T06:37:14.478253+0000","last_fullsized":"2024-09-19T06:37:14.478253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:04.653997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479576+0000","last_change":"2024-09-19T06:37:09.439605+0000","last_active":"2024-09-19T06:37:14.479576+0000","last_peered":"2024-09-19T06:37:14.479576+0000","last_clean":"2024-09-19T06:37:14.479576+0000","last_became_active":"2024-09-19T06:37:09.432601+0000","last_became_peered":"2024-09-19T06:37:09.432601+0000","last_unstale":"2024-09-19T06:37:14.479576+0000","last_undegraded":"2024-09-19T06:37:14.479576+0000","last_fullsized":"2024-09-19T06:37:14.479576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:50.640062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815206+0000","last_change":"2024-09-19T06:37:09.440268+0000","last_active":"2024-09-19T06:37:14.815206+0000","last_peered":"2024-09-19T06:37:14.815206+0000","last_clean":"2024-09-19T06:37:14.815206+0000","last_became_active":"2024-09-19T06:37:09.439937+0000","last_became_peered":"2024-09-19T06:37:09.439937+0000","last_unstale":"2024-09-19T06:37:14.815206+0000","last_undegraded":"2024-09-19T06:37:14.815206+0000","last_fullsized":"2024-09-19T06:37:14.815206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:32:46.182979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030922+0000","last_change":"2024-09-19T06:37:09.437080+0000","last_active":"2024-09-19T06:37:15.030922+0000","last_peered":"2024-09-19T06:37:15.030922+0000","last_clean":"2024-09-19T06:37:15.030922+0000","last_became_active":"2024-09-19T06:37:09.436752+0000","last_became_peered":"2024-09-19T06:37:09.436752+0000","last_unstale":"2024-09-19T06:37:15.030922+0000","last_undegraded":"2024-09-19T06:37:15.030922+0000","last_fullsized":"2024-09-19T06:37:15.030922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:31.423640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029549+0000","last_change":"2024-09-19T06:37:09.448942+0000","last_active":"2024-09-19T06:37:15.029549+0000","last_peered":"2024-09-19T06:37:15.029549+0000","last_clean":"2024-09-19T06:37:15.029549+0000","last_became_active":"2024-09-19T06:37:09.448647+0000","last_became_peered":"2024-09-19T06:37:09.448647+0000","last_unstale":"2024-09-19T06:37:15.029549+0000","last_undegraded":"2024-09-19T06:37:15.029549+0000","last_fullsized":"2024-09-19T06:37:15.029549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:49.027909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029809+0000","last_change":"2024-09-19T06:37:09.445015+0000","last_active":"2024-09-19T06:37:15.029809+0000","last_peered":"2024-09-19T06:37:15.029809+0000","last_clean":"2024-09-19T06:37:15.029809+0000","last_became_active":"2024-09-19T06:37:09.444737+0000","last_became_peered":"2024-09-19T06:37:09.444737+0000","last_unstale":"2024-09-19T06:37:15.029809+0000","last_undegraded":"2024-09-19T06:37:15.029809+0000","last_fullsized":"2024-09-19T06:37:15.029809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:16.194580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029853+0000","last_change":"2024-09-19T06:37:09.446025+0000","last_active":"2024-09-19T06:37:15.029853+0000","last_peered":"2024-09-19T06:37:15.029853+0000","last_clean":"2024-09-19T06:37:15.029853+0000","last_became_active":"2024-09-19T06:37:09.445503+0000","last_became_peered":"2024-09-19T06:37:09.445503+0000","last_unstale":"2024-09-19T06:37:15.029853+0000","last_undegraded":"2024-09-19T06:37:15.029853+0000","last_fullsized":"2024-09-19T06:37:15.029853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:30.469995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477784+0000","last_change":"2024-09-19T06:37:09.441302+0000","last_active":"2024-09-19T06:37:14.477784+0000","last_peered":"2024-09-19T06:37:14.477784+0000","last_clean":"2024-09-19T06:37:14.477784+0000","last_became_active":"2024-09-19T06:37:09.439767+0000","last_became_peered":"2024-09-19T06:37:09.439767+0000","last_unstale":"2024-09-19T06:37:14.477784+0000","last_undegraded":"2024-09-19T06:37:14.477784+0000","last_fullsized":"2024-09-19T06:37:14.477784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:01.038823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030560+0000","last_change":"2024-09-19T06:37:09.440976+0000","last_active":"2024-09-19T06:37:15.030560+0000","last_peered":"2024-09-19T06:37:15.030560+0000","last_clean":"2024-09-19T06:37:15.030560+0000","last_became_active":"2024-09-19T06:37:09.440702+0000","last_became_peered":"2024-09-19T06:37:09.440702+0000","last_unstale":"2024-09-19T06:37:15.030560+0000","last_undegraded":"2024-09-19T06:37:15.030560+0000","last_fullsized":"2024-09-19T06:37:15.030560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:21.281400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477942+0000","last_change":"2024-09-19T06:37:09.442301+0000","last_active":"2024-09-19T06:37:14.477942+0000","last_peered":"2024-09-19T06:37:14.477942+0000","last_clean":"2024-09-19T06:37:14.477942+0000","last_became_active":"2024-09-19T06:37:09.442053+0000","last_became_peered":"2024-09-19T06:37:09.442053+0000","last_unstale":"2024-09-19T06:37:14.477942+0000","last_undegraded":"2024-09-19T06:37:14.477942+0000","last_fullsized":"2024-09-19T06:37:14.477942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:26.189384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479335+0000","last_change":"2024-09-19T06:37:09.441525+0000","last_active":"2024-09-19T06:37:14.479335+0000","last_peered":"2024-09-19T06:37:14.479335+0000","last_clean":"2024-09-19T06:37:14.479335+0000","last_became_active":"2024-09-19T06:37:09.441179+0000","last_became_peered":"2024-09-19T06:37:09.441179+0000","last_unstale":"2024-09-19T06:37:14.479335+0000","last_undegraded":"2024-09-19T06:37:14.479335+0000","last_fullsized":"2024-09-19T06:37:14.479335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:47.235113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479743+0000","last_change":"2024-09-19T06:37:09.437163+0000","last_active":"2024-09-19T06:37:14.479743+0000","last_peered":"2024-09-19T06:37:14.479743+0000","last_clean":"2024-09-19T06:37:14.479743+0000","last_became_active":"2024-09-19T06:37:09.436892+0000","last_became_peered":"2024-09-19T06:37:09.436892+0000","last_unstale":"2024-09-19T06:37:14.479743+0000","last_undegraded":"2024-09-19T06:37:14.479743+0000","last_fullsized":"2024-09-19T06:37:14.479743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:47:58.347385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477114+0000","last_change":"2024-09-19T06:37:09.437524+0000","last_active":"2024-09-19T06:37:14.477114+0000","last_peered":"2024-09-19T06:37:14.477114+0000","last_clean":"2024-09-19T06:37:14.477114+0000","last_became_active":"2024-09-19T06:37:09.437023+0000","last_became_peered":"2024-09-19T06:37:09.437023+0000","last_unstale":"2024-09-19T06:37:14.477114+0000","last_undegraded":"2024-09-19T06:37:14.477114+0000","last_fullsized":"2024-09-19T06:37:14.477114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:31.398914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478456+0000","last_change":"2024-09-19T06:37:09.448814+0000","last_active":"2024-09-19T06:37:14.478456+0000","last_peered":"2024-09-19T06:37:14.478456+0000","last_clean":"2024-09-19T06:37:14.478456+0000","last_became_active":"2024-09-19T06:37:09.448547+0000","last_became_peered":"2024-09-19T06:37:09.448547+0000","last_unstale":"2024-09-19T06:37:14.478456+0000","last_undegraded":"2024-09-19T06:37:14.478456+0000","last_fullsized":"2024-09-19T06:37:14.478456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:13.526300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030114+0000","last_change":"2024-09-19T06:37:09.446910+0000","last_active":"2024-09-19T06:37:15.030114+0000","last_peered":"2024-09-19T06:37:15.030114+0000","last_clean":"2024-09-19T06:37:15.030114+0000","last_became_active":"2024-09-19T06:37:09.446603+0000","last_became_peered":"2024-09-19T06:37:09.446603+0000","last_unstale":"2024-09-19T06:37:15.030114+0000","last_undegraded":"2024-09-19T06:37:15.030114+0000","last_fullsized":"2024-09-19T06:37:15.030114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:47.006354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479198+0000","last_change":"2024-09-19T06:37:09.430160+0000","last_active":"2024-09-19T06:37:14.479198+0000","last_peered":"2024-09-19T06:37:14.479198+0000","last_clean":"2024-09-19T06:37:14.479198+0000","last_became_active":"2024-09-19T06:37:09.429813+0000","last_became_peered":"2024-09-19T06:37:09.429813+0000","last_unstale":"2024-09-19T06:37:14.479198+0000","last_undegraded":"2024-09-19T06:37:14.479198+0000","last_fullsized":"2024-09-19T06:37:14.479198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:10.353834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030011+0000","last_change":"2024-09-19T06:37:09.446622+0000","last_active":"2024-09-19T06:37:15.030011+0000","last_peered":"2024-09-19T06:37:15.030011+0000","last_clean":"2024-09-19T06:37:15.030011+0000","last_became_active":"2024-09-19T06:37:09.446349+0000","last_became_peered":"2024-09-19T06:37:09.446349+0000","last_unstale":"2024-09-19T06:37:15.030011+0000","last_undegraded":"2024-09-19T06:37:15.030011+0000","last_fullsized":"2024-09-19T06:37:15.030011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:01.702039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030152+0000","last_change":"2024-09-19T06:37:09.446789+0000","last_active":"2024-09-19T06:37:15.030152+0000","last_peered":"2024-09-19T06:37:15.030152+0000","last_clean":"2024-09-19T06:37:15.030152+0000","last_became_active":"2024-09-19T06:37:09.446557+0000","last_became_peered":"2024-09-19T06:37:09.446557+0000","last_unstale":"2024-09-19T06:37:15.030152+0000","last_undegraded":"2024-09-19T06:37:15.030152+0000","last_fullsized":"2024-09-19T06:37:15.030152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:18.119474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030246+0000","last_change":"2024-09-19T06:37:09.448093+0000","last_active":"2024-09-19T06:37:15.030246+0000","last_peered":"2024-09-19T06:37:15.030246+0000","last_clean":"2024-09-19T06:37:15.030246+0000","last_became_active":"2024-09-19T06:37:09.447753+0000","last_became_peered":"2024-09-19T06:37:09.447753+0000","last_unstale":"2024-09-19T06:37:15.030246+0000","last_undegraded":"2024-09-19T06:37:15.030246+0000","last_fullsized":"2024-09-19T06:37:15.030246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:11.944092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479640+0000","last_change":"2024-09-19T06:37:09.442798+0000","last_active":"2024-09-19T06:37:14.479640+0000","last_peered":"2024-09-19T06:37:14.479640+0000","last_clean":"2024-09-19T06:37:14.479640+0000","last_became_active":"2024-09-19T06:37:09.442047+0000","last_became_peered":"2024-09-19T06:37:09.442047+0000","last_unstale":"2024-09-19T06:37:14.479640+0000","last_undegraded":"2024-09-19T06:37:14.479640+0000","last_fullsized":"2024-09-19T06:37:14.479640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:33.193185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65040,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509452,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509452,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":348160,"data_stored":698736,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":698680,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":107730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:37:40.537 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:37:40.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.669+0000 7f5881d4b640 1 Processor -- start 2024-09-19T06:37:40.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.669+0000 7f5881d4b640 1 -- start start 2024-09-19T06:37:40.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.670+0000 7f5881d4b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f587c154ed0 0x7f587c0c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:40.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.670+0000 7f5881d4b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f587c06bbc0 0x7f587c06d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:40.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.670+0000 7f5881d4b640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f587c072da0 con 0x7f587c15e560 2024-09-19T06:37:40.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.670+0000 7f5881d4b640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f587c06d210 con 0x7f587c154ed0 2024-09-19T06:37:40.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.670+0000 7f5881d4b640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f587c072b40 con 0x7f587c06bbc0 2024-09-19T06:37:40.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.670+0000 7f587b7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f587c154ed0 0x7f587c0c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:40.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.670+0000 7f587bfff640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f587c15e560 0x7f587c15ea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:35272/0 (socket says 172.21.15.86:35272) 2024-09-19T06:37:40.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.670+0000 7f587bfff640 1 -- 172.21.15.86:0/199148210 learned_addr learned my addr 172.21.15.86:0/199148210 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:37:40.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.670+0000 7f587affd640 1 --2- 172.21.15.86:0/199148210 >> v2:172.21.15.169:3300/0 conn(0x7f587c06bbc0 0x7f587c06d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:40.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.671+0000 7f587b7fe640 1 -- 172.21.15.86:0/199148210 >> v2:172.21.15.169:3300/0 conn(0x7f587c06bbc0 msgr2=0x7f587c06d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:40.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.671+0000 7f587b7fe640 1 --2- 172.21.15.86:0/199148210 >> v2:172.21.15.169:3300/0 conn(0x7f587c06bbc0 0x7f587c06d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.671+0000 7f587b7fe640 1 -- 172.21.15.86:0/199148210 >> v1:172.21.15.86:6789/0 conn(0x7f587c15e560 legacy=0x7f587c15ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:40.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.671+0000 7f587b7fe640 1 -- 172.21.15.86:0/199148210 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f587c073040 con 0x7f587c154ed0 2024-09-19T06:37:40.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.671+0000 7f587a7fc640 1 -- 172.21.15.86:0/199148210 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3150240298 0 0) 0x7f587c072da0 con 0x7f587c15e560 2024-09-19T06:37:40.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.671+0000 7f587b7fe640 1 --2- 172.21.15.86:0/199148210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c154ed0 0x7f587c0c9de0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f587c0c9d70 tx=0x7f586c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104aca4efb253a33 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:40.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.671+0000 7f587a7fc640 1 -- 172.21.15.86:0/199148210 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586c037070 con 0x7f587c154ed0 2024-09-19T06:37:40.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.671+0000 7f587a7fc640 1 -- 172.21.15.86:0/199148210 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f586c032440 con 0x7f587c154ed0 2024-09-19T06:37:40.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.671+0000 7f587a7fc640 1 -- 172.21.15.86:0/199148210 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586c02ae60 con 0x7f587c154ed0 2024-09-19T06:37:40.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.672+0000 7f5881d4b640 1 -- 172.21.15.86:0/199148210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c154ed0 msgr2=0x7f587c0c9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:40.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.672+0000 7f5881d4b640 1 --2- 172.21.15.86:0/199148210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c154ed0 0x7f587c0c9de0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f587c0c9d70 tx=0x7f586c02a110 comp rx=0 tx=0).stop 2024-09-19T06:37:40.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.672+0000 7f5881d4b640 1 -- 172.21.15.86:0/199148210 shutdown_connections 2024-09-19T06:37:40.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.672+0000 7f5881d4b640 1 --2- 172.21.15.86:0/199148210 >> v2:172.21.15.169:3300/0 conn(0x7f587c06bbc0 0x7f587c06d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.672+0000 7f5881d4b640 1 --2- 172.21.15.86:0/199148210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c154ed0 0x7f587c0c9de0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.672+0000 7f5881d4b640 1 -- 172.21.15.86:0/199148210 >> 172.21.15.86:0/199148210 conn(0x7f587c0ca320 msgr2=0x7f587c0ca730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:40.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.672+0000 7f5881d4b640 1 -- 172.21.15.86:0/199148210 shutdown_connections 2024-09-19T06:37:40.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.672+0000 7f5881d4b640 1 -- 172.21.15.86:0/199148210 wait complete. 2024-09-19T06:37:40.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.673+0000 7f5881d4b640 1 Processor -- start 2024-09-19T06:37:40.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.673+0000 7f5881d4b640 1 -- start start 2024-09-19T06:37:40.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.674+0000 7f5881d4b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f587c06bbc0 0x7f587c156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:40.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.674+0000 7f5881d4b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f587c154ed0 0x7f587c1f4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:40.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.674+0000 7f5881d4b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c15e560 0x7f587c159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:40.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.674+0000 7f5881d4b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f587c1552b0 con 0x7f587c15e560 2024-09-19T06:37:40.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.674+0000 7f5881d4b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f587c0c8220 con 0x7f587c154ed0 2024-09-19T06:37:40.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.674+0000 7f5881d4b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f587c15f120 con 0x7f587c06bbc0 2024-09-19T06:37:40.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.674+0000 7f587bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c15e560 0x7f587c159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:40.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.674+0000 7f587bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c15e560 0x7f587c159550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57072/0 (socket says 172.21.15.86:57072) 2024-09-19T06:37:40.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.674+0000 7f587bfff640 1 -- 172.21.15.86:0/1296194354 learned_addr learned my addr 172.21.15.86:0/1296194354 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:40.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.674+0000 7f587affd640 1 --2- 172.21.15.86:0/1296194354 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f587c154ed0 0x7f587c1f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:40.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.674+0000 7f587b7fe640 1 --2- 172.21.15.86:0/1296194354 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f587c06bbc0 0x7f587c156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:40.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.674+0000 7f587bfff640 1 -- 172.21.15.86:0/1296194354 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f587c06bbc0 msgr2=0x7f587c156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:40.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.674+0000 7f587bfff640 1 --2- 172.21.15.86:0/1296194354 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f587c06bbc0 0x7f587c156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.674+0000 7f587bfff640 1 -- 172.21.15.86:0/1296194354 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f587c154ed0 msgr2=0x7f587c1f4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:40.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.674+0000 7f587bfff640 1 --2- 172.21.15.86:0/1296194354 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f587c154ed0 0x7f587c1f4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.674+0000 7f587bfff640 1 -- 172.21.15.86:0/1296194354 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f587c1f4c30 con 0x7f587c15e560 2024-09-19T06:37:40.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.674+0000 7f587affd640 1 --2- 172.21.15.86:0/1296194354 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f587c154ed0 0x7f587c1f4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:40.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.674+0000 7f587b7fe640 1 --2- 172.21.15.86:0/1296194354 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f587c06bbc0 0x7f587c156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:40.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.675+0000 7f587bfff640 1 --2- 172.21.15.86:0/1296194354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c15e560 0x7f587c159550 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f587400c730 tx=0x7f587400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:40.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.675+0000 7f5863fff640 1 -- 172.21.15.86:0/1296194354 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5874018070 con 0x7f587c15e560 2024-09-19T06:37:40.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.675+0000 7f5863fff640 1 -- 172.21.15.86:0/1296194354 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f587400ce40 con 0x7f587c15e560 2024-09-19T06:37:40.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.675+0000 7f5881d4b640 1 -- 172.21.15.86:0/1296194354 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f587c151ac0 con 0x7f587c15e560 2024-09-19T06:37:40.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.675+0000 7f5863fff640 1 -- 172.21.15.86:0/1296194354 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587400a880 con 0x7f587c15e560 2024-09-19T06:37:40.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.675+0000 7f5881d4b640 1 -- 172.21.15.86:0/1296194354 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f587c15aad0 con 0x7f587c15e560 2024-09-19T06:37:40.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.676+0000 7f5881d4b640 1 -- 172.21.15.86:0/1296194354 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f587c073260 con 0x7f587c15e560 2024-09-19T06:37:40.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.676+0000 7f5863fff640 1 -- 172.21.15.86:0/1296194354 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f587401b070 con 0x7f587c15e560 2024-09-19T06:37:40.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.677+0000 7f5863fff640 1 --2- 172.21.15.86:0/1296194354 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f586806c2b0 0x7f586806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:40.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.677+0000 7f587b7fe640 1 --2- 172.21.15.86:0/1296194354 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f586806c2b0 0x7f586806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:40.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.677+0000 7f5863fff640 1 -- 172.21.15.86:0/1296194354 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f587408ad40 con 0x7f587c15e560 2024-09-19T06:37:40.681 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.677+0000 7f587b7fe640 1 --2- 172.21.15.86:0/1296194354 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f586806c2b0 0x7f586806e770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f586c034000 tx=0x7f586c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:40.683 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.682+0000 7f5863fff640 1 -- 172.21.15.86:0/1296194354 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f587c073260 con 0x7f587c15e560 2024-09-19T06:37:40.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.846+0000 7f5881d4b640 1 -- 172.21.15.86:0/1296194354 --> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f587c0caed0 con 0x7f586806c2b0 2024-09-19T06:37:40.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.854+0000 7f5863fff640 1 -- 172.21.15.86:0/1296194354 <== mgr.4105 v2:172.21.15.86:6816/4165134248 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332608 (secure 0 0 0) 0x7f587c0caed0 con 0x7f586806c2b0 2024-09-19T06:37:40.860 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:40.861 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-09-19T06:37:40.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.857+0000 7f5881d4b640 1 -- 172.21.15.86:0/1296194354 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f586806c2b0 msgr2=0x7f586806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:40.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.857+0000 7f5881d4b640 1 --2- 172.21.15.86:0/1296194354 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f586806c2b0 0x7f586806e770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f586c034000 tx=0x7f586c02e000 comp rx=0 tx=0).stop 2024-09-19T06:37:40.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.857+0000 7f5881d4b640 1 -- 172.21.15.86:0/1296194354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c15e560 msgr2=0x7f587c159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:40.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.857+0000 7f5881d4b640 1 --2- 172.21.15.86:0/1296194354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c15e560 0x7f587c159550 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f587400c730 tx=0x7f587400cbf0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.857+0000 7f5881d4b640 1 -- 172.21.15.86:0/1296194354 shutdown_connections 2024-09-19T06:37:40.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.857+0000 7f5881d4b640 1 --2- 172.21.15.86:0/1296194354 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f586806c2b0 0x7f586806e770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.857+0000 7f5881d4b640 1 --2- 172.21.15.86:0/1296194354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c15e560 0x7f587c159550 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.857+0000 7f5881d4b640 1 --2- 172.21.15.86:0/1296194354 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f587c154ed0 0x7f587c1f4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.857+0000 7f5881d4b640 1 --2- 172.21.15.86:0/1296194354 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f587c06bbc0 0x7f587c156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.857+0000 7f5881d4b640 1 -- 172.21.15.86:0/1296194354 >> 172.21.15.86:0/1296194354 conn(0x7f587c0ca320 msgr2=0x7f587c0c94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:40.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.857+0000 7f5881d4b640 1 -- 172.21.15.86:0/1296194354 shutdown_connections 2024-09-19T06:37:40.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:40.857+0000 7f5881d4b640 1 -- 172.21.15.86:0/1296194354 wait complete. 2024-09-19T06:37:40.869 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-09-19T06:37:39.747744+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218536,"kb_used_data":2304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756184,"statfs":{"total":773094113280,"available":772870332416,"internally_reserved":0,"allocated":2359296,"data_stored":2051860,"data_compressed":65040,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002648"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030305+0000","last_change":"2024-09-19T06:37:08.446272+0000","last_active":"2024-09-19T06:37:15.030305+0000","last_peered":"2024-09-19T06:37:15.030305+0000","last_clean":"2024-09-19T06:37:15.030305+0000","last_became_active":"2024-09-19T06:37:08.446044+0000","last_became_peered":"2024-09-19T06:37:08.446044+0000","last_unstale":"2024-09-19T06:37:15.030305+0000","last_undegraded":"2024-09-19T06:37:15.030305+0000","last_fullsized":"2024-09-19T06:37:15.030305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:37.623543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477629+0000","last_change":"2024-09-19T06:37:09.441539+0000","last_active":"2024-09-19T06:37:14.477629+0000","last_peered":"2024-09-19T06:37:14.477629+0000","last_clean":"2024-09-19T06:37:14.477629+0000","last_became_active":"2024-09-19T06:37:09.440839+0000","last_became_peered":"2024-09-19T06:37:09.440839+0000","last_unstale":"2024-09-19T06:37:14.477629+0000","last_undegraded":"2024-09-19T06:37:14.477629+0000","last_fullsized":"2024-09-19T06:37:14.477629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:49.222252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477205+0000","last_change":"2024-09-19T06:37:13.461355+0000","last_active":"2024-09-19T06:37:14.477205+0000","last_peered":"2024-09-19T06:37:14.477205+0000","last_clean":"2024-09-19T06:37:14.477205+0000","last_became_active":"2024-09-19T06:37:13.460936+0000","last_became_peered":"2024-09-19T06:37:13.460936+0000","last_unstale":"2024-09-19T06:37:14.477205+0000","last_undegraded":"2024-09-19T06:37:14.477205+0000","last_fullsized":"2024-09-19T06:37:14.477205+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:59.860583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477847+0000","last_change":"2024-09-19T06:37:08.438583+0000","last_active":"2024-09-19T06:37:14.477847+0000","last_peered":"2024-09-19T06:37:14.477847+0000","last_clean":"2024-09-19T06:37:14.477847+0000","last_became_active":"2024-09-19T06:37:08.437921+0000","last_became_peered":"2024-09-19T06:37:08.437921+0000","last_unstale":"2024-09-19T06:37:14.477847+0000","last_undegraded":"2024-09-19T06:37:14.477847+0000","last_fullsized":"2024-09-19T06:37:14.477847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:58:23.269120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030018+0000","last_change":"2024-09-19T06:37:09.450731+0000","last_active":"2024-09-19T06:37:15.030018+0000","last_peered":"2024-09-19T06:37:15.030018+0000","last_clean":"2024-09-19T06:37:15.030018+0000","last_became_active":"2024-09-19T06:37:09.450430+0000","last_became_peered":"2024-09-19T06:37:09.450430+0000","last_unstale":"2024-09-19T06:37:15.030018+0000","last_undegraded":"2024-09-19T06:37:15.030018+0000","last_fullsized":"2024-09-19T06:37:15.030018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:21.701872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029552+0000","last_change":"2024-09-19T06:37:13.459445+0000","last_active":"2024-09-19T06:37:15.029552+0000","last_peered":"2024-09-19T06:37:15.029552+0000","last_clean":"2024-09-19T06:37:15.029552+0000","last_became_active":"2024-09-19T06:37:13.459040+0000","last_became_peered":"2024-09-19T06:37:13.459040+0000","last_unstale":"2024-09-19T06:37:15.029552+0000","last_undegraded":"2024-09-19T06:37:15.029552+0000","last_fullsized":"2024-09-19T06:37:15.029552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:37.676097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479475+0000","last_change":"2024-09-19T06:37:08.448303+0000","last_active":"2024-09-19T06:37:14.479475+0000","last_peered":"2024-09-19T06:37:14.479475+0000","last_clean":"2024-09-19T06:37:14.479475+0000","last_became_active":"2024-09-19T06:37:08.447559+0000","last_became_peered":"2024-09-19T06:37:08.447559+0000","last_unstale":"2024-09-19T06:37:14.479475+0000","last_undegraded":"2024-09-19T06:37:14.479475+0000","last_fullsized":"2024-09-19T06:37:14.479475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:43.093216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030079+0000","last_change":"2024-09-19T06:37:09.445971+0000","last_active":"2024-09-19T06:37:15.030079+0000","last_peered":"2024-09-19T06:37:15.030079+0000","last_clean":"2024-09-19T06:37:15.030079+0000","last_became_active":"2024-09-19T06:37:09.444806+0000","last_became_peered":"2024-09-19T06:37:09.444806+0000","last_unstale":"2024-09-19T06:37:15.030079+0000","last_undegraded":"2024-09-19T06:37:15.030079+0000","last_fullsized":"2024-09-19T06:37:15.030079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:15.765835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030528+0000","last_change":"2024-09-19T06:37:13.459035+0000","last_active":"2024-09-19T06:37:15.030528+0000","last_peered":"2024-09-19T06:37:15.030528+0000","last_clean":"2024-09-19T06:37:15.030528+0000","last_became_active":"2024-09-19T06:37:13.458588+0000","last_became_peered":"2024-09-19T06:37:13.458588+0000","last_unstale":"2024-09-19T06:37:15.030528+0000","last_undegraded":"2024-09-19T06:37:15.030528+0000","last_fullsized":"2024-09-19T06:37:15.030528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:27.900054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479040+0000","last_change":"2024-09-19T06:37:08.446363+0000","last_active":"2024-09-19T06:37:14.479040+0000","last_peered":"2024-09-19T06:37:14.479040+0000","last_clean":"2024-09-19T06:37:14.479040+0000","last_became_active":"2024-09-19T06:37:08.446053+0000","last_became_peered":"2024-09-19T06:37:08.446053+0000","last_unstale":"2024-09-19T06:37:14.479040+0000","last_undegraded":"2024-09-19T06:37:14.479040+0000","last_fullsized":"2024-09-19T06:37:14.479040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:22.488347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030495+0000","last_change":"2024-09-19T06:37:09.445124+0000","last_active":"2024-09-19T06:37:15.030495+0000","last_peered":"2024-09-19T06:37:15.030495+0000","last_clean":"2024-09-19T06:37:15.030495+0000","last_became_active":"2024-09-19T06:37:09.444824+0000","last_became_peered":"2024-09-19T06:37:09.444824+0000","last_unstale":"2024-09-19T06:37:15.030495+0000","last_undegraded":"2024-09-19T06:37:15.030495+0000","last_fullsized":"2024-09-19T06:37:15.030495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:40:05.642055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030082+0000","last_change":"2024-09-19T06:37:13.459720+0000","last_active":"2024-09-19T06:37:15.030082+0000","last_peered":"2024-09-19T06:37:15.030082+0000","last_clean":"2024-09-19T06:37:15.030082+0000","last_became_active":"2024-09-19T06:37:13.459350+0000","last_became_peered":"2024-09-19T06:37:13.459350+0000","last_unstale":"2024-09-19T06:37:15.030082+0000","last_undegraded":"2024-09-19T06:37:15.030082+0000","last_fullsized":"2024-09-19T06:37:15.030082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:29.546976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478406+0000","last_change":"2024-09-19T06:37:09.447795+0000","last_active":"2024-09-19T06:37:14.478406+0000","last_peered":"2024-09-19T06:37:14.478406+0000","last_clean":"2024-09-19T06:37:14.478406+0000","last_became_active":"2024-09-19T06:37:09.447502+0000","last_became_peered":"2024-09-19T06:37:09.447502+0000","last_unstale":"2024-09-19T06:37:14.478406+0000","last_undegraded":"2024-09-19T06:37:14.478406+0000","last_fullsized":"2024-09-19T06:37:14.478406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:51.384743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479493+0000","last_change":"2024-09-19T06:37:08.446179+0000","last_active":"2024-09-19T06:37:14.479493+0000","last_peered":"2024-09-19T06:37:14.479493+0000","last_clean":"2024-09-19T06:37:14.479493+0000","last_became_active":"2024-09-19T06:37:08.445834+0000","last_became_peered":"2024-09-19T06:37:08.445834+0000","last_unstale":"2024-09-19T06:37:14.479493+0000","last_undegraded":"2024-09-19T06:37:14.479493+0000","last_fullsized":"2024-09-19T06:37:14.479493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:03.783414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030572+0000","last_change":"2024-09-19T06:37:13.460344+0000","last_active":"2024-09-19T06:37:15.030572+0000","last_peered":"2024-09-19T06:37:15.030572+0000","last_clean":"2024-09-19T06:37:15.030572+0000","last_became_active":"2024-09-19T06:37:13.459967+0000","last_became_peered":"2024-09-19T06:37:13.459967+0000","last_unstale":"2024-09-19T06:37:15.030572+0000","last_undegraded":"2024-09-19T06:37:15.030572+0000","last_fullsized":"2024-09-19T06:37:15.030572+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:59.096218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477943+0000","last_change":"2024-09-19T06:37:09.449884+0000","last_active":"2024-09-19T06:37:14.477943+0000","last_peered":"2024-09-19T06:37:14.477943+0000","last_clean":"2024-09-19T06:37:14.477943+0000","last_became_active":"2024-09-19T06:37:09.449645+0000","last_became_peered":"2024-09-19T06:37:09.449645+0000","last_unstale":"2024-09-19T06:37:14.477943+0000","last_undegraded":"2024-09-19T06:37:14.477943+0000","last_fullsized":"2024-09-19T06:37:14.477943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:07.353098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030475+0000","last_change":"2024-09-19T06:37:08.437022+0000","last_active":"2024-09-19T06:37:15.030475+0000","last_peered":"2024-09-19T06:37:15.030475+0000","last_clean":"2024-09-19T06:37:15.030475+0000","last_became_active":"2024-09-19T06:37:08.436761+0000","last_became_peered":"2024-09-19T06:37:08.436761+0000","last_unstale":"2024-09-19T06:37:15.030475+0000","last_undegraded":"2024-09-19T06:37:15.030475+0000","last_fullsized":"2024-09-19T06:37:15.030475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:04.985581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030395+0000","last_change":"2024-09-19T06:37:13.460470+0000","last_active":"2024-09-19T06:37:15.030395+0000","last_peered":"2024-09-19T06:37:15.030395+0000","last_clean":"2024-09-19T06:37:15.030395+0000","last_became_active":"2024-09-19T06:37:13.460072+0000","last_became_peered":"2024-09-19T06:37:13.460072+0000","last_unstale":"2024-09-19T06:37:15.030395+0000","last_undegraded":"2024-09-19T06:37:15.030395+0000","last_fullsized":"2024-09-19T06:37:15.030395+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:50.835286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477295+0000","last_change":"2024-09-19T06:37:09.433042+0000","last_active":"2024-09-19T06:37:14.477295+0000","last_peered":"2024-09-19T06:37:14.477295+0000","last_clean":"2024-09-19T06:37:14.477295+0000","last_became_active":"2024-09-19T06:37:09.432589+0000","last_became_peered":"2024-09-19T06:37:09.432589+0000","last_unstale":"2024-09-19T06:37:14.477295+0000","last_undegraded":"2024-09-19T06:37:14.477295+0000","last_fullsized":"2024-09-19T06:37:14.477295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:18.661071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029869+0000","last_change":"2024-09-19T06:37:08.444408+0000","last_active":"2024-09-19T06:37:15.029869+0000","last_peered":"2024-09-19T06:37:15.029869+0000","last_clean":"2024-09-19T06:37:15.029869+0000","last_became_active":"2024-09-19T06:37:08.444160+0000","last_became_peered":"2024-09-19T06:37:08.444160+0000","last_unstale":"2024-09-19T06:37:15.029869+0000","last_undegraded":"2024-09-19T06:37:15.029869+0000","last_fullsized":"2024-09-19T06:37:15.029869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:54.304153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030788+0000","last_change":"2024-09-19T06:37:13.466175+0000","last_active":"2024-09-19T06:37:15.030788+0000","last_peered":"2024-09-19T06:37:15.030788+0000","last_clean":"2024-09-19T06:37:15.030788+0000","last_became_active":"2024-09-19T06:37:13.465731+0000","last_became_peered":"2024-09-19T06:37:13.465731+0000","last_unstale":"2024-09-19T06:37:15.030788+0000","last_undegraded":"2024-09-19T06:37:15.030788+0000","last_fullsized":"2024-09-19T06:37:15.030788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:01.100164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029947+0000","last_change":"2024-09-19T06:37:09.437254+0000","last_active":"2024-09-19T06:37:15.029947+0000","last_peered":"2024-09-19T06:37:15.029947+0000","last_clean":"2024-09-19T06:37:15.029947+0000","last_became_active":"2024-09-19T06:37:09.436512+0000","last_became_peered":"2024-09-19T06:37:09.436512+0000","last_unstale":"2024-09-19T06:37:15.029947+0000","last_undegraded":"2024-09-19T06:37:15.029947+0000","last_fullsized":"2024-09-19T06:37:15.029947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:21.893793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478028+0000","last_change":"2024-09-19T06:37:08.446216+0000","last_active":"2024-09-19T06:37:14.478028+0000","last_peered":"2024-09-19T06:37:14.478028+0000","last_clean":"2024-09-19T06:37:14.478028+0000","last_became_active":"2024-09-19T06:37:08.445845+0000","last_became_peered":"2024-09-19T06:37:08.445845+0000","last_unstale":"2024-09-19T06:37:14.478028+0000","last_undegraded":"2024-09-19T06:37:14.478028+0000","last_fullsized":"2024-09-19T06:37:14.478028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:04.033283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030215+0000","last_change":"2024-09-19T06:37:13.462192+0000","last_active":"2024-09-19T06:37:15.030215+0000","last_peered":"2024-09-19T06:37:15.030215+0000","last_clean":"2024-09-19T06:37:15.030215+0000","last_became_active":"2024-09-19T06:37:13.460955+0000","last_became_peered":"2024-09-19T06:37:13.460955+0000","last_unstale":"2024-09-19T06:37:15.030215+0000","last_undegraded":"2024-09-19T06:37:15.030215+0000","last_fullsized":"2024-09-19T06:37:15.030215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:53.583488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030554+0000","last_change":"2024-09-19T06:37:09.445989+0000","last_active":"2024-09-19T06:37:15.030554+0000","last_peered":"2024-09-19T06:37:15.030554+0000","last_clean":"2024-09-19T06:37:15.030554+0000","last_became_active":"2024-09-19T06:37:09.445705+0000","last_became_peered":"2024-09-19T06:37:09.445705+0000","last_unstale":"2024-09-19T06:37:15.030554+0000","last_undegraded":"2024-09-19T06:37:15.030554+0000","last_fullsized":"2024-09-19T06:37:15.030554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:24.592460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478969+0000","last_change":"2024-09-19T06:37:08.446226+0000","last_active":"2024-09-19T06:37:14.478969+0000","last_peered":"2024-09-19T06:37:14.478969+0000","last_clean":"2024-09-19T06:37:14.478969+0000","last_became_active":"2024-09-19T06:37:08.445929+0000","last_became_peered":"2024-09-19T06:37:08.445929+0000","last_unstale":"2024-09-19T06:37:14.478969+0000","last_undegraded":"2024-09-19T06:37:14.478969+0000","last_fullsized":"2024-09-19T06:37:14.478969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:32.233033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029648+0000","last_change":"2024-09-19T06:37:13.462598+0000","last_active":"2024-09-19T06:37:15.029648+0000","last_peered":"2024-09-19T06:37:15.029648+0000","last_clean":"2024-09-19T06:37:15.029648+0000","last_became_active":"2024-09-19T06:37:13.462217+0000","last_became_peered":"2024-09-19T06:37:13.462217+0000","last_unstale":"2024-09-19T06:37:15.029648+0000","last_undegraded":"2024-09-19T06:37:15.029648+0000","last_fullsized":"2024-09-19T06:37:15.029648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:04.109419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477866+0000","last_change":"2024-09-19T06:37:09.434309+0000","last_active":"2024-09-19T06:37:14.477866+0000","last_peered":"2024-09-19T06:37:14.477866+0000","last_clean":"2024-09-19T06:37:14.477866+0000","last_became_active":"2024-09-19T06:37:09.433897+0000","last_became_peered":"2024-09-19T06:37:09.433897+0000","last_unstale":"2024-09-19T06:37:14.477866+0000","last_undegraded":"2024-09-19T06:37:14.477866+0000","last_fullsized":"2024-09-19T06:37:14.477866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:59.054484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030307+0000","last_change":"2024-09-19T06:37:08.441525+0000","last_active":"2024-09-19T06:37:15.030307+0000","last_peered":"2024-09-19T06:37:15.030307+0000","last_clean":"2024-09-19T06:37:15.030307+0000","last_became_active":"2024-09-19T06:37:08.441245+0000","last_became_peered":"2024-09-19T06:37:08.441245+0000","last_unstale":"2024-09-19T06:37:15.030307+0000","last_undegraded":"2024-09-19T06:37:15.030307+0000","last_fullsized":"2024-09-19T06:37:15.030307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:19.820705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477133+0000","last_change":"2024-09-19T06:37:13.468486+0000","last_active":"2024-09-19T06:37:14.477133+0000","last_peered":"2024-09-19T06:37:14.477133+0000","last_clean":"2024-09-19T06:37:14.477133+0000","last_became_active":"2024-09-19T06:37:13.468074+0000","last_became_peered":"2024-09-19T06:37:13.468074+0000","last_unstale":"2024-09-19T06:37:14.477133+0000","last_undegraded":"2024-09-19T06:37:14.477133+0000","last_fullsized":"2024-09-19T06:37:14.477133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:36.783781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030772+0000","last_change":"2024-09-19T06:37:09.435864+0000","last_active":"2024-09-19T06:37:15.030772+0000","last_peered":"2024-09-19T06:37:15.030772+0000","last_clean":"2024-09-19T06:37:15.030772+0000","last_became_active":"2024-09-19T06:37:09.435597+0000","last_became_peered":"2024-09-19T06:37:09.435597+0000","last_unstale":"2024-09-19T06:37:15.030772+0000","last_undegraded":"2024-09-19T06:37:15.030772+0000","last_fullsized":"2024-09-19T06:37:15.030772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:20.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479615+0000","last_change":"2024-09-19T06:37:08.447931+0000","last_active":"2024-09-19T06:37:14.479615+0000","last_peered":"2024-09-19T06:37:14.479615+0000","last_clean":"2024-09-19T06:37:14.479615+0000","last_became_active":"2024-09-19T06:37:08.447630+0000","last_became_peered":"2024-09-19T06:37:08.447630+0000","last_unstale":"2024-09-19T06:37:14.479615+0000","last_undegraded":"2024-09-19T06:37:14.479615+0000","last_fullsized":"2024-09-19T06:37:14.479615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:17.375740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030552+0000","last_change":"2024-09-19T06:37:13.468360+0000","last_active":"2024-09-19T06:37:15.030552+0000","last_peered":"2024-09-19T06:37:15.030552+0000","last_clean":"2024-09-19T06:37:15.030552+0000","last_became_active":"2024-09-19T06:37:13.467926+0000","last_became_peered":"2024-09-19T06:37:13.467926+0000","last_unstale":"2024-09-19T06:37:15.030552+0000","last_undegraded":"2024-09-19T06:37:15.030552+0000","last_fullsized":"2024-09-19T06:37:15.030552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:55.089630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030606+0000","last_change":"2024-09-19T06:37:09.441678+0000","last_active":"2024-09-19T06:37:15.030606+0000","last_peered":"2024-09-19T06:37:15.030606+0000","last_clean":"2024-09-19T06:37:15.030606+0000","last_became_active":"2024-09-19T06:37:09.441406+0000","last_became_peered":"2024-09-19T06:37:09.441406+0000","last_unstale":"2024-09-19T06:37:15.030606+0000","last_undegraded":"2024-09-19T06:37:15.030606+0000","last_fullsized":"2024-09-19T06:37:15.030606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:14.638004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030831+0000","last_change":"2024-09-19T06:37:08.438805+0000","last_active":"2024-09-19T06:37:15.030831+0000","last_peered":"2024-09-19T06:37:15.030831+0000","last_clean":"2024-09-19T06:37:15.030831+0000","last_became_active":"2024-09-19T06:37:08.438528+0000","last_became_peered":"2024-09-19T06:37:08.438528+0000","last_unstale":"2024-09-19T06:37:15.030831+0000","last_undegraded":"2024-09-19T06:37:15.030831+0000","last_fullsized":"2024-09-19T06:37:15.030831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:55.500347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030303+0000","last_change":"2024-09-19T06:37:13.459697+0000","last_active":"2024-09-19T06:37:15.030303+0000","last_peered":"2024-09-19T06:37:15.030303+0000","last_clean":"2024-09-19T06:37:15.030303+0000","last_became_active":"2024-09-19T06:37:13.459303+0000","last_became_peered":"2024-09-19T06:37:13.459303+0000","last_unstale":"2024-09-19T06:37:15.030303+0000","last_undegraded":"2024-09-19T06:37:15.030303+0000","last_fullsized":"2024-09-19T06:37:15.030303+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:01.695905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.031009+0000","last_change":"2024-09-19T06:37:09.449701+0000","last_active":"2024-09-19T06:37:15.031009+0000","last_peered":"2024-09-19T06:37:15.031009+0000","last_clean":"2024-09-19T06:37:15.031009+0000","last_became_active":"2024-09-19T06:37:09.448899+0000","last_became_peered":"2024-09-19T06:37:09.448899+0000","last_unstale":"2024-09-19T06:37:15.031009+0000","last_undegraded":"2024-09-19T06:37:15.031009+0000","last_fullsized":"2024-09-19T06:37:15.031009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:17.448251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030609+0000","last_change":"2024-09-19T06:37:08.434263+0000","last_active":"2024-09-19T06:37:15.030609+0000","last_peered":"2024-09-19T06:37:15.030609+0000","last_clean":"2024-09-19T06:37:15.030609+0000","last_became_active":"2024-09-19T06:37:08.433984+0000","last_became_peered":"2024-09-19T06:37:08.433984+0000","last_unstale":"2024-09-19T06:37:15.030609+0000","last_undegraded":"2024-09-19T06:37:15.030609+0000","last_fullsized":"2024-09-19T06:37:15.030609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:05.599054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030728+0000","last_change":"2024-09-19T06:37:13.464527+0000","last_active":"2024-09-19T06:37:15.030728+0000","last_peered":"2024-09-19T06:37:15.030728+0000","last_clean":"2024-09-19T06:37:15.030728+0000","last_became_active":"2024-09-19T06:37:13.461685+0000","last_became_peered":"2024-09-19T06:37:13.461685+0000","last_unstale":"2024-09-19T06:37:15.030728+0000","last_undegraded":"2024-09-19T06:37:15.030728+0000","last_fullsized":"2024-09-19T06:37:15.030728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:57.229892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030028+0000","last_change":"2024-09-19T06:37:09.434421+0000","last_active":"2024-09-19T06:37:15.030028+0000","last_peered":"2024-09-19T06:37:15.030028+0000","last_clean":"2024-09-19T06:37:15.030028+0000","last_became_active":"2024-09-19T06:37:09.434119+0000","last_became_peered":"2024-09-19T06:37:09.434119+0000","last_unstale":"2024-09-19T06:37:15.030028+0000","last_undegraded":"2024-09-19T06:37:15.030028+0000","last_fullsized":"2024-09-19T06:37:15.030028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:56.984336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.814975+0000","last_change":"2024-09-19T06:37:08.436856+0000","last_active":"2024-09-19T06:37:14.814975+0000","last_peered":"2024-09-19T06:37:14.814975+0000","last_clean":"2024-09-19T06:37:14.814975+0000","last_became_active":"2024-09-19T06:37:08.435718+0000","last_became_peered":"2024-09-19T06:37:08.435718+0000","last_unstale":"2024-09-19T06:37:14.814975+0000","last_undegraded":"2024-09-19T06:37:14.814975+0000","last_fullsized":"2024-09-19T06:37:14.814975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:58.650430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030892+0000","last_change":"2024-09-19T06:37:13.466081+0000","last_active":"2024-09-19T06:37:15.030892+0000","last_peered":"2024-09-19T06:37:15.030892+0000","last_clean":"2024-09-19T06:37:15.030892+0000","last_became_active":"2024-09-19T06:37:13.465348+0000","last_became_peered":"2024-09-19T06:37:13.465348+0000","last_unstale":"2024-09-19T06:37:15.030892+0000","last_undegraded":"2024-09-19T06:37:15.030892+0000","last_fullsized":"2024-09-19T06:37:15.030892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:11.592737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029583+0000","last_change":"2024-09-19T06:37:09.444888+0000","last_active":"2024-09-19T06:37:15.029583+0000","last_peered":"2024-09-19T06:37:15.029583+0000","last_clean":"2024-09-19T06:37:15.029583+0000","last_became_active":"2024-09-19T06:37:09.444605+0000","last_became_peered":"2024-09-19T06:37:09.444605+0000","last_unstale":"2024-09-19T06:37:15.029583+0000","last_undegraded":"2024-09-19T06:37:15.029583+0000","last_fullsized":"2024-09-19T06:37:15.029583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:53.868356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478136+0000","last_change":"2024-09-19T06:37:08.446760+0000","last_active":"2024-09-19T06:37:14.478136+0000","last_peered":"2024-09-19T06:37:14.478136+0000","last_clean":"2024-09-19T06:37:14.478136+0000","last_became_active":"2024-09-19T06:37:08.446474+0000","last_became_peered":"2024-09-19T06:37:08.446474+0000","last_unstale":"2024-09-19T06:37:14.478136+0000","last_undegraded":"2024-09-19T06:37:14.478136+0000","last_fullsized":"2024-09-19T06:37:14.478136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:12.597952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030429+0000","last_change":"2024-09-19T06:37:13.471220+0000","last_active":"2024-09-19T06:37:15.030429+0000","last_peered":"2024-09-19T06:37:15.030429+0000","last_clean":"2024-09-19T06:37:15.030429+0000","last_became_active":"2024-09-19T06:37:13.470860+0000","last_became_peered":"2024-09-19T06:37:13.470860+0000","last_unstale":"2024-09-19T06:37:15.030429+0000","last_undegraded":"2024-09-19T06:37:15.030429+0000","last_fullsized":"2024-09-19T06:37:15.030429+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:07.659583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477346+0000","last_change":"2024-09-19T06:37:09.440366+0000","last_active":"2024-09-19T06:37:14.477346+0000","last_peered":"2024-09-19T06:37:14.477346+0000","last_clean":"2024-09-19T06:37:14.477346+0000","last_became_active":"2024-09-19T06:37:09.439478+0000","last_became_peered":"2024-09-19T06:37:09.439478+0000","last_unstale":"2024-09-19T06:37:14.477346+0000","last_undegraded":"2024-09-19T06:37:14.477346+0000","last_fullsized":"2024-09-19T06:37:14.477346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:21.837351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029827+0000","last_change":"2024-09-19T06:37:08.435473+0000","last_active":"2024-09-19T06:37:15.029827+0000","last_peered":"2024-09-19T06:37:15.029827+0000","last_clean":"2024-09-19T06:37:15.029827+0000","last_became_active":"2024-09-19T06:37:08.435183+0000","last_became_peered":"2024-09-19T06:37:08.435183+0000","last_unstale":"2024-09-19T06:37:15.029827+0000","last_undegraded":"2024-09-19T06:37:15.029827+0000","last_fullsized":"2024-09-19T06:37:15.029827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:53.115010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478240+0000","last_change":"2024-09-19T06:36:58.829099+0000","last_active":"2024-09-19T06:37:14.478240+0000","last_peered":"2024-09-19T06:37:14.478240+0000","last_clean":"2024-09-19T06:37:14.478240+0000","last_became_active":"2024-09-19T06:36:58.828079+0000","last_became_peered":"2024-09-19T06:36:58.828079+0000","last_unstale":"2024-09-19T06:37:14.478240+0000","last_undegraded":"2024-09-19T06:37:14.478240+0000","last_fullsized":"2024-09-19T06:37:14.478240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:36:57.771085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:36:57.771085+0000","last_clean_scrub_stamp":"2024-09-19T06:36:57.771085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:14.663925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477944+0000","last_change":"2024-09-19T06:37:13.464435+0000","last_active":"2024-09-19T06:37:14.477944+0000","last_peered":"2024-09-19T06:37:14.477944+0000","last_clean":"2024-09-19T06:37:14.477944+0000","last_became_active":"2024-09-19T06:37:13.464101+0000","last_became_peered":"2024-09-19T06:37:13.464101+0000","last_unstale":"2024-09-19T06:37:14.477944+0000","last_undegraded":"2024-09-19T06:37:14.477944+0000","last_fullsized":"2024-09-19T06:37:14.477944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:30.073937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479308+0000","last_change":"2024-09-19T06:37:09.442774+0000","last_active":"2024-09-19T06:37:14.479308+0000","last_peered":"2024-09-19T06:37:14.479308+0000","last_clean":"2024-09-19T06:37:14.479308+0000","last_became_active":"2024-09-19T06:37:09.442515+0000","last_became_peered":"2024-09-19T06:37:09.442515+0000","last_unstale":"2024-09-19T06:37:14.479308+0000","last_undegraded":"2024-09-19T06:37:14.479308+0000","last_fullsized":"2024-09-19T06:37:14.479308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:57.376059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815252+0000","last_change":"2024-09-19T06:37:08.438038+0000","last_active":"2024-09-19T06:37:14.815252+0000","last_peered":"2024-09-19T06:37:14.815252+0000","last_clean":"2024-09-19T06:37:14.815252+0000","last_became_active":"2024-09-19T06:37:08.437771+0000","last_became_peered":"2024-09-19T06:37:08.437771+0000","last_unstale":"2024-09-19T06:37:14.815252+0000","last_undegraded":"2024-09-19T06:37:14.815252+0000","last_fullsized":"2024-09-19T06:37:14.815252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:07.210382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477772+0000","last_change":"2024-09-19T06:37:13.470916+0000","last_active":"2024-09-19T06:37:14.477772+0000","last_peered":"2024-09-19T06:37:14.477772+0000","last_clean":"2024-09-19T06:37:14.477772+0000","last_became_active":"2024-09-19T06:37:13.470488+0000","last_became_peered":"2024-09-19T06:37:13.470488+0000","last_unstale":"2024-09-19T06:37:14.477772+0000","last_undegraded":"2024-09-19T06:37:14.477772+0000","last_fullsized":"2024-09-19T06:37:14.477772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:27.884932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030150+0000","last_change":"2024-09-19T06:37:09.442213+0000","last_active":"2024-09-19T06:37:15.030150+0000","last_peered":"2024-09-19T06:37:15.030150+0000","last_clean":"2024-09-19T06:37:15.030150+0000","last_became_active":"2024-09-19T06:37:09.441850+0000","last_became_peered":"2024-09-19T06:37:09.441850+0000","last_unstale":"2024-09-19T06:37:15.030150+0000","last_undegraded":"2024-09-19T06:37:15.030150+0000","last_fullsized":"2024-09-19T06:37:15.030150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:43.728914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030863+0000","last_change":"2024-09-19T06:37:08.431703+0000","last_active":"2024-09-19T06:37:15.030863+0000","last_peered":"2024-09-19T06:37:15.030863+0000","last_clean":"2024-09-19T06:37:15.030863+0000","last_became_active":"2024-09-19T06:37:08.431443+0000","last_became_peered":"2024-09-19T06:37:08.431443+0000","last_unstale":"2024-09-19T06:37:15.030863+0000","last_undegraded":"2024-09-19T06:37:15.030863+0000","last_fullsized":"2024-09-19T06:37:15.030863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:02.007521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030768+0000","last_change":"2024-09-19T06:37:13.469295+0000","last_active":"2024-09-19T06:37:15.030768+0000","last_peered":"2024-09-19T06:37:15.030768+0000","last_clean":"2024-09-19T06:37:15.030768+0000","last_became_active":"2024-09-19T06:37:13.468879+0000","last_became_peered":"2024-09-19T06:37:13.468879+0000","last_unstale":"2024-09-19T06:37:15.030768+0000","last_undegraded":"2024-09-19T06:37:15.030768+0000","last_fullsized":"2024-09-19T06:37:15.030768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:34.380034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479747+0000","last_change":"2024-09-19T06:37:09.439264+0000","last_active":"2024-09-19T06:37:14.479747+0000","last_peered":"2024-09-19T06:37:14.479747+0000","last_clean":"2024-09-19T06:37:14.479747+0000","last_became_active":"2024-09-19T06:37:09.438954+0000","last_became_peered":"2024-09-19T06:37:09.438954+0000","last_unstale":"2024-09-19T06:37:14.479747+0000","last_undegraded":"2024-09-19T06:37:14.479747+0000","last_fullsized":"2024-09-19T06:37:14.479747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:55.094093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815232+0000","last_change":"2024-09-19T06:37:08.437406+0000","last_active":"2024-09-19T06:37:14.815232+0000","last_peered":"2024-09-19T06:37:14.815232+0000","last_clean":"2024-09-19T06:37:14.815232+0000","last_became_active":"2024-09-19T06:37:08.437093+0000","last_became_peered":"2024-09-19T06:37:08.437093+0000","last_unstale":"2024-09-19T06:37:14.815232+0000","last_undegraded":"2024-09-19T06:37:14.815232+0000","last_fullsized":"2024-09-19T06:37:14.815232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:25.158027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029476+0000","last_change":"2024-09-19T06:37:13.460116+0000","last_active":"2024-09-19T06:37:15.029476+0000","last_peered":"2024-09-19T06:37:15.029476+0000","last_clean":"2024-09-19T06:37:15.029476+0000","last_became_active":"2024-09-19T06:37:13.459707+0000","last_became_peered":"2024-09-19T06:37:13.459707+0000","last_unstale":"2024-09-19T06:37:15.029476+0000","last_undegraded":"2024-09-19T06:37:15.029476+0000","last_fullsized":"2024-09-19T06:37:15.029476+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:02.657115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479032+0000","last_change":"2024-09-19T06:37:09.442670+0000","last_active":"2024-09-19T06:37:14.479032+0000","last_peered":"2024-09-19T06:37:14.479032+0000","last_clean":"2024-09-19T06:37:14.479032+0000","last_became_active":"2024-09-19T06:37:09.442390+0000","last_became_peered":"2024-09-19T06:37:09.442390+0000","last_unstale":"2024-09-19T06:37:14.479032+0000","last_undegraded":"2024-09-19T06:37:14.479032+0000","last_fullsized":"2024-09-19T06:37:14.479032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:02:26.726663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030129+0000","last_change":"2024-09-19T06:37:08.437263+0000","last_active":"2024-09-19T06:37:15.030129+0000","last_peered":"2024-09-19T06:37:15.030129+0000","last_clean":"2024-09-19T06:37:15.030129+0000","last_became_active":"2024-09-19T06:37:08.436982+0000","last_became_peered":"2024-09-19T06:37:08.436982+0000","last_unstale":"2024-09-19T06:37:15.030129+0000","last_undegraded":"2024-09-19T06:37:15.030129+0000","last_fullsized":"2024-09-19T06:37:15.030129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:14.895925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029466+0000","last_change":"2024-09-19T06:37:13.459433+0000","last_active":"2024-09-19T06:37:15.029466+0000","last_peered":"2024-09-19T06:37:15.029466+0000","last_clean":"2024-09-19T06:37:15.029466+0000","last_became_active":"2024-09-19T06:37:13.459031+0000","last_became_peered":"2024-09-19T06:37:13.459031+0000","last_unstale":"2024-09-19T06:37:15.029466+0000","last_undegraded":"2024-09-19T06:37:15.029466+0000","last_fullsized":"2024-09-19T06:37:15.029466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:07.294413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478514+0000","last_change":"2024-09-19T06:37:09.439142+0000","last_active":"2024-09-19T06:37:14.478514+0000","last_peered":"2024-09-19T06:37:14.478514+0000","last_clean":"2024-09-19T06:37:14.478514+0000","last_became_active":"2024-09-19T06:37:09.437717+0000","last_became_peered":"2024-09-19T06:37:09.437717+0000","last_unstale":"2024-09-19T06:37:14.478514+0000","last_undegraded":"2024-09-19T06:37:14.478514+0000","last_fullsized":"2024-09-19T06:37:14.478514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:32.934290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.814858+0000","last_change":"2024-09-19T06:37:08.430649+0000","last_active":"2024-09-19T06:37:14.814858+0000","last_peered":"2024-09-19T06:37:14.814858+0000","last_clean":"2024-09-19T06:37:14.814858+0000","last_became_active":"2024-09-19T06:37:08.430324+0000","last_became_peered":"2024-09-19T06:37:08.430324+0000","last_unstale":"2024-09-19T06:37:14.814858+0000","last_undegraded":"2024-09-19T06:37:14.814858+0000","last_fullsized":"2024-09-19T06:37:14.814858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:56.656357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030152+0000","last_change":"2024-09-19T06:37:13.463695+0000","last_active":"2024-09-19T06:37:15.030152+0000","last_peered":"2024-09-19T06:37:15.030152+0000","last_clean":"2024-09-19T06:37:15.030152+0000","last_became_active":"2024-09-19T06:37:13.463334+0000","last_became_peered":"2024-09-19T06:37:13.463334+0000","last_unstale":"2024-09-19T06:37:15.030152+0000","last_undegraded":"2024-09-19T06:37:15.030152+0000","last_fullsized":"2024-09-19T06:37:15.030152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:46.991800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477668+0000","last_change":"2024-09-19T06:37:09.450168+0000","last_active":"2024-09-19T06:37:14.477668+0000","last_peered":"2024-09-19T06:37:14.477668+0000","last_clean":"2024-09-19T06:37:14.477668+0000","last_became_active":"2024-09-19T06:37:09.449872+0000","last_became_peered":"2024-09-19T06:37:09.449872+0000","last_unstale":"2024-09-19T06:37:14.477668+0000","last_undegraded":"2024-09-19T06:37:14.477668+0000","last_fullsized":"2024-09-19T06:37:14.477668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:02:28.282840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478710+0000","last_change":"2024-09-19T06:37:08.442428+0000","last_active":"2024-09-19T06:37:14.478710+0000","last_peered":"2024-09-19T06:37:14.478710+0000","last_clean":"2024-09-19T06:37:14.478710+0000","last_became_active":"2024-09-19T06:37:08.442120+0000","last_became_peered":"2024-09-19T06:37:08.442120+0000","last_unstale":"2024-09-19T06:37:14.478710+0000","last_undegraded":"2024-09-19T06:37:14.478710+0000","last_fullsized":"2024-09-19T06:37:14.478710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:48.816822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477870+0000","last_change":"2024-09-19T06:37:13.471319+0000","last_active":"2024-09-19T06:37:14.477870+0000","last_peered":"2024-09-19T06:37:14.477870+0000","last_clean":"2024-09-19T06:37:14.477870+0000","last_became_active":"2024-09-19T06:37:13.470887+0000","last_became_peered":"2024-09-19T06:37:13.470887+0000","last_unstale":"2024-09-19T06:37:14.477870+0000","last_undegraded":"2024-09-19T06:37:14.477870+0000","last_fullsized":"2024-09-19T06:37:14.477870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:21.884985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479407+0000","last_change":"2024-09-19T06:37:09.439142+0000","last_active":"2024-09-19T06:37:14.479407+0000","last_peered":"2024-09-19T06:37:14.479407+0000","last_clean":"2024-09-19T06:37:14.479407+0000","last_became_active":"2024-09-19T06:37:09.437635+0000","last_became_peered":"2024-09-19T06:37:09.437635+0000","last_unstale":"2024-09-19T06:37:14.479407+0000","last_undegraded":"2024-09-19T06:37:14.479407+0000","last_fullsized":"2024-09-19T06:37:14.479407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:46.773889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030517+0000","last_change":"2024-09-19T06:37:08.438932+0000","last_active":"2024-09-19T06:37:15.030517+0000","last_peered":"2024-09-19T06:37:15.030517+0000","last_clean":"2024-09-19T06:37:15.030517+0000","last_became_active":"2024-09-19T06:37:08.438405+0000","last_became_peered":"2024-09-19T06:37:08.438405+0000","last_unstale":"2024-09-19T06:37:15.030517+0000","last_undegraded":"2024-09-19T06:37:15.030517+0000","last_fullsized":"2024-09-19T06:37:15.030517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:59.606628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477677+0000","last_change":"2024-09-19T06:37:13.459370+0000","last_active":"2024-09-19T06:37:14.477677+0000","last_peered":"2024-09-19T06:37:14.477677+0000","last_clean":"2024-09-19T06:37:14.477677+0000","last_became_active":"2024-09-19T06:37:13.458928+0000","last_became_peered":"2024-09-19T06:37:13.458928+0000","last_unstale":"2024-09-19T06:37:14.477677+0000","last_undegraded":"2024-09-19T06:37:14.477677+0000","last_fullsized":"2024-09-19T06:37:14.477677+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:00.179404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029933+0000","last_change":"2024-09-19T06:37:09.448958+0000","last_active":"2024-09-19T06:37:15.029933+0000","last_peered":"2024-09-19T06:37:15.029933+0000","last_clean":"2024-09-19T06:37:15.029933+0000","last_became_active":"2024-09-19T06:37:09.448697+0000","last_became_peered":"2024-09-19T06:37:09.448697+0000","last_unstale":"2024-09-19T06:37:15.029933+0000","last_undegraded":"2024-09-19T06:37:15.029933+0000","last_fullsized":"2024-09-19T06:37:15.029933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:16.306915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030900+0000","last_change":"2024-09-19T06:37:08.442685+0000","last_active":"2024-09-19T06:37:15.030900+0000","last_peered":"2024-09-19T06:37:15.030900+0000","last_clean":"2024-09-19T06:37:15.030900+0000","last_became_active":"2024-09-19T06:37:08.442436+0000","last_became_peered":"2024-09-19T06:37:08.442436+0000","last_unstale":"2024-09-19T06:37:15.030900+0000","last_undegraded":"2024-09-19T06:37:15.030900+0000","last_fullsized":"2024-09-19T06:37:15.030900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:09.952733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030332+0000","last_change":"2024-09-19T06:37:13.457651+0000","last_active":"2024-09-19T06:37:15.030332+0000","last_peered":"2024-09-19T06:37:15.030332+0000","last_clean":"2024-09-19T06:37:15.030332+0000","last_became_active":"2024-09-19T06:37:13.457246+0000","last_became_peered":"2024-09-19T06:37:13.457246+0000","last_unstale":"2024-09-19T06:37:15.030332+0000","last_undegraded":"2024-09-19T06:37:15.030332+0000","last_fullsized":"2024-09-19T06:37:15.030332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:18.553158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479228+0000","last_change":"2024-09-19T06:37:09.441212+0000","last_active":"2024-09-19T06:37:14.479228+0000","last_peered":"2024-09-19T06:37:14.479228+0000","last_clean":"2024-09-19T06:37:14.479228+0000","last_became_active":"2024-09-19T06:37:09.440209+0000","last_became_peered":"2024-09-19T06:37:09.440209+0000","last_unstale":"2024-09-19T06:37:14.479228+0000","last_undegraded":"2024-09-19T06:37:14.479228+0000","last_fullsized":"2024-09-19T06:37:14.479228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:52.173784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:24.168847+0000","last_change":"2024-09-19T06:37:08.442615+0000","last_active":"2024-09-19T06:37:24.168847+0000","last_peered":"2024-09-19T06:37:24.168847+0000","last_clean":"2024-09-19T06:37:24.168847+0000","last_became_active":"2024-09-19T06:37:08.442242+0000","last_became_peered":"2024-09-19T06:37:08.442242+0000","last_unstale":"2024-09-19T06:37:24.168847+0000","last_undegraded":"2024-09-19T06:37:24.168847+0000","last_fullsized":"2024-09-19T06:37:24.168847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:23.813400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030495+0000","last_change":"2024-09-19T06:37:13.464688+0000","last_active":"2024-09-19T06:37:15.030495+0000","last_peered":"2024-09-19T06:37:15.030495+0000","last_clean":"2024-09-19T06:37:15.030495+0000","last_became_active":"2024-09-19T06:37:13.461620+0000","last_became_peered":"2024-09-19T06:37:13.461620+0000","last_unstale":"2024-09-19T06:37:15.030495+0000","last_undegraded":"2024-09-19T06:37:15.030495+0000","last_fullsized":"2024-09-19T06:37:15.030495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:02.928332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030727+0000","last_change":"2024-09-19T06:37:09.440021+0000","last_active":"2024-09-19T06:37:15.030727+0000","last_peered":"2024-09-19T06:37:15.030727+0000","last_clean":"2024-09-19T06:37:15.030727+0000","last_became_active":"2024-09-19T06:37:09.437800+0000","last_became_peered":"2024-09-19T06:37:09.437800+0000","last_unstale":"2024-09-19T06:37:15.030727+0000","last_undegraded":"2024-09-19T06:37:15.030727+0000","last_fullsized":"2024-09-19T06:37:15.030727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:51.963097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030761+0000","last_change":"2024-09-19T06:37:08.434422+0000","last_active":"2024-09-19T06:37:15.030761+0000","last_peered":"2024-09-19T06:37:15.030761+0000","last_clean":"2024-09-19T06:37:15.030761+0000","last_became_active":"2024-09-19T06:37:08.434151+0000","last_became_peered":"2024-09-19T06:37:08.434151+0000","last_unstale":"2024-09-19T06:37:15.030761+0000","last_undegraded":"2024-09-19T06:37:15.030761+0000","last_fullsized":"2024-09-19T06:37:15.030761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:49.540748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030746+0000","last_change":"2024-09-19T06:37:13.459321+0000","last_active":"2024-09-19T06:37:15.030746+0000","last_peered":"2024-09-19T06:37:15.030746+0000","last_clean":"2024-09-19T06:37:15.030746+0000","last_became_active":"2024-09-19T06:37:13.458924+0000","last_became_peered":"2024-09-19T06:37:13.458924+0000","last_unstale":"2024-09-19T06:37:15.030746+0000","last_undegraded":"2024-09-19T06:37:15.030746+0000","last_fullsized":"2024-09-19T06:37:15.030746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:11.428574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030167+0000","last_change":"2024-09-19T06:37:09.448450+0000","last_active":"2024-09-19T06:37:15.030167+0000","last_peered":"2024-09-19T06:37:15.030167+0000","last_clean":"2024-09-19T06:37:15.030167+0000","last_became_active":"2024-09-19T06:37:09.448173+0000","last_became_peered":"2024-09-19T06:37:09.448173+0000","last_unstale":"2024-09-19T06:37:15.030167+0000","last_undegraded":"2024-09-19T06:37:15.030167+0000","last_fullsized":"2024-09-19T06:37:15.030167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:22.442374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030854+0000","last_change":"2024-09-19T06:37:08.442796+0000","last_active":"2024-09-19T06:37:15.030854+0000","last_peered":"2024-09-19T06:37:15.030854+0000","last_clean":"2024-09-19T06:37:15.030854+0000","last_became_active":"2024-09-19T06:37:08.442126+0000","last_became_peered":"2024-09-19T06:37:08.442126+0000","last_unstale":"2024-09-19T06:37:15.030854+0000","last_undegraded":"2024-09-19T06:37:15.030854+0000","last_fullsized":"2024-09-19T06:37:15.030854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:27.716141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477293+0000","last_change":"2024-09-19T06:37:13.464100+0000","last_active":"2024-09-19T06:37:14.477293+0000","last_peered":"2024-09-19T06:37:14.477293+0000","last_clean":"2024-09-19T06:37:14.477293+0000","last_became_active":"2024-09-19T06:37:13.462750+0000","last_became_peered":"2024-09-19T06:37:13.462750+0000","last_unstale":"2024-09-19T06:37:14.477293+0000","last_undegraded":"2024-09-19T06:37:14.477293+0000","last_fullsized":"2024-09-19T06:37:14.477293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:49.139841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030752+0000","last_change":"2024-09-19T06:37:09.448328+0000","last_active":"2024-09-19T06:37:15.030752+0000","last_peered":"2024-09-19T06:37:15.030752+0000","last_clean":"2024-09-19T06:37:15.030752+0000","last_became_active":"2024-09-19T06:37:09.448056+0000","last_became_peered":"2024-09-19T06:37:09.448056+0000","last_unstale":"2024-09-19T06:37:15.030752+0000","last_undegraded":"2024-09-19T06:37:15.030752+0000","last_fullsized":"2024-09-19T06:37:15.030752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:53.451104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478778+0000","last_change":"2024-09-19T06:37:08.439543+0000","last_active":"2024-09-19T06:37:14.478778+0000","last_peered":"2024-09-19T06:37:14.478778+0000","last_clean":"2024-09-19T06:37:14.478778+0000","last_became_active":"2024-09-19T06:37:08.438785+0000","last_became_peered":"2024-09-19T06:37:08.438785+0000","last_unstale":"2024-09-19T06:37:14.478778+0000","last_undegraded":"2024-09-19T06:37:14.478778+0000","last_fullsized":"2024-09-19T06:37:14.478778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:51.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477286+0000","last_change":"2024-09-19T06:37:13.462327+0000","last_active":"2024-09-19T06:37:14.477286+0000","last_peered":"2024-09-19T06:37:14.477286+0000","last_clean":"2024-09-19T06:37:14.477286+0000","last_became_active":"2024-09-19T06:37:13.461762+0000","last_became_peered":"2024-09-19T06:37:13.461762+0000","last_unstale":"2024-09-19T06:37:14.477286+0000","last_undegraded":"2024-09-19T06:37:14.477286+0000","last_fullsized":"2024-09-19T06:37:14.477286+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:26.931537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029982+0000","last_change":"2024-09-19T06:37:13.471309+0000","last_active":"2024-09-19T06:37:15.029982+0000","last_peered":"2024-09-19T06:37:15.029982+0000","last_clean":"2024-09-19T06:37:15.029982+0000","last_became_active":"2024-09-19T06:37:13.470969+0000","last_became_peered":"2024-09-19T06:37:13.470969+0000","last_unstale":"2024-09-19T06:37:15.029982+0000","last_undegraded":"2024-09-19T06:37:15.029982+0000","last_fullsized":"2024-09-19T06:37:15.029982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:30.990159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029769+0000","last_change":"2024-09-19T06:37:09.443308+0000","last_active":"2024-09-19T06:37:15.029769+0000","last_peered":"2024-09-19T06:37:15.029769+0000","last_clean":"2024-09-19T06:37:15.029769+0000","last_became_active":"2024-09-19T06:37:09.443069+0000","last_became_peered":"2024-09-19T06:37:09.443069+0000","last_unstale":"2024-09-19T06:37:15.029769+0000","last_undegraded":"2024-09-19T06:37:15.029769+0000","last_fullsized":"2024-09-19T06:37:15.029769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:31:33.708578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029646+0000","last_change":"2024-09-19T06:37:08.441967+0000","last_active":"2024-09-19T06:37:15.029646+0000","last_peered":"2024-09-19T06:37:15.029646+0000","last_clean":"2024-09-19T06:37:15.029646+0000","last_became_active":"2024-09-19T06:37:08.441698+0000","last_became_peered":"2024-09-19T06:37:08.441698+0000","last_unstale":"2024-09-19T06:37:15.029646+0000","last_undegraded":"2024-09-19T06:37:15.029646+0000","last_fullsized":"2024-09-19T06:37:15.029646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:56.933775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478180+0000","last_change":"2024-09-19T06:37:13.470903+0000","last_active":"2024-09-19T06:37:14.478180+0000","last_peered":"2024-09-19T06:37:14.478180+0000","last_clean":"2024-09-19T06:37:14.478180+0000","last_became_active":"2024-09-19T06:37:13.470528+0000","last_became_peered":"2024-09-19T06:37:13.470528+0000","last_unstale":"2024-09-19T06:37:14.478180+0000","last_undegraded":"2024-09-19T06:37:14.478180+0000","last_fullsized":"2024-09-19T06:37:14.478180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:45.999436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477209+0000","last_change":"2024-09-19T06:37:09.448953+0000","last_active":"2024-09-19T06:37:14.477209+0000","last_peered":"2024-09-19T06:37:14.477209+0000","last_clean":"2024-09-19T06:37:14.477209+0000","last_became_active":"2024-09-19T06:37:09.448658+0000","last_became_peered":"2024-09-19T06:37:09.448658+0000","last_unstale":"2024-09-19T06:37:14.477209+0000","last_undegraded":"2024-09-19T06:37:14.477209+0000","last_fullsized":"2024-09-19T06:37:14.477209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:07.333392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477562+0000","last_change":"2024-09-19T06:37:08.440800+0000","last_active":"2024-09-19T06:37:14.477562+0000","last_peered":"2024-09-19T06:37:14.477562+0000","last_clean":"2024-09-19T06:37:14.477562+0000","last_became_active":"2024-09-19T06:37:08.440591+0000","last_became_peered":"2024-09-19T06:37:08.440591+0000","last_unstale":"2024-09-19T06:37:14.477562+0000","last_undegraded":"2024-09-19T06:37:14.477562+0000","last_fullsized":"2024-09-19T06:37:14.477562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:05.540261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478578+0000","last_change":"2024-09-19T06:37:08.441268+0000","last_active":"2024-09-19T06:37:14.478578+0000","last_peered":"2024-09-19T06:37:14.478578+0000","last_clean":"2024-09-19T06:37:14.478578+0000","last_became_active":"2024-09-19T06:37:08.440969+0000","last_became_peered":"2024-09-19T06:37:08.440969+0000","last_unstale":"2024-09-19T06:37:14.478578+0000","last_undegraded":"2024-09-19T06:37:14.478578+0000","last_fullsized":"2024-09-19T06:37:14.478578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:59.426336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030814+0000","last_change":"2024-09-19T06:37:09.444857+0000","last_active":"2024-09-19T06:37:15.030814+0000","last_peered":"2024-09-19T06:37:15.030814+0000","last_clean":"2024-09-19T06:37:15.030814+0000","last_became_active":"2024-09-19T06:37:09.444562+0000","last_became_peered":"2024-09-19T06:37:09.444562+0000","last_unstale":"2024-09-19T06:37:15.030814+0000","last_undegraded":"2024-09-19T06:37:15.030814+0000","last_fullsized":"2024-09-19T06:37:15.030814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:02.470787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815254+0000","last_change":"2024-09-19T06:37:13.467183+0000","last_active":"2024-09-19T06:37:14.815254+0000","last_peered":"2024-09-19T06:37:14.815254+0000","last_clean":"2024-09-19T06:37:14.815254+0000","last_became_active":"2024-09-19T06:37:13.466765+0000","last_became_peered":"2024-09-19T06:37:13.466765+0000","last_unstale":"2024-09-19T06:37:14.815254+0000","last_undegraded":"2024-09-19T06:37:14.815254+0000","last_fullsized":"2024-09-19T06:37:14.815254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:35.184815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477901+0000","last_change":"2024-09-19T06:37:08.443993+0000","last_active":"2024-09-19T06:37:14.477901+0000","last_peered":"2024-09-19T06:37:14.477901+0000","last_clean":"2024-09-19T06:37:14.477901+0000","last_became_active":"2024-09-19T06:37:08.443774+0000","last_became_peered":"2024-09-19T06:37:08.443774+0000","last_unstale":"2024-09-19T06:37:14.477901+0000","last_undegraded":"2024-09-19T06:37:14.477901+0000","last_fullsized":"2024-09-19T06:37:14.477901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:16.005073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029942+0000","last_change":"2024-09-19T06:37:09.440258+0000","last_active":"2024-09-19T06:37:15.029942+0000","last_peered":"2024-09-19T06:37:15.029942+0000","last_clean":"2024-09-19T06:37:15.029942+0000","last_became_active":"2024-09-19T06:37:09.438457+0000","last_became_peered":"2024-09-19T06:37:09.438457+0000","last_unstale":"2024-09-19T06:37:15.029942+0000","last_undegraded":"2024-09-19T06:37:15.029942+0000","last_fullsized":"2024-09-19T06:37:15.029942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:24.636340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477624+0000","last_change":"2024-09-19T06:37:13.462800+0000","last_active":"2024-09-19T06:37:14.477624+0000","last_peered":"2024-09-19T06:37:14.477624+0000","last_clean":"2024-09-19T06:37:14.477624+0000","last_became_active":"2024-09-19T06:37:13.462393+0000","last_became_peered":"2024-09-19T06:37:13.462393+0000","last_unstale":"2024-09-19T06:37:14.477624+0000","last_undegraded":"2024-09-19T06:37:14.477624+0000","last_fullsized":"2024-09-19T06:37:14.477624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:35.901637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477580+0000","last_change":"2024-09-19T06:37:09.450421+0000","last_active":"2024-09-19T06:37:14.477580+0000","last_peered":"2024-09-19T06:37:14.477580+0000","last_clean":"2024-09-19T06:37:14.477580+0000","last_became_active":"2024-09-19T06:37:09.450147+0000","last_became_peered":"2024-09-19T06:37:09.450147+0000","last_unstale":"2024-09-19T06:37:14.477580+0000","last_undegraded":"2024-09-19T06:37:14.477580+0000","last_fullsized":"2024-09-19T06:37:14.477580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:42.949759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.814967+0000","last_change":"2024-09-19T06:37:09.435131+0000","last_active":"2024-09-19T06:37:14.814967+0000","last_peered":"2024-09-19T06:37:14.814967+0000","last_clean":"2024-09-19T06:37:14.814967+0000","last_became_active":"2024-09-19T06:37:09.434840+0000","last_became_peered":"2024-09-19T06:37:09.434840+0000","last_unstale":"2024-09-19T06:37:14.814967+0000","last_undegraded":"2024-09-19T06:37:14.814967+0000","last_fullsized":"2024-09-19T06:37:14.814967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:20.484554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030415+0000","last_change":"2024-09-19T06:37:09.445196+0000","last_active":"2024-09-19T06:37:15.030415+0000","last_peered":"2024-09-19T06:37:15.030415+0000","last_clean":"2024-09-19T06:37:15.030415+0000","last_became_active":"2024-09-19T06:37:09.444907+0000","last_became_peered":"2024-09-19T06:37:09.444907+0000","last_unstale":"2024-09-19T06:37:15.030415+0000","last_undegraded":"2024-09-19T06:37:15.030415+0000","last_fullsized":"2024-09-19T06:37:15.030415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:17.605675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030729+0000","last_change":"2024-09-19T06:37:09.447966+0000","last_active":"2024-09-19T06:37:15.030729+0000","last_peered":"2024-09-19T06:37:15.030729+0000","last_clean":"2024-09-19T06:37:15.030729+0000","last_became_active":"2024-09-19T06:37:09.447692+0000","last_became_peered":"2024-09-19T06:37:09.447692+0000","last_unstale":"2024-09-19T06:37:15.030729+0000","last_undegraded":"2024-09-19T06:37:15.030729+0000","last_fullsized":"2024-09-19T06:37:15.030729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:01.517824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477900+0000","last_change":"2024-09-19T06:37:09.442651+0000","last_active":"2024-09-19T06:37:14.477900+0000","last_peered":"2024-09-19T06:37:14.477900+0000","last_clean":"2024-09-19T06:37:14.477900+0000","last_became_active":"2024-09-19T06:37:09.442195+0000","last_became_peered":"2024-09-19T06:37:09.442195+0000","last_unstale":"2024-09-19T06:37:14.477900+0000","last_undegraded":"2024-09-19T06:37:14.477900+0000","last_fullsized":"2024-09-19T06:37:14.477900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:15.658285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030600+0000","last_change":"2024-09-19T06:37:09.441782+0000","last_active":"2024-09-19T06:37:15.030600+0000","last_peered":"2024-09-19T06:37:15.030600+0000","last_clean":"2024-09-19T06:37:15.030600+0000","last_became_active":"2024-09-19T06:37:09.441456+0000","last_became_peered":"2024-09-19T06:37:09.441456+0000","last_unstale":"2024-09-19T06:37:15.030600+0000","last_undegraded":"2024-09-19T06:37:15.030600+0000","last_fullsized":"2024-09-19T06:37:15.030600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:04:28.458974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479237+0000","last_change":"2024-09-19T06:37:09.449856+0000","last_active":"2024-09-19T06:37:14.479237+0000","last_peered":"2024-09-19T06:37:14.479237+0000","last_clean":"2024-09-19T06:37:14.479237+0000","last_became_active":"2024-09-19T06:37:09.449562+0000","last_became_peered":"2024-09-19T06:37:09.449562+0000","last_unstale":"2024-09-19T06:37:14.479237+0000","last_undegraded":"2024-09-19T06:37:14.479237+0000","last_fullsized":"2024-09-19T06:37:14.479237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:49.182126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477764+0000","last_change":"2024-09-19T06:37:09.438551+0000","last_active":"2024-09-19T06:37:14.477764+0000","last_peered":"2024-09-19T06:37:14.477764+0000","last_clean":"2024-09-19T06:37:14.477764+0000","last_became_active":"2024-09-19T06:37:09.437624+0000","last_became_peered":"2024-09-19T06:37:09.437624+0000","last_unstale":"2024-09-19T06:37:14.477764+0000","last_undegraded":"2024-09-19T06:37:14.477764+0000","last_fullsized":"2024-09-19T06:37:14.477764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:46.565780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029601+0000","last_change":"2024-09-19T06:37:09.438737+0000","last_active":"2024-09-19T06:37:15.029601+0000","last_peered":"2024-09-19T06:37:15.029601+0000","last_clean":"2024-09-19T06:37:15.029601+0000","last_became_active":"2024-09-19T06:37:09.438453+0000","last_became_peered":"2024-09-19T06:37:09.438453+0000","last_unstale":"2024-09-19T06:37:15.029601+0000","last_undegraded":"2024-09-19T06:37:15.029601+0000","last_fullsized":"2024-09-19T06:37:15.029601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.982275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477390+0000","last_change":"2024-09-19T06:37:09.442093+0000","last_active":"2024-09-19T06:37:14.477390+0000","last_peered":"2024-09-19T06:37:14.477390+0000","last_clean":"2024-09-19T06:37:14.477390+0000","last_became_active":"2024-09-19T06:37:09.439710+0000","last_became_peered":"2024-09-19T06:37:09.439710+0000","last_unstale":"2024-09-19T06:37:14.477390+0000","last_undegraded":"2024-09-19T06:37:14.477390+0000","last_fullsized":"2024-09-19T06:37:14.477390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:02.626854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030310+0000","last_change":"2024-09-19T06:37:09.438271+0000","last_active":"2024-09-19T06:37:15.030310+0000","last_peered":"2024-09-19T06:37:15.030310+0000","last_clean":"2024-09-19T06:37:15.030310+0000","last_became_active":"2024-09-19T06:37:09.438009+0000","last_became_peered":"2024-09-19T06:37:09.438009+0000","last_unstale":"2024-09-19T06:37:15.030310+0000","last_undegraded":"2024-09-19T06:37:15.030310+0000","last_fullsized":"2024-09-19T06:37:15.030310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:26.395210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030632+0000","last_change":"2024-09-19T06:37:09.449633+0000","last_active":"2024-09-19T06:37:15.030632+0000","last_peered":"2024-09-19T06:37:15.030632+0000","last_clean":"2024-09-19T06:37:15.030632+0000","last_became_active":"2024-09-19T06:37:09.449379+0000","last_became_peered":"2024-09-19T06:37:09.449379+0000","last_unstale":"2024-09-19T06:37:15.030632+0000","last_undegraded":"2024-09-19T06:37:15.030632+0000","last_fullsized":"2024-09-19T06:37:15.030632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:29.565038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478253+0000","last_change":"2024-09-19T06:37:09.447808+0000","last_active":"2024-09-19T06:37:14.478253+0000","last_peered":"2024-09-19T06:37:14.478253+0000","last_clean":"2024-09-19T06:37:14.478253+0000","last_became_active":"2024-09-19T06:37:09.447514+0000","last_became_peered":"2024-09-19T06:37:09.447514+0000","last_unstale":"2024-09-19T06:37:14.478253+0000","last_undegraded":"2024-09-19T06:37:14.478253+0000","last_fullsized":"2024-09-19T06:37:14.478253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:04.653997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479576+0000","last_change":"2024-09-19T06:37:09.439605+0000","last_active":"2024-09-19T06:37:14.479576+0000","last_peered":"2024-09-19T06:37:14.479576+0000","last_clean":"2024-09-19T06:37:14.479576+0000","last_became_active":"2024-09-19T06:37:09.432601+0000","last_became_peered":"2024-09-19T06:37:09.432601+0000","last_unstale":"2024-09-19T06:37:14.479576+0000","last_undegraded":"2024-09-19T06:37:14.479576+0000","last_fullsized":"2024-09-19T06:37:14.479576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:50.640062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815206+0000","last_change":"2024-09-19T06:37:09.440268+0000","last_active":"2024-09-19T06:37:14.815206+0000","last_peered":"2024-09-19T06:37:14.815206+0000","last_clean":"2024-09-19T06:37:14.815206+0000","last_became_active":"2024-09-19T06:37:09.439937+0000","last_became_peered":"2024-09-19T06:37:09.439937+0000","last_unstale":"2024-09-19T06:37:14.815206+0000","last_undegraded":"2024-09-19T06:37:14.815206+0000","last_fullsized":"2024-09-19T06:37:14.815206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:32:46.182979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030922+0000","last_change":"2024-09-19T06:37:09.437080+0000","last_active":"2024-09-19T06:37:15.030922+0000","last_peered":"2024-09-19T06:37:15.030922+0000","last_clean":"2024-09-19T06:37:15.030922+0000","last_became_active":"2024-09-19T06:37:09.436752+0000","last_became_peered":"2024-09-19T06:37:09.436752+0000","last_unstale":"2024-09-19T06:37:15.030922+0000","last_undegraded":"2024-09-19T06:37:15.030922+0000","last_fullsized":"2024-09-19T06:37:15.030922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:31.423640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029549+0000","last_change":"2024-09-19T06:37:09.448942+0000","last_active":"2024-09-19T06:37:15.029549+0000","last_peered":"2024-09-19T06:37:15.029549+0000","last_clean":"2024-09-19T06:37:15.029549+0000","last_became_active":"2024-09-19T06:37:09.448647+0000","last_became_peered":"2024-09-19T06:37:09.448647+0000","last_unstale":"2024-09-19T06:37:15.029549+0000","last_undegraded":"2024-09-19T06:37:15.029549+0000","last_fullsized":"2024-09-19T06:37:15.029549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:49.027909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029809+0000","last_change":"2024-09-19T06:37:09.445015+0000","last_active":"2024-09-19T06:37:15.029809+0000","last_peered":"2024-09-19T06:37:15.029809+0000","last_clean":"2024-09-19T06:37:15.029809+0000","last_became_active":"2024-09-19T06:37:09.444737+0000","last_became_peered":"2024-09-19T06:37:09.444737+0000","last_unstale":"2024-09-19T06:37:15.029809+0000","last_undegraded":"2024-09-19T06:37:15.029809+0000","last_fullsized":"2024-09-19T06:37:15.029809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:16.194580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029853+0000","last_change":"2024-09-19T06:37:09.446025+0000","last_active":"2024-09-19T06:37:15.029853+0000","last_peered":"2024-09-19T06:37:15.029853+0000","last_clean":"2024-09-19T06:37:15.029853+0000","last_became_active":"2024-09-19T06:37:09.445503+0000","last_became_peered":"2024-09-19T06:37:09.445503+0000","last_unstale":"2024-09-19T06:37:15.029853+0000","last_undegraded":"2024-09-19T06:37:15.029853+0000","last_fullsized":"2024-09-19T06:37:15.029853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:30.469995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477784+0000","last_change":"2024-09-19T06:37:09.441302+0000","last_active":"2024-09-19T06:37:14.477784+0000","last_peered":"2024-09-19T06:37:14.477784+0000","last_clean":"2024-09-19T06:37:14.477784+0000","last_became_active":"2024-09-19T06:37:09.439767+0000","last_became_peered":"2024-09-19T06:37:09.439767+0000","last_unstale":"2024-09-19T06:37:14.477784+0000","last_undegraded":"2024-09-19T06:37:14.477784+0000","last_fullsized":"2024-09-19T06:37:14.477784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:01.038823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030560+0000","last_change":"2024-09-19T06:37:09.440976+0000","last_active":"2024-09-19T06:37:15.030560+0000","last_peered":"2024-09-19T06:37:15.030560+0000","last_clean":"2024-09-19T06:37:15.030560+0000","last_became_active":"2024-09-19T06:37:09.440702+0000","last_became_peered":"2024-09-19T06:37:09.440702+0000","last_unstale":"2024-09-19T06:37:15.030560+0000","last_undegraded":"2024-09-19T06:37:15.030560+0000","last_fullsized":"2024-09-19T06:37:15.030560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:21.281400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477942+0000","last_change":"2024-09-19T06:37:09.442301+0000","last_active":"2024-09-19T06:37:14.477942+0000","last_peered":"2024-09-19T06:37:14.477942+0000","last_clean":"2024-09-19T06:37:14.477942+0000","last_became_active":"2024-09-19T06:37:09.442053+0000","last_became_peered":"2024-09-19T06:37:09.442053+0000","last_unstale":"2024-09-19T06:37:14.477942+0000","last_undegraded":"2024-09-19T06:37:14.477942+0000","last_fullsized":"2024-09-19T06:37:14.477942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:26.189384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479335+0000","last_change":"2024-09-19T06:37:09.441525+0000","last_active":"2024-09-19T06:37:14.479335+0000","last_peered":"2024-09-19T06:37:14.479335+0000","last_clean":"2024-09-19T06:37:14.479335+0000","last_became_active":"2024-09-19T06:37:09.441179+0000","last_became_peered":"2024-09-19T06:37:09.441179+0000","last_unstale":"2024-09-19T06:37:14.479335+0000","last_undegraded":"2024-09-19T06:37:14.479335+0000","last_fullsized":"2024-09-19T06:37:14.479335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:47.235113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479743+0000","last_change":"2024-09-19T06:37:09.437163+0000","last_active":"2024-09-19T06:37:14.479743+0000","last_peered":"2024-09-19T06:37:14.479743+0000","last_clean":"2024-09-19T06:37:14.479743+0000","last_became_active":"2024-09-19T06:37:09.436892+0000","last_became_peered":"2024-09-19T06:37:09.436892+0000","last_unstale":"2024-09-19T06:37:14.479743+0000","last_undegraded":"2024-09-19T06:37:14.479743+0000","last_fullsized":"2024-09-19T06:37:14.479743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:47:58.347385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477114+0000","last_change":"2024-09-19T06:37:09.437524+0000","last_active":"2024-09-19T06:37:14.477114+0000","last_peered":"2024-09-19T06:37:14.477114+0000","last_clean":"2024-09-19T06:37:14.477114+0000","last_became_active":"2024-09-19T06:37:09.437023+0000","last_became_peered":"2024-09-19T06:37:09.437023+0000","last_unstale":"2024-09-19T06:37:14.477114+0000","last_undegraded":"2024-09-19T06:37:14.477114+0000","last_fullsized":"2024-09-19T06:37:14.477114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:31.398914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478456+0000","last_change":"2024-09-19T06:37:09.448814+0000","last_active":"2024-09-19T06:37:14.478456+0000","last_peered":"2024-09-19T06:37:14.478456+0000","last_clean":"2024-09-19T06:37:14.478456+0000","last_became_active":"2024-09-19T06:37:09.448547+0000","last_became_peered":"2024-09-19T06:37:09.448547+0000","last_unstale":"2024-09-19T06:37:14.478456+0000","last_undegraded":"2024-09-19T06:37:14.478456+0000","last_fullsized":"2024-09-19T06:37:14.478456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:13.526300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030114+0000","last_change":"2024-09-19T06:37:09.446910+0000","last_active":"2024-09-19T06:37:15.030114+0000","last_peered":"2024-09-19T06:37:15.030114+0000","last_clean":"2024-09-19T06:37:15.030114+0000","last_became_active":"2024-09-19T06:37:09.446603+0000","last_became_peered":"2024-09-19T06:37:09.446603+0000","last_unstale":"2024-09-19T06:37:15.030114+0000","last_undegraded":"2024-09-19T06:37:15.030114+0000","last_fullsized":"2024-09-19T06:37:15.030114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:47.006354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479198+0000","last_change":"2024-09-19T06:37:09.430160+0000","last_active":"2024-09-19T06:37:14.479198+0000","last_peered":"2024-09-19T06:37:14.479198+0000","last_clean":"2024-09-19T06:37:14.479198+0000","last_became_active":"2024-09-19T06:37:09.429813+0000","last_became_peered":"2024-09-19T06:37:09.429813+0000","last_unstale":"2024-09-19T06:37:14.479198+0000","last_undegraded":"2024-09-19T06:37:14.479198+0000","last_fullsized":"2024-09-19T06:37:14.479198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:10.353834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030011+0000","last_change":"2024-09-19T06:37:09.446622+0000","last_active":"2024-09-19T06:37:15.030011+0000","last_peered":"2024-09-19T06:37:15.030011+0000","last_clean":"2024-09-19T06:37:15.030011+0000","last_became_active":"2024-09-19T06:37:09.446349+0000","last_became_peered":"2024-09-19T06:37:09.446349+0000","last_unstale":"2024-09-19T06:37:15.030011+0000","last_undegraded":"2024-09-19T06:37:15.030011+0000","last_fullsized":"2024-09-19T06:37:15.030011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:01.702039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030152+0000","last_change":"2024-09-19T06:37:09.446789+0000","last_active":"2024-09-19T06:37:15.030152+0000","last_peered":"2024-09-19T06:37:15.030152+0000","last_clean":"2024-09-19T06:37:15.030152+0000","last_became_active":"2024-09-19T06:37:09.446557+0000","last_became_peered":"2024-09-19T06:37:09.446557+0000","last_unstale":"2024-09-19T06:37:15.030152+0000","last_undegraded":"2024-09-19T06:37:15.030152+0000","last_fullsized":"2024-09-19T06:37:15.030152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:18.119474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030246+0000","last_change":"2024-09-19T06:37:09.448093+0000","last_active":"2024-09-19T06:37:15.030246+0000","last_peered":"2024-09-19T06:37:15.030246+0000","last_clean":"2024-09-19T06:37:15.030246+0000","last_became_active":"2024-09-19T06:37:09.447753+0000","last_became_peered":"2024-09-19T06:37:09.447753+0000","last_unstale":"2024-09-19T06:37:15.030246+0000","last_undegraded":"2024-09-19T06:37:15.030246+0000","last_fullsized":"2024-09-19T06:37:15.030246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:11.944092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479640+0000","last_change":"2024-09-19T06:37:09.442798+0000","last_active":"2024-09-19T06:37:14.479640+0000","last_peered":"2024-09-19T06:37:14.479640+0000","last_clean":"2024-09-19T06:37:14.479640+0000","last_became_active":"2024-09-19T06:37:09.442047+0000","last_became_peered":"2024-09-19T06:37:09.442047+0000","last_unstale":"2024-09-19T06:37:14.479640+0000","last_undegraded":"2024-09-19T06:37:14.479640+0000","last_fullsized":"2024-09-19T06:37:14.479640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:33.193185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65040,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509452,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509452,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":348160,"data_stored":698736,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":698680,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":107730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:37:40.874 INFO:tasks.mds_thrash.ceph_manager:clean! 2024-09-19T06:37:40.874 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:37:41.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.005+0000 7f09f7cd0640 1 Processor -- start 2024-09-19T06:37:41.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.005+0000 7f09f7cd0640 1 -- start start 2024-09-19T06:37:41.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.006+0000 7f09f7cd0640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f09f0158720 0x7f09f006db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:41.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.006+0000 7f09f7cd0640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f09f006ccd0 0x7f09f006d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:41.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.006+0000 7f09f7cd0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09f0158b70 con 0x7f09f0151e60 2024-09-19T06:37:41.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.006+0000 7f09f7cd0640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f09f006e0d0 con 0x7f09f006ccd0 2024-09-19T06:37:41.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.006+0000 7f09f7cd0640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f09f00c5dd0 con 0x7f09f0158720 2024-09-19T06:37:41.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.006+0000 7f09f626d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f09f006ccd0 0x7f09f006d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:41.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.006+0000 7f09f626d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f09f006ccd0 0x7f09f006d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57080/0 (socket says 172.21.15.86:57080) 2024-09-19T06:37:41.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.007+0000 7f09f626d640 1 -- 172.21.15.86:0/341006414 learned_addr learned my addr 172.21.15.86:0/341006414 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:41.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.007+0000 7f09f526b640 1 --2- 172.21.15.86:0/341006414 >> v2:172.21.15.169:3300/0 conn(0x7f09f0158720 0x7f09f006db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:41.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.007+0000 7f09f626d640 1 -- 172.21.15.86:0/341006414 >> v2:172.21.15.169:3300/0 conn(0x7f09f0158720 msgr2=0x7f09f006db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:41.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.007+0000 7f09f626d640 1 --2- 172.21.15.86:0/341006414 >> v2:172.21.15.169:3300/0 conn(0x7f09f0158720 0x7f09f006db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.007+0000 7f09f626d640 1 -- 172.21.15.86:0/341006414 >> v1:172.21.15.169:6789/0 conn(0x7f09f0151e60 legacy=0x7f09f00c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:41.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.007+0000 7f09f626d640 1 -- 172.21.15.86:0/341006414 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f00c82c0 con 0x7f09f006ccd0 2024-09-19T06:37:41.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.007+0000 7f09f526b640 1 --2- 172.21.15.86:0/341006414 >> v2:172.21.15.169:3300/0 conn(0x7f09f0158720 0x7f09f006db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:41.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.007+0000 7f09f626d640 1 --2- 172.21.15.86:0/341006414 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09f006ccd0 0x7f09f006d0d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f09f006f370 tx=0x7f09e802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f631ac38959d392 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:41.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.008+0000 7f09f4a6a640 1 -- 172.21.15.86:0/341006414 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e8037070 con 0x7f09f006ccd0 2024-09-19T06:37:41.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.008+0000 7f09f4a6a640 1 -- 172.21.15.86:0/341006414 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e802ae50 con 0x7f09f006ccd0 2024-09-19T06:37:41.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.008+0000 7f09f4a6a640 1 -- 172.21.15.86:0/341006414 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e8032860 con 0x7f09f006ccd0 2024-09-19T06:37:41.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.008+0000 7f09f7cd0640 1 -- 172.21.15.86:0/341006414 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09f006ccd0 msgr2=0x7f09f006d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:41.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.008+0000 7f09f7cd0640 1 --2- 172.21.15.86:0/341006414 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09f006ccd0 0x7f09f006d0d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f09f006f370 tx=0x7f09e802a300 comp rx=0 tx=0).stop 2024-09-19T06:37:41.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.008+0000 7f09f7cd0640 1 -- 172.21.15.86:0/341006414 shutdown_connections 2024-09-19T06:37:41.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.008+0000 7f09f7cd0640 1 --2- 172.21.15.86:0/341006414 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09f006ccd0 0x7f09f006d0d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.008+0000 7f09f7cd0640 1 --2- 172.21.15.86:0/341006414 >> v2:172.21.15.169:3300/0 conn(0x7f09f0158720 0x7f09f006db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.008+0000 7f09f7cd0640 1 -- 172.21.15.86:0/341006414 >> 172.21.15.86:0/341006414 conn(0x7f09f00cdd80 msgr2=0x7f09f00ca220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:41.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.008+0000 7f09f7cd0640 1 -- 172.21.15.86:0/341006414 shutdown_connections 2024-09-19T06:37:41.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.008+0000 7f09f7cd0640 1 -- 172.21.15.86:0/341006414 wait complete. 2024-09-19T06:37:41.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.009+0000 7f09f7cd0640 1 Processor -- start 2024-09-19T06:37:41.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.009+0000 7f09f7cd0640 1 -- start start 2024-09-19T06:37:41.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.010+0000 7f09f7cd0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09f006ccd0 0x7f09f015b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:41.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.010+0000 7f09f7cd0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09f0151e60 0x7f09f006be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:41.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.010+0000 7f09f7cd0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09f0158720 0x7f09f01f0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:41.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.010+0000 7f09f7cd0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f09f00c8b60 con 0x7f09f006ccd0 2024-09-19T06:37:41.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.010+0000 7f09f7cd0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f09f00c8880 con 0x7f09f0158720 2024-09-19T06:37:41.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.010+0000 7f09f7cd0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f09f00c8e40 con 0x7f09f0151e60 2024-09-19T06:37:41.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.010+0000 7f09f5a6c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09f006ccd0 0x7f09f015b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:41.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.010+0000 7f09f5a6c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09f006ccd0 0x7f09f015b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57084/0 (socket says 172.21.15.86:57084) 2024-09-19T06:37:41.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.010+0000 7f09f5a6c640 1 -- 172.21.15.86:0/1214267934 learned_addr learned my addr 172.21.15.86:0/1214267934 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:41.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.010+0000 7f09f526b640 1 --2- 172.21.15.86:0/1214267934 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09f0151e60 0x7f09f006be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:41.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.010+0000 7f09f626d640 1 --2- 172.21.15.86:0/1214267934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09f0158720 0x7f09f01f0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:41.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.011+0000 7f09f5a6c640 1 -- 172.21.15.86:0/1214267934 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09f0151e60 msgr2=0x7f09f006be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:41.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.011+0000 7f09f5a6c640 1 --2- 172.21.15.86:0/1214267934 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09f0151e60 0x7f09f006be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.011+0000 7f09f5a6c640 1 -- 172.21.15.86:0/1214267934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09f0158720 msgr2=0x7f09f01f0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:41.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.011+0000 7f09f5a6c640 1 --2- 172.21.15.86:0/1214267934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09f0158720 0x7f09f01f0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.011+0000 7f09f5a6c640 1 -- 172.21.15.86:0/1214267934 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f01f4330 con 0x7f09f006ccd0 2024-09-19T06:37:41.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.011+0000 7f09f5a6c640 1 --2- 172.21.15.86:0/1214267934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09f006ccd0 0x7f09f015b7e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00c7c0 tx=0x7f09ec00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:41.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.011+0000 7f09e67fc640 1 -- 172.21.15.86:0/1214267934 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ec016020 con 0x7f09f006ccd0 2024-09-19T06:37:41.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.011+0000 7f09e67fc640 1 -- 172.21.15.86:0/1214267934 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09ec006d50 con 0x7f09f006ccd0 2024-09-19T06:37:41.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.011+0000 7f09e67fc640 1 -- 172.21.15.86:0/1214267934 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ec003bb0 con 0x7f09f006ccd0 2024-09-19T06:37:41.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.011+0000 7f09f7cd0640 1 -- 172.21.15.86:0/1214267934 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09f015b110 con 0x7f09f006ccd0 2024-09-19T06:37:41.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.011+0000 7f09f7cd0640 1 -- 172.21.15.86:0/1214267934 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09f01f45d0 con 0x7f09f006ccd0 2024-09-19T06:37:41.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.012+0000 7f09f7cd0640 1 -- 172.21.15.86:0/1214267934 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09f01f4bc0 con 0x7f09f006ccd0 2024-09-19T06:37:41.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.012+0000 7f09e67fc640 1 -- 172.21.15.86:0/1214267934 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f09ec00a850 con 0x7f09f006ccd0 2024-09-19T06:37:41.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.013+0000 7f09e67fc640 1 --2- 172.21.15.86:0/1214267934 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f09d406c2b0 0x7f09d406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:41.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.013+0000 7f09e67fc640 1 -- 172.21.15.86:0/1214267934 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f09ec08b2a0 con 0x7f09f006ccd0 2024-09-19T06:37:41.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.013+0000 7f09f526b640 1 --2- 172.21.15.86:0/1214267934 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f09d406c2b0 0x7f09d406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:41.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.013+0000 7f09f526b640 1 --2- 172.21.15.86:0/1214267934 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f09d406c2b0 0x7f09d406e770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f09f01eea40 tx=0x7f09e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:41.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.017+0000 7f09e67fc640 1 -- 172.21.15.86:0/1214267934 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f09ec020020 con 0x7f09f006ccd0 2024-09-19T06:37:41.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.179+0000 7f09f7cd0640 1 -- 172.21.15.86:0/1214267934 --> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f09f0152240 con 0x7f09d406c2b0 2024-09-19T06:37:41.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.186+0000 7f09e67fc640 1 -- 172.21.15.86:0/1214267934 <== mgr.4105 v2:172.21.15.86:6816/4165134248 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332608 (secure 0 0 0) 0x7f09f0152240 con 0x7f09d406c2b0 2024-09-19T06:37:41.191 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:41.193 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-09-19T06:37:41.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.190+0000 7f09f7cd0640 1 -- 172.21.15.86:0/1214267934 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f09d406c2b0 msgr2=0x7f09d406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:41.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.190+0000 7f09f7cd0640 1 --2- 172.21.15.86:0/1214267934 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f09d406c2b0 0x7f09d406e770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f09f01eea40 tx=0x7f09e0008040 comp rx=0 tx=0).stop 2024-09-19T06:37:41.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.190+0000 7f09f7cd0640 1 -- 172.21.15.86:0/1214267934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09f006ccd0 msgr2=0x7f09f015b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:41.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.190+0000 7f09f7cd0640 1 --2- 172.21.15.86:0/1214267934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09f006ccd0 0x7f09f015b7e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00c7c0 tx=0x7f09ec00cc80 comp rx=0 tx=0).stop 2024-09-19T06:37:41.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.190+0000 7f09f7cd0640 1 -- 172.21.15.86:0/1214267934 shutdown_connections 2024-09-19T06:37:41.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.190+0000 7f09f7cd0640 1 --2- 172.21.15.86:0/1214267934 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f09d406c2b0 0x7f09d406e770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.190+0000 7f09f7cd0640 1 --2- 172.21.15.86:0/1214267934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09f0158720 0x7f09f01f0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.190+0000 7f09f7cd0640 1 --2- 172.21.15.86:0/1214267934 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09f0151e60 0x7f09f006be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.190+0000 7f09f7cd0640 1 --2- 172.21.15.86:0/1214267934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09f006ccd0 0x7f09f015b7e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.190+0000 7f09f7cd0640 1 -- 172.21.15.86:0/1214267934 >> 172.21.15.86:0/1214267934 conn(0x7f09f00cdd80 msgr2=0x7f09f00c9260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:41.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.190+0000 7f09f7cd0640 1 -- 172.21.15.86:0/1214267934 shutdown_connections 2024-09-19T06:37:41.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.190+0000 7f09f7cd0640 1 -- 172.21.15.86:0/1214267934 wait complete. 2024-09-19T06:37:41.202 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-09-19T06:37:39.747744+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218536,"kb_used_data":2304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756184,"statfs":{"total":773094113280,"available":772870332416,"internally_reserved":0,"allocated":2359296,"data_stored":2051860,"data_compressed":65040,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002648"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030305+0000","last_change":"2024-09-19T06:37:08.446272+0000","last_active":"2024-09-19T06:37:15.030305+0000","last_peered":"2024-09-19T06:37:15.030305+0000","last_clean":"2024-09-19T06:37:15.030305+0000","last_became_active":"2024-09-19T06:37:08.446044+0000","last_became_peered":"2024-09-19T06:37:08.446044+0000","last_unstale":"2024-09-19T06:37:15.030305+0000","last_undegraded":"2024-09-19T06:37:15.030305+0000","last_fullsized":"2024-09-19T06:37:15.030305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:37.623543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477629+0000","last_change":"2024-09-19T06:37:09.441539+0000","last_active":"2024-09-19T06:37:14.477629+0000","last_peered":"2024-09-19T06:37:14.477629+0000","last_clean":"2024-09-19T06:37:14.477629+0000","last_became_active":"2024-09-19T06:37:09.440839+0000","last_became_peered":"2024-09-19T06:37:09.440839+0000","last_unstale":"2024-09-19T06:37:14.477629+0000","last_undegraded":"2024-09-19T06:37:14.477629+0000","last_fullsized":"2024-09-19T06:37:14.477629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:49.222252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477205+0000","last_change":"2024-09-19T06:37:13.461355+0000","last_active":"2024-09-19T06:37:14.477205+0000","last_peered":"2024-09-19T06:37:14.477205+0000","last_clean":"2024-09-19T06:37:14.477205+0000","last_became_active":"2024-09-19T06:37:13.460936+0000","last_became_peered":"2024-09-19T06:37:13.460936+0000","last_unstale":"2024-09-19T06:37:14.477205+0000","last_undegraded":"2024-09-19T06:37:14.477205+0000","last_fullsized":"2024-09-19T06:37:14.477205+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:59.860583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477847+0000","last_change":"2024-09-19T06:37:08.438583+0000","last_active":"2024-09-19T06:37:14.477847+0000","last_peered":"2024-09-19T06:37:14.477847+0000","last_clean":"2024-09-19T06:37:14.477847+0000","last_became_active":"2024-09-19T06:37:08.437921+0000","last_became_peered":"2024-09-19T06:37:08.437921+0000","last_unstale":"2024-09-19T06:37:14.477847+0000","last_undegraded":"2024-09-19T06:37:14.477847+0000","last_fullsized":"2024-09-19T06:37:14.477847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:58:23.269120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030018+0000","last_change":"2024-09-19T06:37:09.450731+0000","last_active":"2024-09-19T06:37:15.030018+0000","last_peered":"2024-09-19T06:37:15.030018+0000","last_clean":"2024-09-19T06:37:15.030018+0000","last_became_active":"2024-09-19T06:37:09.450430+0000","last_became_peered":"2024-09-19T06:37:09.450430+0000","last_unstale":"2024-09-19T06:37:15.030018+0000","last_undegraded":"2024-09-19T06:37:15.030018+0000","last_fullsized":"2024-09-19T06:37:15.030018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:21.701872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029552+0000","last_change":"2024-09-19T06:37:13.459445+0000","last_active":"2024-09-19T06:37:15.029552+0000","last_peered":"2024-09-19T06:37:15.029552+0000","last_clean":"2024-09-19T06:37:15.029552+0000","last_became_active":"2024-09-19T06:37:13.459040+0000","last_became_peered":"2024-09-19T06:37:13.459040+0000","last_unstale":"2024-09-19T06:37:15.029552+0000","last_undegraded":"2024-09-19T06:37:15.029552+0000","last_fullsized":"2024-09-19T06:37:15.029552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:37.676097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479475+0000","last_change":"2024-09-19T06:37:08.448303+0000","last_active":"2024-09-19T06:37:14.479475+0000","last_peered":"2024-09-19T06:37:14.479475+0000","last_clean":"2024-09-19T06:37:14.479475+0000","last_became_active":"2024-09-19T06:37:08.447559+0000","last_became_peered":"2024-09-19T06:37:08.447559+0000","last_unstale":"2024-09-19T06:37:14.479475+0000","last_undegraded":"2024-09-19T06:37:14.479475+0000","last_fullsized":"2024-09-19T06:37:14.479475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:43.093216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030079+0000","last_change":"2024-09-19T06:37:09.445971+0000","last_active":"2024-09-19T06:37:15.030079+0000","last_peered":"2024-09-19T06:37:15.030079+0000","last_clean":"2024-09-19T06:37:15.030079+0000","last_became_active":"2024-09-19T06:37:09.444806+0000","last_became_peered":"2024-09-19T06:37:09.444806+0000","last_unstale":"2024-09-19T06:37:15.030079+0000","last_undegraded":"2024-09-19T06:37:15.030079+0000","last_fullsized":"2024-09-19T06:37:15.030079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:15.765835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030528+0000","last_change":"2024-09-19T06:37:13.459035+0000","last_active":"2024-09-19T06:37:15.030528+0000","last_peered":"2024-09-19T06:37:15.030528+0000","last_clean":"2024-09-19T06:37:15.030528+0000","last_became_active":"2024-09-19T06:37:13.458588+0000","last_became_peered":"2024-09-19T06:37:13.458588+0000","last_unstale":"2024-09-19T06:37:15.030528+0000","last_undegraded":"2024-09-19T06:37:15.030528+0000","last_fullsized":"2024-09-19T06:37:15.030528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:27.900054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479040+0000","last_change":"2024-09-19T06:37:08.446363+0000","last_active":"2024-09-19T06:37:14.479040+0000","last_peered":"2024-09-19T06:37:14.479040+0000","last_clean":"2024-09-19T06:37:14.479040+0000","last_became_active":"2024-09-19T06:37:08.446053+0000","last_became_peered":"2024-09-19T06:37:08.446053+0000","last_unstale":"2024-09-19T06:37:14.479040+0000","last_undegraded":"2024-09-19T06:37:14.479040+0000","last_fullsized":"2024-09-19T06:37:14.479040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:22.488347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030495+0000","last_change":"2024-09-19T06:37:09.445124+0000","last_active":"2024-09-19T06:37:15.030495+0000","last_peered":"2024-09-19T06:37:15.030495+0000","last_clean":"2024-09-19T06:37:15.030495+0000","last_became_active":"2024-09-19T06:37:09.444824+0000","last_became_peered":"2024-09-19T06:37:09.444824+0000","last_unstale":"2024-09-19T06:37:15.030495+0000","last_undegraded":"2024-09-19T06:37:15.030495+0000","last_fullsized":"2024-09-19T06:37:15.030495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:40:05.642055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030082+0000","last_change":"2024-09-19T06:37:13.459720+0000","last_active":"2024-09-19T06:37:15.030082+0000","last_peered":"2024-09-19T06:37:15.030082+0000","last_clean":"2024-09-19T06:37:15.030082+0000","last_became_active":"2024-09-19T06:37:13.459350+0000","last_became_peered":"2024-09-19T06:37:13.459350+0000","last_unstale":"2024-09-19T06:37:15.030082+0000","last_undegraded":"2024-09-19T06:37:15.030082+0000","last_fullsized":"2024-09-19T06:37:15.030082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:29.546976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478406+0000","last_change":"2024-09-19T06:37:09.447795+0000","last_active":"2024-09-19T06:37:14.478406+0000","last_peered":"2024-09-19T06:37:14.478406+0000","last_clean":"2024-09-19T06:37:14.478406+0000","last_became_active":"2024-09-19T06:37:09.447502+0000","last_became_peered":"2024-09-19T06:37:09.447502+0000","last_unstale":"2024-09-19T06:37:14.478406+0000","last_undegraded":"2024-09-19T06:37:14.478406+0000","last_fullsized":"2024-09-19T06:37:14.478406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:51.384743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479493+0000","last_change":"2024-09-19T06:37:08.446179+0000","last_active":"2024-09-19T06:37:14.479493+0000","last_peered":"2024-09-19T06:37:14.479493+0000","last_clean":"2024-09-19T06:37:14.479493+0000","last_became_active":"2024-09-19T06:37:08.445834+0000","last_became_peered":"2024-09-19T06:37:08.445834+0000","last_unstale":"2024-09-19T06:37:14.479493+0000","last_undegraded":"2024-09-19T06:37:14.479493+0000","last_fullsized":"2024-09-19T06:37:14.479493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:03.783414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030572+0000","last_change":"2024-09-19T06:37:13.460344+0000","last_active":"2024-09-19T06:37:15.030572+0000","last_peered":"2024-09-19T06:37:15.030572+0000","last_clean":"2024-09-19T06:37:15.030572+0000","last_became_active":"2024-09-19T06:37:13.459967+0000","last_became_peered":"2024-09-19T06:37:13.459967+0000","last_unstale":"2024-09-19T06:37:15.030572+0000","last_undegraded":"2024-09-19T06:37:15.030572+0000","last_fullsized":"2024-09-19T06:37:15.030572+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:59.096218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477943+0000","last_change":"2024-09-19T06:37:09.449884+0000","last_active":"2024-09-19T06:37:14.477943+0000","last_peered":"2024-09-19T06:37:14.477943+0000","last_clean":"2024-09-19T06:37:14.477943+0000","last_became_active":"2024-09-19T06:37:09.449645+0000","last_became_peered":"2024-09-19T06:37:09.449645+0000","last_unstale":"2024-09-19T06:37:14.477943+0000","last_undegraded":"2024-09-19T06:37:14.477943+0000","last_fullsized":"2024-09-19T06:37:14.477943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:07.353098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030475+0000","last_change":"2024-09-19T06:37:08.437022+0000","last_active":"2024-09-19T06:37:15.030475+0000","last_peered":"2024-09-19T06:37:15.030475+0000","last_clean":"2024-09-19T06:37:15.030475+0000","last_became_active":"2024-09-19T06:37:08.436761+0000","last_became_peered":"2024-09-19T06:37:08.436761+0000","last_unstale":"2024-09-19T06:37:15.030475+0000","last_undegraded":"2024-09-19T06:37:15.030475+0000","last_fullsized":"2024-09-19T06:37:15.030475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:04.985581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030395+0000","last_change":"2024-09-19T06:37:13.460470+0000","last_active":"2024-09-19T06:37:15.030395+0000","last_peered":"2024-09-19T06:37:15.030395+0000","last_clean":"2024-09-19T06:37:15.030395+0000","last_became_active":"2024-09-19T06:37:13.460072+0000","last_became_peered":"2024-09-19T06:37:13.460072+0000","last_unstale":"2024-09-19T06:37:15.030395+0000","last_undegraded":"2024-09-19T06:37:15.030395+0000","last_fullsized":"2024-09-19T06:37:15.030395+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:50.835286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477295+0000","last_change":"2024-09-19T06:37:09.433042+0000","last_active":"2024-09-19T06:37:14.477295+0000","last_peered":"2024-09-19T06:37:14.477295+0000","last_clean":"2024-09-19T06:37:14.477295+0000","last_became_active":"2024-09-19T06:37:09.432589+0000","last_became_peered":"2024-09-19T06:37:09.432589+0000","last_unstale":"2024-09-19T06:37:14.477295+0000","last_undegraded":"2024-09-19T06:37:14.477295+0000","last_fullsized":"2024-09-19T06:37:14.477295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:18.661071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029869+0000","last_change":"2024-09-19T06:37:08.444408+0000","last_active":"2024-09-19T06:37:15.029869+0000","last_peered":"2024-09-19T06:37:15.029869+0000","last_clean":"2024-09-19T06:37:15.029869+0000","last_became_active":"2024-09-19T06:37:08.444160+0000","last_became_peered":"2024-09-19T06:37:08.444160+0000","last_unstale":"2024-09-19T06:37:15.029869+0000","last_undegraded":"2024-09-19T06:37:15.029869+0000","last_fullsized":"2024-09-19T06:37:15.029869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:54.304153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030788+0000","last_change":"2024-09-19T06:37:13.466175+0000","last_active":"2024-09-19T06:37:15.030788+0000","last_peered":"2024-09-19T06:37:15.030788+0000","last_clean":"2024-09-19T06:37:15.030788+0000","last_became_active":"2024-09-19T06:37:13.465731+0000","last_became_peered":"2024-09-19T06:37:13.465731+0000","last_unstale":"2024-09-19T06:37:15.030788+0000","last_undegraded":"2024-09-19T06:37:15.030788+0000","last_fullsized":"2024-09-19T06:37:15.030788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:01.100164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029947+0000","last_change":"2024-09-19T06:37:09.437254+0000","last_active":"2024-09-19T06:37:15.029947+0000","last_peered":"2024-09-19T06:37:15.029947+0000","last_clean":"2024-09-19T06:37:15.029947+0000","last_became_active":"2024-09-19T06:37:09.436512+0000","last_became_peered":"2024-09-19T06:37:09.436512+0000","last_unstale":"2024-09-19T06:37:15.029947+0000","last_undegraded":"2024-09-19T06:37:15.029947+0000","last_fullsized":"2024-09-19T06:37:15.029947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:21.893793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478028+0000","last_change":"2024-09-19T06:37:08.446216+0000","last_active":"2024-09-19T06:37:14.478028+0000","last_peered":"2024-09-19T06:37:14.478028+0000","last_clean":"2024-09-19T06:37:14.478028+0000","last_became_active":"2024-09-19T06:37:08.445845+0000","last_became_peered":"2024-09-19T06:37:08.445845+0000","last_unstale":"2024-09-19T06:37:14.478028+0000","last_undegraded":"2024-09-19T06:37:14.478028+0000","last_fullsized":"2024-09-19T06:37:14.478028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:04.033283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030215+0000","last_change":"2024-09-19T06:37:13.462192+0000","last_active":"2024-09-19T06:37:15.030215+0000","last_peered":"2024-09-19T06:37:15.030215+0000","last_clean":"2024-09-19T06:37:15.030215+0000","last_became_active":"2024-09-19T06:37:13.460955+0000","last_became_peered":"2024-09-19T06:37:13.460955+0000","last_unstale":"2024-09-19T06:37:15.030215+0000","last_undegraded":"2024-09-19T06:37:15.030215+0000","last_fullsized":"2024-09-19T06:37:15.030215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:53.583488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030554+0000","last_change":"2024-09-19T06:37:09.445989+0000","last_active":"2024-09-19T06:37:15.030554+0000","last_peered":"2024-09-19T06:37:15.030554+0000","last_clean":"2024-09-19T06:37:15.030554+0000","last_became_active":"2024-09-19T06:37:09.445705+0000","last_became_peered":"2024-09-19T06:37:09.445705+0000","last_unstale":"2024-09-19T06:37:15.030554+0000","last_undegraded":"2024-09-19T06:37:15.030554+0000","last_fullsized":"2024-09-19T06:37:15.030554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:24.592460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478969+0000","last_change":"2024-09-19T06:37:08.446226+0000","last_active":"2024-09-19T06:37:14.478969+0000","last_peered":"2024-09-19T06:37:14.478969+0000","last_clean":"2024-09-19T06:37:14.478969+0000","last_became_active":"2024-09-19T06:37:08.445929+0000","last_became_peered":"2024-09-19T06:37:08.445929+0000","last_unstale":"2024-09-19T06:37:14.478969+0000","last_undegraded":"2024-09-19T06:37:14.478969+0000","last_fullsized":"2024-09-19T06:37:14.478969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:32.233033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029648+0000","last_change":"2024-09-19T06:37:13.462598+0000","last_active":"2024-09-19T06:37:15.029648+0000","last_peered":"2024-09-19T06:37:15.029648+0000","last_clean":"2024-09-19T06:37:15.029648+0000","last_became_active":"2024-09-19T06:37:13.462217+0000","last_became_peered":"2024-09-19T06:37:13.462217+0000","last_unstale":"2024-09-19T06:37:15.029648+0000","last_undegraded":"2024-09-19T06:37:15.029648+0000","last_fullsized":"2024-09-19T06:37:15.029648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:04.109419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477866+0000","last_change":"2024-09-19T06:37:09.434309+0000","last_active":"2024-09-19T06:37:14.477866+0000","last_peered":"2024-09-19T06:37:14.477866+0000","last_clean":"2024-09-19T06:37:14.477866+0000","last_became_active":"2024-09-19T06:37:09.433897+0000","last_became_peered":"2024-09-19T06:37:09.433897+0000","last_unstale":"2024-09-19T06:37:14.477866+0000","last_undegraded":"2024-09-19T06:37:14.477866+0000","last_fullsized":"2024-09-19T06:37:14.477866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:59.054484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030307+0000","last_change":"2024-09-19T06:37:08.441525+0000","last_active":"2024-09-19T06:37:15.030307+0000","last_peered":"2024-09-19T06:37:15.030307+0000","last_clean":"2024-09-19T06:37:15.030307+0000","last_became_active":"2024-09-19T06:37:08.441245+0000","last_became_peered":"2024-09-19T06:37:08.441245+0000","last_unstale":"2024-09-19T06:37:15.030307+0000","last_undegraded":"2024-09-19T06:37:15.030307+0000","last_fullsized":"2024-09-19T06:37:15.030307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:19.820705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477133+0000","last_change":"2024-09-19T06:37:13.468486+0000","last_active":"2024-09-19T06:37:14.477133+0000","last_peered":"2024-09-19T06:37:14.477133+0000","last_clean":"2024-09-19T06:37:14.477133+0000","last_became_active":"2024-09-19T06:37:13.468074+0000","last_became_peered":"2024-09-19T06:37:13.468074+0000","last_unstale":"2024-09-19T06:37:14.477133+0000","last_undegraded":"2024-09-19T06:37:14.477133+0000","last_fullsized":"2024-09-19T06:37:14.477133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:36.783781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030772+0000","last_change":"2024-09-19T06:37:09.435864+0000","last_active":"2024-09-19T06:37:15.030772+0000","last_peered":"2024-09-19T06:37:15.030772+0000","last_clean":"2024-09-19T06:37:15.030772+0000","last_became_active":"2024-09-19T06:37:09.435597+0000","last_became_peered":"2024-09-19T06:37:09.435597+0000","last_unstale":"2024-09-19T06:37:15.030772+0000","last_undegraded":"2024-09-19T06:37:15.030772+0000","last_fullsized":"2024-09-19T06:37:15.030772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:20.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479615+0000","last_change":"2024-09-19T06:37:08.447931+0000","last_active":"2024-09-19T06:37:14.479615+0000","last_peered":"2024-09-19T06:37:14.479615+0000","last_clean":"2024-09-19T06:37:14.479615+0000","last_became_active":"2024-09-19T06:37:08.447630+0000","last_became_peered":"2024-09-19T06:37:08.447630+0000","last_unstale":"2024-09-19T06:37:14.479615+0000","last_undegraded":"2024-09-19T06:37:14.479615+0000","last_fullsized":"2024-09-19T06:37:14.479615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:17.375740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030552+0000","last_change":"2024-09-19T06:37:13.468360+0000","last_active":"2024-09-19T06:37:15.030552+0000","last_peered":"2024-09-19T06:37:15.030552+0000","last_clean":"2024-09-19T06:37:15.030552+0000","last_became_active":"2024-09-19T06:37:13.467926+0000","last_became_peered":"2024-09-19T06:37:13.467926+0000","last_unstale":"2024-09-19T06:37:15.030552+0000","last_undegraded":"2024-09-19T06:37:15.030552+0000","last_fullsized":"2024-09-19T06:37:15.030552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:55.089630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030606+0000","last_change":"2024-09-19T06:37:09.441678+0000","last_active":"2024-09-19T06:37:15.030606+0000","last_peered":"2024-09-19T06:37:15.030606+0000","last_clean":"2024-09-19T06:37:15.030606+0000","last_became_active":"2024-09-19T06:37:09.441406+0000","last_became_peered":"2024-09-19T06:37:09.441406+0000","last_unstale":"2024-09-19T06:37:15.030606+0000","last_undegraded":"2024-09-19T06:37:15.030606+0000","last_fullsized":"2024-09-19T06:37:15.030606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:14.638004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030831+0000","last_change":"2024-09-19T06:37:08.438805+0000","last_active":"2024-09-19T06:37:15.030831+0000","last_peered":"2024-09-19T06:37:15.030831+0000","last_clean":"2024-09-19T06:37:15.030831+0000","last_became_active":"2024-09-19T06:37:08.438528+0000","last_became_peered":"2024-09-19T06:37:08.438528+0000","last_unstale":"2024-09-19T06:37:15.030831+0000","last_undegraded":"2024-09-19T06:37:15.030831+0000","last_fullsized":"2024-09-19T06:37:15.030831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:55.500347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030303+0000","last_change":"2024-09-19T06:37:13.459697+0000","last_active":"2024-09-19T06:37:15.030303+0000","last_peered":"2024-09-19T06:37:15.030303+0000","last_clean":"2024-09-19T06:37:15.030303+0000","last_became_active":"2024-09-19T06:37:13.459303+0000","last_became_peered":"2024-09-19T06:37:13.459303+0000","last_unstale":"2024-09-19T06:37:15.030303+0000","last_undegraded":"2024-09-19T06:37:15.030303+0000","last_fullsized":"2024-09-19T06:37:15.030303+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:01.695905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.031009+0000","last_change":"2024-09-19T06:37:09.449701+0000","last_active":"2024-09-19T06:37:15.031009+0000","last_peered":"2024-09-19T06:37:15.031009+0000","last_clean":"2024-09-19T06:37:15.031009+0000","last_became_active":"2024-09-19T06:37:09.448899+0000","last_became_peered":"2024-09-19T06:37:09.448899+0000","last_unstale":"2024-09-19T06:37:15.031009+0000","last_undegraded":"2024-09-19T06:37:15.031009+0000","last_fullsized":"2024-09-19T06:37:15.031009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:17.448251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030609+0000","last_change":"2024-09-19T06:37:08.434263+0000","last_active":"2024-09-19T06:37:15.030609+0000","last_peered":"2024-09-19T06:37:15.030609+0000","last_clean":"2024-09-19T06:37:15.030609+0000","last_became_active":"2024-09-19T06:37:08.433984+0000","last_became_peered":"2024-09-19T06:37:08.433984+0000","last_unstale":"2024-09-19T06:37:15.030609+0000","last_undegraded":"2024-09-19T06:37:15.030609+0000","last_fullsized":"2024-09-19T06:37:15.030609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:05.599054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030728+0000","last_change":"2024-09-19T06:37:13.464527+0000","last_active":"2024-09-19T06:37:15.030728+0000","last_peered":"2024-09-19T06:37:15.030728+0000","last_clean":"2024-09-19T06:37:15.030728+0000","last_became_active":"2024-09-19T06:37:13.461685+0000","last_became_peered":"2024-09-19T06:37:13.461685+0000","last_unstale":"2024-09-19T06:37:15.030728+0000","last_undegraded":"2024-09-19T06:37:15.030728+0000","last_fullsized":"2024-09-19T06:37:15.030728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:57.229892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030028+0000","last_change":"2024-09-19T06:37:09.434421+0000","last_active":"2024-09-19T06:37:15.030028+0000","last_peered":"2024-09-19T06:37:15.030028+0000","last_clean":"2024-09-19T06:37:15.030028+0000","last_became_active":"2024-09-19T06:37:09.434119+0000","last_became_peered":"2024-09-19T06:37:09.434119+0000","last_unstale":"2024-09-19T06:37:15.030028+0000","last_undegraded":"2024-09-19T06:37:15.030028+0000","last_fullsized":"2024-09-19T06:37:15.030028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:56.984336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.814975+0000","last_change":"2024-09-19T06:37:08.436856+0000","last_active":"2024-09-19T06:37:14.814975+0000","last_peered":"2024-09-19T06:37:14.814975+0000","last_clean":"2024-09-19T06:37:14.814975+0000","last_became_active":"2024-09-19T06:37:08.435718+0000","last_became_peered":"2024-09-19T06:37:08.435718+0000","last_unstale":"2024-09-19T06:37:14.814975+0000","last_undegraded":"2024-09-19T06:37:14.814975+0000","last_fullsized":"2024-09-19T06:37:14.814975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:58.650430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030892+0000","last_change":"2024-09-19T06:37:13.466081+0000","last_active":"2024-09-19T06:37:15.030892+0000","last_peered":"2024-09-19T06:37:15.030892+0000","last_clean":"2024-09-19T06:37:15.030892+0000","last_became_active":"2024-09-19T06:37:13.465348+0000","last_became_peered":"2024-09-19T06:37:13.465348+0000","last_unstale":"2024-09-19T06:37:15.030892+0000","last_undegraded":"2024-09-19T06:37:15.030892+0000","last_fullsized":"2024-09-19T06:37:15.030892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:11.592737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029583+0000","last_change":"2024-09-19T06:37:09.444888+0000","last_active":"2024-09-19T06:37:15.029583+0000","last_peered":"2024-09-19T06:37:15.029583+0000","last_clean":"2024-09-19T06:37:15.029583+0000","last_became_active":"2024-09-19T06:37:09.444605+0000","last_became_peered":"2024-09-19T06:37:09.444605+0000","last_unstale":"2024-09-19T06:37:15.029583+0000","last_undegraded":"2024-09-19T06:37:15.029583+0000","last_fullsized":"2024-09-19T06:37:15.029583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:53.868356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478136+0000","last_change":"2024-09-19T06:37:08.446760+0000","last_active":"2024-09-19T06:37:14.478136+0000","last_peered":"2024-09-19T06:37:14.478136+0000","last_clean":"2024-09-19T06:37:14.478136+0000","last_became_active":"2024-09-19T06:37:08.446474+0000","last_became_peered":"2024-09-19T06:37:08.446474+0000","last_unstale":"2024-09-19T06:37:14.478136+0000","last_undegraded":"2024-09-19T06:37:14.478136+0000","last_fullsized":"2024-09-19T06:37:14.478136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:12.597952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030429+0000","last_change":"2024-09-19T06:37:13.471220+0000","last_active":"2024-09-19T06:37:15.030429+0000","last_peered":"2024-09-19T06:37:15.030429+0000","last_clean":"2024-09-19T06:37:15.030429+0000","last_became_active":"2024-09-19T06:37:13.470860+0000","last_became_peered":"2024-09-19T06:37:13.470860+0000","last_unstale":"2024-09-19T06:37:15.030429+0000","last_undegraded":"2024-09-19T06:37:15.030429+0000","last_fullsized":"2024-09-19T06:37:15.030429+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:07.659583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477346+0000","last_change":"2024-09-19T06:37:09.440366+0000","last_active":"2024-09-19T06:37:14.477346+0000","last_peered":"2024-09-19T06:37:14.477346+0000","last_clean":"2024-09-19T06:37:14.477346+0000","last_became_active":"2024-09-19T06:37:09.439478+0000","last_became_peered":"2024-09-19T06:37:09.439478+0000","last_unstale":"2024-09-19T06:37:14.477346+0000","last_undegraded":"2024-09-19T06:37:14.477346+0000","last_fullsized":"2024-09-19T06:37:14.477346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:21.837351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029827+0000","last_change":"2024-09-19T06:37:08.435473+0000","last_active":"2024-09-19T06:37:15.029827+0000","last_peered":"2024-09-19T06:37:15.029827+0000","last_clean":"2024-09-19T06:37:15.029827+0000","last_became_active":"2024-09-19T06:37:08.435183+0000","last_became_peered":"2024-09-19T06:37:08.435183+0000","last_unstale":"2024-09-19T06:37:15.029827+0000","last_undegraded":"2024-09-19T06:37:15.029827+0000","last_fullsized":"2024-09-19T06:37:15.029827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:53.115010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478240+0000","last_change":"2024-09-19T06:36:58.829099+0000","last_active":"2024-09-19T06:37:14.478240+0000","last_peered":"2024-09-19T06:37:14.478240+0000","last_clean":"2024-09-19T06:37:14.478240+0000","last_became_active":"2024-09-19T06:36:58.828079+0000","last_became_peered":"2024-09-19T06:36:58.828079+0000","last_unstale":"2024-09-19T06:37:14.478240+0000","last_undegraded":"2024-09-19T06:37:14.478240+0000","last_fullsized":"2024-09-19T06:37:14.478240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:36:57.771085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:36:57.771085+0000","last_clean_scrub_stamp":"2024-09-19T06:36:57.771085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:14.663925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477944+0000","last_change":"2024-09-19T06:37:13.464435+0000","last_active":"2024-09-19T06:37:14.477944+0000","last_peered":"2024-09-19T06:37:14.477944+0000","last_clean":"2024-09-19T06:37:14.477944+0000","last_became_active":"2024-09-19T06:37:13.464101+0000","last_became_peered":"2024-09-19T06:37:13.464101+0000","last_unstale":"2024-09-19T06:37:14.477944+0000","last_undegraded":"2024-09-19T06:37:14.477944+0000","last_fullsized":"2024-09-19T06:37:14.477944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:30.073937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479308+0000","last_change":"2024-09-19T06:37:09.442774+0000","last_active":"2024-09-19T06:37:14.479308+0000","last_peered":"2024-09-19T06:37:14.479308+0000","last_clean":"2024-09-19T06:37:14.479308+0000","last_became_active":"2024-09-19T06:37:09.442515+0000","last_became_peered":"2024-09-19T06:37:09.442515+0000","last_unstale":"2024-09-19T06:37:14.479308+0000","last_undegraded":"2024-09-19T06:37:14.479308+0000","last_fullsized":"2024-09-19T06:37:14.479308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:57.376059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815252+0000","last_change":"2024-09-19T06:37:08.438038+0000","last_active":"2024-09-19T06:37:14.815252+0000","last_peered":"2024-09-19T06:37:14.815252+0000","last_clean":"2024-09-19T06:37:14.815252+0000","last_became_active":"2024-09-19T06:37:08.437771+0000","last_became_peered":"2024-09-19T06:37:08.437771+0000","last_unstale":"2024-09-19T06:37:14.815252+0000","last_undegraded":"2024-09-19T06:37:14.815252+0000","last_fullsized":"2024-09-19T06:37:14.815252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:07.210382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477772+0000","last_change":"2024-09-19T06:37:13.470916+0000","last_active":"2024-09-19T06:37:14.477772+0000","last_peered":"2024-09-19T06:37:14.477772+0000","last_clean":"2024-09-19T06:37:14.477772+0000","last_became_active":"2024-09-19T06:37:13.470488+0000","last_became_peered":"2024-09-19T06:37:13.470488+0000","last_unstale":"2024-09-19T06:37:14.477772+0000","last_undegraded":"2024-09-19T06:37:14.477772+0000","last_fullsized":"2024-09-19T06:37:14.477772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:27.884932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030150+0000","last_change":"2024-09-19T06:37:09.442213+0000","last_active":"2024-09-19T06:37:15.030150+0000","last_peered":"2024-09-19T06:37:15.030150+0000","last_clean":"2024-09-19T06:37:15.030150+0000","last_became_active":"2024-09-19T06:37:09.441850+0000","last_became_peered":"2024-09-19T06:37:09.441850+0000","last_unstale":"2024-09-19T06:37:15.030150+0000","last_undegraded":"2024-09-19T06:37:15.030150+0000","last_fullsized":"2024-09-19T06:37:15.030150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:43.728914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030863+0000","last_change":"2024-09-19T06:37:08.431703+0000","last_active":"2024-09-19T06:37:15.030863+0000","last_peered":"2024-09-19T06:37:15.030863+0000","last_clean":"2024-09-19T06:37:15.030863+0000","last_became_active":"2024-09-19T06:37:08.431443+0000","last_became_peered":"2024-09-19T06:37:08.431443+0000","last_unstale":"2024-09-19T06:37:15.030863+0000","last_undegraded":"2024-09-19T06:37:15.030863+0000","last_fullsized":"2024-09-19T06:37:15.030863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:02.007521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030768+0000","last_change":"2024-09-19T06:37:13.469295+0000","last_active":"2024-09-19T06:37:15.030768+0000","last_peered":"2024-09-19T06:37:15.030768+0000","last_clean":"2024-09-19T06:37:15.030768+0000","last_became_active":"2024-09-19T06:37:13.468879+0000","last_became_peered":"2024-09-19T06:37:13.468879+0000","last_unstale":"2024-09-19T06:37:15.030768+0000","last_undegraded":"2024-09-19T06:37:15.030768+0000","last_fullsized":"2024-09-19T06:37:15.030768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:34.380034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479747+0000","last_change":"2024-09-19T06:37:09.439264+0000","last_active":"2024-09-19T06:37:14.479747+0000","last_peered":"2024-09-19T06:37:14.479747+0000","last_clean":"2024-09-19T06:37:14.479747+0000","last_became_active":"2024-09-19T06:37:09.438954+0000","last_became_peered":"2024-09-19T06:37:09.438954+0000","last_unstale":"2024-09-19T06:37:14.479747+0000","last_undegraded":"2024-09-19T06:37:14.479747+0000","last_fullsized":"2024-09-19T06:37:14.479747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:55.094093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815232+0000","last_change":"2024-09-19T06:37:08.437406+0000","last_active":"2024-09-19T06:37:14.815232+0000","last_peered":"2024-09-19T06:37:14.815232+0000","last_clean":"2024-09-19T06:37:14.815232+0000","last_became_active":"2024-09-19T06:37:08.437093+0000","last_became_peered":"2024-09-19T06:37:08.437093+0000","last_unstale":"2024-09-19T06:37:14.815232+0000","last_undegraded":"2024-09-19T06:37:14.815232+0000","last_fullsized":"2024-09-19T06:37:14.815232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:25.158027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029476+0000","last_change":"2024-09-19T06:37:13.460116+0000","last_active":"2024-09-19T06:37:15.029476+0000","last_peered":"2024-09-19T06:37:15.029476+0000","last_clean":"2024-09-19T06:37:15.029476+0000","last_became_active":"2024-09-19T06:37:13.459707+0000","last_became_peered":"2024-09-19T06:37:13.459707+0000","last_unstale":"2024-09-19T06:37:15.029476+0000","last_undegraded":"2024-09-19T06:37:15.029476+0000","last_fullsized":"2024-09-19T06:37:15.029476+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:02.657115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479032+0000","last_change":"2024-09-19T06:37:09.442670+0000","last_active":"2024-09-19T06:37:14.479032+0000","last_peered":"2024-09-19T06:37:14.479032+0000","last_clean":"2024-09-19T06:37:14.479032+0000","last_became_active":"2024-09-19T06:37:09.442390+0000","last_became_peered":"2024-09-19T06:37:09.442390+0000","last_unstale":"2024-09-19T06:37:14.479032+0000","last_undegraded":"2024-09-19T06:37:14.479032+0000","last_fullsized":"2024-09-19T06:37:14.479032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:02:26.726663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030129+0000","last_change":"2024-09-19T06:37:08.437263+0000","last_active":"2024-09-19T06:37:15.030129+0000","last_peered":"2024-09-19T06:37:15.030129+0000","last_clean":"2024-09-19T06:37:15.030129+0000","last_became_active":"2024-09-19T06:37:08.436982+0000","last_became_peered":"2024-09-19T06:37:08.436982+0000","last_unstale":"2024-09-19T06:37:15.030129+0000","last_undegraded":"2024-09-19T06:37:15.030129+0000","last_fullsized":"2024-09-19T06:37:15.030129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:14.895925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029466+0000","last_change":"2024-09-19T06:37:13.459433+0000","last_active":"2024-09-19T06:37:15.029466+0000","last_peered":"2024-09-19T06:37:15.029466+0000","last_clean":"2024-09-19T06:37:15.029466+0000","last_became_active":"2024-09-19T06:37:13.459031+0000","last_became_peered":"2024-09-19T06:37:13.459031+0000","last_unstale":"2024-09-19T06:37:15.029466+0000","last_undegraded":"2024-09-19T06:37:15.029466+0000","last_fullsized":"2024-09-19T06:37:15.029466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:07.294413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478514+0000","last_change":"2024-09-19T06:37:09.439142+0000","last_active":"2024-09-19T06:37:14.478514+0000","last_peered":"2024-09-19T06:37:14.478514+0000","last_clean":"2024-09-19T06:37:14.478514+0000","last_became_active":"2024-09-19T06:37:09.437717+0000","last_became_peered":"2024-09-19T06:37:09.437717+0000","last_unstale":"2024-09-19T06:37:14.478514+0000","last_undegraded":"2024-09-19T06:37:14.478514+0000","last_fullsized":"2024-09-19T06:37:14.478514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:32.934290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.814858+0000","last_change":"2024-09-19T06:37:08.430649+0000","last_active":"2024-09-19T06:37:14.814858+0000","last_peered":"2024-09-19T06:37:14.814858+0000","last_clean":"2024-09-19T06:37:14.814858+0000","last_became_active":"2024-09-19T06:37:08.430324+0000","last_became_peered":"2024-09-19T06:37:08.430324+0000","last_unstale":"2024-09-19T06:37:14.814858+0000","last_undegraded":"2024-09-19T06:37:14.814858+0000","last_fullsized":"2024-09-19T06:37:14.814858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:56.656357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030152+0000","last_change":"2024-09-19T06:37:13.463695+0000","last_active":"2024-09-19T06:37:15.030152+0000","last_peered":"2024-09-19T06:37:15.030152+0000","last_clean":"2024-09-19T06:37:15.030152+0000","last_became_active":"2024-09-19T06:37:13.463334+0000","last_became_peered":"2024-09-19T06:37:13.463334+0000","last_unstale":"2024-09-19T06:37:15.030152+0000","last_undegraded":"2024-09-19T06:37:15.030152+0000","last_fullsized":"2024-09-19T06:37:15.030152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:46.991800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477668+0000","last_change":"2024-09-19T06:37:09.450168+0000","last_active":"2024-09-19T06:37:14.477668+0000","last_peered":"2024-09-19T06:37:14.477668+0000","last_clean":"2024-09-19T06:37:14.477668+0000","last_became_active":"2024-09-19T06:37:09.449872+0000","last_became_peered":"2024-09-19T06:37:09.449872+0000","last_unstale":"2024-09-19T06:37:14.477668+0000","last_undegraded":"2024-09-19T06:37:14.477668+0000","last_fullsized":"2024-09-19T06:37:14.477668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:02:28.282840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478710+0000","last_change":"2024-09-19T06:37:08.442428+0000","last_active":"2024-09-19T06:37:14.478710+0000","last_peered":"2024-09-19T06:37:14.478710+0000","last_clean":"2024-09-19T06:37:14.478710+0000","last_became_active":"2024-09-19T06:37:08.442120+0000","last_became_peered":"2024-09-19T06:37:08.442120+0000","last_unstale":"2024-09-19T06:37:14.478710+0000","last_undegraded":"2024-09-19T06:37:14.478710+0000","last_fullsized":"2024-09-19T06:37:14.478710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:48.816822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477870+0000","last_change":"2024-09-19T06:37:13.471319+0000","last_active":"2024-09-19T06:37:14.477870+0000","last_peered":"2024-09-19T06:37:14.477870+0000","last_clean":"2024-09-19T06:37:14.477870+0000","last_became_active":"2024-09-19T06:37:13.470887+0000","last_became_peered":"2024-09-19T06:37:13.470887+0000","last_unstale":"2024-09-19T06:37:14.477870+0000","last_undegraded":"2024-09-19T06:37:14.477870+0000","last_fullsized":"2024-09-19T06:37:14.477870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:21.884985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479407+0000","last_change":"2024-09-19T06:37:09.439142+0000","last_active":"2024-09-19T06:37:14.479407+0000","last_peered":"2024-09-19T06:37:14.479407+0000","last_clean":"2024-09-19T06:37:14.479407+0000","last_became_active":"2024-09-19T06:37:09.437635+0000","last_became_peered":"2024-09-19T06:37:09.437635+0000","last_unstale":"2024-09-19T06:37:14.479407+0000","last_undegraded":"2024-09-19T06:37:14.479407+0000","last_fullsized":"2024-09-19T06:37:14.479407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:46.773889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030517+0000","last_change":"2024-09-19T06:37:08.438932+0000","last_active":"2024-09-19T06:37:15.030517+0000","last_peered":"2024-09-19T06:37:15.030517+0000","last_clean":"2024-09-19T06:37:15.030517+0000","last_became_active":"2024-09-19T06:37:08.438405+0000","last_became_peered":"2024-09-19T06:37:08.438405+0000","last_unstale":"2024-09-19T06:37:15.030517+0000","last_undegraded":"2024-09-19T06:37:15.030517+0000","last_fullsized":"2024-09-19T06:37:15.030517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:59.606628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477677+0000","last_change":"2024-09-19T06:37:13.459370+0000","last_active":"2024-09-19T06:37:14.477677+0000","last_peered":"2024-09-19T06:37:14.477677+0000","last_clean":"2024-09-19T06:37:14.477677+0000","last_became_active":"2024-09-19T06:37:13.458928+0000","last_became_peered":"2024-09-19T06:37:13.458928+0000","last_unstale":"2024-09-19T06:37:14.477677+0000","last_undegraded":"2024-09-19T06:37:14.477677+0000","last_fullsized":"2024-09-19T06:37:14.477677+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:00.179404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029933+0000","last_change":"2024-09-19T06:37:09.448958+0000","last_active":"2024-09-19T06:37:15.029933+0000","last_peered":"2024-09-19T06:37:15.029933+0000","last_clean":"2024-09-19T06:37:15.029933+0000","last_became_active":"2024-09-19T06:37:09.448697+0000","last_became_peered":"2024-09-19T06:37:09.448697+0000","last_unstale":"2024-09-19T06:37:15.029933+0000","last_undegraded":"2024-09-19T06:37:15.029933+0000","last_fullsized":"2024-09-19T06:37:15.029933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:16.306915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030900+0000","last_change":"2024-09-19T06:37:08.442685+0000","last_active":"2024-09-19T06:37:15.030900+0000","last_peered":"2024-09-19T06:37:15.030900+0000","last_clean":"2024-09-19T06:37:15.030900+0000","last_became_active":"2024-09-19T06:37:08.442436+0000","last_became_peered":"2024-09-19T06:37:08.442436+0000","last_unstale":"2024-09-19T06:37:15.030900+0000","last_undegraded":"2024-09-19T06:37:15.030900+0000","last_fullsized":"2024-09-19T06:37:15.030900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:09.952733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030332+0000","last_change":"2024-09-19T06:37:13.457651+0000","last_active":"2024-09-19T06:37:15.030332+0000","last_peered":"2024-09-19T06:37:15.030332+0000","last_clean":"2024-09-19T06:37:15.030332+0000","last_became_active":"2024-09-19T06:37:13.457246+0000","last_became_peered":"2024-09-19T06:37:13.457246+0000","last_unstale":"2024-09-19T06:37:15.030332+0000","last_undegraded":"2024-09-19T06:37:15.030332+0000","last_fullsized":"2024-09-19T06:37:15.030332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:18.553158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479228+0000","last_change":"2024-09-19T06:37:09.441212+0000","last_active":"2024-09-19T06:37:14.479228+0000","last_peered":"2024-09-19T06:37:14.479228+0000","last_clean":"2024-09-19T06:37:14.479228+0000","last_became_active":"2024-09-19T06:37:09.440209+0000","last_became_peered":"2024-09-19T06:37:09.440209+0000","last_unstale":"2024-09-19T06:37:14.479228+0000","last_undegraded":"2024-09-19T06:37:14.479228+0000","last_fullsized":"2024-09-19T06:37:14.479228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:52.173784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:24.168847+0000","last_change":"2024-09-19T06:37:08.442615+0000","last_active":"2024-09-19T06:37:24.168847+0000","last_peered":"2024-09-19T06:37:24.168847+0000","last_clean":"2024-09-19T06:37:24.168847+0000","last_became_active":"2024-09-19T06:37:08.442242+0000","last_became_peered":"2024-09-19T06:37:08.442242+0000","last_unstale":"2024-09-19T06:37:24.168847+0000","last_undegraded":"2024-09-19T06:37:24.168847+0000","last_fullsized":"2024-09-19T06:37:24.168847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:23.813400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030495+0000","last_change":"2024-09-19T06:37:13.464688+0000","last_active":"2024-09-19T06:37:15.030495+0000","last_peered":"2024-09-19T06:37:15.030495+0000","last_clean":"2024-09-19T06:37:15.030495+0000","last_became_active":"2024-09-19T06:37:13.461620+0000","last_became_peered":"2024-09-19T06:37:13.461620+0000","last_unstale":"2024-09-19T06:37:15.030495+0000","last_undegraded":"2024-09-19T06:37:15.030495+0000","last_fullsized":"2024-09-19T06:37:15.030495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:02.928332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030727+0000","last_change":"2024-09-19T06:37:09.440021+0000","last_active":"2024-09-19T06:37:15.030727+0000","last_peered":"2024-09-19T06:37:15.030727+0000","last_clean":"2024-09-19T06:37:15.030727+0000","last_became_active":"2024-09-19T06:37:09.437800+0000","last_became_peered":"2024-09-19T06:37:09.437800+0000","last_unstale":"2024-09-19T06:37:15.030727+0000","last_undegraded":"2024-09-19T06:37:15.030727+0000","last_fullsized":"2024-09-19T06:37:15.030727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:51.963097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030761+0000","last_change":"2024-09-19T06:37:08.434422+0000","last_active":"2024-09-19T06:37:15.030761+0000","last_peered":"2024-09-19T06:37:15.030761+0000","last_clean":"2024-09-19T06:37:15.030761+0000","last_became_active":"2024-09-19T06:37:08.434151+0000","last_became_peered":"2024-09-19T06:37:08.434151+0000","last_unstale":"2024-09-19T06:37:15.030761+0000","last_undegraded":"2024-09-19T06:37:15.030761+0000","last_fullsized":"2024-09-19T06:37:15.030761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:49.540748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030746+0000","last_change":"2024-09-19T06:37:13.459321+0000","last_active":"2024-09-19T06:37:15.030746+0000","last_peered":"2024-09-19T06:37:15.030746+0000","last_clean":"2024-09-19T06:37:15.030746+0000","last_became_active":"2024-09-19T06:37:13.458924+0000","last_became_peered":"2024-09-19T06:37:13.458924+0000","last_unstale":"2024-09-19T06:37:15.030746+0000","last_undegraded":"2024-09-19T06:37:15.030746+0000","last_fullsized":"2024-09-19T06:37:15.030746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:11.428574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030167+0000","last_change":"2024-09-19T06:37:09.448450+0000","last_active":"2024-09-19T06:37:15.030167+0000","last_peered":"2024-09-19T06:37:15.030167+0000","last_clean":"2024-09-19T06:37:15.030167+0000","last_became_active":"2024-09-19T06:37:09.448173+0000","last_became_peered":"2024-09-19T06:37:09.448173+0000","last_unstale":"2024-09-19T06:37:15.030167+0000","last_undegraded":"2024-09-19T06:37:15.030167+0000","last_fullsized":"2024-09-19T06:37:15.030167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:22.442374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030854+0000","last_change":"2024-09-19T06:37:08.442796+0000","last_active":"2024-09-19T06:37:15.030854+0000","last_peered":"2024-09-19T06:37:15.030854+0000","last_clean":"2024-09-19T06:37:15.030854+0000","last_became_active":"2024-09-19T06:37:08.442126+0000","last_became_peered":"2024-09-19T06:37:08.442126+0000","last_unstale":"2024-09-19T06:37:15.030854+0000","last_undegraded":"2024-09-19T06:37:15.030854+0000","last_fullsized":"2024-09-19T06:37:15.030854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:27.716141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477293+0000","last_change":"2024-09-19T06:37:13.464100+0000","last_active":"2024-09-19T06:37:14.477293+0000","last_peered":"2024-09-19T06:37:14.477293+0000","last_clean":"2024-09-19T06:37:14.477293+0000","last_became_active":"2024-09-19T06:37:13.462750+0000","last_became_peered":"2024-09-19T06:37:13.462750+0000","last_unstale":"2024-09-19T06:37:14.477293+0000","last_undegraded":"2024-09-19T06:37:14.477293+0000","last_fullsized":"2024-09-19T06:37:14.477293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:49.139841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030752+0000","last_change":"2024-09-19T06:37:09.448328+0000","last_active":"2024-09-19T06:37:15.030752+0000","last_peered":"2024-09-19T06:37:15.030752+0000","last_clean":"2024-09-19T06:37:15.030752+0000","last_became_active":"2024-09-19T06:37:09.448056+0000","last_became_peered":"2024-09-19T06:37:09.448056+0000","last_unstale":"2024-09-19T06:37:15.030752+0000","last_undegraded":"2024-09-19T06:37:15.030752+0000","last_fullsized":"2024-09-19T06:37:15.030752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:53.451104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478778+0000","last_change":"2024-09-19T06:37:08.439543+0000","last_active":"2024-09-19T06:37:14.478778+0000","last_peered":"2024-09-19T06:37:14.478778+0000","last_clean":"2024-09-19T06:37:14.478778+0000","last_became_active":"2024-09-19T06:37:08.438785+0000","last_became_peered":"2024-09-19T06:37:08.438785+0000","last_unstale":"2024-09-19T06:37:14.478778+0000","last_undegraded":"2024-09-19T06:37:14.478778+0000","last_fullsized":"2024-09-19T06:37:14.478778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:51.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477286+0000","last_change":"2024-09-19T06:37:13.462327+0000","last_active":"2024-09-19T06:37:14.477286+0000","last_peered":"2024-09-19T06:37:14.477286+0000","last_clean":"2024-09-19T06:37:14.477286+0000","last_became_active":"2024-09-19T06:37:13.461762+0000","last_became_peered":"2024-09-19T06:37:13.461762+0000","last_unstale":"2024-09-19T06:37:14.477286+0000","last_undegraded":"2024-09-19T06:37:14.477286+0000","last_fullsized":"2024-09-19T06:37:14.477286+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:26.931537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029982+0000","last_change":"2024-09-19T06:37:13.471309+0000","last_active":"2024-09-19T06:37:15.029982+0000","last_peered":"2024-09-19T06:37:15.029982+0000","last_clean":"2024-09-19T06:37:15.029982+0000","last_became_active":"2024-09-19T06:37:13.470969+0000","last_became_peered":"2024-09-19T06:37:13.470969+0000","last_unstale":"2024-09-19T06:37:15.029982+0000","last_undegraded":"2024-09-19T06:37:15.029982+0000","last_fullsized":"2024-09-19T06:37:15.029982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:30.990159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029769+0000","last_change":"2024-09-19T06:37:09.443308+0000","last_active":"2024-09-19T06:37:15.029769+0000","last_peered":"2024-09-19T06:37:15.029769+0000","last_clean":"2024-09-19T06:37:15.029769+0000","last_became_active":"2024-09-19T06:37:09.443069+0000","last_became_peered":"2024-09-19T06:37:09.443069+0000","last_unstale":"2024-09-19T06:37:15.029769+0000","last_undegraded":"2024-09-19T06:37:15.029769+0000","last_fullsized":"2024-09-19T06:37:15.029769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:31:33.708578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029646+0000","last_change":"2024-09-19T06:37:08.441967+0000","last_active":"2024-09-19T06:37:15.029646+0000","last_peered":"2024-09-19T06:37:15.029646+0000","last_clean":"2024-09-19T06:37:15.029646+0000","last_became_active":"2024-09-19T06:37:08.441698+0000","last_became_peered":"2024-09-19T06:37:08.441698+0000","last_unstale":"2024-09-19T06:37:15.029646+0000","last_undegraded":"2024-09-19T06:37:15.029646+0000","last_fullsized":"2024-09-19T06:37:15.029646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:56.933775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478180+0000","last_change":"2024-09-19T06:37:13.470903+0000","last_active":"2024-09-19T06:37:14.478180+0000","last_peered":"2024-09-19T06:37:14.478180+0000","last_clean":"2024-09-19T06:37:14.478180+0000","last_became_active":"2024-09-19T06:37:13.470528+0000","last_became_peered":"2024-09-19T06:37:13.470528+0000","last_unstale":"2024-09-19T06:37:14.478180+0000","last_undegraded":"2024-09-19T06:37:14.478180+0000","last_fullsized":"2024-09-19T06:37:14.478180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:45.999436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477209+0000","last_change":"2024-09-19T06:37:09.448953+0000","last_active":"2024-09-19T06:37:14.477209+0000","last_peered":"2024-09-19T06:37:14.477209+0000","last_clean":"2024-09-19T06:37:14.477209+0000","last_became_active":"2024-09-19T06:37:09.448658+0000","last_became_peered":"2024-09-19T06:37:09.448658+0000","last_unstale":"2024-09-19T06:37:14.477209+0000","last_undegraded":"2024-09-19T06:37:14.477209+0000","last_fullsized":"2024-09-19T06:37:14.477209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:07.333392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477562+0000","last_change":"2024-09-19T06:37:08.440800+0000","last_active":"2024-09-19T06:37:14.477562+0000","last_peered":"2024-09-19T06:37:14.477562+0000","last_clean":"2024-09-19T06:37:14.477562+0000","last_became_active":"2024-09-19T06:37:08.440591+0000","last_became_peered":"2024-09-19T06:37:08.440591+0000","last_unstale":"2024-09-19T06:37:14.477562+0000","last_undegraded":"2024-09-19T06:37:14.477562+0000","last_fullsized":"2024-09-19T06:37:14.477562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:05.540261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478578+0000","last_change":"2024-09-19T06:37:08.441268+0000","last_active":"2024-09-19T06:37:14.478578+0000","last_peered":"2024-09-19T06:37:14.478578+0000","last_clean":"2024-09-19T06:37:14.478578+0000","last_became_active":"2024-09-19T06:37:08.440969+0000","last_became_peered":"2024-09-19T06:37:08.440969+0000","last_unstale":"2024-09-19T06:37:14.478578+0000","last_undegraded":"2024-09-19T06:37:14.478578+0000","last_fullsized":"2024-09-19T06:37:14.478578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:59.426336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030814+0000","last_change":"2024-09-19T06:37:09.444857+0000","last_active":"2024-09-19T06:37:15.030814+0000","last_peered":"2024-09-19T06:37:15.030814+0000","last_clean":"2024-09-19T06:37:15.030814+0000","last_became_active":"2024-09-19T06:37:09.444562+0000","last_became_peered":"2024-09-19T06:37:09.444562+0000","last_unstale":"2024-09-19T06:37:15.030814+0000","last_undegraded":"2024-09-19T06:37:15.030814+0000","last_fullsized":"2024-09-19T06:37:15.030814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:02.470787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815254+0000","last_change":"2024-09-19T06:37:13.467183+0000","last_active":"2024-09-19T06:37:14.815254+0000","last_peered":"2024-09-19T06:37:14.815254+0000","last_clean":"2024-09-19T06:37:14.815254+0000","last_became_active":"2024-09-19T06:37:13.466765+0000","last_became_peered":"2024-09-19T06:37:13.466765+0000","last_unstale":"2024-09-19T06:37:14.815254+0000","last_undegraded":"2024-09-19T06:37:14.815254+0000","last_fullsized":"2024-09-19T06:37:14.815254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:35.184815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477901+0000","last_change":"2024-09-19T06:37:08.443993+0000","last_active":"2024-09-19T06:37:14.477901+0000","last_peered":"2024-09-19T06:37:14.477901+0000","last_clean":"2024-09-19T06:37:14.477901+0000","last_became_active":"2024-09-19T06:37:08.443774+0000","last_became_peered":"2024-09-19T06:37:08.443774+0000","last_unstale":"2024-09-19T06:37:14.477901+0000","last_undegraded":"2024-09-19T06:37:14.477901+0000","last_fullsized":"2024-09-19T06:37:14.477901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:16.005073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029942+0000","last_change":"2024-09-19T06:37:09.440258+0000","last_active":"2024-09-19T06:37:15.029942+0000","last_peered":"2024-09-19T06:37:15.029942+0000","last_clean":"2024-09-19T06:37:15.029942+0000","last_became_active":"2024-09-19T06:37:09.438457+0000","last_became_peered":"2024-09-19T06:37:09.438457+0000","last_unstale":"2024-09-19T06:37:15.029942+0000","last_undegraded":"2024-09-19T06:37:15.029942+0000","last_fullsized":"2024-09-19T06:37:15.029942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:24.636340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477624+0000","last_change":"2024-09-19T06:37:13.462800+0000","last_active":"2024-09-19T06:37:14.477624+0000","last_peered":"2024-09-19T06:37:14.477624+0000","last_clean":"2024-09-19T06:37:14.477624+0000","last_became_active":"2024-09-19T06:37:13.462393+0000","last_became_peered":"2024-09-19T06:37:13.462393+0000","last_unstale":"2024-09-19T06:37:14.477624+0000","last_undegraded":"2024-09-19T06:37:14.477624+0000","last_fullsized":"2024-09-19T06:37:14.477624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:35.901637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477580+0000","last_change":"2024-09-19T06:37:09.450421+0000","last_active":"2024-09-19T06:37:14.477580+0000","last_peered":"2024-09-19T06:37:14.477580+0000","last_clean":"2024-09-19T06:37:14.477580+0000","last_became_active":"2024-09-19T06:37:09.450147+0000","last_became_peered":"2024-09-19T06:37:09.450147+0000","last_unstale":"2024-09-19T06:37:14.477580+0000","last_undegraded":"2024-09-19T06:37:14.477580+0000","last_fullsized":"2024-09-19T06:37:14.477580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:42.949759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.814967+0000","last_change":"2024-09-19T06:37:09.435131+0000","last_active":"2024-09-19T06:37:14.814967+0000","last_peered":"2024-09-19T06:37:14.814967+0000","last_clean":"2024-09-19T06:37:14.814967+0000","last_became_active":"2024-09-19T06:37:09.434840+0000","last_became_peered":"2024-09-19T06:37:09.434840+0000","last_unstale":"2024-09-19T06:37:14.814967+0000","last_undegraded":"2024-09-19T06:37:14.814967+0000","last_fullsized":"2024-09-19T06:37:14.814967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:20.484554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030415+0000","last_change":"2024-09-19T06:37:09.445196+0000","last_active":"2024-09-19T06:37:15.030415+0000","last_peered":"2024-09-19T06:37:15.030415+0000","last_clean":"2024-09-19T06:37:15.030415+0000","last_became_active":"2024-09-19T06:37:09.444907+0000","last_became_peered":"2024-09-19T06:37:09.444907+0000","last_unstale":"2024-09-19T06:37:15.030415+0000","last_undegraded":"2024-09-19T06:37:15.030415+0000","last_fullsized":"2024-09-19T06:37:15.030415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:17.605675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030729+0000","last_change":"2024-09-19T06:37:09.447966+0000","last_active":"2024-09-19T06:37:15.030729+0000","last_peered":"2024-09-19T06:37:15.030729+0000","last_clean":"2024-09-19T06:37:15.030729+0000","last_became_active":"2024-09-19T06:37:09.447692+0000","last_became_peered":"2024-09-19T06:37:09.447692+0000","last_unstale":"2024-09-19T06:37:15.030729+0000","last_undegraded":"2024-09-19T06:37:15.030729+0000","last_fullsized":"2024-09-19T06:37:15.030729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:01.517824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477900+0000","last_change":"2024-09-19T06:37:09.442651+0000","last_active":"2024-09-19T06:37:14.477900+0000","last_peered":"2024-09-19T06:37:14.477900+0000","last_clean":"2024-09-19T06:37:14.477900+0000","last_became_active":"2024-09-19T06:37:09.442195+0000","last_became_peered":"2024-09-19T06:37:09.442195+0000","last_unstale":"2024-09-19T06:37:14.477900+0000","last_undegraded":"2024-09-19T06:37:14.477900+0000","last_fullsized":"2024-09-19T06:37:14.477900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:15.658285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030600+0000","last_change":"2024-09-19T06:37:09.441782+0000","last_active":"2024-09-19T06:37:15.030600+0000","last_peered":"2024-09-19T06:37:15.030600+0000","last_clean":"2024-09-19T06:37:15.030600+0000","last_became_active":"2024-09-19T06:37:09.441456+0000","last_became_peered":"2024-09-19T06:37:09.441456+0000","last_unstale":"2024-09-19T06:37:15.030600+0000","last_undegraded":"2024-09-19T06:37:15.030600+0000","last_fullsized":"2024-09-19T06:37:15.030600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:04:28.458974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479237+0000","last_change":"2024-09-19T06:37:09.449856+0000","last_active":"2024-09-19T06:37:14.479237+0000","last_peered":"2024-09-19T06:37:14.479237+0000","last_clean":"2024-09-19T06:37:14.479237+0000","last_became_active":"2024-09-19T06:37:09.449562+0000","last_became_peered":"2024-09-19T06:37:09.449562+0000","last_unstale":"2024-09-19T06:37:14.479237+0000","last_undegraded":"2024-09-19T06:37:14.479237+0000","last_fullsized":"2024-09-19T06:37:14.479237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:49.182126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477764+0000","last_change":"2024-09-19T06:37:09.438551+0000","last_active":"2024-09-19T06:37:14.477764+0000","last_peered":"2024-09-19T06:37:14.477764+0000","last_clean":"2024-09-19T06:37:14.477764+0000","last_became_active":"2024-09-19T06:37:09.437624+0000","last_became_peered":"2024-09-19T06:37:09.437624+0000","last_unstale":"2024-09-19T06:37:14.477764+0000","last_undegraded":"2024-09-19T06:37:14.477764+0000","last_fullsized":"2024-09-19T06:37:14.477764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:46.565780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029601+0000","last_change":"2024-09-19T06:37:09.438737+0000","last_active":"2024-09-19T06:37:15.029601+0000","last_peered":"2024-09-19T06:37:15.029601+0000","last_clean":"2024-09-19T06:37:15.029601+0000","last_became_active":"2024-09-19T06:37:09.438453+0000","last_became_peered":"2024-09-19T06:37:09.438453+0000","last_unstale":"2024-09-19T06:37:15.029601+0000","last_undegraded":"2024-09-19T06:37:15.029601+0000","last_fullsized":"2024-09-19T06:37:15.029601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.982275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477390+0000","last_change":"2024-09-19T06:37:09.442093+0000","last_active":"2024-09-19T06:37:14.477390+0000","last_peered":"2024-09-19T06:37:14.477390+0000","last_clean":"2024-09-19T06:37:14.477390+0000","last_became_active":"2024-09-19T06:37:09.439710+0000","last_became_peered":"2024-09-19T06:37:09.439710+0000","last_unstale":"2024-09-19T06:37:14.477390+0000","last_undegraded":"2024-09-19T06:37:14.477390+0000","last_fullsized":"2024-09-19T06:37:14.477390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:02.626854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030310+0000","last_change":"2024-09-19T06:37:09.438271+0000","last_active":"2024-09-19T06:37:15.030310+0000","last_peered":"2024-09-19T06:37:15.030310+0000","last_clean":"2024-09-19T06:37:15.030310+0000","last_became_active":"2024-09-19T06:37:09.438009+0000","last_became_peered":"2024-09-19T06:37:09.438009+0000","last_unstale":"2024-09-19T06:37:15.030310+0000","last_undegraded":"2024-09-19T06:37:15.030310+0000","last_fullsized":"2024-09-19T06:37:15.030310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:26.395210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030632+0000","last_change":"2024-09-19T06:37:09.449633+0000","last_active":"2024-09-19T06:37:15.030632+0000","last_peered":"2024-09-19T06:37:15.030632+0000","last_clean":"2024-09-19T06:37:15.030632+0000","last_became_active":"2024-09-19T06:37:09.449379+0000","last_became_peered":"2024-09-19T06:37:09.449379+0000","last_unstale":"2024-09-19T06:37:15.030632+0000","last_undegraded":"2024-09-19T06:37:15.030632+0000","last_fullsized":"2024-09-19T06:37:15.030632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:29.565038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478253+0000","last_change":"2024-09-19T06:37:09.447808+0000","last_active":"2024-09-19T06:37:14.478253+0000","last_peered":"2024-09-19T06:37:14.478253+0000","last_clean":"2024-09-19T06:37:14.478253+0000","last_became_active":"2024-09-19T06:37:09.447514+0000","last_became_peered":"2024-09-19T06:37:09.447514+0000","last_unstale":"2024-09-19T06:37:14.478253+0000","last_undegraded":"2024-09-19T06:37:14.478253+0000","last_fullsized":"2024-09-19T06:37:14.478253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:04.653997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479576+0000","last_change":"2024-09-19T06:37:09.439605+0000","last_active":"2024-09-19T06:37:14.479576+0000","last_peered":"2024-09-19T06:37:14.479576+0000","last_clean":"2024-09-19T06:37:14.479576+0000","last_became_active":"2024-09-19T06:37:09.432601+0000","last_became_peered":"2024-09-19T06:37:09.432601+0000","last_unstale":"2024-09-19T06:37:14.479576+0000","last_undegraded":"2024-09-19T06:37:14.479576+0000","last_fullsized":"2024-09-19T06:37:14.479576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:50.640062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.815206+0000","last_change":"2024-09-19T06:37:09.440268+0000","last_active":"2024-09-19T06:37:14.815206+0000","last_peered":"2024-09-19T06:37:14.815206+0000","last_clean":"2024-09-19T06:37:14.815206+0000","last_became_active":"2024-09-19T06:37:09.439937+0000","last_became_peered":"2024-09-19T06:37:09.439937+0000","last_unstale":"2024-09-19T06:37:14.815206+0000","last_undegraded":"2024-09-19T06:37:14.815206+0000","last_fullsized":"2024-09-19T06:37:14.815206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:32:46.182979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030922+0000","last_change":"2024-09-19T06:37:09.437080+0000","last_active":"2024-09-19T06:37:15.030922+0000","last_peered":"2024-09-19T06:37:15.030922+0000","last_clean":"2024-09-19T06:37:15.030922+0000","last_became_active":"2024-09-19T06:37:09.436752+0000","last_became_peered":"2024-09-19T06:37:09.436752+0000","last_unstale":"2024-09-19T06:37:15.030922+0000","last_undegraded":"2024-09-19T06:37:15.030922+0000","last_fullsized":"2024-09-19T06:37:15.030922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:31.423640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029549+0000","last_change":"2024-09-19T06:37:09.448942+0000","last_active":"2024-09-19T06:37:15.029549+0000","last_peered":"2024-09-19T06:37:15.029549+0000","last_clean":"2024-09-19T06:37:15.029549+0000","last_became_active":"2024-09-19T06:37:09.448647+0000","last_became_peered":"2024-09-19T06:37:09.448647+0000","last_unstale":"2024-09-19T06:37:15.029549+0000","last_undegraded":"2024-09-19T06:37:15.029549+0000","last_fullsized":"2024-09-19T06:37:15.029549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:49.027909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029809+0000","last_change":"2024-09-19T06:37:09.445015+0000","last_active":"2024-09-19T06:37:15.029809+0000","last_peered":"2024-09-19T06:37:15.029809+0000","last_clean":"2024-09-19T06:37:15.029809+0000","last_became_active":"2024-09-19T06:37:09.444737+0000","last_became_peered":"2024-09-19T06:37:09.444737+0000","last_unstale":"2024-09-19T06:37:15.029809+0000","last_undegraded":"2024-09-19T06:37:15.029809+0000","last_fullsized":"2024-09-19T06:37:15.029809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:16.194580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.029853+0000","last_change":"2024-09-19T06:37:09.446025+0000","last_active":"2024-09-19T06:37:15.029853+0000","last_peered":"2024-09-19T06:37:15.029853+0000","last_clean":"2024-09-19T06:37:15.029853+0000","last_became_active":"2024-09-19T06:37:09.445503+0000","last_became_peered":"2024-09-19T06:37:09.445503+0000","last_unstale":"2024-09-19T06:37:15.029853+0000","last_undegraded":"2024-09-19T06:37:15.029853+0000","last_fullsized":"2024-09-19T06:37:15.029853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:30.469995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477784+0000","last_change":"2024-09-19T06:37:09.441302+0000","last_active":"2024-09-19T06:37:14.477784+0000","last_peered":"2024-09-19T06:37:14.477784+0000","last_clean":"2024-09-19T06:37:14.477784+0000","last_became_active":"2024-09-19T06:37:09.439767+0000","last_became_peered":"2024-09-19T06:37:09.439767+0000","last_unstale":"2024-09-19T06:37:14.477784+0000","last_undegraded":"2024-09-19T06:37:14.477784+0000","last_fullsized":"2024-09-19T06:37:14.477784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:01.038823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030560+0000","last_change":"2024-09-19T06:37:09.440976+0000","last_active":"2024-09-19T06:37:15.030560+0000","last_peered":"2024-09-19T06:37:15.030560+0000","last_clean":"2024-09-19T06:37:15.030560+0000","last_became_active":"2024-09-19T06:37:09.440702+0000","last_became_peered":"2024-09-19T06:37:09.440702+0000","last_unstale":"2024-09-19T06:37:15.030560+0000","last_undegraded":"2024-09-19T06:37:15.030560+0000","last_fullsized":"2024-09-19T06:37:15.030560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:21.281400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477942+0000","last_change":"2024-09-19T06:37:09.442301+0000","last_active":"2024-09-19T06:37:14.477942+0000","last_peered":"2024-09-19T06:37:14.477942+0000","last_clean":"2024-09-19T06:37:14.477942+0000","last_became_active":"2024-09-19T06:37:09.442053+0000","last_became_peered":"2024-09-19T06:37:09.442053+0000","last_unstale":"2024-09-19T06:37:14.477942+0000","last_undegraded":"2024-09-19T06:37:14.477942+0000","last_fullsized":"2024-09-19T06:37:14.477942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:26.189384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479335+0000","last_change":"2024-09-19T06:37:09.441525+0000","last_active":"2024-09-19T06:37:14.479335+0000","last_peered":"2024-09-19T06:37:14.479335+0000","last_clean":"2024-09-19T06:37:14.479335+0000","last_became_active":"2024-09-19T06:37:09.441179+0000","last_became_peered":"2024-09-19T06:37:09.441179+0000","last_unstale":"2024-09-19T06:37:14.479335+0000","last_undegraded":"2024-09-19T06:37:14.479335+0000","last_fullsized":"2024-09-19T06:37:14.479335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:47.235113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479743+0000","last_change":"2024-09-19T06:37:09.437163+0000","last_active":"2024-09-19T06:37:14.479743+0000","last_peered":"2024-09-19T06:37:14.479743+0000","last_clean":"2024-09-19T06:37:14.479743+0000","last_became_active":"2024-09-19T06:37:09.436892+0000","last_became_peered":"2024-09-19T06:37:09.436892+0000","last_unstale":"2024-09-19T06:37:14.479743+0000","last_undegraded":"2024-09-19T06:37:14.479743+0000","last_fullsized":"2024-09-19T06:37:14.479743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:47:58.347385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.477114+0000","last_change":"2024-09-19T06:37:09.437524+0000","last_active":"2024-09-19T06:37:14.477114+0000","last_peered":"2024-09-19T06:37:14.477114+0000","last_clean":"2024-09-19T06:37:14.477114+0000","last_became_active":"2024-09-19T06:37:09.437023+0000","last_became_peered":"2024-09-19T06:37:09.437023+0000","last_unstale":"2024-09-19T06:37:14.477114+0000","last_undegraded":"2024-09-19T06:37:14.477114+0000","last_fullsized":"2024-09-19T06:37:14.477114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:31.398914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.478456+0000","last_change":"2024-09-19T06:37:09.448814+0000","last_active":"2024-09-19T06:37:14.478456+0000","last_peered":"2024-09-19T06:37:14.478456+0000","last_clean":"2024-09-19T06:37:14.478456+0000","last_became_active":"2024-09-19T06:37:09.448547+0000","last_became_peered":"2024-09-19T06:37:09.448547+0000","last_unstale":"2024-09-19T06:37:14.478456+0000","last_undegraded":"2024-09-19T06:37:14.478456+0000","last_fullsized":"2024-09-19T06:37:14.478456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:13.526300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030114+0000","last_change":"2024-09-19T06:37:09.446910+0000","last_active":"2024-09-19T06:37:15.030114+0000","last_peered":"2024-09-19T06:37:15.030114+0000","last_clean":"2024-09-19T06:37:15.030114+0000","last_became_active":"2024-09-19T06:37:09.446603+0000","last_became_peered":"2024-09-19T06:37:09.446603+0000","last_unstale":"2024-09-19T06:37:15.030114+0000","last_undegraded":"2024-09-19T06:37:15.030114+0000","last_fullsized":"2024-09-19T06:37:15.030114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:47.006354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479198+0000","last_change":"2024-09-19T06:37:09.430160+0000","last_active":"2024-09-19T06:37:14.479198+0000","last_peered":"2024-09-19T06:37:14.479198+0000","last_clean":"2024-09-19T06:37:14.479198+0000","last_became_active":"2024-09-19T06:37:09.429813+0000","last_became_peered":"2024-09-19T06:37:09.429813+0000","last_unstale":"2024-09-19T06:37:14.479198+0000","last_undegraded":"2024-09-19T06:37:14.479198+0000","last_fullsized":"2024-09-19T06:37:14.479198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:10.353834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030011+0000","last_change":"2024-09-19T06:37:09.446622+0000","last_active":"2024-09-19T06:37:15.030011+0000","last_peered":"2024-09-19T06:37:15.030011+0000","last_clean":"2024-09-19T06:37:15.030011+0000","last_became_active":"2024-09-19T06:37:09.446349+0000","last_became_peered":"2024-09-19T06:37:09.446349+0000","last_unstale":"2024-09-19T06:37:15.030011+0000","last_undegraded":"2024-09-19T06:37:15.030011+0000","last_fullsized":"2024-09-19T06:37:15.030011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:01.702039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030152+0000","last_change":"2024-09-19T06:37:09.446789+0000","last_active":"2024-09-19T06:37:15.030152+0000","last_peered":"2024-09-19T06:37:15.030152+0000","last_clean":"2024-09-19T06:37:15.030152+0000","last_became_active":"2024-09-19T06:37:09.446557+0000","last_became_peered":"2024-09-19T06:37:09.446557+0000","last_unstale":"2024-09-19T06:37:15.030152+0000","last_undegraded":"2024-09-19T06:37:15.030152+0000","last_fullsized":"2024-09-19T06:37:15.030152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:18.119474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:15.030246+0000","last_change":"2024-09-19T06:37:09.448093+0000","last_active":"2024-09-19T06:37:15.030246+0000","last_peered":"2024-09-19T06:37:15.030246+0000","last_clean":"2024-09-19T06:37:15.030246+0000","last_became_active":"2024-09-19T06:37:09.447753+0000","last_became_peered":"2024-09-19T06:37:09.447753+0000","last_unstale":"2024-09-19T06:37:15.030246+0000","last_undegraded":"2024-09-19T06:37:15.030246+0000","last_fullsized":"2024-09-19T06:37:15.030246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:11.944092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T06:37:14.479640+0000","last_change":"2024-09-19T06:37:09.442798+0000","last_active":"2024-09-19T06:37:14.479640+0000","last_peered":"2024-09-19T06:37:14.479640+0000","last_clean":"2024-09-19T06:37:14.479640+0000","last_became_active":"2024-09-19T06:37:09.442047+0000","last_became_peered":"2024-09-19T06:37:09.442047+0000","last_unstale":"2024-09-19T06:37:14.479640+0000","last_undegraded":"2024-09-19T06:37:14.479640+0000","last_fullsized":"2024-09-19T06:37:14.479640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:33.193185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65040,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509452,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509452,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":348160,"data_stored":698736,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":698680,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":107730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:37:41.207 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:37:41.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.340+0000 7ff16c800640 1 Processor -- start 2024-09-19T06:37:41.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.340+0000 7ff16c800640 1 -- start start 2024-09-19T06:37:41.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.341+0000 7ff16c800640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff168152f20 0x7ff1680c9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:41.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.341+0000 7ff16c800640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff1680c55a0 0x7ff1680ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:41.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.341+0000 7ff16c800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1680ca720 0x7ff1680ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:41.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.341+0000 7ff16c800640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7ff1680c97c0 con 0x7ff1680c55a0 2024-09-19T06:37:41.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.341+0000 7ff16c800640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7ff1680c6910 con 0x7ff168152f20 2024-09-19T06:37:41.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.341+0000 7ff16c800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff1680c7e00 con 0x7ff1680ca720 2024-09-19T06:37:41.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.341+0000 7ff15e59c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff1680c55a0 0x7ff1680ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:41.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.341+0000 7ff15e59c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff1680c55a0 0x7ff1680ca1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57088/0 (socket says 172.21.15.86:57088) 2024-09-19T06:37:41.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.341+0000 7ff15e59c640 1 -- 172.21.15.86:0/2099174443 learned_addr learned my addr 172.21.15.86:0/2099174443 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:41.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.341+0000 7ff166d9d640 1 --2- 172.21.15.86:0/2099174443 >> v2:172.21.15.169:3300/0 conn(0x7ff168152f20 0x7ff1680c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:41.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.341+0000 7ff16759e640 1 --2- 172.21.15.86:0/2099174443 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1680ca720 0x7ff1680ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:41.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.341+0000 7ff15e59c640 1 -- 172.21.15.86:0/2099174443 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1680ca720 msgr2=0x7ff1680ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:41.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.341+0000 7ff15e59c640 1 --2- 172.21.15.86:0/2099174443 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1680ca720 0x7ff1680ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.341+0000 7ff15e59c640 1 -- 172.21.15.86:0/2099174443 >> v2:172.21.15.169:3300/0 conn(0x7ff168152f20 msgr2=0x7ff1680c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:41.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.341+0000 7ff15e59c640 1 --2- 172.21.15.86:0/2099174443 >> v2:172.21.15.169:3300/0 conn(0x7ff168152f20 0x7ff1680c9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.341+0000 7ff15e59c640 1 -- 172.21.15.86:0/2099174443 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1680c5dd0 con 0x7ff1680c55a0 2024-09-19T06:37:41.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.341+0000 7ff166d9d640 1 --2- 172.21.15.86:0/2099174443 >> v2:172.21.15.169:3300/0 conn(0x7ff168152f20 0x7ff1680c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:41.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.342+0000 7ff15e59c640 1 --2- 172.21.15.86:0/2099174443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1680c55a0 0x7ff1680ca1e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff1680c5fa0 tx=0x7ff15002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceee3dfa3a983d03 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:41.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.342+0000 7ff16659c640 1 -- 172.21.15.86:0/2099174443 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff150037070 con 0x7ff1680c55a0 2024-09-19T06:37:41.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.342+0000 7ff16659c640 1 -- 172.21.15.86:0/2099174443 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff150032440 con 0x7ff1680c55a0 2024-09-19T06:37:41.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.342+0000 7ff16659c640 1 -- 172.21.15.86:0/2099174443 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff150032810 con 0x7ff1680c55a0 2024-09-19T06:37:41.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.343+0000 7ff16c800640 1 -- 172.21.15.86:0/2099174443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1680c55a0 msgr2=0x7ff1680ca1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:41.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.343+0000 7ff16c800640 1 --2- 172.21.15.86:0/2099174443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1680c55a0 0x7ff1680ca1e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff1680c5fa0 tx=0x7ff15002a1c0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.343+0000 7ff16c800640 1 -- 172.21.15.86:0/2099174443 shutdown_connections 2024-09-19T06:37:41.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.343+0000 7ff16c800640 1 --2- 172.21.15.86:0/2099174443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1680c55a0 0x7ff1680ca1e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.343+0000 7ff16c800640 1 --2- 172.21.15.86:0/2099174443 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1680ca720 0x7ff1680ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.343+0000 7ff16c800640 1 --2- 172.21.15.86:0/2099174443 >> v2:172.21.15.169:3300/0 conn(0x7ff168152f20 0x7ff1680c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.343+0000 7ff16c800640 1 -- 172.21.15.86:0/2099174443 >> 172.21.15.86:0/2099174443 conn(0x7ff16806c010 msgr2=0x7ff168067890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:41.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.343+0000 7ff16c800640 1 -- 172.21.15.86:0/2099174443 shutdown_connections 2024-09-19T06:37:41.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.343+0000 7ff16c800640 1 -- 172.21.15.86:0/2099174443 wait complete. 2024-09-19T06:37:41.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.344+0000 7ff16c800640 1 Processor -- start 2024-09-19T06:37:41.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.344+0000 7ff16c800640 1 -- start start 2024-09-19T06:37:41.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.345+0000 7ff16c800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1680c55a0 0x7ff168145440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:41.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.345+0000 7ff16c800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1680ca720 0x7ff1681f1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:41.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.345+0000 7ff16c800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff168152f20 0x7ff1681e2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:41.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.345+0000 7ff16c800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff1680c6070 con 0x7ff1680ca720 2024-09-19T06:37:41.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.345+0000 7ff16c800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff1680c9d50 con 0x7ff168152f20 2024-09-19T06:37:41.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.345+0000 7ff16c800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff1680c6350 con 0x7ff1680c55a0 2024-09-19T06:37:41.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.345+0000 7ff15e59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1680ca720 0x7ff1681f1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:41.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.345+0000 7ff15e59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1680ca720 0x7ff1681f1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57098/0 (socket says 172.21.15.86:57098) 2024-09-19T06:37:41.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.345+0000 7ff15e59c640 1 -- 172.21.15.86:0/123173558 learned_addr learned my addr 172.21.15.86:0/123173558 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:41.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.345+0000 7ff16759e640 1 --2- 172.21.15.86:0/123173558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff168152f20 0x7ff1681e2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:41.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.345+0000 7ff166d9d640 1 --2- 172.21.15.86:0/123173558 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1680c55a0 0x7ff168145440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:41.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.345+0000 7ff15e59c640 1 -- 172.21.15.86:0/123173558 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1680c55a0 msgr2=0x7ff168145440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:41.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.345+0000 7ff15e59c640 1 --2- 172.21.15.86:0/123173558 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1680c55a0 0x7ff168145440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.345+0000 7ff15e59c640 1 -- 172.21.15.86:0/123173558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff168152f20 msgr2=0x7ff1681e2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:41.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.345+0000 7ff15e59c640 1 --2- 172.21.15.86:0/123173558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff168152f20 0x7ff1681e2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.345+0000 7ff15e59c640 1 -- 172.21.15.86:0/123173558 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1681e32f0 con 0x7ff1680ca720 2024-09-19T06:37:41.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.345+0000 7ff15e59c640 1 --2- 172.21.15.86:0/123173558 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1680ca720 0x7ff1681f1e90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff15002a200 tx=0x7ff1500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:41.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.346+0000 7ff15ffff640 1 -- 172.21.15.86:0/123173558 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff150041020 con 0x7ff1680ca720 2024-09-19T06:37:41.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.346+0000 7ff15ffff640 1 -- 172.21.15.86:0/123173558 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1500306c0 con 0x7ff1680ca720 2024-09-19T06:37:41.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.346+0000 7ff16c800640 1 -- 172.21.15.86:0/123173558 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1681e35d0 con 0x7ff1680ca720 2024-09-19T06:37:41.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.346+0000 7ff15ffff640 1 -- 172.21.15.86:0/123173558 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff150037040 con 0x7ff1680ca720 2024-09-19T06:37:41.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.346+0000 7ff16c800640 1 -- 172.21.15.86:0/123173558 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff168145980 con 0x7ff1680ca720 2024-09-19T06:37:41.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.347+0000 7ff16c800640 1 -- 172.21.15.86:0/123173558 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1681e3040 con 0x7ff1680ca720 2024-09-19T06:37:41.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.347+0000 7ff15ffff640 1 -- 172.21.15.86:0/123173558 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff150044020 con 0x7ff1680ca720 2024-09-19T06:37:41.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.347+0000 7ff15ffff640 1 --2- 172.21.15.86:0/123173558 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff14806c2e0 0x7ff14806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:41.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.347+0000 7ff15ffff640 1 -- 172.21.15.86:0/123173558 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff1500abef0 con 0x7ff1680ca720 2024-09-19T06:37:41.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.347+0000 7ff166d9d640 1 --2- 172.21.15.86:0/123173558 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff14806c2e0 0x7ff14806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:41.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.348+0000 7ff166d9d640 1 --2- 172.21.15.86:0/123173558 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff14806c2e0 0x7ff14806e7a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff15800d8b0 tx=0x7ff158008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:41.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.352+0000 7ff15ffff640 1 -- 172.21.15.86:0/123173558 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff15004b030 con 0x7ff1680ca720 2024-09-19T06:37:41.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.557+0000 7ff16c800640 1 -- 172.21.15.86:0/123173558 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1680c6630 con 0x7ff1680ca720 2024-09-19T06:37:41.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.557+0000 7ff15ffff640 1 -- 172.21.15.86:0/123173558 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6871 (secure 0 0 0) 0x7ff15007a320 con 0x7ff1680ca720 2024-09-19T06:37:41.559 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:41.559 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":9,"btime":"2024-09-19T06:37:28:505383+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:37:27.843067+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6837/201961024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":201961024},{"type":"v1","addr":"172.21.15.169:6837","nonce":201961024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-09-19T06:37:41.559 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 9 2024-09-19T06:37:41.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.559+0000 7ff16c800640 1 -- 172.21.15.86:0/123173558 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff14806c2e0 msgr2=0x7ff14806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:41.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.559+0000 7ff16c800640 1 --2- 172.21.15.86:0/123173558 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff14806c2e0 0x7ff14806e7a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff15800d8b0 tx=0x7ff158008040 comp rx=0 tx=0).stop 2024-09-19T06:37:41.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.559+0000 7ff16c800640 1 -- 172.21.15.86:0/123173558 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1680ca720 msgr2=0x7ff1681f1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:41.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.559+0000 7ff16c800640 1 --2- 172.21.15.86:0/123173558 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1680ca720 0x7ff1681f1e90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff15002a200 tx=0x7ff1500046c0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.559+0000 7ff16c800640 1 -- 172.21.15.86:0/123173558 shutdown_connections 2024-09-19T06:37:41.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.559+0000 7ff16c800640 1 --2- 172.21.15.86:0/123173558 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff14806c2e0 0x7ff14806e7a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.559+0000 7ff16c800640 1 --2- 172.21.15.86:0/123173558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff168152f20 0x7ff1681e2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.559+0000 7ff16c800640 1 --2- 172.21.15.86:0/123173558 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1680ca720 0x7ff1681f1e90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.559+0000 7ff16c800640 1 --2- 172.21.15.86:0/123173558 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1680c55a0 0x7ff168145440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.559+0000 7ff16c800640 1 -- 172.21.15.86:0/123173558 >> 172.21.15.86:0/123173558 conn(0x7ff16806c010 msgr2=0x7ff1680c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:41.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.559+0000 7ff16c800640 1 -- 172.21.15.86:0/123173558 shutdown_connections 2024-09-19T06:37:41.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.559+0000 7ff16c800640 1 -- 172.21.15.86:0/123173558 wait complete. 2024-09-19T06:37:41.572 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T06:37:41.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.668+0000 7f367799f640 1 Processor -- start 2024-09-19T06:37:41.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.668+0000 7f367799f640 1 -- start start 2024-09-19T06:37:41.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.669+0000 7f367799f640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3670152050 0x7f3670157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:41.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.669+0000 7f367799f640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f367015bb10 0x7f36700c8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:41.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.669+0000 7f367799f640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3670158310 con 0x7f36700ca530 2024-09-19T06:37:41.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.669+0000 7f367799f640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f3670158bb0 con 0x7f367015bb10 2024-09-19T06:37:41.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.669+0000 7f367799f640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f36701585f0 con 0x7f3670152050 2024-09-19T06:37:41.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.669+0000 7f3674f3a640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f367015bb10 0x7f36700c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:41.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.669+0000 7f3674f3a640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f367015bb10 0x7f36700c8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57102/0 (socket says 172.21.15.86:57102) 2024-09-19T06:37:41.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.669+0000 7f3674f3a640 1 -- 172.21.15.86:0/1257968411 learned_addr learned my addr 172.21.15.86:0/1257968411 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:41.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.670+0000 7f367573b640 1 --2- 172.21.15.86:0/1257968411 >> v2:172.21.15.169:3300/0 conn(0x7f3670152050 0x7f3670157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:41.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.670+0000 7f3674f3a640 1 -- 172.21.15.86:0/1257968411 >> v2:172.21.15.169:3300/0 conn(0x7f3670152050 msgr2=0x7f3670157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:41.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.670+0000 7f3674f3a640 1 --2- 172.21.15.86:0/1257968411 >> v2:172.21.15.169:3300/0 conn(0x7f3670152050 0x7f3670157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.670+0000 7f3674f3a640 1 -- 172.21.15.86:0/1257968411 >> v1:172.21.15.169:6789/0 conn(0x7f36700ca530 legacy=0x7f367006ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:37:41.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.670+0000 7f3674f3a640 1 -- 172.21.15.86:0/1257968411 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36701588d0 con 0x7f367015bb10 2024-09-19T06:37:41.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.670+0000 7f367573b640 1 --2- 172.21.15.86:0/1257968411 >> v2:172.21.15.169:3300/0 conn(0x7f3670152050 0x7f3670157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:41.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.670+0000 7f3674f3a640 1 --2- 172.21.15.86:0/1257968411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f367015bb10 0x7f36700c8830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f36700cb260 tx=0x7f366402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ffabda30d85de38 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:41.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.670+0000 7f366ffff640 1 -- 172.21.15.86:0/1257968411 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3664037070 con 0x7f367015bb10 2024-09-19T06:37:41.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.671+0000 7f366ffff640 1 -- 172.21.15.86:0/1257968411 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3664032440 con 0x7f367015bb10 2024-09-19T06:37:41.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.671+0000 7f366ffff640 1 -- 172.21.15.86:0/1257968411 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3664032810 con 0x7f367015bb10 2024-09-19T06:37:41.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.671+0000 7f367799f640 1 -- 172.21.15.86:0/1257968411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f367015bb10 msgr2=0x7f36700c8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:41.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.671+0000 7f367799f640 1 --2- 172.21.15.86:0/1257968411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f367015bb10 0x7f36700c8830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f36700cb260 tx=0x7f366402a1a0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.671+0000 7f367799f640 1 -- 172.21.15.86:0/1257968411 shutdown_connections 2024-09-19T06:37:41.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.671+0000 7f367799f640 1 --2- 172.21.15.86:0/1257968411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f367015bb10 0x7f36700c8830 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.671+0000 7f367799f640 1 --2- 172.21.15.86:0/1257968411 >> v2:172.21.15.169:3300/0 conn(0x7f3670152050 0x7f3670157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.671+0000 7f367799f640 1 -- 172.21.15.86:0/1257968411 >> 172.21.15.86:0/1257968411 conn(0x7f367006fd60 msgr2=0x7f3670070140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:41.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.671+0000 7f367799f640 1 -- 172.21.15.86:0/1257968411 shutdown_connections 2024-09-19T06:37:41.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.671+0000 7f367799f640 1 -- 172.21.15.86:0/1257968411 wait complete. 2024-09-19T06:37:41.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.672+0000 7f367799f640 1 Processor -- start 2024-09-19T06:37:41.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.672+0000 7f367799f640 1 -- start start 2024-09-19T06:37:41.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.673+0000 7f367799f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36700ca530 0x7f3670157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:41.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.673+0000 7f367799f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3670152050 0x7f36701f2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:41.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.673+0000 7f367799f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f367015bb10 0x7f36701f1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:41.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.673+0000 7f367799f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f36700c4810 con 0x7f3670152050 2024-09-19T06:37:41.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.673+0000 7f367799f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f367015b5f0 con 0x7f367015bb10 2024-09-19T06:37:41.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.673+0000 7f367799f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f36700c8d70 con 0x7f36700ca530 2024-09-19T06:37:41.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.673+0000 7f3674f3a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3670152050 0x7f36701f2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:41.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.673+0000 7f3674f3a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3670152050 0x7f36701f2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57118/0 (socket says 172.21.15.86:57118) 2024-09-19T06:37:41.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.673+0000 7f3674f3a640 1 -- 172.21.15.86:0/2514164665 learned_addr learned my addr 172.21.15.86:0/2514164665 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:37:41.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.673+0000 7f367573b640 1 --2- 172.21.15.86:0/2514164665 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36700ca530 0x7f3670157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:41.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.673+0000 7f3675f3c640 1 --2- 172.21.15.86:0/2514164665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f367015bb10 0x7f36701f1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:41.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.673+0000 7f3674f3a640 1 -- 172.21.15.86:0/2514164665 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36700ca530 msgr2=0x7f3670157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:41.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.673+0000 7f3674f3a640 1 --2- 172.21.15.86:0/2514164665 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36700ca530 0x7f3670157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.673+0000 7f3674f3a640 1 -- 172.21.15.86:0/2514164665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f367015bb10 msgr2=0x7f36701f1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:41.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.673+0000 7f3674f3a640 1 --2- 172.21.15.86:0/2514164665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f367015bb10 0x7f36701f1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.673+0000 7f3674f3a640 1 -- 172.21.15.86:0/2514164665 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3670159a50 con 0x7f3670152050 2024-09-19T06:37:41.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.673+0000 7f3675f3c640 1 --2- 172.21.15.86:0/2514164665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f367015bb10 0x7f36701f1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:41.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.673+0000 7f3674f3a640 1 --2- 172.21.15.86:0/2514164665 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3670152050 0x7f36701f2540 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f366402a1e0 tx=0x7f36640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:41.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.674+0000 7f366dffb640 1 -- 172.21.15.86:0/2514164665 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3664041020 con 0x7f3670152050 2024-09-19T06:37:41.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.674+0000 7f366dffb640 1 -- 172.21.15.86:0/2514164665 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3664030990 con 0x7f3670152050 2024-09-19T06:37:41.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.674+0000 7f366dffb640 1 -- 172.21.15.86:0/2514164665 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3664037040 con 0x7f3670152050 2024-09-19T06:37:41.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.674+0000 7f367799f640 1 -- 172.21.15.86:0/2514164665 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3670159cf0 con 0x7f3670152050 2024-09-19T06:37:41.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.674+0000 7f367799f640 1 -- 172.21.15.86:0/2514164665 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f367015ae80 con 0x7f3670152050 2024-09-19T06:37:41.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.675+0000 7f367799f640 1 -- 172.21.15.86:0/2514164665 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f367015bf60 con 0x7f3670152050 2024-09-19T06:37:41.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.675+0000 7f366dffb640 1 -- 172.21.15.86:0/2514164665 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3664044020 con 0x7f3670152050 2024-09-19T06:37:41.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.676+0000 7f366dffb640 1 --2- 172.21.15.86:0/2514164665 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f365c06c2b0 0x7f365c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:41.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.676+0000 7f366dffb640 1 -- 172.21.15.86:0/2514164665 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f36640ac1e0 con 0x7f3670152050 2024-09-19T06:37:41.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.676+0000 7f367573b640 1 --2- 172.21.15.86:0/2514164665 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f365c06c2b0 0x7f365c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:41.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.676+0000 7f367573b640 1 --2- 172.21.15.86:0/2514164665 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f365c06c2b0 0x7f365c06e770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f36600075b0 tx=0x7f3660007540 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:41.681 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.680+0000 7f366dffb640 1 -- 172.21.15.86:0/2514164665 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f366404b030 con 0x7f3670152050 2024-09-19T06:37:41.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.848+0000 7f367799f640 1 -- 172.21.15.86:0/2514164665 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36700c8360 con 0x7f3670152050 2024-09-19T06:37:41.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.849+0000 7f366dffb640 1 -- 172.21.15.86:0/2514164665 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18586 (secure 0 0 0) 0x7f366407a610 con 0x7f3670152050 2024-09-19T06:37:41.850 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:37:41.851 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":26,"fsid":"1785f09f-0959-457d-8c4a-6cce2e655a37","created":"2024-09-19T06:36:45.671544+0000","modified":"2024-09-19T06:37:13.796252+0000","last_up_change":"2024-09-19T06:36:56.765680+0000","last_in_change":"2024-09-19T06:36:47.816681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:36:57.770634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:37:06.588120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:37:07.739726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T06:37:11.457476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bd3ce3f2-2a37-40ec-8dc3-69246437277c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6827","nonce":1588074611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6829","nonce":1588074611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6833","nonce":1588074611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6831","nonce":1588074611}]},"public_addr":"172.21.15.86:6827/1588074611","cluster_addr":"172.21.15.86:6829/1588074611","heartbeat_back_addr":"172.21.15.86:6833/1588074611","heartbeat_front_addr":"172.21.15.86:6831/1588074611","state":["exists","up"]},{"osd":1,"uuid":"871d7d23-ed03-4629-bca9-5b71ad0d926a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6819","nonce":1785682938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6821","nonce":1785682938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6825","nonce":1785682938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6823","nonce":1785682938}]},"public_addr":"172.21.15.86:6819/1785682938","cluster_addr":"172.21.15.86:6821/1785682938","heartbeat_back_addr":"172.21.15.86:6825/1785682938","heartbeat_front_addr":"172.21.15.86:6823/1785682938","state":["exists","up"]},{"osd":2,"uuid":"39d3562d-8c52-4af9-935a-2d90abb8b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6801","nonce":3306127846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6803","nonce":3306127846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6807","nonce":3306127846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6805","nonce":3306127846}]},"public_addr":"172.21.15.86:6801/3306127846","cluster_addr":"172.21.15.86:6803/3306127846","heartbeat_back_addr":"172.21.15.86:6807/3306127846","heartbeat_front_addr":"172.21.15.86:6805/3306127846","state":["exists","up"]},{"osd":3,"uuid":"7f88c5b1-042c-4a9f-a674-32456e0644a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6809","nonce":694275178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6811","nonce":694275178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6815","nonce":694275178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6813","nonce":694275178}]},"public_addr":"172.21.15.86:6809/694275178","cluster_addr":"172.21.15.86:6811/694275178","heartbeat_back_addr":"172.21.15.86:6815/694275178","heartbeat_front_addr":"172.21.15.86:6813/694275178","state":["exists","up"]},{"osd":4,"uuid":"18aa391b-0863-48bf-bff6-107e22ee9752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6811","nonce":1326795640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6815","nonce":1326795640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6823","nonce":1326795640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6819","nonce":1326795640}]},"public_addr":"172.21.15.169:6811/1326795640","cluster_addr":"172.21.15.169:6815/1326795640","heartbeat_back_addr":"172.21.15.169:6823/1326795640","heartbeat_front_addr":"172.21.15.169:6819/1326795640","state":["exists","up"]},{"osd":5,"uuid":"90fa5ca6-1815-4af1-a664-b45a9e19dd56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6825","nonce":3538913242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6827","nonce":3538913242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6831","nonce":3538913242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6829","nonce":3538913242}]},"public_addr":"172.21.15.169:6825/3538913242","cluster_addr":"172.21.15.169:6827/3538913242","heartbeat_back_addr":"172.21.15.169:6831/3538913242","heartbeat_front_addr":"172.21.15.169:6829/3538913242","state":["exists","up"]},{"osd":6,"uuid":"8b2019fc-6cc2-4394-9a7c-7951544f7cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6810","nonce":494424253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6814","nonce":494424253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6822","nonce":494424253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6818","nonce":494424253}]},"public_addr":"172.21.15.169:6810/494424253","cluster_addr":"172.21.15.169:6814/494424253","heartbeat_back_addr":"172.21.15.169:6822/494424253","heartbeat_front_addr":"172.21.15.169:6818/494424253","state":["exists","up"]},{"osd":7,"uuid":"622e3b2c-5302-4b0a-b7f2-f4050801401e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6801","nonce":797235989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6803","nonce":797235989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6807","nonce":797235989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6805","nonce":797235989}]},"public_addr":"172.21.15.169:6801/797235989","cluster_addr":"172.21.15.169:6803/797235989","heartbeat_back_addr":"172.21.15.169:6807/797235989","heartbeat_front_addr":"172.21.15.169:6805/797235989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.130643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.611572+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:53.419992+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.560112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.112065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.774642+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.341946+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.117884+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:37:41.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.851+0000 7f367799f640 1 -- 172.21.15.86:0/2514164665 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f365c06c2b0 msgr2=0x7f365c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:41.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.851+0000 7f367799f640 1 --2- 172.21.15.86:0/2514164665 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f365c06c2b0 0x7f365c06e770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f36600075b0 tx=0x7f3660007540 comp rx=0 tx=0).stop 2024-09-19T06:37:41.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.851+0000 7f367799f640 1 -- 172.21.15.86:0/2514164665 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3670152050 msgr2=0x7f36701f2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:41.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.851+0000 7f367799f640 1 --2- 172.21.15.86:0/2514164665 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3670152050 0x7f36701f2540 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f366402a1e0 tx=0x7f36640046c0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.851+0000 7f367799f640 1 -- 172.21.15.86:0/2514164665 shutdown_connections 2024-09-19T06:37:41.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.851+0000 7f367799f640 1 --2- 172.21.15.86:0/2514164665 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f365c06c2b0 0x7f365c06e770 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.851+0000 7f367799f640 1 --2- 172.21.15.86:0/2514164665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f367015bb10 0x7f36701f1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.851+0000 7f367799f640 1 --2- 172.21.15.86:0/2514164665 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3670152050 0x7f36701f2540 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.851+0000 7f367799f640 1 --2- 172.21.15.86:0/2514164665 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36700ca530 0x7f3670157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.851+0000 7f367799f640 1 -- 172.21.15.86:0/2514164665 >> 172.21.15.86:0/2514164665 conn(0x7f367006fd60 msgr2=0x7f3670072e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:41.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.851+0000 7f367799f640 1 -- 172.21.15.86:0/2514164665 shutdown_connections 2024-09-19T06:37:41.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:37:41.851+0000 7f367799f640 1 -- 172.21.15.86:0/2514164665 wait complete. 2024-09-19T06:37:41.864 DEBUG:tasks.mds_thrash:Yielding 2024-09-19T06:37:41.864 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T06:37:41.877 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T06:37:41.878 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T06:37:41.878 INFO:tasks.workunit:timeout=3h 2024-09-19T06:37:41.878 INFO:tasks.workunit:cleanup=True 2024-09-19T06:37:41.878 DEBUG:teuthology.orchestra.run.smithi086:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T06:37:41.879 INFO:tasks.mds_thrash.fs.[cephfs]:starting mds_do_thrash for fs cephfs 2024-09-19T06:37:41.879 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 80 secs before thrashing 2024-09-19T06:37:41.894 INFO:teuthology.orchestra.run.smithi086.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T06:37:41.894 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-19T06:37:41.894 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 29h/41d Inode: 1 Links: 2 2024-09-19T06:37:41.894 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:37:41.894 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-19T06:37:41.894 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-19T06:37:41.894 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-19 06:37:14.423792748 +0000 2024-09-19T06:37:41.894 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-19 06:37:24.166410185 +0000 2024-09-19T06:37:41.894 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-09-19 06:37:14.423792748 +0000 2024-09-19T06:37:41.895 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T06:37:41.895 DEBUG:teuthology.orchestra.run.smithi086:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T06:37:41.962 DEBUG:teuthology.orchestra.run.smithi086:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T06:37:42.019 INFO:tasks.workunit.client.0.smithi086.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T06:38:07.325 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:38:07.328 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:38:37.446 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:38:37.450 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:38:37.637 INFO:tasks.workunit.client.0.smithi086.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T06:38:37.744 INFO:tasks.workunit.client.0.smithi086.stderr: 2024-09-19T06:38:37.744 INFO:tasks.workunit.client.0.smithi086.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T06:38:37.744 INFO:tasks.workunit.client.0.smithi086.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T06:38:37.744 INFO:tasks.workunit.client.0.smithi086.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T06:38:37.745 INFO:tasks.workunit.client.0.smithi086.stderr: 2024-09-19T06:38:37.745 INFO:tasks.workunit.client.0.smithi086.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T06:38:37.745 INFO:tasks.workunit.client.0.smithi086.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T06:38:37.745 INFO:tasks.workunit.client.0.smithi086.stderr: 2024-09-19T06:38:37.745 INFO:tasks.workunit.client.0.smithi086.stderr: git switch -c 2024-09-19T06:38:37.745 INFO:tasks.workunit.client.0.smithi086.stderr: 2024-09-19T06:38:37.745 INFO:tasks.workunit.client.0.smithi086.stderr:Or undo this operation with: 2024-09-19T06:38:37.745 INFO:tasks.workunit.client.0.smithi086.stderr: 2024-09-19T06:38:37.745 INFO:tasks.workunit.client.0.smithi086.stderr: git switch - 2024-09-19T06:38:37.745 INFO:tasks.workunit.client.0.smithi086.stderr: 2024-09-19T06:38:37.746 INFO:tasks.workunit.client.0.smithi086.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T06:38:37.746 INFO:tasks.workunit.client.0.smithi086.stderr: 2024-09-19T06:38:37.746 INFO:tasks.workunit.client.0.smithi086.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T06:38:37.747 DEBUG:teuthology.orchestra.run.smithi086:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T06:38:37.813 INFO:tasks.workunit.client.0.smithi086.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T06:38:37.816 INFO:tasks.workunit.client.0.smithi086.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T06:38:37.816 INFO:tasks.workunit.client.0.smithi086.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T06:38:38.436 INFO:tasks.workunit.client.0.smithi086.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T06:38:38.515 INFO:tasks.workunit.client.0.smithi086.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T06:38:38.555 INFO:tasks.workunit.client.0.smithi086.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T06:38:38.557 INFO:tasks.workunit.client.0.smithi086.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T06:38:38.557 INFO:tasks.workunit.client.0.smithi086.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T06:38:38.597 INFO:tasks.workunit.client.0.smithi086.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T06:38:38.600 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:38:38.600 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T06:38:38.656 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-09-19T06:38:38.658 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-09-19T06:38:38.658 DEBUG:teuthology.orchestra.run.smithi086:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-19T06:38:38.719 INFO:tasks.workunit.client.0.smithi086.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-19T06:38:38.719 INFO:tasks.workunit.client.0.smithi086.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2024-09-19T06:38:38.720 INFO:tasks.workunit.client.0.smithi086.stderr:+ trap -- retry EXIT 2024-09-19T06:38:38.720 INFO:tasks.workunit.client.0.smithi086.stderr:+ rm -rf ffsb 2024-09-19T06:38:38.720 INFO:tasks.workunit.client.0.smithi086.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-09-19T06:38:38.723 INFO:tasks.workunit.client.0.smithi086.stderr:Cloning into 'ffsb'... 2024-09-19T06:38:40.941 INFO:tasks.workunit.client.0.smithi086.stderr:+ trap - EXIT 2024-09-19T06:38:40.941 INFO:tasks.workunit.client.0.smithi086.stderr:+ cd ffsb 2024-09-19T06:38:40.941 INFO:tasks.workunit.client.0.smithi086.stderr:+ ./configure 2024-09-19T06:38:41.347 INFO:tasks.workunit.client.0.smithi086.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-19T06:38:42.355 INFO:tasks.workunit.client.0.smithi086.stdout:checking whether build environment is sane... yes 2024-09-19T06:38:42.365 INFO:tasks.workunit.client.0.smithi086.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-19T06:38:42.365 INFO:tasks.workunit.client.0.smithi086.stdout:checking for gawk... gawk 2024-09-19T06:38:42.381 INFO:tasks.workunit.client.0.smithi086.stdout:checking whether make sets $(MAKE)... yes 2024-09-19T06:38:42.414 INFO:tasks.workunit.client.0.smithi086.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-19T06:38:42.414 INFO:tasks.workunit.client.0.smithi086.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-19T06:38:42.425 INFO:tasks.workunit.client.0.smithi086.stdout:checking for style of include used by make... GNU 2024-09-19T06:38:42.429 INFO:tasks.workunit.client.0.smithi086.stdout:checking for gcc... gcc 2024-09-19T06:38:42.488 INFO:tasks.workunit.client.0.smithi086.stdout:checking for C compiler default output file name... a.out 2024-09-19T06:38:42.489 INFO:tasks.workunit.client.0.smithi086.stdout:checking whether the C compiler works... yes 2024-09-19T06:38:42.492 INFO:tasks.workunit.client.0.smithi086.stdout:checking whether we are cross compiling... no 2024-09-19T06:38:42.528 INFO:tasks.workunit.client.0.smithi086.stdout:checking for suffix of executables... 2024-09-19T06:38:42.559 INFO:tasks.workunit.client.0.smithi086.stdout:checking for suffix of object files... o 2024-09-19T06:38:42.587 INFO:tasks.workunit.client.0.smithi086.stdout:checking whether we are using the GNU C compiler... yes 2024-09-19T06:38:42.617 INFO:tasks.workunit.client.0.smithi086.stdout:checking whether gcc accepts -g... yes 2024-09-19T06:38:43.099 INFO:tasks.workunit.client.0.smithi086.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-19T06:38:43.200 INFO:tasks.workunit.client.0.smithi086.stdout:checking dependency style of gcc... gcc3 2024-09-19T06:38:44.001 INFO:tasks.workunit.client.0.smithi086.stdout:checking how to run the C preprocessor... gcc -E 2024-09-19T06:38:44.077 INFO:tasks.workunit.client.0.smithi086.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-19T06:38:44.078 INFO:tasks.workunit.client.0.smithi086.stdout:checking for egrep... /usr/bin/grep -E 2024-09-19T06:38:44.087 INFO:tasks.workunit.client.0.smithi086.stdout:checking for AIX... no 2024-09-19T06:38:44.294 INFO:tasks.workunit.client.0.smithi086.stdout:checking for gcc... (cached) gcc 2024-09-19T06:38:44.303 INFO:tasks.workunit.client.0.smithi086.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-19T06:38:44.303 INFO:tasks.workunit.client.0.smithi086.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-19T06:38:44.303 INFO:tasks.workunit.client.0.smithi086.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-19T06:38:44.303 INFO:tasks.workunit.client.0.smithi086.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-19T06:38:44.598 INFO:tasks.workunit.client.0.smithi086.stdout:checking for main in -lm... yes 2024-09-19T06:38:44.646 INFO:tasks.workunit.client.0.smithi086.stdout:checking for main in -lpthread... yes 2024-09-19T06:38:45.241 INFO:tasks.workunit.client.0.smithi086.stdout:checking for ANSI C header files... yes 2024-09-19T06:38:45.301 INFO:tasks.workunit.client.0.smithi086.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-19T06:38:45.344 INFO:tasks.workunit.client.0.smithi086.stdout:checking for sys/types.h... yes 2024-09-19T06:38:45.387 INFO:tasks.workunit.client.0.smithi086.stdout:checking for sys/stat.h... yes 2024-09-19T06:38:45.430 INFO:tasks.workunit.client.0.smithi086.stdout:checking for stdlib.h... yes 2024-09-19T06:38:45.489 INFO:tasks.workunit.client.0.smithi086.stdout:checking for string.h... yes 2024-09-19T06:38:45.536 INFO:tasks.workunit.client.0.smithi086.stdout:checking for memory.h... yes 2024-09-19T06:38:45.583 INFO:tasks.workunit.client.0.smithi086.stdout:checking for strings.h... yes 2024-09-19T06:38:45.631 INFO:tasks.workunit.client.0.smithi086.stdout:checking for inttypes.h... yes 2024-09-19T06:38:45.678 INFO:tasks.workunit.client.0.smithi086.stdout:checking for stdint.h... yes 2024-09-19T06:38:45.727 INFO:tasks.workunit.client.0.smithi086.stdout:checking for unistd.h... yes 2024-09-19T06:38:45.782 INFO:tasks.workunit.client.0.smithi086.stdout:checking pthread.h usability... yes 2024-09-19T06:38:45.803 INFO:tasks.workunit.client.0.smithi086.stdout:checking pthread.h presence... yes 2024-09-19T06:38:45.803 INFO:tasks.workunit.client.0.smithi086.stdout:checking for pthread.h... yes 2024-09-19T06:38:45.856 INFO:tasks.workunit.client.0.smithi086.stdout:checking fcntl.h usability... yes 2024-09-19T06:38:45.876 INFO:tasks.workunit.client.0.smithi086.stdout:checking fcntl.h presence... yes 2024-09-19T06:38:45.876 INFO:tasks.workunit.client.0.smithi086.stdout:checking for fcntl.h... yes 2024-09-19T06:38:45.932 INFO:tasks.workunit.client.0.smithi086.stdout:checking limits.h usability... yes 2024-09-19T06:38:45.951 INFO:tasks.workunit.client.0.smithi086.stdout:checking limits.h presence... yes 2024-09-19T06:38:45.951 INFO:tasks.workunit.client.0.smithi086.stdout:checking for limits.h... yes 2024-09-19T06:38:45.965 INFO:tasks.workunit.client.0.smithi086.stdout:checking for stdint.h... (cached) yes 2024-09-19T06:38:46.010 INFO:tasks.workunit.client.0.smithi086.stdout:checking sys/time.h usability... yes 2024-09-19T06:38:46.030 INFO:tasks.workunit.client.0.smithi086.stdout:checking sys/time.h presence... yes 2024-09-19T06:38:46.030 INFO:tasks.workunit.client.0.smithi086.stdout:checking for sys/time.h... yes 2024-09-19T06:38:46.043 INFO:tasks.workunit.client.0.smithi086.stdout:checking for unistd.h... (cached) yes 2024-09-19T06:38:46.083 INFO:tasks.workunit.client.0.smithi086.stdout:checking sys/vfs.h usability... yes 2024-09-19T06:38:46.102 INFO:tasks.workunit.client.0.smithi086.stdout:checking sys/vfs.h presence... yes 2024-09-19T06:38:46.103 INFO:tasks.workunit.client.0.smithi086.stdout:checking for sys/vfs.h... yes 2024-09-19T06:38:46.147 INFO:tasks.workunit.client.0.smithi086.stdout:checking sys/limits.h usability... no 2024-09-19T06:38:46.167 INFO:tasks.workunit.client.0.smithi086.stdout:checking sys/limits.h presence... no 2024-09-19T06:38:46.167 INFO:tasks.workunit.client.0.smithi086.stdout:checking for sys/limits.h... no 2024-09-19T06:38:46.199 INFO:tasks.workunit.client.0.smithi086.stdout:checking for an ANSI C-conforming const... yes 2024-09-19T06:38:46.232 INFO:tasks.workunit.client.0.smithi086.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-19T06:38:46.233 INFO:tasks.workunit.client.0.smithi086.stdout:checking for function prototypes... yes 2024-09-19T06:38:46.260 INFO:tasks.workunit.client.0.smithi086.stdout:checking whether setvbuf arguments are reversed... no 2024-09-19T06:38:46.327 INFO:tasks.workunit.client.0.smithi086.stdout:checking for system... yes 2024-09-19T06:38:46.386 INFO:tasks.workunit.client.0.smithi086.stdout:checking for gettimeofday... yes 2024-09-19T06:38:46.445 INFO:tasks.workunit.client.0.smithi086.stdout:checking for mkdir... yes 2024-09-19T06:38:46.508 INFO:tasks.workunit.client.0.smithi086.stdout:checking for strerror... yes 2024-09-19T06:38:46.571 INFO:tasks.workunit.client.0.smithi086.stdout:checking for open64... yes 2024-09-19T06:38:46.631 INFO:tasks.workunit.client.0.smithi086.stdout:checking for stat64... yes 2024-09-19T06:38:46.689 INFO:tasks.workunit.client.0.smithi086.stdout:checking for fseeko64... yes 2024-09-19T06:38:46.748 INFO:tasks.workunit.client.0.smithi086.stdout:checking for lrand48_r... yes 2024-09-19T06:38:46.807 INFO:tasks.workunit.client.0.smithi086.stdout:checking for srand48_r... yes 2024-09-19T06:38:46.829 INFO:tasks.workunit.client.0.smithi086.stdout:configure: creating ./config.status 2024-09-19T06:38:46.926 INFO:tasks.workunit.client.0.smithi086.stdout:config.status: creating Makefile 2024-09-19T06:38:46.939 INFO:tasks.workunit.client.0.smithi086.stdout:config.status: creating config.h 2024-09-19T06:38:46.957 INFO:tasks.workunit.client.0.smithi086.stdout:config.status: executing depfiles commands 2024-09-19T06:38:47.005 INFO:tasks.workunit.client.0.smithi086.stdout:config.status: executing default commands 2024-09-19T06:38:47.405 INFO:tasks.workunit.client.0.smithi086.stderr:+ make 2024-09-19T06:38:47.412 INFO:tasks.workunit.client.0.smithi086.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-09-19T06:38:47.414 INFO:tasks.workunit.client.0.smithi086.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-09-19T06:38:47.415 INFO:tasks.workunit.client.0.smithi086.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-09-19T06:38:47.415 INFO:tasks.workunit.client.0.smithi086.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-09-19T06:38:47.415 INFO:tasks.workunit.client.0.smithi086.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-09-19T06:38:47.415 INFO:tasks.workunit.client.0.smithi086.stderr: any GNU archive site. 2024-09-19T06:38:47.417 INFO:tasks.workunit.client.0.smithi086.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-09-19T06:38:47.418 INFO:tasks.workunit.client.0.smithi086.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-09-19T06:38:47.419 INFO:tasks.workunit.client.0.smithi086.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-09-19T06:38:47.419 INFO:tasks.workunit.client.0.smithi086.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-09-19T06:38:47.419 INFO:tasks.workunit.client.0.smithi086.stderr: You might want to install the `Automake' and `Perl' packages. 2024-09-19T06:38:47.419 INFO:tasks.workunit.client.0.smithi086.stderr: Grab them from any GNU archive site. 2024-09-19T06:38:47.455 INFO:tasks.workunit.client.0.smithi086.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-09-19T06:38:47.775 INFO:tasks.workunit.client.0.smithi086.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-09-19T06:38:47.776 INFO:tasks.workunit.client.0.smithi086.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-09-19T06:38:47.776 INFO:tasks.workunit.client.0.smithi086.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-09-19T06:38:47.776 INFO:tasks.workunit.client.0.smithi086.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-09-19T06:38:48.700 INFO:tasks.workunit.client.0.smithi086.stdout:/bin/sh ./config.status --recheck 2024-09-19T06:38:49.192 INFO:tasks.workunit.client.0.smithi086.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-09-19T06:38:49.300 INFO:tasks.workunit.client.0.smithi086.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-19T06:38:50.308 INFO:tasks.workunit.client.0.smithi086.stdout:checking whether build environment is sane... yes 2024-09-19T06:38:50.313 INFO:tasks.workunit.client.0.smithi086.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-19T06:38:50.313 INFO:tasks.workunit.client.0.smithi086.stdout:checking for gawk... gawk 2024-09-19T06:38:50.329 INFO:tasks.workunit.client.0.smithi086.stdout:checking whether make sets $(MAKE)... yes 2024-09-19T06:38:50.362 INFO:tasks.workunit.client.0.smithi086.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-19T06:38:50.362 INFO:tasks.workunit.client.0.smithi086.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-19T06:38:50.373 INFO:tasks.workunit.client.0.smithi086.stdout:checking for style of include used by make... GNU 2024-09-19T06:38:50.378 INFO:tasks.workunit.client.0.smithi086.stdout:checking for gcc... gcc 2024-09-19T06:38:51.219 INFO:tasks.workunit.client.0.smithi086.stdout:checking whether the C compiler works... yes 2024-09-19T06:38:51.219 INFO:tasks.workunit.client.0.smithi086.stdout:checking for C compiler default output file name... a.out 2024-09-19T06:38:51.259 INFO:tasks.workunit.client.0.smithi086.stdout:checking for suffix of executables... 2024-09-19T06:38:51.299 INFO:tasks.workunit.client.0.smithi086.stdout:checking whether we are cross compiling... no 2024-09-19T06:38:51.337 INFO:tasks.workunit.client.0.smithi086.stdout:checking for suffix of object files... o 2024-09-19T06:38:51.362 INFO:tasks.workunit.client.0.smithi086.stdout:checking whether we are using the GNU C compiler... yes 2024-09-19T06:38:51.386 INFO:tasks.workunit.client.0.smithi086.stdout:checking whether gcc accepts -g... yes 2024-09-19T06:38:51.423 INFO:tasks.workunit.client.0.smithi086.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-19T06:38:52.314 INFO:tasks.workunit.client.0.smithi086.stdout:checking dependency style of gcc... gcc3 2024-09-19T06:38:52.891 INFO:tasks.workunit.client.0.smithi086.stdout:checking how to run the C preprocessor... gcc -E 2024-09-19T06:38:52.943 INFO:tasks.workunit.client.0.smithi086.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-19T06:38:52.944 INFO:tasks.workunit.client.0.smithi086.stdout:checking for egrep... /usr/bin/grep -E 2024-09-19T06:38:53.071 INFO:tasks.workunit.client.0.smithi086.stdout:checking for ANSI C header files... yes 2024-09-19T06:38:53.103 INFO:tasks.workunit.client.0.smithi086.stdout:checking for sys/types.h... yes 2024-09-19T06:38:53.138 INFO:tasks.workunit.client.0.smithi086.stdout:checking for sys/stat.h... yes 2024-09-19T06:38:53.175 INFO:tasks.workunit.client.0.smithi086.stdout:checking for stdlib.h... yes 2024-09-19T06:38:53.212 INFO:tasks.workunit.client.0.smithi086.stdout:checking for string.h... yes 2024-09-19T06:38:53.250 INFO:tasks.workunit.client.0.smithi086.stdout:checking for memory.h... yes 2024-09-19T06:38:53.287 INFO:tasks.workunit.client.0.smithi086.stdout:checking for strings.h... yes 2024-09-19T06:38:53.324 INFO:tasks.workunit.client.0.smithi086.stdout:checking for inttypes.h... yes 2024-09-19T06:38:53.571 INFO:tasks.workunit.client.0.smithi086.stdout:checking for stdint.h... yes 2024-09-19T06:38:53.611 INFO:tasks.workunit.client.0.smithi086.stdout:checking for unistd.h... yes 2024-09-19T06:38:53.654 INFO:tasks.workunit.client.0.smithi086.stdout:checking minix/config.h usability... no 2024-09-19T06:38:53.679 INFO:tasks.workunit.client.0.smithi086.stdout:checking minix/config.h presence... no 2024-09-19T06:38:53.679 INFO:tasks.workunit.client.0.smithi086.stdout:checking for minix/config.h... no 2024-09-19T06:38:53.713 INFO:tasks.workunit.client.0.smithi086.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-09-19T06:38:53.713 INFO:tasks.workunit.client.0.smithi086.stdout:checking for gcc... (cached) gcc 2024-09-19T06:38:53.746 INFO:tasks.workunit.client.0.smithi086.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-19T06:38:53.746 INFO:tasks.workunit.client.0.smithi086.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-19T06:38:53.746 INFO:tasks.workunit.client.0.smithi086.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-19T06:38:53.747 INFO:tasks.workunit.client.0.smithi086.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-19T06:38:53.786 INFO:tasks.workunit.client.0.smithi086.stdout:checking for main in -lm... yes 2024-09-19T06:38:54.085 INFO:tasks.workunit.client.0.smithi086.stdout:checking for main in -lpthread... yes 2024-09-19T06:38:54.086 INFO:tasks.workunit.client.0.smithi086.stdout:checking for ANSI C header files... (cached) yes 2024-09-19T06:38:54.126 INFO:tasks.workunit.client.0.smithi086.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-19T06:38:55.143 INFO:tasks.workunit.client.0.smithi086.stdout:checking pthread.h usability... yes 2024-09-19T06:38:55.229 INFO:tasks.workunit.client.0.smithi086.stdout:checking pthread.h presence... yes 2024-09-19T06:38:55.229 INFO:tasks.workunit.client.0.smithi086.stdout:checking for pthread.h... yes 2024-09-19T06:38:55.307 INFO:tasks.workunit.client.0.smithi086.stdout:checking fcntl.h usability... yes 2024-09-19T06:38:55.328 INFO:tasks.workunit.client.0.smithi086.stdout:checking fcntl.h presence... yes 2024-09-19T06:38:55.328 INFO:tasks.workunit.client.0.smithi086.stdout:checking for fcntl.h... yes 2024-09-19T06:38:55.393 INFO:tasks.workunit.client.0.smithi086.stdout:checking limits.h usability... yes 2024-09-19T06:38:55.412 INFO:tasks.workunit.client.0.smithi086.stdout:checking limits.h presence... yes 2024-09-19T06:38:55.412 INFO:tasks.workunit.client.0.smithi086.stdout:checking for limits.h... yes 2024-09-19T06:38:55.425 INFO:tasks.workunit.client.0.smithi086.stdout:checking for stdint.h... (cached) yes 2024-09-19T06:38:55.464 INFO:tasks.workunit.client.0.smithi086.stdout:checking sys/time.h usability... yes 2024-09-19T06:38:55.494 INFO:tasks.workunit.client.0.smithi086.stdout:checking sys/time.h presence... yes 2024-09-19T06:38:55.494 INFO:tasks.workunit.client.0.smithi086.stdout:checking for sys/time.h... yes 2024-09-19T06:38:55.504 INFO:tasks.workunit.client.0.smithi086.stdout:checking for unistd.h... (cached) yes 2024-09-19T06:38:55.556 INFO:tasks.workunit.client.0.smithi086.stdout:checking sys/vfs.h usability... yes 2024-09-19T06:38:55.579 INFO:tasks.workunit.client.0.smithi086.stdout:checking sys/vfs.h presence... yes 2024-09-19T06:38:55.579 INFO:tasks.workunit.client.0.smithi086.stdout:checking for sys/vfs.h... yes 2024-09-19T06:38:55.632 INFO:tasks.workunit.client.0.smithi086.stdout:checking sys/limits.h usability... no 2024-09-19T06:38:55.657 INFO:tasks.workunit.client.0.smithi086.stdout:checking sys/limits.h presence... no 2024-09-19T06:38:55.657 INFO:tasks.workunit.client.0.smithi086.stdout:checking for sys/limits.h... no 2024-09-19T06:38:55.681 INFO:tasks.workunit.client.0.smithi086.stdout:checking for an ANSI C-conforming const... yes 2024-09-19T06:38:55.709 INFO:tasks.workunit.client.0.smithi086.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-19T06:38:55.763 INFO:tasks.workunit.client.0.smithi086.stdout:checking for system... yes 2024-09-19T06:38:55.817 INFO:tasks.workunit.client.0.smithi086.stdout:checking for gettimeofday... yes 2024-09-19T06:38:56.547 INFO:tasks.workunit.client.0.smithi086.stdout:checking for mkdir... yes 2024-09-19T06:38:56.603 INFO:tasks.workunit.client.0.smithi086.stdout:checking for strerror... yes 2024-09-19T06:38:56.659 INFO:tasks.workunit.client.0.smithi086.stdout:checking for open64... yes 2024-09-19T06:38:57.189 INFO:tasks.workunit.client.0.smithi086.stdout:checking for stat64... yes 2024-09-19T06:38:57.587 INFO:tasks.workunit.client.0.smithi086.stdout:checking for fseeko64... yes 2024-09-19T06:38:57.643 INFO:tasks.workunit.client.0.smithi086.stdout:checking for lrand48_r... yes 2024-09-19T06:38:57.697 INFO:tasks.workunit.client.0.smithi086.stdout:checking for srand48_r... yes 2024-09-19T06:38:57.719 INFO:tasks.workunit.client.0.smithi086.stdout:configure: creating ./config.status 2024-09-19T06:38:57.777 INFO:tasks.workunit.client.0.smithi086.stdout: /bin/sh ./config.status 2024-09-19T06:38:57.822 INFO:tasks.workunit.client.0.smithi086.stdout:config.status: creating Makefile 2024-09-19T06:38:57.833 INFO:tasks.workunit.client.0.smithi086.stdout:config.status: creating config.h 2024-09-19T06:38:57.852 INFO:tasks.workunit.client.0.smithi086.stdout:config.status: executing depfiles commands 2024-09-19T06:38:57.863 INFO:tasks.workunit.client.0.smithi086.stdout:config.status: executing default commands 2024-09-19T06:38:58.143 INFO:tasks.workunit.client.0.smithi086.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-09-19T06:38:59.214 INFO:tasks.workunit.client.0.smithi086.stdout:rm -f stamp-h1 2024-09-19T06:38:59.217 INFO:tasks.workunit.client.0.smithi086.stdout:touch config.h.in 2024-09-19T06:38:59.218 INFO:tasks.workunit.client.0.smithi086.stdout:cd . && /bin/sh ./config.status config.h 2024-09-19T06:38:59.264 INFO:tasks.workunit.client.0.smithi086.stdout:config.status: creating config.h 2024-09-19T06:38:59.291 INFO:tasks.workunit.client.0.smithi086.stdout:make all-am 2024-09-19T06:38:59.296 INFO:tasks.workunit.client.0.smithi086.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-19T06:38:59.296 INFO:tasks.workunit.client.0.smithi086.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-09-19T06:38:59.766 INFO:tasks.workunit.client.0.smithi086.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-09-19T06:38:59.769 INFO:tasks.workunit.client.0.smithi086.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-09-19T06:38:59.865 INFO:tasks.workunit.client.0.smithi086.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-09-19T06:38:59.868 INFO:tasks.workunit.client.0.smithi086.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-09-19T06:38:59.951 INFO:tasks.workunit.client.0.smithi086.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-09-19T06:38:59.954 INFO:tasks.workunit.client.0.smithi086.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-09-19T06:39:00.037 INFO:tasks.workunit.client.0.smithi086.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-09-19T06:39:00.040 INFO:tasks.workunit.client.0.smithi086.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-09-19T06:39:00.157 INFO:tasks.workunit.client.0.smithi086.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-09-19T06:39:00.160 INFO:tasks.workunit.client.0.smithi086.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-09-19T06:39:00.207 INFO:tasks.workunit.client.0.smithi086.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-09-19T06:39:00.210 INFO:tasks.workunit.client.0.smithi086.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-09-19T06:39:00.251 INFO:tasks.workunit.client.0.smithi086.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-09-19T06:39:00.254 INFO:tasks.workunit.client.0.smithi086.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-09-19T06:39:00.298 INFO:tasks.workunit.client.0.smithi086.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-09-19T06:39:00.302 INFO:tasks.workunit.client.0.smithi086.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-09-19T06:39:00.501 INFO:tasks.workunit.client.0.smithi086.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-09-19T06:39:00.505 INFO:tasks.workunit.client.0.smithi086.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-09-19T06:39:00.633 INFO:tasks.workunit.client.0.smithi086.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-09-19T06:39:00.635 INFO:tasks.workunit.client.0.smithi086.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-09-19T06:39:00.783 INFO:tasks.workunit.client.0.smithi086.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-09-19T06:39:00.786 INFO:tasks.workunit.client.0.smithi086.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-09-19T06:39:00.853 INFO:tasks.workunit.client.0.smithi086.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-09-19T06:39:00.855 INFO:tasks.workunit.client.0.smithi086.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-09-19T06:39:00.923 INFO:tasks.workunit.client.0.smithi086.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-09-19T06:39:00.926 INFO:tasks.workunit.client.0.smithi086.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-09-19T06:39:01.026 INFO:tasks.workunit.client.0.smithi086.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-09-19T06:39:01.028 INFO:tasks.workunit.client.0.smithi086.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-09-19T06:39:01.055 INFO:tasks.workunit.client.0.smithi086.stderr:In file included from parser.h:22, 2024-09-19T06:39:01.055 INFO:tasks.workunit.client.0.smithi086.stderr: from parser.c:25: 2024-09-19T06:39:01.055 INFO:tasks.workunit.client.0.smithi086.stderr:parser.c: In function ‘init_filesys’: 2024-09-19T06:39:01.056 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T06:39:01.056 INFO:tasks.workunit.client.0.smithi086.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T06:39:01.056 INFO:tasks.workunit.client.0.smithi086.stderr: | ^ 2024-09-19T06:39:01.056 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T06:39:01.056 INFO:tasks.workunit.client.0.smithi086.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T06:39:01.056 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~ 2024-09-19T06:39:01.056 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T06:39:01.056 INFO:tasks.workunit.client.0.smithi086.stderr: 36 | container_of(ptr, type, member) 2024-09-19T06:39:01.056 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~~~~~ 2024-09-19T06:39:01.056 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-19T06:39:01.056 INFO:tasks.workunit.client.0.smithi086.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-19T06:39:01.056 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~~~ 2024-09-19T06:39:01.057 INFO:tasks.workunit.client.0.smithi086.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T06:39:01.057 INFO:tasks.workunit.client.0.smithi086.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-19T06:39:01.057 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T06:39:01.057 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T06:39:01.057 INFO:tasks.workunit.client.0.smithi086.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T06:39:01.057 INFO:tasks.workunit.client.0.smithi086.stderr: | ^ 2024-09-19T06:39:01.057 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T06:39:01.057 INFO:tasks.workunit.client.0.smithi086.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T06:39:01.057 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~ 2024-09-19T06:39:01.057 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T06:39:01.057 INFO:tasks.workunit.client.0.smithi086.stderr: 36 | container_of(ptr, type, member) 2024-09-19T06:39:01.057 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~~~~~ 2024-09-19T06:39:01.057 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-19T06:39:01.058 INFO:tasks.workunit.client.0.smithi086.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-19T06:39:01.058 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~~~ 2024-09-19T06:39:01.058 INFO:tasks.workunit.client.0.smithi086.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T06:39:01.058 INFO:tasks.workunit.client.0.smithi086.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-19T06:39:01.058 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T06:39:01.058 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T06:39:01.058 INFO:tasks.workunit.client.0.smithi086.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T06:39:01.059 INFO:tasks.workunit.client.0.smithi086.stderr: | ^ 2024-09-19T06:39:01.059 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T06:39:01.059 INFO:tasks.workunit.client.0.smithi086.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T06:39:01.059 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~ 2024-09-19T06:39:01.059 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T06:39:01.059 INFO:tasks.workunit.client.0.smithi086.stderr: 36 | container_of(ptr, type, member) 2024-09-19T06:39:01.060 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~~~~~ 2024-09-19T06:39:01.060 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-19T06:39:01.060 INFO:tasks.workunit.client.0.smithi086.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-19T06:39:01.060 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~~~ 2024-09-19T06:39:01.060 INFO:tasks.workunit.client.0.smithi086.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T06:39:01.061 INFO:tasks.workunit.client.0.smithi086.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-19T06:39:01.061 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T06:39:01.061 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T06:39:01.061 INFO:tasks.workunit.client.0.smithi086.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T06:39:01.061 INFO:tasks.workunit.client.0.smithi086.stderr: | ^ 2024-09-19T06:39:01.062 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T06:39:01.062 INFO:tasks.workunit.client.0.smithi086.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T06:39:01.062 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~ 2024-09-19T06:39:01.062 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T06:39:01.062 INFO:tasks.workunit.client.0.smithi086.stderr: 36 | container_of(ptr, type, member) 2024-09-19T06:39:01.062 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~~~~~ 2024-09-19T06:39:01.063 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-19T06:39:01.063 INFO:tasks.workunit.client.0.smithi086.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-19T06:39:01.063 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~~~ 2024-09-19T06:39:01.063 INFO:tasks.workunit.client.0.smithi086.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T06:39:01.063 INFO:tasks.workunit.client.0.smithi086.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-19T06:39:01.063 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T06:39:01.064 INFO:tasks.workunit.client.0.smithi086.stderr:parser.c: In function ‘init_tg_stats’: 2024-09-19T06:39:01.064 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T06:39:01.064 INFO:tasks.workunit.client.0.smithi086.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T06:39:01.064 INFO:tasks.workunit.client.0.smithi086.stderr: | ^ 2024-09-19T06:39:01.064 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T06:39:01.064 INFO:tasks.workunit.client.0.smithi086.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T06:39:01.065 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~ 2024-09-19T06:39:01.065 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T06:39:01.065 INFO:tasks.workunit.client.0.smithi086.stderr: 36 | container_of(ptr, type, member) 2024-09-19T06:39:01.065 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~~~~~ 2024-09-19T06:39:01.065 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-19T06:39:01.066 INFO:tasks.workunit.client.0.smithi086.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-19T06:39:01.066 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~~~ 2024-09-19T06:39:01.066 INFO:tasks.workunit.client.0.smithi086.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T06:39:01.066 INFO:tasks.workunit.client.0.smithi086.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-19T06:39:01.066 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T06:39:01.066 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T06:39:01.067 INFO:tasks.workunit.client.0.smithi086.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T06:39:01.067 INFO:tasks.workunit.client.0.smithi086.stderr: | ^ 2024-09-19T06:39:01.067 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T06:39:01.067 INFO:tasks.workunit.client.0.smithi086.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T06:39:01.067 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~ 2024-09-19T06:39:01.068 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T06:39:01.068 INFO:tasks.workunit.client.0.smithi086.stderr: 36 | container_of(ptr, type, member) 2024-09-19T06:39:01.068 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~~~~~ 2024-09-19T06:39:01.068 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-19T06:39:01.068 INFO:tasks.workunit.client.0.smithi086.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-19T06:39:01.068 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~~~ 2024-09-19T06:39:01.068 INFO:tasks.workunit.client.0.smithi086.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T06:39:01.069 INFO:tasks.workunit.client.0.smithi086.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-19T06:39:01.069 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T06:39:01.069 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T06:39:01.069 INFO:tasks.workunit.client.0.smithi086.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T06:39:01.069 INFO:tasks.workunit.client.0.smithi086.stderr: | ^ 2024-09-19T06:39:01.069 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T06:39:01.069 INFO:tasks.workunit.client.0.smithi086.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T06:39:01.070 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~ 2024-09-19T06:39:01.070 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T06:39:01.070 INFO:tasks.workunit.client.0.smithi086.stderr: 36 | container_of(ptr, type, member) 2024-09-19T06:39:01.070 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~~~~~ 2024-09-19T06:39:01.070 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-19T06:39:01.070 INFO:tasks.workunit.client.0.smithi086.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-19T06:39:01.070 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~~~ 2024-09-19T06:39:01.071 INFO:tasks.workunit.client.0.smithi086.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T06:39:01.071 INFO:tasks.workunit.client.0.smithi086.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-19T06:39:01.071 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T06:39:01.071 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T06:39:01.071 INFO:tasks.workunit.client.0.smithi086.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T06:39:01.072 INFO:tasks.workunit.client.0.smithi086.stderr: | ^ 2024-09-19T06:39:01.072 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T06:39:01.072 INFO:tasks.workunit.client.0.smithi086.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T06:39:01.072 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~ 2024-09-19T06:39:01.072 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T06:39:01.073 INFO:tasks.workunit.client.0.smithi086.stderr: 36 | container_of(ptr, type, member) 2024-09-19T06:39:01.073 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~~~~~ 2024-09-19T06:39:01.073 INFO:tasks.workunit.client.0.smithi086.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-19T06:39:01.073 INFO:tasks.workunit.client.0.smithi086.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-19T06:39:01.073 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~~~ 2024-09-19T06:39:01.074 INFO:tasks.workunit.client.0.smithi086.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T06:39:01.074 INFO:tasks.workunit.client.0.smithi086.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-19T06:39:01.074 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T06:39:01.100 INFO:tasks.workunit.client.0.smithi086.stderr:parser.c: In function ‘get_optstr’: 2024-09-19T06:39:01.100 INFO:tasks.workunit.client.0.smithi086.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-09-19T06:39:01.100 INFO:tasks.workunit.client.0.smithi086.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-09-19T06:39:01.100 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T06:39:01.101 INFO:tasks.workunit.client.0.smithi086.stderr:parser.c:200:14: note: source object declared here 2024-09-19T06:39:01.101 INFO:tasks.workunit.client.0.smithi086.stderr: 200 | char temp[BUFSIZE]; 2024-09-19T06:39:01.101 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~ 2024-09-19T06:39:01.106 INFO:tasks.workunit.client.0.smithi086.stderr:parser.c: In function ‘size64_convert’: 2024-09-19T06:39:01.106 INFO:tasks.workunit.client.0.smithi086.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-09-19T06:39:01.106 INFO:tasks.workunit.client.0.smithi086.stderr: 119 | memcpy(unit, "\0", 3); 2024-09-19T06:39:01.107 INFO:tasks.workunit.client.0.smithi086.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-09-19T06:39:01.398 INFO:tasks.workunit.client.0.smithi086.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-09-19T06:39:01.401 INFO:tasks.workunit.client.0.smithi086.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-09-19T06:39:01.456 INFO:tasks.workunit.client.0.smithi086.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-09-19T06:39:01.458 INFO:tasks.workunit.client.0.smithi086.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-09-19T06:39:01.545 INFO:tasks.workunit.client.0.smithi086.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-09-19T06:39:01.548 INFO:tasks.workunit.client.0.smithi086.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-09-19T06:39:01.577 INFO:tasks.workunit.client.0.smithi086.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-09-19T06:39:01.580 INFO:tasks.workunit.client.0.smithi086.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-09-19T06:39:01.611 INFO:tasks.workunit.client.0.smithi086.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-19T06:39:01.611 INFO:tasks.workunit.client.0.smithi086.stderr:+ cd .. 2024-09-19T06:39:01.611 INFO:tasks.workunit.client.0.smithi086.stderr:+ mkdir tmp 2024-09-19T06:39:01.613 INFO:tasks.workunit.client.0.smithi086.stderr:+ cd tmp 2024-09-19T06:39:01.613 INFO:tasks.workunit.client.0.smithi086.stderr:+ for f in $mydir/*.ffsb 2024-09-19T06:39:01.613 INFO:tasks.workunit.client.0.smithi086.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2024-09-19T06:39:01.614 INFO:tasks.workunit.client.0.smithi086.stdout:FFSB version 6.0-RC2 started 2024-09-19T06:39:01.614 INFO:tasks.workunit.client.0.smithi086.stdout: 2024-09-19T06:39:01.617 INFO:tasks.workunit.client.0.smithi086.stdout:benchmark time = 300 2024-09-19T06:39:01.617 INFO:tasks.workunit.client.0.smithi086.stdout:ThreadGroup 0 2024-09-19T06:39:01.617 INFO:tasks.workunit.client.0.smithi086.stdout:================ 2024-09-19T06:39:01.617 INFO:tasks.workunit.client.0.smithi086.stdout: num_threads = 32 2024-09-19T06:39:01.617 INFO:tasks.workunit.client.0.smithi086.stdout: 2024-09-19T06:39:01.617 INFO:tasks.workunit.client.0.smithi086.stdout: read_random = off 2024-09-19T06:39:01.617 INFO:tasks.workunit.client.0.smithi086.stdout: read_size = 0 (0B) 2024-09-19T06:39:01.617 INFO:tasks.workunit.client.0.smithi086.stdout: read_blocksize = 0 (0B) 2024-09-19T06:39:01.617 INFO:tasks.workunit.client.0.smithi086.stdout: read_skip = off 2024-09-19T06:39:01.617 INFO:tasks.workunit.client.0.smithi086.stdout: read_skipsize = 0 (0B) 2024-09-19T06:39:01.617 INFO:tasks.workunit.client.0.smithi086.stdout: 2024-09-19T06:39:01.618 INFO:tasks.workunit.client.0.smithi086.stdout: write_random = on 2024-09-19T06:39:01.618 INFO:tasks.workunit.client.0.smithi086.stdout: write_size = 5242880 (5MB) 2024-09-19T06:39:01.618 INFO:tasks.workunit.client.0.smithi086.stdout: fsync_file = 0 2024-09-19T06:39:01.618 INFO:tasks.workunit.client.0.smithi086.stdout: write_blocksize = 4096 (4KB) 2024-09-19T06:39:01.618 INFO:tasks.workunit.client.0.smithi086.stdout: wait time = 0 2024-09-19T06:39:01.618 INFO:tasks.workunit.client.0.smithi086.stdout: 2024-09-19T06:39:01.618 INFO:tasks.workunit.client.0.smithi086.stdout: op weights 2024-09-19T06:39:01.618 INFO:tasks.workunit.client.0.smithi086.stdout: read = 0 (0.00%) 2024-09-19T06:39:01.618 INFO:tasks.workunit.client.0.smithi086.stdout: readall = 0 (0.00%) 2024-09-19T06:39:01.618 INFO:tasks.workunit.client.0.smithi086.stdout: write = 1 (100.00%) 2024-09-19T06:39:01.618 INFO:tasks.workunit.client.0.smithi086.stdout: create = 0 (0.00%) 2024-09-19T06:39:01.618 INFO:tasks.workunit.client.0.smithi086.stdout: append = 0 (0.00%) 2024-09-19T06:39:01.618 INFO:tasks.workunit.client.0.smithi086.stdout: delete = 0 (0.00%) 2024-09-19T06:39:01.619 INFO:tasks.workunit.client.0.smithi086.stdout: metaop = 0 (0.00%) 2024-09-19T06:39:01.619 INFO:tasks.workunit.client.0.smithi086.stdout: createdir = 0 (0.00%) 2024-09-19T06:39:01.619 INFO:tasks.workunit.client.0.smithi086.stdout: stat = 0 (0.00%) 2024-09-19T06:39:01.619 INFO:tasks.workunit.client.0.smithi086.stdout: writeall = 0 (0.00%) 2024-09-19T06:39:01.619 INFO:tasks.workunit.client.0.smithi086.stdout: writeall_fsync = 0 (0.00%) 2024-09-19T06:39:01.619 INFO:tasks.workunit.client.0.smithi086.stdout: open_close = 0 (0.00%) 2024-09-19T06:39:01.619 INFO:tasks.workunit.client.0.smithi086.stdout: write_fsync = 0 (0.00%) 2024-09-19T06:39:01.619 INFO:tasks.workunit.client.0.smithi086.stdout: create_fsync = 0 (0.00%) 2024-09-19T06:39:01.619 INFO:tasks.workunit.client.0.smithi086.stdout: append_fsync = 0 (0.00%) 2024-09-19T06:39:01.619 INFO:tasks.workunit.client.0.smithi086.stdout: 2024-09-19T06:39:01.620 INFO:tasks.workunit.client.0.smithi086.stdout:FileSystem . 2024-09-19T06:39:01.620 INFO:tasks.workunit.client.0.smithi086.stdout:========== 2024-09-19T06:39:01.620 INFO:tasks.workunit.client.0.smithi086.stdout: num_dirs = 0 2024-09-19T06:39:01.620 INFO:tasks.workunit.client.0.smithi086.stdout: starting files = 128 2024-09-19T06:39:01.620 INFO:tasks.workunit.client.0.smithi086.stdout: 2024-09-19T06:39:01.620 INFO:tasks.workunit.client.0.smithi086.stdout: min file size = 104857600 (100MB) 2024-09-19T06:39:01.620 INFO:tasks.workunit.client.0.smithi086.stdout: max file size = 104857600 (100MB) 2024-09-19T06:39:01.620 INFO:tasks.workunit.client.0.smithi086.stdout: directio = off 2024-09-19T06:39:01.620 INFO:tasks.workunit.client.0.smithi086.stdout: alignedio = on 2024-09-19T06:39:01.620 INFO:tasks.workunit.client.0.smithi086.stdout: bufferedio = off 2024-09-19T06:39:01.620 INFO:tasks.workunit.client.0.smithi086.stdout: 2024-09-19T06:39:01.620 INFO:tasks.workunit.client.0.smithi086.stdout: aging is off 2024-09-19T06:39:01.620 INFO:tasks.workunit.client.0.smithi086.stdout: current utilization = 0.03% 2024-09-19T06:39:01.621 INFO:tasks.workunit.client.0.smithi086.stdout: 2024-09-19T06:39:01.621 INFO:tasks.workunit.client.0.smithi086.stdout:checking existing fs: . 2024-09-19T06:39:01.621 INFO:tasks.workunit.client.0.smithi086.stdout:recreating new fileset 2024-09-19T06:39:01.621 INFO:tasks.workunit.client.0.smithi086.stderr:opendir: No such file or directory 2024-09-19T06:39:01.880 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:39:01.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.981+0000 7f425883c640 1 Processor -- start 2024-09-19T06:39:01.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.981+0000 7f425883c640 1 -- start start 2024-09-19T06:39:01.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.982+0000 7f425883c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4254152060 0x7f4254072d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:01.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.982+0000 7f425883c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f425406bd10 0x7f42540732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:01.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.982+0000 7f425883c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4254158710 con 0x7f42540c3680 2024-09-19T06:39:01.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.982+0000 7f425883c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f42540716c0 con 0x7f4254152060 2024-09-19T06:39:01.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.982+0000 7f425883c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4254152440 con 0x7f425406bd10 2024-09-19T06:39:01.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.982+0000 7f425259c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4254152060 0x7f4254072d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:01.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.982+0000 7f4251d9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f425406bd10 0x7f42540732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:01.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.982+0000 7f425259c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4254152060 0x7f4254072d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:46842/0 (socket says 172.21.15.86:46842) 2024-09-19T06:39:01.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.982+0000 7f4251d9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f425406bd10 0x7f42540732d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:54386/0 (socket says 172.21.15.86:54386) 2024-09-19T06:39:01.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.982+0000 7f425259c640 1 -- 172.21.15.86:0/1023805726 learned_addr learned my addr 172.21.15.86:0/1023805726 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:39:01.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.982+0000 7f4252d9d640 1 --1- 172.21.15.86:0/1023805726 >> v1:172.21.15.169:6789/0 conn(0x7f42540c3680 0x7f42540719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:39910/0 (socket says 172.21.15.86:39910) 2024-09-19T06:39:01.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.983+0000 7f425259c640 1 -- 172.21.15.86:0/1023805726 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f425406bd10 msgr2=0x7f42540732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:01.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.983+0000 7f425259c640 1 --2- 172.21.15.86:0/1023805726 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f425406bd10 0x7f42540732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:01.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.983+0000 7f425259c640 1 -- 172.21.15.86:0/1023805726 >> v1:172.21.15.169:6789/0 conn(0x7f42540c3680 legacy=0x7f42540719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:01.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.983+0000 7f425159a640 1 -- 172.21.15.86:0/1023805726 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 92253564 0 0) 0x7f4254158710 con 0x7f42540c3680 2024-09-19T06:39:01.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.983+0000 7f425259c640 1 -- 172.21.15.86:0/1023805726 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42541589b0 con 0x7f4254152060 2024-09-19T06:39:01.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.983+0000 7f425259c640 1 --2- 172.21.15.86:0/1023805726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4254152060 0x7f4254072d90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4244009870 tx=0x7f424402a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a8b957e99da9730 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:01.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.984+0000 7f425159a640 1 -- 172.21.15.86:0/1023805726 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4244037070 con 0x7f4254152060 2024-09-19T06:39:01.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.984+0000 7f425159a640 1 -- 172.21.15.86:0/1023805726 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f424402ae50 con 0x7f4254152060 2024-09-19T06:39:01.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.984+0000 7f425159a640 1 -- 172.21.15.86:0/1023805726 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4244032860 con 0x7f4254152060 2024-09-19T06:39:01.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.984+0000 7f425883c640 1 -- 172.21.15.86:0/1023805726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4254152060 msgr2=0x7f4254072d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:01.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.984+0000 7f425883c640 1 --2- 172.21.15.86:0/1023805726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4254152060 0x7f4254072d90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4244009870 tx=0x7f424402a300 comp rx=0 tx=0).stop 2024-09-19T06:39:01.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.984+0000 7f425883c640 1 -- 172.21.15.86:0/1023805726 shutdown_connections 2024-09-19T06:39:01.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.984+0000 7f425883c640 1 --2- 172.21.15.86:0/1023805726 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f425406bd10 0x7f42540732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:01.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.984+0000 7f425883c640 1 --2- 172.21.15.86:0/1023805726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4254152060 0x7f4254072d90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:01.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.984+0000 7f425883c640 1 -- 172.21.15.86:0/1023805726 >> 172.21.15.86:0/1023805726 conn(0x7f42540c9280 msgr2=0x7f42540c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:01.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.984+0000 7f425883c640 1 -- 172.21.15.86:0/1023805726 shutdown_connections 2024-09-19T06:39:01.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.984+0000 7f425883c640 1 -- 172.21.15.86:0/1023805726 wait complete. 2024-09-19T06:39:01.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.986+0000 7f425883c640 1 Processor -- start 2024-09-19T06:39:01.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.986+0000 7f425883c640 1 -- start start 2024-09-19T06:39:01.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.986+0000 7f425883c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f425406bd10 0x7f425414fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:01.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.986+0000 7f425883c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42540c3680 0x7f425414ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:01.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.986+0000 7f425883c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4254152060 0x7f4254149120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:01.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.986+0000 7f425883c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f42540c9e10 con 0x7f4254152060 2024-09-19T06:39:01.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.986+0000 7f425883c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4254071350 con 0x7f425406bd10 2024-09-19T06:39:01.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.986+0000 7f425883c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f42540720d0 con 0x7f42540c3680 2024-09-19T06:39:01.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.986+0000 7f4252d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4254152060 0x7f4254149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:01.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.986+0000 7f4252d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4254152060 0x7f4254149120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35262/0 (socket says 172.21.15.86:35262) 2024-09-19T06:39:01.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.986+0000 7f4252d9d640 1 -- 172.21.15.86:0/1939814869 learned_addr learned my addr 172.21.15.86:0/1939814869 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:39:01.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.987+0000 7f4251d9b640 1 --2- 172.21.15.86:0/1939814869 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42540c3680 0x7f425414ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:01.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.987+0000 7f425259c640 1 --2- 172.21.15.86:0/1939814869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f425406bd10 0x7f425414fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:01.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.987+0000 7f4252d9d640 1 -- 172.21.15.86:0/1939814869 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42540c3680 msgr2=0x7f425414ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:01.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.987+0000 7f4252d9d640 1 --2- 172.21.15.86:0/1939814869 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42540c3680 0x7f425414ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:01.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.987+0000 7f4252d9d640 1 -- 172.21.15.86:0/1939814869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f425406bd10 msgr2=0x7f425414fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:01.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.987+0000 7f4252d9d640 1 --2- 172.21.15.86:0/1939814869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f425406bd10 0x7f425414fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:01.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.987+0000 7f4252d9d640 1 -- 172.21.15.86:0/1939814869 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42541537e0 con 0x7f4254152060 2024-09-19T06:39:01.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.987+0000 7f425259c640 1 --2- 172.21.15.86:0/1939814869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f425406bd10 0x7f425414fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:01.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.987+0000 7f4252d9d640 1 --2- 172.21.15.86:0/1939814869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4254152060 0x7f4254149120 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f424c00c7a0 tx=0x7f424c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:01.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.987+0000 7f4242ffd640 1 -- 172.21.15.86:0/1939814869 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c018070 con 0x7f4254152060 2024-09-19T06:39:01.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.987+0000 7f4242ffd640 1 -- 172.21.15.86:0/1939814869 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f424c00a640 con 0x7f4254152060 2024-09-19T06:39:01.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.987+0000 7f425883c640 1 -- 172.21.15.86:0/1939814869 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f425414c8b0 con 0x7f4254152060 2024-09-19T06:39:01.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.987+0000 7f4242ffd640 1 -- 172.21.15.86:0/1939814869 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c00aab0 con 0x7f4254152060 2024-09-19T06:39:01.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.987+0000 7f425883c640 1 -- 172.21.15.86:0/1939814869 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f425414ce70 con 0x7f4254152060 2024-09-19T06:39:01.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.988+0000 7f425883c640 1 -- 172.21.15.86:0/1939814869 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4254072490 con 0x7f4254152060 2024-09-19T06:39:01.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.989+0000 7f4242ffd640 1 -- 172.21.15.86:0/1939814869 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f424c00ac50 con 0x7f4254152060 2024-09-19T06:39:01.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.989+0000 7f4242ffd640 1 --2- 172.21.15.86:0/1939814869 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f423406c2b0 0x7f423406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:01.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.989+0000 7f4242ffd640 1 -- 172.21.15.86:0/1939814869 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f424c08af40 con 0x7f4254152060 2024-09-19T06:39:01.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.989+0000 7f425259c640 1 --2- 172.21.15.86:0/1939814869 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f423406c2b0 0x7f423406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:01.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.990+0000 7f425259c640 1 --2- 172.21.15.86:0/1939814869 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f423406c2b0 0x7f423406e770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4244034000 tx=0x7f424402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:01.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:01.993+0000 7f4242ffd640 1 -- 172.21.15.86:0/1939814869 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f424c059230 con 0x7f4254152060 2024-09-19T06:39:02.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.198+0000 7f425883c640 1 -- 172.21.15.86:0/1939814869 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42541539b0 con 0x7f4254152060 2024-09-19T06:39:02.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.198+0000 7f4242ffd640 1 -- 172.21.15.86:0/1939814869 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6871 (secure 0 0 0) 0x7f424c058b30 con 0x7f4254152060 2024-09-19T06:39:02.200 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:39:02.200 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":9,"btime":"2024-09-19T06:37:28:505383+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:37:27.843067+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6837/201961024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":201961024},{"type":"v1","addr":"172.21.15.169:6837","nonce":201961024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-09-19T06:39:02.200 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 9 2024-09-19T06:39:02.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.200+0000 7f425883c640 1 -- 172.21.15.86:0/1939814869 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f423406c2b0 msgr2=0x7f423406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:02.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.200+0000 7f425883c640 1 --2- 172.21.15.86:0/1939814869 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f423406c2b0 0x7f423406e770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4244034000 tx=0x7f424402e000 comp rx=0 tx=0).stop 2024-09-19T06:39:02.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.200+0000 7f425883c640 1 -- 172.21.15.86:0/1939814869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4254152060 msgr2=0x7f4254149120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:02.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.200+0000 7f425883c640 1 --2- 172.21.15.86:0/1939814869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4254152060 0x7f4254149120 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f424c00c7a0 tx=0x7f424c00cc60 comp rx=0 tx=0).stop 2024-09-19T06:39:02.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.200+0000 7f425883c640 1 -- 172.21.15.86:0/1939814869 shutdown_connections 2024-09-19T06:39:02.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.200+0000 7f425883c640 1 --2- 172.21.15.86:0/1939814869 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f423406c2b0 0x7f423406e770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:02.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.200+0000 7f425883c640 1 --2- 172.21.15.86:0/1939814869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4254152060 0x7f4254149120 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:02.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.200+0000 7f425883c640 1 --2- 172.21.15.86:0/1939814869 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42540c3680 0x7f425414ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:02.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.200+0000 7f425883c640 1 --2- 172.21.15.86:0/1939814869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f425406bd10 0x7f425414fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:02.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.200+0000 7f425883c640 1 -- 172.21.15.86:0/1939814869 >> 172.21.15.86:0/1939814869 conn(0x7f42540c9280 msgr2=0x7f425414b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:02.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.200+0000 7f425883c640 1 -- 172.21.15.86:0/1939814869 shutdown_connections 2024-09-19T06:39:02.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.200+0000 7f425883c640 1 -- 172.21.15.86:0/1939814869 wait complete. 2024-09-19T06:39:02.214 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.d (rank=0) 2024-09-19T06:39:02.214 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T06:39:02.214 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:39:02.224 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T06:39:02.224 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:39:02.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.320+0000 7f2cce83c640 1 Processor -- start 2024-09-19T06:39:02.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.320+0000 7f2cce83c640 1 -- start start 2024-09-19T06:39:02.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.321+0000 7f2cce83c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2cc8152c20 0x7f2cc8153000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:02.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.321+0000 7f2cce83c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2cc80c64a0 0x7f2cc80c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:02.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.321+0000 7f2cce83c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2cc80c7310 0x7f2cc80c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:02.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.321+0000 7f2cce83c640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f2cc8158d70 con 0x7f2cc80c64a0 2024-09-19T06:39:02.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.321+0000 7f2cce83c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f2cc80c3d20 con 0x7f2cc80c7310 2024-09-19T06:39:02.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.321+0000 7f2cce83c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2cc80c4000 con 0x7f2cc8152c20 2024-09-19T06:39:02.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.321+0000 7f2cc77fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2cc80c64a0 0x7f2cc80c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:02.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.321+0000 7f2cc77fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2cc80c64a0 0x7f2cc80c68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56242/0 (socket says 172.21.15.86:56242) 2024-09-19T06:39:02.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.321+0000 7f2cc77fe640 1 -- 172.21.15.86:0/1329286039 learned_addr learned my addr 172.21.15.86:0/1329286039 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:39:02.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.321+0000 7f2cccdd9640 1 --2- 172.21.15.86:0/1329286039 >> v2:172.21.15.169:3300/0 conn(0x7f2cc80c7310 0x7f2cc80c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:02.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.321+0000 7f2cc7fff640 1 --2- 172.21.15.86:0/1329286039 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2cc8152c20 0x7f2cc8153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:02.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.321+0000 7f2cc77fe640 1 -- 172.21.15.86:0/1329286039 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2cc8152c20 msgr2=0x7f2cc8153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:02.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.321+0000 7f2cc77fe640 1 --2- 172.21.15.86:0/1329286039 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2cc8152c20 0x7f2cc8153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:02.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.321+0000 7f2cc77fe640 1 -- 172.21.15.86:0/1329286039 >> v2:172.21.15.169:3300/0 conn(0x7f2cc80c7310 msgr2=0x7f2cc80c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:02.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.321+0000 7f2cc77fe640 1 --2- 172.21.15.86:0/1329286039 >> v2:172.21.15.169:3300/0 conn(0x7f2cc80c7310 0x7f2cc80c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:02.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.321+0000 7f2cc77fe640 1 -- 172.21.15.86:0/1329286039 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc80c42e0 con 0x7f2cc80c64a0 2024-09-19T06:39:02.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.322+0000 7f2cc77fe640 1 --2- 172.21.15.86:0/1329286039 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cc80c64a0 0x7f2cc80c68e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80c9e70 tx=0x7f2cbc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47824f175a24f198 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:02.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.322+0000 7f2cc6ffd640 1 -- 172.21.15.86:0/1329286039 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc037070 con 0x7f2cc80c64a0 2024-09-19T06:39:02.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.322+0000 7f2cc6ffd640 1 -- 172.21.15.86:0/1329286039 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cbc032440 con 0x7f2cc80c64a0 2024-09-19T06:39:02.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.322+0000 7f2cc6ffd640 1 -- 172.21.15.86:0/1329286039 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc032810 con 0x7f2cc80c64a0 2024-09-19T06:39:02.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.322+0000 7f2cce83c640 1 -- 172.21.15.86:0/1329286039 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cc80c64a0 msgr2=0x7f2cc80c68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:02.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.322+0000 7f2cce83c640 1 --2- 172.21.15.86:0/1329286039 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cc80c64a0 0x7f2cc80c68e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80c9e70 tx=0x7f2cbc02a270 comp rx=0 tx=0).stop 2024-09-19T06:39:02.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.322+0000 7f2cce83c640 1 -- 172.21.15.86:0/1329286039 shutdown_connections 2024-09-19T06:39:02.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.322+0000 7f2cce83c640 1 --2- 172.21.15.86:0/1329286039 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cc80c64a0 0x7f2cc80c68e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:02.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.322+0000 7f2cce83c640 1 --2- 172.21.15.86:0/1329286039 >> v2:172.21.15.169:3300/0 conn(0x7f2cc80c7310 0x7f2cc80c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:02.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.322+0000 7f2cce83c640 1 --2- 172.21.15.86:0/1329286039 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2cc8152c20 0x7f2cc8153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:02.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.322+0000 7f2cce83c640 1 -- 172.21.15.86:0/1329286039 >> 172.21.15.86:0/1329286039 conn(0x7f2cc80c9280 msgr2=0x7f2cc80c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:02.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.323+0000 7f2cce83c640 1 -- 172.21.15.86:0/1329286039 shutdown_connections 2024-09-19T06:39:02.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.323+0000 7f2cce83c640 1 -- 172.21.15.86:0/1329286039 wait complete. 2024-09-19T06:39:02.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.324+0000 7f2cce83c640 1 Processor -- start 2024-09-19T06:39:02.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.324+0000 7f2cce83c640 1 -- start start 2024-09-19T06:39:02.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.324+0000 7f2cce83c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cc80c64a0 0x7f2cc8151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:02.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.324+0000 7f2cce83c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2cc80c7310 0x7f2cc814af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:02.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.325+0000 7f2cce83c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2cc8152c20 0x7f2cc80c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:02.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.325+0000 7f2cce83c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc80c48a0 con 0x7f2cc80c64a0 2024-09-19T06:39:02.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.325+0000 7f2cce83c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc806d900 con 0x7f2cc80c7310 2024-09-19T06:39:02.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.325+0000 7f2cce83c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2cc80c4a20 con 0x7f2cc8152c20 2024-09-19T06:39:02.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.325+0000 7f2cc7fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cc80c64a0 0x7f2cc8151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:02.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.325+0000 7f2cc7fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cc80c64a0 0x7f2cc8151700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56252/0 (socket says 172.21.15.86:56252) 2024-09-19T06:39:02.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.325+0000 7f2cc7fff640 1 -- 172.21.15.86:0/3170321434 learned_addr learned my addr 172.21.15.86:0/3170321434 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:39:02.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.325+0000 7f2cc77fe640 1 --2- 172.21.15.86:0/3170321434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2cc80c7310 0x7f2cc814af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:02.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.325+0000 7f2cccdd9640 1 --2- 172.21.15.86:0/3170321434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2cc8152c20 0x7f2cc80c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:02.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.325+0000 7f2cc7fff640 1 -- 172.21.15.86:0/3170321434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2cc8152c20 msgr2=0x7f2cc80c2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:02.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.325+0000 7f2cc7fff640 1 --2- 172.21.15.86:0/3170321434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2cc8152c20 0x7f2cc80c2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:02.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.325+0000 7f2cc7fff640 1 -- 172.21.15.86:0/3170321434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2cc80c7310 msgr2=0x7f2cc814af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:02.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.325+0000 7f2cc7fff640 1 --2- 172.21.15.86:0/3170321434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2cc80c7310 0x7f2cc814af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:02.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.325+0000 7f2cc7fff640 1 -- 172.21.15.86:0/3170321434 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc81f0910 con 0x7f2cc80c64a0 2024-09-19T06:39:02.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.325+0000 7f2cc7fff640 1 --2- 172.21.15.86:0/3170321434 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cc80c64a0 0x7f2cc8151700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2cb800d5f0 tx=0x7f2cb800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:02.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.325+0000 7f2cc4ff9640 1 -- 172.21.15.86:0/3170321434 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb80125f0 con 0x7f2cc80c64a0 2024-09-19T06:39:02.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.325+0000 7f2cc4ff9640 1 -- 172.21.15.86:0/3170321434 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb8019070 con 0x7f2cc80c64a0 2024-09-19T06:39:02.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.325+0000 7f2cce83c640 1 -- 172.21.15.86:0/3170321434 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc8071120 con 0x7f2cc80c64a0 2024-09-19T06:39:02.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.325+0000 7f2cc4ff9640 1 -- 172.21.15.86:0/3170321434 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb80129d0 con 0x7f2cc80c64a0 2024-09-19T06:39:02.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.325+0000 7f2cce83c640 1 -- 172.21.15.86:0/3170321434 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc80716e0 con 0x7f2cc80c64a0 2024-09-19T06:39:02.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.326+0000 7f2cce83c640 1 -- 172.21.15.86:0/3170321434 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cc80c68e0 con 0x7f2cc80c64a0 2024-09-19T06:39:02.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.327+0000 7f2cc4ff9640 1 -- 172.21.15.86:0/3170321434 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2cb8012b70 con 0x7f2cc80c64a0 2024-09-19T06:39:02.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.327+0000 7f2cc4ff9640 1 --2- 172.21.15.86:0/3170321434 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2cb406c2e0 0x7f2cb406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:02.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.327+0000 7f2cc4ff9640 1 -- 172.21.15.86:0/3170321434 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f2cb808b9e0 con 0x7f2cc80c64a0 2024-09-19T06:39:02.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.327+0000 7f2cc77fe640 1 --2- 172.21.15.86:0/3170321434 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2cb406c2e0 0x7f2cb406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:02.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.328+0000 7f2cc77fe640 1 --2- 172.21.15.86:0/3170321434 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2cb406c2e0 0x7f2cb406e7a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc034000 tx=0x7f2cbc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:02.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.331+0000 7f2cc4ff9640 1 -- 172.21.15.86:0/3170321434 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2cb8059790 con 0x7f2cc80c64a0 2024-09-19T06:39:02.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.534+0000 7f2cce83c640 1 -- 172.21.15.86:0/3170321434 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2cc80c3550 con 0x7f2cc80c64a0 2024-09-19T06:39:02.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.535+0000 7f2cc4ff9640 1 -- 172.21.15.86:0/3170321434 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6871 (secure 0 0 0) 0x7f2cb805da90 con 0x7f2cc80c64a0 2024-09-19T06:39:02.537 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:39:02.537 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":9,"btime":"2024-09-19T06:37:28:505383+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:37:27.843067+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6837/201961024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":201961024},{"type":"v1","addr":"172.21.15.169:6837","nonce":201961024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-09-19T06:39:02.537 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 9 2024-09-19T06:39:02.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.537+0000 7f2cce83c640 1 -- 172.21.15.86:0/3170321434 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2cb406c2e0 msgr2=0x7f2cb406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:02.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.537+0000 7f2cce83c640 1 --2- 172.21.15.86:0/3170321434 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2cb406c2e0 0x7f2cb406e7a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc034000 tx=0x7f2cbc02e000 comp rx=0 tx=0).stop 2024-09-19T06:39:02.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.537+0000 7f2cce83c640 1 -- 172.21.15.86:0/3170321434 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cc80c64a0 msgr2=0x7f2cc8151700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:02.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.537+0000 7f2cce83c640 1 --2- 172.21.15.86:0/3170321434 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cc80c64a0 0x7f2cc8151700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2cb800d5f0 tx=0x7f2cb800dab0 comp rx=0 tx=0).stop 2024-09-19T06:39:02.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.537+0000 7f2cce83c640 1 -- 172.21.15.86:0/3170321434 shutdown_connections 2024-09-19T06:39:02.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.537+0000 7f2cce83c640 1 --2- 172.21.15.86:0/3170321434 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2cb406c2e0 0x7f2cb406e7a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:02.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.537+0000 7f2cce83c640 1 --2- 172.21.15.86:0/3170321434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2cc8152c20 0x7f2cc80c2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:02.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.537+0000 7f2cce83c640 1 --2- 172.21.15.86:0/3170321434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2cc80c7310 0x7f2cc814af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:02.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.537+0000 7f2cce83c640 1 --2- 172.21.15.86:0/3170321434 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cc80c64a0 0x7f2cc8151700 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:02.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.537+0000 7f2cce83c640 1 -- 172.21.15.86:0/3170321434 >> 172.21.15.86:0/3170321434 conn(0x7f2cc80c9280 msgr2=0x7f2cc80c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:02.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.537+0000 7f2cce83c640 1 -- 172.21.15.86:0/3170321434 shutdown_connections 2024-09-19T06:39:02.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:02.537+0000 7f2cce83c640 1 -- 172.21.15.86:0/3170321434 wait complete. 2024-09-19T06:39:02.549 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-09-19T06:39:04.550 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:39:04.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.710+0000 7fb0e2118640 1 Processor -- start 2024-09-19T06:39:04.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.711+0000 7fb0e2118640 1 -- start start 2024-09-19T06:39:04.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.712+0000 7fb0e2118640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb0dc0d1120 0x7fb0dc15da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:04.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.712+0000 7fb0e2118640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0dc15e410 con 0x7fb0dc0d0d40 2024-09-19T06:39:04.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.712+0000 7fb0e2118640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0dc15c9c0 con 0x7fb0dc15dfa0 2024-09-19T06:39:04.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.712+0000 7fb0e2118640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fb0dc15c770 con 0x7fb0dc0d1120 2024-09-19T06:39:04.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.712+0000 7fb0db7fe640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb0dc0d0d40 0x7fb0dc0ca6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:43838/0 (socket says 172.21.15.86:43838) 2024-09-19T06:39:04.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.712+0000 7fb0db7fe640 1 -- 172.21.15.86:0/2786085177 learned_addr learned my addr 172.21.15.86:0/2786085177 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:39:04.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.712+0000 7fb0daffd640 1 --2- 172.21.15.86:0/2786085177 >> v2:172.21.15.169:3300/0 conn(0x7fb0dc0d1120 0x7fb0dc15da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:04.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.712+0000 7fb0da7fc640 1 -- 172.21.15.86:0/2786085177 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2173526734 0 0) 0x7fb0dc15e410 con 0x7fb0dc0d0d40 2024-09-19T06:39:04.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.712+0000 7fb0da7fc640 1 -- 172.21.15.86:0/2786085177 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0c4003520 con 0x7fb0dc0d0d40 2024-09-19T06:39:04.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.712+0000 7fb0da7fc640 1 -- 172.21.15.86:0/2786085177 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 989640749 0 0) 0x7fb0dc15c9c0 con 0x7fb0dc15dfa0 2024-09-19T06:39:04.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.713+0000 7fb0da7fc640 1 -- 172.21.15.86:0/2786085177 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0dc15e410 con 0x7fb0dc15dfa0 2024-09-19T06:39:04.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.713+0000 7fb0daffd640 1 -- 172.21.15.86:0/2786085177 >> v1:172.21.15.169:6789/0 conn(0x7fb0dc15dfa0 legacy=0x7fb0dc0b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:04.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.713+0000 7fb0daffd640 1 -- 172.21.15.86:0/2786085177 >> v1:172.21.15.86:6789/0 conn(0x7fb0dc0d0d40 legacy=0x7fb0dc0ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:04.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.713+0000 7fb0daffd640 1 -- 172.21.15.86:0/2786085177 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0dc15cca0 con 0x7fb0dc0d1120 2024-09-19T06:39:04.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.714+0000 7fb0daffd640 1 --2- 172.21.15.86:0/2786085177 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0dc0d1120 0x7fb0dc15da60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb0d00097a0 tx=0x7fb0d002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ee4f559b7bc6bc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:04.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.714+0000 7fb0da7fc640 1 -- 172.21.15.86:0/2786085177 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0037070 con 0x7fb0dc0d1120 2024-09-19T06:39:04.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.714+0000 7fb0da7fc640 1 -- 172.21.15.86:0/2786085177 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d0032440 con 0x7fb0dc0d1120 2024-09-19T06:39:04.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.714+0000 7fb0da7fc640 1 -- 172.21.15.86:0/2786085177 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0032810 con 0x7fb0dc0d1120 2024-09-19T06:39:04.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.714+0000 7fb0e2118640 1 -- 172.21.15.86:0/2786085177 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0dc0d1120 msgr2=0x7fb0dc15da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:04.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.714+0000 7fb0e2118640 1 --2- 172.21.15.86:0/2786085177 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0dc0d1120 0x7fb0dc15da60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb0d00097a0 tx=0x7fb0d002a230 comp rx=0 tx=0).stop 2024-09-19T06:39:04.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.715+0000 7fb0e2118640 1 -- 172.21.15.86:0/2786085177 shutdown_connections 2024-09-19T06:39:04.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.715+0000 7fb0e2118640 1 --2- 172.21.15.86:0/2786085177 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0dc0d1120 0x7fb0dc15da60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:04.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.715+0000 7fb0e2118640 1 -- 172.21.15.86:0/2786085177 >> 172.21.15.86:0/2786085177 conn(0x7fb0dc06d910 msgr2=0x7fb0dc06dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:04.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.715+0000 7fb0e2118640 1 -- 172.21.15.86:0/2786085177 shutdown_connections 2024-09-19T06:39:04.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.715+0000 7fb0e2118640 1 -- 172.21.15.86:0/2786085177 wait complete. 2024-09-19T06:39:04.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.716+0000 7fb0e2118640 1 Processor -- start 2024-09-19T06:39:04.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.716+0000 7fb0e2118640 1 -- start start 2024-09-19T06:39:04.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.717+0000 7fb0e2118640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0dc0d0d40 0x7fb0dc0c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:04.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.717+0000 7fb0e2118640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb0dc0d1120 0x7fb0dc0c7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:04.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.717+0000 7fb0e2118640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0dc15dfa0 0x7fb0dc15e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:04.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.717+0000 7fb0e2118640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc15d260 con 0x7fb0dc15dfa0 2024-09-19T06:39:04.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.717+0000 7fb0e2118640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc0b3f20 con 0x7fb0dc0d0d40 2024-09-19T06:39:04.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.717+0000 7fb0e2118640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb0dc0cadd0 con 0x7fb0dc0d1120 2024-09-19T06:39:04.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.717+0000 7fb0db7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0dc0d0d40 0x7fb0dc0c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:04.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.717+0000 7fb0daffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb0dc0d1120 0x7fb0dc0c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:04.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.717+0000 7fb0dbfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0dc15dfa0 0x7fb0dc15e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:04.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.717+0000 7fb0db7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0dc0d0d40 0x7fb0dc0c5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:58656/0 (socket says 172.21.15.86:58656) 2024-09-19T06:39:04.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.717+0000 7fb0db7fe640 1 -- 172.21.15.86:0/3737063982 learned_addr learned my addr 172.21.15.86:0/3737063982 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:39:04.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.718+0000 7fb0dbfff640 1 -- 172.21.15.86:0/3737063982 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb0dc0d1120 msgr2=0x7fb0dc0c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:04.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.718+0000 7fb0dbfff640 1 --2- 172.21.15.86:0/3737063982 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb0dc0d1120 0x7fb0dc0c7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:04.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.718+0000 7fb0dbfff640 1 -- 172.21.15.86:0/3737063982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0dc0d0d40 msgr2=0x7fb0dc0c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:04.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.718+0000 7fb0dbfff640 1 --2- 172.21.15.86:0/3737063982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0dc0d0d40 0x7fb0dc0c5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:04.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.718+0000 7fb0dbfff640 1 -- 172.21.15.86:0/3737063982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0dc0c4e20 con 0x7fb0dc15dfa0 2024-09-19T06:39:04.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.718+0000 7fb0db7fe640 1 --2- 172.21.15.86:0/3737063982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0dc0d0d40 0x7fb0dc0c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:39:04.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.718+0000 7fb0dbfff640 1 --2- 172.21.15.86:0/3737063982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0dc15dfa0 0x7fb0dc15e870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400c760 tx=0x7fb0d400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:04.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.718+0000 7fb0c3fff640 1 -- 172.21.15.86:0/3737063982 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d4003b70 con 0x7fb0dc15dfa0 2024-09-19T06:39:04.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.718+0000 7fb0c3fff640 1 -- 172.21.15.86:0/3737063982 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d4003d30 con 0x7fb0dc15dfa0 2024-09-19T06:39:04.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.718+0000 7fb0e2118640 1 -- 172.21.15.86:0/3737063982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0dc0c50a0 con 0x7fb0dc15dfa0 2024-09-19T06:39:04.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.718+0000 7fb0c3fff640 1 -- 172.21.15.86:0/3737063982 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d4005310 con 0x7fb0dc15dfa0 2024-09-19T06:39:04.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.718+0000 7fb0e2118640 1 -- 172.21.15.86:0/3737063982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0dc0c62f0 con 0x7fb0dc15dfa0 2024-09-19T06:39:04.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.719+0000 7fb0e2118640 1 -- 172.21.15.86:0/3737063982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0dc0c6530 con 0x7fb0dc15dfa0 2024-09-19T06:39:04.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.719+0000 7fb0c3fff640 1 -- 172.21.15.86:0/3737063982 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb0d40054b0 con 0x7fb0dc15dfa0 2024-09-19T06:39:04.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.720+0000 7fb0c3fff640 1 --2- 172.21.15.86:0/3737063982 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb0c806c2b0 0x7fb0c806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:04.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.720+0000 7fb0db7fe640 1 --2- 172.21.15.86:0/3737063982 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb0c806c2b0 0x7fb0c806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:04.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.720+0000 7fb0c3fff640 1 -- 172.21.15.86:0/3737063982 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fb0d408b410 con 0x7fb0dc15dfa0 2024-09-19T06:39:04.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.720+0000 7fb0db7fe640 1 --2- 172.21.15.86:0/3737063982 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb0c806c2b0 0x7fb0c806e770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc000f60 tx=0x7fb0cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:04.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.724+0000 7fb0c3fff640 1 -- 172.21.15.86:0/3737063982 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb0dc0c6530 con 0x7fb0dc15dfa0 2024-09-19T06:39:04.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.924+0000 7fb0e2118640 1 -- 172.21.15.86:0/3737063982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0dc0b57d0 con 0x7fb0dc15dfa0 2024-09-19T06:39:04.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.925+0000 7fb0c3fff640 1 -- 172.21.15.86:0/3737063982 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6871 (secure 0 0 0) 0x7fb0dc0c4e20 con 0x7fb0dc15dfa0 2024-09-19T06:39:04.926 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:39:04.926 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":9,"btime":"2024-09-19T06:37:28:505383+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:37:27.843067+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6837/201961024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":201961024},{"type":"v1","addr":"172.21.15.169:6837","nonce":201961024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-09-19T06:39:04.927 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 9 2024-09-19T06:39:04.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.927+0000 7fb0e2118640 1 -- 172.21.15.86:0/3737063982 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb0c806c2b0 msgr2=0x7fb0c806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:04.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.927+0000 7fb0e2118640 1 --2- 172.21.15.86:0/3737063982 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb0c806c2b0 0x7fb0c806e770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc000f60 tx=0x7fb0cc009040 comp rx=0 tx=0).stop 2024-09-19T06:39:04.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.927+0000 7fb0e2118640 1 -- 172.21.15.86:0/3737063982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0dc15dfa0 msgr2=0x7fb0dc15e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:04.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.927+0000 7fb0e2118640 1 --2- 172.21.15.86:0/3737063982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0dc15dfa0 0x7fb0dc15e870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400c760 tx=0x7fb0d400cc20 comp rx=0 tx=0).stop 2024-09-19T06:39:04.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.927+0000 7fb0e2118640 1 -- 172.21.15.86:0/3737063982 shutdown_connections 2024-09-19T06:39:04.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.927+0000 7fb0e2118640 1 --2- 172.21.15.86:0/3737063982 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb0c806c2b0 0x7fb0c806e770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:04.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.927+0000 7fb0e2118640 1 --2- 172.21.15.86:0/3737063982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0dc15dfa0 0x7fb0dc15e870 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:04.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.927+0000 7fb0e2118640 1 --2- 172.21.15.86:0/3737063982 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb0dc0d1120 0x7fb0dc0c7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:04.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.927+0000 7fb0e2118640 1 --2- 172.21.15.86:0/3737063982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0dc0d0d40 0x7fb0dc0c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:04.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.927+0000 7fb0e2118640 1 -- 172.21.15.86:0/3737063982 >> 172.21.15.86:0/3737063982 conn(0x7fb0dc06d910 msgr2=0x7fb0dc0ca490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:04.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.927+0000 7fb0e2118640 1 -- 172.21.15.86:0/3737063982 shutdown_connections 2024-09-19T06:39:04.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:04.927+0000 7fb0e2118640 1 -- 172.21.15.86:0/3737063982 wait complete. 2024-09-19T06:39:04.940 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-09-19T06:39:06.941 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:39:07.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.049+0000 7fda78911640 1 Processor -- start 2024-09-19T06:39:07.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.050+0000 7fda78911640 1 -- start start 2024-09-19T06:39:07.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.050+0000 7fda78911640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fda74152060 0x7fda74072d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:07.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.050+0000 7fda78911640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda740c3680 0x7fda740732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:07.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.050+0000 7fda78911640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda74158710 con 0x7fda7406bd10 2024-09-19T06:39:07.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.051+0000 7fda78911640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fda740716c0 con 0x7fda74152060 2024-09-19T06:39:07.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.051+0000 7fda78911640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fda74152440 con 0x7fda740c3680 2024-09-19T06:39:07.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.051+0000 7fda72d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda740c3680 0x7fda740732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:07.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.051+0000 7fda7259c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fda74152060 0x7fda74072d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:07.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.051+0000 7fda71d9b640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fda7406bd10 0x7fda740719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:51742/0 (socket says 172.21.15.86:51742) 2024-09-19T06:39:07.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.051+0000 7fda71d9b640 1 -- 172.21.15.86:0/1742819385 learned_addr learned my addr 172.21.15.86:0/1742819385 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:39:07.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.051+0000 7fda7259c640 1 -- 172.21.15.86:0/1742819385 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda740c3680 msgr2=0x7fda740732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:07.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.051+0000 7fda7259c640 1 --2- 172.21.15.86:0/1742819385 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda740c3680 0x7fda740732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.051+0000 7fda7259c640 1 -- 172.21.15.86:0/1742819385 >> v1:172.21.15.169:6789/0 conn(0x7fda7406bd10 legacy=0x7fda740719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:07.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.051+0000 7fda7259c640 1 -- 172.21.15.86:0/1742819385 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda741589b0 con 0x7fda74152060 2024-09-19T06:39:07.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.052+0000 7fda7259c640 1 --2- 172.21.15.86:0/1742819385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda74152060 0x7fda74072d90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fda74071840 tx=0x7fda6402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cddbb6baf007e6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:07.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.052+0000 7fda7159a640 1 -- 172.21.15.86:0/1742819385 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda64037070 con 0x7fda74152060 2024-09-19T06:39:07.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.052+0000 7fda7159a640 1 -- 172.21.15.86:0/1742819385 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda64032440 con 0x7fda74152060 2024-09-19T06:39:07.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.052+0000 7fda7159a640 1 -- 172.21.15.86:0/1742819385 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda64032810 con 0x7fda74152060 2024-09-19T06:39:07.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.053+0000 7fda78911640 1 -- 172.21.15.86:0/1742819385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda74152060 msgr2=0x7fda74072d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:07.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.053+0000 7fda78911640 1 --2- 172.21.15.86:0/1742819385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda74152060 0x7fda74072d90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fda74071840 tx=0x7fda6402a210 comp rx=0 tx=0).stop 2024-09-19T06:39:07.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.053+0000 7fda78911640 1 -- 172.21.15.86:0/1742819385 shutdown_connections 2024-09-19T06:39:07.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.053+0000 7fda78911640 1 --2- 172.21.15.86:0/1742819385 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda740c3680 0x7fda740732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.053+0000 7fda78911640 1 --2- 172.21.15.86:0/1742819385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda74152060 0x7fda74072d90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.053+0000 7fda78911640 1 -- 172.21.15.86:0/1742819385 >> 172.21.15.86:0/1742819385 conn(0x7fda740c9280 msgr2=0x7fda740c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:07.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.053+0000 7fda78911640 1 -- 172.21.15.86:0/1742819385 shutdown_connections 2024-09-19T06:39:07.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.053+0000 7fda78911640 1 -- 172.21.15.86:0/1742819385 wait complete. 2024-09-19T06:39:07.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.054+0000 7fda78911640 1 Processor -- start 2024-09-19T06:39:07.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.054+0000 7fda78911640 1 -- start start 2024-09-19T06:39:07.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.055+0000 7fda78911640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda7406bd10 0x7fda7414b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:07.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.055+0000 7fda78911640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda740c3680 0x7fda7414e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:07.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.055+0000 7fda78911640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda74152060 0x7fda7414a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:07.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.055+0000 7fda78911640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fda740c9e10 con 0x7fda7406bd10 2024-09-19T06:39:07.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.055+0000 7fda78911640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fda74071350 con 0x7fda740c3680 2024-09-19T06:39:07.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.055+0000 7fda78911640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fda740720d0 con 0x7fda74152060 2024-09-19T06:39:07.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.055+0000 7fda7259c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda7406bd10 0x7fda7414b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:07.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.055+0000 7fda7259c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda7406bd10 0x7fda7414b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56282/0 (socket says 172.21.15.86:56282) 2024-09-19T06:39:07.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.055+0000 7fda7259c640 1 -- 172.21.15.86:0/900792125 learned_addr learned my addr 172.21.15.86:0/900792125 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:39:07.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.055+0000 7fda71d9b640 1 --2- 172.21.15.86:0/900792125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda740c3680 0x7fda7414e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:07.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.055+0000 7fda72d9d640 1 --2- 172.21.15.86:0/900792125 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda74152060 0x7fda7414a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:07.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.055+0000 7fda7259c640 1 -- 172.21.15.86:0/900792125 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda74152060 msgr2=0x7fda7414a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:07.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.055+0000 7fda7259c640 1 --2- 172.21.15.86:0/900792125 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda74152060 0x7fda7414a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.056+0000 7fda7259c640 1 -- 172.21.15.86:0/900792125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda740c3680 msgr2=0x7fda7414e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:07.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.056+0000 7fda7259c640 1 --2- 172.21.15.86:0/900792125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda740c3680 0x7fda7414e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.056+0000 7fda7259c640 1 -- 172.21.15.86:0/900792125 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda740c77d0 con 0x7fda7406bd10 2024-09-19T06:39:07.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.056+0000 7fda71d9b640 1 --2- 172.21.15.86:0/900792125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda740c3680 0x7fda7414e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:07.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.056+0000 7fda7259c640 1 --2- 172.21.15.86:0/900792125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda7406bd10 0x7fda7414b400 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fda64035040 tx=0x7fda640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:07.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.056+0000 7fda6affd640 1 -- 172.21.15.86:0/900792125 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda64037040 con 0x7fda7406bd10 2024-09-19T06:39:07.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.056+0000 7fda6affd640 1 -- 172.21.15.86:0/900792125 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda64042070 con 0x7fda7406bd10 2024-09-19T06:39:07.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.056+0000 7fda6affd640 1 -- 172.21.15.86:0/900792125 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda64030960 con 0x7fda7406bd10 2024-09-19T06:39:07.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.056+0000 7fda78911640 1 -- 172.21.15.86:0/900792125 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda740c7ab0 con 0x7fda7406bd10 2024-09-19T06:39:07.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.056+0000 7fda78911640 1 -- 172.21.15.86:0/900792125 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda741552f0 con 0x7fda7406bd10 2024-09-19T06:39:07.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.057+0000 7fda78911640 1 -- 172.21.15.86:0/900792125 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda740c7cb0 con 0x7fda7406bd10 2024-09-19T06:39:07.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.058+0000 7fda6affd640 1 -- 172.21.15.86:0/900792125 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fda64030b00 con 0x7fda7406bd10 2024-09-19T06:39:07.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.058+0000 7fda6affd640 1 --2- 172.21.15.86:0/900792125 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fda5406c2b0 0x7fda5406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:07.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.058+0000 7fda6affd640 1 -- 172.21.15.86:0/900792125 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fda640ac1d0 con 0x7fda7406bd10 2024-09-19T06:39:07.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.058+0000 7fda71d9b640 1 --2- 172.21.15.86:0/900792125 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fda5406c2b0 0x7fda5406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:07.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.059+0000 7fda71d9b640 1 --2- 172.21.15.86:0/900792125 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fda5406c2b0 0x7fda5406e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fda7414ff30 tx=0x7fda5c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:07.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.062+0000 7fda6affd640 1 -- 172.21.15.86:0/900792125 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fda740c7cb0 con 0x7fda7406bd10 2024-09-19T06:39:07.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.261+0000 7fda78911640 1 -- 172.21.15.86:0/900792125 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda74072460 con 0x7fda7406bd10 2024-09-19T06:39:07.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.262+0000 7fda6affd640 1 -- 172.21.15.86:0/900792125 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6871 (secure 0 0 0) 0x7fda64045360 con 0x7fda7406bd10 2024-09-19T06:39:07.263 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:39:07.264 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":9,"btime":"2024-09-19T06:37:28:505383+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:37:27.843067+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6837/201961024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":201961024},{"type":"v1","addr":"172.21.15.169:6837","nonce":201961024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-09-19T06:39:07.264 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 9 2024-09-19T06:39:07.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.264+0000 7fda78911640 1 -- 172.21.15.86:0/900792125 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fda5406c2b0 msgr2=0x7fda5406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:07.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.264+0000 7fda78911640 1 --2- 172.21.15.86:0/900792125 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fda5406c2b0 0x7fda5406e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fda7414ff30 tx=0x7fda5c009040 comp rx=0 tx=0).stop 2024-09-19T06:39:07.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.264+0000 7fda78911640 1 -- 172.21.15.86:0/900792125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda7406bd10 msgr2=0x7fda7414b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:07.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.264+0000 7fda78911640 1 --2- 172.21.15.86:0/900792125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda7406bd10 0x7fda7414b400 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fda64035040 tx=0x7fda640046c0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.264+0000 7fda78911640 1 -- 172.21.15.86:0/900792125 shutdown_connections 2024-09-19T06:39:07.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.264+0000 7fda78911640 1 --2- 172.21.15.86:0/900792125 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fda5406c2b0 0x7fda5406e770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.264+0000 7fda78911640 1 --2- 172.21.15.86:0/900792125 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda74152060 0x7fda7414a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.264+0000 7fda78911640 1 --2- 172.21.15.86:0/900792125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda740c3680 0x7fda7414e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.264+0000 7fda78911640 1 --2- 172.21.15.86:0/900792125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda7406bd10 0x7fda7414b400 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.264+0000 7fda78911640 1 -- 172.21.15.86:0/900792125 >> 172.21.15.86:0/900792125 conn(0x7fda740c9280 msgr2=0x7fda740c5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:07.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.264+0000 7fda78911640 1 -- 172.21.15.86:0/900792125 shutdown_connections 2024-09-19T06:39:07.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:07.264+0000 7fda78911640 1 -- 172.21.15.86:0/900792125 wait complete. 2024-09-19T06:39:07.276 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-09-19T06:39:07.625 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:39:07.628 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:39:09.278 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:39:09.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.390+0000 7f267e578640 1 Processor -- start 2024-09-19T06:39:09.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.390+0000 7f267e578640 1 -- start start 2024-09-19T06:39:09.395 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.391+0000 7f267e578640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26780c6df0 0x7f267815e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:09.395 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.391+0000 7f267e578640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f26780cba40 0x7f2678158360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:09.395 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.391+0000 7f267e578640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26780cce20 con 0x7f26780cb660 2024-09-19T06:39:09.395 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.391+0000 7f267e578640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f26780cd100 con 0x7f26780cba40 2024-09-19T06:39:09.395 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.391+0000 7f267e578640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f26780c6310 con 0x7f26780c6df0 2024-09-19T06:39:09.395 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.391+0000 7f267cb15640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f26780cba40 0x7f2678158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:09.395 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.391+0000 7f2677fff640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f26780cb660 0x7f26780cc650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:43852/0 (socket says 172.21.15.86:43852) 2024-09-19T06:39:09.395 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.391+0000 7f2677fff640 1 -- 172.21.15.86:0/2006370722 learned_addr learned my addr 172.21.15.86:0/2006370722 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:39:09.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.392+0000 7f26777fe640 1 --2- 172.21.15.86:0/2006370722 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26780c6df0 0x7f267815e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:09.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.392+0000 7f267cb15640 1 -- 172.21.15.86:0/2006370722 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26780c6df0 msgr2=0x7f267815e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:09.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.392+0000 7f267cb15640 1 --2- 172.21.15.86:0/2006370722 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26780c6df0 0x7f267815e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:09.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.392+0000 7f2676ffd640 1 -- 172.21.15.86:0/2006370722 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3047154993 0 0) 0x7f26780cce20 con 0x7f26780cb660 2024-09-19T06:39:09.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.392+0000 7f267cb15640 1 -- 172.21.15.86:0/2006370722 >> v1:172.21.15.86:6789/0 conn(0x7f26780cb660 legacy=0x7f26780cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:09.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.392+0000 7f267cb15640 1 -- 172.21.15.86:0/2006370722 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26780c65f0 con 0x7f26780cba40 2024-09-19T06:39:09.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.392+0000 7f267cb15640 1 --2- 172.21.15.86:0/2006370722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26780cba40 0x7f2678158360 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2670009d90 tx=0x7f267002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9540d4cd520c28 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:09.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.393+0000 7f2676ffd640 1 -- 172.21.15.86:0/2006370722 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2670007740 con 0x7f26780cba40 2024-09-19T06:39:09.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.393+0000 7f2676ffd640 1 -- 172.21.15.86:0/2006370722 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26700078e0 con 0x7f26780cba40 2024-09-19T06:39:09.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.393+0000 7f2676ffd640 1 -- 172.21.15.86:0/2006370722 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2670007cb0 con 0x7f26780cba40 2024-09-19T06:39:09.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.393+0000 7f267e578640 1 -- 172.21.15.86:0/2006370722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26780cba40 msgr2=0x7f2678158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:09.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.393+0000 7f267e578640 1 --2- 172.21.15.86:0/2006370722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26780cba40 0x7f2678158360 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2670009d90 tx=0x7f267002a660 comp rx=0 tx=0).stop 2024-09-19T06:39:09.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.393+0000 7f267e578640 1 -- 172.21.15.86:0/2006370722 shutdown_connections 2024-09-19T06:39:09.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.393+0000 7f267e578640 1 --2- 172.21.15.86:0/2006370722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26780cba40 0x7f2678158360 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:09.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.393+0000 7f267e578640 1 --2- 172.21.15.86:0/2006370722 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26780c6df0 0x7f267815e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:09.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.393+0000 7f267e578640 1 -- 172.21.15.86:0/2006370722 >> 172.21.15.86:0/2006370722 conn(0x7f267806bcc0 msgr2=0x7f267806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:09.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.393+0000 7f267e578640 1 -- 172.21.15.86:0/2006370722 shutdown_connections 2024-09-19T06:39:09.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.393+0000 7f267e578640 1 -- 172.21.15.86:0/2006370722 wait complete. 2024-09-19T06:39:09.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.394+0000 7f267e578640 1 Processor -- start 2024-09-19T06:39:09.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.395+0000 7f267e578640 1 -- start start 2024-09-19T06:39:09.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.395+0000 7f267e578640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26780c6df0 0x7f26780ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:09.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.395+0000 7f267e578640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26780cb660 0x7f2678150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:09.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.395+0000 7f267e578640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26780cba40 0x7f26781f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:09.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.395+0000 7f267e578640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f267815ee00 con 0x7f26780cb660 2024-09-19T06:39:09.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.395+0000 7f267e578640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f26780c7e70 con 0x7f26780c6df0 2024-09-19T06:39:09.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.395+0000 7f267e578640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f267815ef80 con 0x7f26780cba40 2024-09-19T06:39:09.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.395+0000 7f26777fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26780cb660 0x7f2678150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:09.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.396+0000 7f26777fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26780cb660 0x7f2678150530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56302/0 (socket says 172.21.15.86:56302) 2024-09-19T06:39:09.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.396+0000 7f26777fe640 1 -- 172.21.15.86:0/704977647 learned_addr learned my addr 172.21.15.86:0/704977647 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:39:09.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.396+0000 7f2677fff640 1 --2- 172.21.15.86:0/704977647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26780c6df0 0x7f26780ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:09.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.396+0000 7f267cb15640 1 --2- 172.21.15.86:0/704977647 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26780cba40 0x7f26781f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:09.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.396+0000 7f26777fe640 1 -- 172.21.15.86:0/704977647 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26780cba40 msgr2=0x7f26781f4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:09.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.396+0000 7f26777fe640 1 --2- 172.21.15.86:0/704977647 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26780cba40 0x7f26781f4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:09.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.396+0000 7f26777fe640 1 -- 172.21.15.86:0/704977647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26780c6df0 msgr2=0x7f26780ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:09.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.396+0000 7f26777fe640 1 --2- 172.21.15.86:0/704977647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26780c6df0 0x7f26780ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:09.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.396+0000 7f26777fe640 1 -- 172.21.15.86:0/704977647 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26780ca560 con 0x7f26780cb660 2024-09-19T06:39:09.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.396+0000 7f267cb15640 1 --2- 172.21.15.86:0/704977647 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26780cba40 0x7f26781f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:39:09.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.396+0000 7f2677fff640 1 --2- 172.21.15.86:0/704977647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26780c6df0 0x7f26780ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:39:09.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.396+0000 7f26777fe640 1 --2- 172.21.15.86:0/704977647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26780cb660 0x7f2678150530 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f266c00d830 tx=0x7f266c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:09.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.396+0000 7f2674ff9640 1 -- 172.21.15.86:0/704977647 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266c00b6c0 con 0x7f26780cb660 2024-09-19T06:39:09.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.396+0000 7f2674ff9640 1 -- 172.21.15.86:0/704977647 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266c019070 con 0x7f26780cb660 2024-09-19T06:39:09.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.396+0000 7f267e578640 1 -- 172.21.15.86:0/704977647 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26781f0fa0 con 0x7f26780cb660 2024-09-19T06:39:09.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.396+0000 7f2674ff9640 1 -- 172.21.15.86:0/704977647 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266c00bac0 con 0x7f26780cb660 2024-09-19T06:39:09.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.396+0000 7f267e578640 1 -- 172.21.15.86:0/704977647 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26781f4690 con 0x7f26780cb660 2024-09-19T06:39:09.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.397+0000 7f267e578640 1 -- 172.21.15.86:0/704977647 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26781f4860 con 0x7f26780cb660 2024-09-19T06:39:09.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.398+0000 7f2674ff9640 1 -- 172.21.15.86:0/704977647 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f266c01e460 con 0x7f26780cb660 2024-09-19T06:39:09.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.398+0000 7f2674ff9640 1 --2- 172.21.15.86:0/704977647 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f266406c2e0 0x7f266406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:09.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.398+0000 7f2674ff9640 1 -- 172.21.15.86:0/704977647 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f266c08bf80 con 0x7f26780cb660 2024-09-19T06:39:09.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.398+0000 7f2677fff640 1 --2- 172.21.15.86:0/704977647 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f266406c2e0 0x7f266406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:09.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.398+0000 7f2677fff640 1 --2- 172.21.15.86:0/704977647 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f266406c2e0 0x7f266406e7a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2668000f60 tx=0x7f2668009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:09.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.403+0000 7f2674ff9640 1 -- 172.21.15.86:0/704977647 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f266c05a260 con 0x7f26780cb660 2024-09-19T06:39:09.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.607+0000 7f267e578640 1 -- 172.21.15.86:0/704977647 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26780c58f0 con 0x7f26780cb660 2024-09-19T06:39:09.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.607+0000 7f2674ff9640 1 -- 172.21.15.86:0/704977647 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6871 (secure 0 0 0) 0x7f266c059b60 con 0x7f26780cb660 2024-09-19T06:39:09.610 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:39:09.610 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":9,"btime":"2024-09-19T06:37:28:505383+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:37:27.843067+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6837/201961024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":201961024},{"type":"v1","addr":"172.21.15.169:6837","nonce":201961024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-09-19T06:39:09.612 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 9 2024-09-19T06:39:09.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.609+0000 7f267e578640 1 -- 172.21.15.86:0/704977647 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f266406c2e0 msgr2=0x7f266406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:09.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.609+0000 7f267e578640 1 --2- 172.21.15.86:0/704977647 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f266406c2e0 0x7f266406e7a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2668000f60 tx=0x7f2668009040 comp rx=0 tx=0).stop 2024-09-19T06:39:09.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.609+0000 7f267e578640 1 -- 172.21.15.86:0/704977647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26780cb660 msgr2=0x7f2678150530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:09.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.609+0000 7f267e578640 1 --2- 172.21.15.86:0/704977647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26780cb660 0x7f2678150530 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f266c00d830 tx=0x7f266c00dcf0 comp rx=0 tx=0).stop 2024-09-19T06:39:09.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.609+0000 7f267e578640 1 -- 172.21.15.86:0/704977647 shutdown_connections 2024-09-19T06:39:09.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.609+0000 7f267e578640 1 --2- 172.21.15.86:0/704977647 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f266406c2e0 0x7f266406e7a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:09.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.609+0000 7f267e578640 1 --2- 172.21.15.86:0/704977647 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26780cba40 0x7f26781f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:09.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.609+0000 7f267e578640 1 --2- 172.21.15.86:0/704977647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26780cb660 0x7f2678150530 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:09.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.609+0000 7f267e578640 1 --2- 172.21.15.86:0/704977647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26780c6df0 0x7f26780ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:09.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.609+0000 7f267e578640 1 -- 172.21.15.86:0/704977647 >> 172.21.15.86:0/704977647 conn(0x7f267806bcc0 msgr2=0x7f267815dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:09.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.609+0000 7f267e578640 1 -- 172.21.15.86:0/704977647 shutdown_connections 2024-09-19T06:39:09.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:09.610+0000 7f267e578640 1 -- 172.21.15.86:0/704977647 wait complete. 2024-09-19T06:39:09.622 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-09-19T06:39:11.623 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:39:11.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.733+0000 7f3af5447640 1 Processor -- start 2024-09-19T06:39:11.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.733+0000 7f3af5447640 1 -- start start 2024-09-19T06:39:11.736 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.734+0000 7f3af5447640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3af00d0de0 0x7f3af015e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:11.736 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.734+0000 7f3af5447640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3af00d11c0 0x7f3af00cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:11.736 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.734+0000 7f3af5447640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3af00cc5c0 con 0x7f3af0155000 2024-09-19T06:39:11.736 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.734+0000 7f3af5447640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f3af015ee10 con 0x7f3af00d11c0 2024-09-19T06:39:11.736 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.734+0000 7f3af5447640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3af015f0f0 con 0x7f3af00d0de0 2024-09-19T06:39:11.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.734+0000 7f3aee7fc640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3af00d11c0 0x7f3af00cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:11.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.734+0000 7f3aef7fe640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f3af0155000 0x7f3af00c7050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:43862/0 (socket says 172.21.15.86:43862) 2024-09-19T06:39:11.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.734+0000 7f3aef7fe640 1 -- 172.21.15.86:0/4258048254 learned_addr learned my addr 172.21.15.86:0/4258048254 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:39:11.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.735+0000 7f3aee7fc640 1 -- 172.21.15.86:0/4258048254 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3af00d0de0 msgr2=0x7f3af015e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:11.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.735+0000 7f3aee7fc640 1 --2- 172.21.15.86:0/4258048254 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3af00d0de0 0x7f3af015e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:11.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.735+0000 7f3aee7fc640 1 -- 172.21.15.86:0/4258048254 >> v1:172.21.15.86:6789/0 conn(0x7f3af0155000 legacy=0x7f3af00c7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:11.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.735+0000 7f3aee7fc640 1 -- 172.21.15.86:0/4258048254 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af015f3d0 con 0x7f3af00d11c0 2024-09-19T06:39:11.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.735+0000 7f3aee7fc640 1 --2- 172.21.15.86:0/4258048254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3af00d11c0 0x7f3af00cbb10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40097a0 tx=0x7f3ae402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7af6ac93c5d78e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:11.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.735+0000 7f3aedffb640 1 -- 172.21.15.86:0/4258048254 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4037070 con 0x7f3af00d11c0 2024-09-19T06:39:11.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.735+0000 7f3aedffb640 1 -- 172.21.15.86:0/4258048254 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ae4032440 con 0x7f3af00d11c0 2024-09-19T06:39:11.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.735+0000 7f3aedffb640 1 -- 172.21.15.86:0/4258048254 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4032810 con 0x7f3af00d11c0 2024-09-19T06:39:11.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.736+0000 7f3af5447640 1 -- 172.21.15.86:0/4258048254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3af00d11c0 msgr2=0x7f3af00cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:11.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.736+0000 7f3af5447640 1 --2- 172.21.15.86:0/4258048254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3af00d11c0 0x7f3af00cbb10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40097a0 tx=0x7f3ae402a210 comp rx=0 tx=0).stop 2024-09-19T06:39:11.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.736+0000 7f3af5447640 1 -- 172.21.15.86:0/4258048254 shutdown_connections 2024-09-19T06:39:11.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.736+0000 7f3af5447640 1 --2- 172.21.15.86:0/4258048254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3af00d11c0 0x7f3af00cbb10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:11.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.736+0000 7f3af5447640 1 --2- 172.21.15.86:0/4258048254 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3af00d0de0 0x7f3af015e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:11.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.736+0000 7f3af5447640 1 -- 172.21.15.86:0/4258048254 >> 172.21.15.86:0/4258048254 conn(0x7f3af006d9f0 msgr2=0x7f3af006de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:11.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.736+0000 7f3af5447640 1 -- 172.21.15.86:0/4258048254 shutdown_connections 2024-09-19T06:39:11.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.736+0000 7f3af5447640 1 -- 172.21.15.86:0/4258048254 wait complete. 2024-09-19T06:39:11.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.737+0000 7f3af5447640 1 Processor -- start 2024-09-19T06:39:11.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.738+0000 7f3af5447640 1 -- start start 2024-09-19T06:39:11.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.738+0000 7f3af5447640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3af00d0de0 0x7f3af01f0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:11.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.738+0000 7f3af5447640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3af00d11c0 0x7f3af01599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:11.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.738+0000 7f3af5447640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3af0155000 0x7f3af015d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:11.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.738+0000 7f3af5447640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3af00cc050 con 0x7f3af00d11c0 2024-09-19T06:39:11.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.738+0000 7f3af5447640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3af00c6b30 con 0x7f3af0155000 2024-09-19T06:39:11.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.738+0000 7f3af5447640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3af00c7760 con 0x7f3af00d0de0 2024-09-19T06:39:11.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.738+0000 7f3aee7fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3af00d11c0 0x7f3af01599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:11.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.738+0000 7f3aee7fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3af00d11c0 0x7f3af01599f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56318/0 (socket says 172.21.15.86:56318) 2024-09-19T06:39:11.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.738+0000 7f3aee7fc640 1 -- 172.21.15.86:0/1413224160 learned_addr learned my addr 172.21.15.86:0/1413224160 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:39:11.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.739+0000 7f3aee7fc640 1 -- 172.21.15.86:0/1413224160 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3af00d0de0 msgr2=0x7f3af01f0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:11.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.739+0000 7f3aeeffd640 1 --2- 172.21.15.86:0/1413224160 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3af00d0de0 0x7f3af01f0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:11.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.739+0000 7f3aee7fc640 1 --2- 172.21.15.86:0/1413224160 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3af00d0de0 0x7f3af01f0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:11.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.739+0000 7f3aef7fe640 1 --2- 172.21.15.86:0/1413224160 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3af0155000 0x7f3af015d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:11.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.739+0000 7f3aee7fc640 1 -- 172.21.15.86:0/1413224160 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3af0155000 msgr2=0x7f3af015d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:11.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.739+0000 7f3aee7fc640 1 --2- 172.21.15.86:0/1413224160 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3af0155000 0x7f3af015d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:11.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.739+0000 7f3aee7fc640 1 -- 172.21.15.86:0/1413224160 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af0159230 con 0x7f3af00d11c0 2024-09-19T06:39:11.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.739+0000 7f3aee7fc640 1 --2- 172.21.15.86:0/1413224160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3af00d11c0 0x7f3af01599f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40098c0 tx=0x7f3ae40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:11.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.739+0000 7f3ad77fe640 1 -- 172.21.15.86:0/1413224160 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4041070 con 0x7f3af00d11c0 2024-09-19T06:39:11.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.739+0000 7f3ad77fe640 1 -- 172.21.15.86:0/1413224160 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ae403c870 con 0x7f3af00d11c0 2024-09-19T06:39:11.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.739+0000 7f3af5447640 1 -- 172.21.15.86:0/1413224160 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3af01571b0 con 0x7f3af00d11c0 2024-09-19T06:39:11.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.739+0000 7f3ad77fe640 1 -- 172.21.15.86:0/1413224160 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4037040 con 0x7f3af00d11c0 2024-09-19T06:39:11.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.739+0000 7f3af5447640 1 -- 172.21.15.86:0/1413224160 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3af0155920 con 0x7f3af00d11c0 2024-09-19T06:39:11.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.740+0000 7f3af5447640 1 -- 172.21.15.86:0/1413224160 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3af00cbb10 con 0x7f3af00d11c0 2024-09-19T06:39:11.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.740+0000 7f3ad77fe640 1 -- 172.21.15.86:0/1413224160 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3ae4044070 con 0x7f3af00d11c0 2024-09-19T06:39:11.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.741+0000 7f3ad77fe640 1 --2- 172.21.15.86:0/1413224160 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f3adc06c2b0 0x7f3adc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:11.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.741+0000 7f3ad77fe640 1 -- 172.21.15.86:0/1413224160 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f3ae40ac360 con 0x7f3af00d11c0 2024-09-19T06:39:11.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.741+0000 7f3aeeffd640 1 --2- 172.21.15.86:0/1413224160 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f3adc06c2b0 0x7f3adc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:11.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.741+0000 7f3aeeffd640 1 --2- 172.21.15.86:0/1413224160 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f3adc06c2b0 0x7f3adc06e770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3ae000a810 tx=0x7f3ae0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:11.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.745+0000 7f3ad77fe640 1 -- 172.21.15.86:0/1413224160 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3ae407a760 con 0x7f3af00d11c0 2024-09-19T06:39:11.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.943+0000 7f3af5447640 1 -- 172.21.15.86:0/1413224160 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3af00b3470 con 0x7f3af00d11c0 2024-09-19T06:39:11.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.944+0000 7f3ad77fe640 1 -- 172.21.15.86:0/1413224160 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6871 (secure 0 0 0) 0x7f3ae407a060 con 0x7f3af00d11c0 2024-09-19T06:39:11.946 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:39:11.946 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":9,"btime":"2024-09-19T06:37:28:505383+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:37:27.843067+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6837/201961024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":201961024},{"type":"v1","addr":"172.21.15.169:6837","nonce":201961024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-09-19T06:39:11.946 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 9 2024-09-19T06:39:11.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.946+0000 7f3af5447640 1 -- 172.21.15.86:0/1413224160 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f3adc06c2b0 msgr2=0x7f3adc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:11.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.946+0000 7f3af5447640 1 --2- 172.21.15.86:0/1413224160 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f3adc06c2b0 0x7f3adc06e770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3ae000a810 tx=0x7f3ae0008040 comp rx=0 tx=0).stop 2024-09-19T06:39:11.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.946+0000 7f3af5447640 1 -- 172.21.15.86:0/1413224160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3af00d11c0 msgr2=0x7f3af01599f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:11.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.946+0000 7f3af5447640 1 --2- 172.21.15.86:0/1413224160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3af00d11c0 0x7f3af01599f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40098c0 tx=0x7f3ae40046c0 comp rx=0 tx=0).stop 2024-09-19T06:39:11.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.946+0000 7f3af5447640 1 -- 172.21.15.86:0/1413224160 shutdown_connections 2024-09-19T06:39:11.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.946+0000 7f3af5447640 1 --2- 172.21.15.86:0/1413224160 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f3adc06c2b0 0x7f3adc06e770 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:11.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.946+0000 7f3af5447640 1 --2- 172.21.15.86:0/1413224160 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3af0155000 0x7f3af015d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:11.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.946+0000 7f3af5447640 1 --2- 172.21.15.86:0/1413224160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3af00d11c0 0x7f3af01599f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:11.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.946+0000 7f3af5447640 1 --2- 172.21.15.86:0/1413224160 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3af00d0de0 0x7f3af01f0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:11.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.946+0000 7f3af5447640 1 -- 172.21.15.86:0/1413224160 >> 172.21.15.86:0/1413224160 conn(0x7f3af006d9f0 msgr2=0x7f3af00cd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:11.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.946+0000 7f3af5447640 1 -- 172.21.15.86:0/1413224160 shutdown_connections 2024-09-19T06:39:11.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:11.946+0000 7f3af5447640 1 -- 172.21.15.86:0/1413224160 wait complete. 2024-09-19T06:39:11.959 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-09-19T06:39:13.959 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:39:14.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.079+0000 7fe827827640 1 Processor -- start 2024-09-19T06:39:14.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.079+0000 7fe827827640 1 -- start start 2024-09-19T06:39:14.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.080+0000 7fe827827640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe820153050 0x7fe8200cb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:14.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.080+0000 7fe827827640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe8200c8b20 0x7fe82015ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:14.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.080+0000 7fe827827640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8200c5da0 con 0x7fe82015cf60 2024-09-19T06:39:14.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.080+0000 7fe827827640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fe820153430 con 0x7fe8200c8b20 2024-09-19T06:39:14.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.080+0000 7fe827827640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe8200c6040 con 0x7fe820153050 2024-09-19T06:39:14.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.080+0000 7fe824dc2640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe8200c8b20 0x7fe82015ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:14.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.080+0000 7fe825dc4640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe82015cf60 0x7fe820073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:59274/0 (socket says 172.21.15.86:59274) 2024-09-19T06:39:14.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.080+0000 7fe825dc4640 1 -- 172.21.15.86:0/2619137947 learned_addr learned my addr 172.21.15.86:0/2619137947 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:39:14.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.080+0000 7fe8255c3640 1 --2- 172.21.15.86:0/2619137947 >> v2:172.21.15.169:3300/0 conn(0x7fe820153050 0x7fe8200cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:14.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.080+0000 7fe824dc2640 1 -- 172.21.15.86:0/2619137947 >> v2:172.21.15.169:3300/0 conn(0x7fe820153050 msgr2=0x7fe8200cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:14.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.080+0000 7fe824dc2640 1 --2- 172.21.15.86:0/2619137947 >> v2:172.21.15.169:3300/0 conn(0x7fe820153050 0x7fe8200cb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:14.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.080+0000 7fe824dc2640 1 -- 172.21.15.86:0/2619137947 >> v1:172.21.15.86:6789/0 conn(0x7fe82015cf60 legacy=0x7fe820073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:14.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.080+0000 7fe817fff640 1 -- 172.21.15.86:0/2619137947 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 329420936 0 0) 0x7fe8200c5da0 con 0x7fe82015cf60 2024-09-19T06:39:14.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.080+0000 7fe824dc2640 1 -- 172.21.15.86:0/2619137947 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8200c6320 con 0x7fe8200c8b20 2024-09-19T06:39:14.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.081+0000 7fe824dc2640 1 --2- 172.21.15.86:0/2619137947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8200c8b20 0x7fe82015ca20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe820072e10 tx=0x7fe81002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d4bf5c0b6ed37f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:14.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.081+0000 7fe817fff640 1 -- 172.21.15.86:0/2619137947 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810037070 con 0x7fe8200c8b20 2024-09-19T06:39:14.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.081+0000 7fe817fff640 1 -- 172.21.15.86:0/2619137947 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe810032440 con 0x7fe8200c8b20 2024-09-19T06:39:14.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.081+0000 7fe817fff640 1 -- 172.21.15.86:0/2619137947 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810032810 con 0x7fe8200c8b20 2024-09-19T06:39:14.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.082+0000 7fe827827640 1 -- 172.21.15.86:0/2619137947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8200c8b20 msgr2=0x7fe82015ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:14.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.082+0000 7fe827827640 1 --2- 172.21.15.86:0/2619137947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8200c8b20 0x7fe82015ca20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe820072e10 tx=0x7fe81002a1a0 comp rx=0 tx=0).stop 2024-09-19T06:39:14.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.082+0000 7fe827827640 1 -- 172.21.15.86:0/2619137947 shutdown_connections 2024-09-19T06:39:14.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.082+0000 7fe827827640 1 --2- 172.21.15.86:0/2619137947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8200c8b20 0x7fe82015ca20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:14.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.082+0000 7fe827827640 1 --2- 172.21.15.86:0/2619137947 >> v2:172.21.15.169:3300/0 conn(0x7fe820153050 0x7fe8200cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:14.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.082+0000 7fe827827640 1 -- 172.21.15.86:0/2619137947 >> 172.21.15.86:0/2619137947 conn(0x7fe820070d10 msgr2=0x7fe8200710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:14.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.082+0000 7fe827827640 1 -- 172.21.15.86:0/2619137947 shutdown_connections 2024-09-19T06:39:14.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.082+0000 7fe827827640 1 -- 172.21.15.86:0/2619137947 wait complete. 2024-09-19T06:39:14.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.083+0000 7fe827827640 1 Processor -- start 2024-09-19T06:39:14.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.083+0000 7fe827827640 1 -- start start 2024-09-19T06:39:14.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.084+0000 7fe827827640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8200c8b20 0x7fe8200c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:14.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.084+0000 7fe827827640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe820153050 0x7fe8200c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:14.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.084+0000 7fe827827640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe82015cf60 0x7fe8200ce740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:14.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.084+0000 7fe827827640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe82015c500 con 0x7fe8200c8b20 2024-09-19T06:39:14.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.084+0000 7fe827827640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe8200c68e0 con 0x7fe820153050 2024-09-19T06:39:14.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.084+0000 7fe827827640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe820073830 con 0x7fe82015cf60 2024-09-19T06:39:14.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.084+0000 7fe8255c3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8200c8b20 0x7fe8200c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:14.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.084+0000 7fe8255c3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8200c8b20 0x7fe8200c3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36714/0 (socket says 172.21.15.86:36714) 2024-09-19T06:39:14.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.084+0000 7fe8255c3640 1 -- 172.21.15.86:0/929993406 learned_addr learned my addr 172.21.15.86:0/929993406 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:39:14.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.084+0000 7fe824dc2640 1 --2- 172.21.15.86:0/929993406 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe820153050 0x7fe8200c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:14.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.084+0000 7fe825dc4640 1 --2- 172.21.15.86:0/929993406 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe82015cf60 0x7fe8200ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:14.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.084+0000 7fe8255c3640 1 -- 172.21.15.86:0/929993406 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe82015cf60 msgr2=0x7fe8200ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:14.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.084+0000 7fe8255c3640 1 --2- 172.21.15.86:0/929993406 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe82015cf60 0x7fe8200ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:14.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.084+0000 7fe8255c3640 1 -- 172.21.15.86:0/929993406 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe820153050 msgr2=0x7fe8200c2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:14.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.084+0000 7fe8255c3640 1 --2- 172.21.15.86:0/929993406 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe820153050 0x7fe8200c2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:14.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.084+0000 7fe8255c3640 1 -- 172.21.15.86:0/929993406 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8201ee8f0 con 0x7fe8200c8b20 2024-09-19T06:39:14.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.084+0000 7fe824dc2640 1 --2- 172.21.15.86:0/929993406 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe820153050 0x7fe8200c2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:14.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.084+0000 7fe8255c3640 1 --2- 172.21.15.86:0/929993406 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8200c8b20 0x7fe8200c3cb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe81c00e9b0 tx=0x7fe81c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:14.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.084+0000 7fe815ffb640 1 -- 172.21.15.86:0/929993406 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c017070 con 0x7fe8200c8b20 2024-09-19T06:39:14.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.084+0000 7fe815ffb640 1 -- 172.21.15.86:0/929993406 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe81c00c9a0 con 0x7fe8200c8b20 2024-09-19T06:39:14.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.084+0000 7fe815ffb640 1 -- 172.21.15.86:0/929993406 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c00cd90 con 0x7fe8200c8b20 2024-09-19T06:39:14.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.084+0000 7fe827827640 1 -- 172.21.15.86:0/929993406 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8201f2910 con 0x7fe8200c8b20 2024-09-19T06:39:14.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.085+0000 7fe827827640 1 -- 172.21.15.86:0/929993406 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8201eee90 con 0x7fe8200c8b20 2024-09-19T06:39:14.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.086+0000 7fe827827640 1 -- 172.21.15.86:0/929993406 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe82015ca20 con 0x7fe8200c8b20 2024-09-19T06:39:14.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.086+0000 7fe815ffb640 1 -- 172.21.15.86:0/929993406 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe81c01a070 con 0x7fe8200c8b20 2024-09-19T06:39:14.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.086+0000 7fe815ffb640 1 --2- 172.21.15.86:0/929993406 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe80406c2b0 0x7fe80406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:14.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.087+0000 7fe815ffb640 1 -- 172.21.15.86:0/929993406 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fe81c08bc30 con 0x7fe8200c8b20 2024-09-19T06:39:14.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.087+0000 7fe824dc2640 1 --2- 172.21.15.86:0/929993406 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe80406c2b0 0x7fe80406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:14.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.087+0000 7fe824dc2640 1 --2- 172.21.15.86:0/929993406 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe80406c2b0 0x7fe80406e770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe810034000 tx=0x7fe81002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:14.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.091+0000 7fe815ffb640 1 -- 172.21.15.86:0/929993406 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe81c059fa0 con 0x7fe8200c8b20 2024-09-19T06:39:14.290 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.289+0000 7fe827827640 1 -- 172.21.15.86:0/929993406 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8200cb2f0 con 0x7fe8200c8b20 2024-09-19T06:39:14.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.289+0000 7fe815ffb640 1 -- 172.21.15.86:0/929993406 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6871 (secure 0 0 0) 0x7fe81c0598a0 con 0x7fe8200c8b20 2024-09-19T06:39:14.291 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:39:14.291 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":9,"btime":"2024-09-19T06:37:28:505383+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:37:27.843067+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6837/201961024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":201961024},{"type":"v1","addr":"172.21.15.169:6837","nonce":201961024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-09-19T06:39:14.291 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 9 2024-09-19T06:39:14.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.291+0000 7fe827827640 1 -- 172.21.15.86:0/929993406 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe80406c2b0 msgr2=0x7fe80406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:14.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.291+0000 7fe827827640 1 --2- 172.21.15.86:0/929993406 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe80406c2b0 0x7fe80406e770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe810034000 tx=0x7fe81002e000 comp rx=0 tx=0).stop 2024-09-19T06:39:14.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.291+0000 7fe827827640 1 -- 172.21.15.86:0/929993406 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8200c8b20 msgr2=0x7fe8200c3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:14.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.291+0000 7fe827827640 1 --2- 172.21.15.86:0/929993406 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8200c8b20 0x7fe8200c3cb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe81c00e9b0 tx=0x7fe81c00ee70 comp rx=0 tx=0).stop 2024-09-19T06:39:14.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.291+0000 7fe827827640 1 -- 172.21.15.86:0/929993406 shutdown_connections 2024-09-19T06:39:14.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.291+0000 7fe827827640 1 --2- 172.21.15.86:0/929993406 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe80406c2b0 0x7fe80406e770 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:14.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.291+0000 7fe827827640 1 --2- 172.21.15.86:0/929993406 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe82015cf60 0x7fe8200ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:14.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.291+0000 7fe827827640 1 --2- 172.21.15.86:0/929993406 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe820153050 0x7fe8200c2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:14.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.291+0000 7fe827827640 1 --2- 172.21.15.86:0/929993406 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8200c8b20 0x7fe8200c3cb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:14.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.291+0000 7fe827827640 1 -- 172.21.15.86:0/929993406 >> 172.21.15.86:0/929993406 conn(0x7fe820070d10 msgr2=0x7fe82014bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:14.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.291+0000 7fe827827640 1 -- 172.21.15.86:0/929993406 shutdown_connections 2024-09-19T06:39:14.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:14.291+0000 7fe827827640 1 -- 172.21.15.86:0/929993406 wait complete. 2024-09-19T06:39:14.304 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-09-19T06:39:16.305 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:39:16.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.413+0000 7f499ba5e640 1 Processor -- start 2024-09-19T06:39:16.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.413+0000 7f499ba5e640 1 -- start start 2024-09-19T06:39:16.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.414+0000 7f499ba5e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f499406bd10 0x7f49940719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:16.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.414+0000 7f499ba5e640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4994158710 con 0x7f4994152060 2024-09-19T06:39:16.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.414+0000 7f499ba5e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49941589b0 con 0x7f49940734a0 2024-09-19T06:39:16.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.414+0000 7f499ba5e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f49940716c0 con 0x7f499406bd10 2024-09-19T06:39:16.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.414+0000 7f49997fa640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f4994152060 0x7f4994072d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:59288/0 (socket says 172.21.15.86:59288) 2024-09-19T06:39:16.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.414+0000 7f49997fa640 1 -- 172.21.15.86:0/1171303452 learned_addr learned my addr 172.21.15.86:0/1171303452 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:39:16.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.415+0000 7f4998ff9640 1 --2- 172.21.15.86:0/1171303452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f499406bd10 0x7f49940719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:16.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.415+0000 7f498bfff640 1 -- 172.21.15.86:0/1171303452 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2173038733 0 0) 0x7f4994158710 con 0x7f4994152060 2024-09-19T06:39:16.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.415+0000 7f498bfff640 1 -- 172.21.15.86:0/1171303452 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4980003520 con 0x7f4994152060 2024-09-19T06:39:16.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.415+0000 7f498bfff640 1 -- 172.21.15.86:0/1171303452 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3759518411 0 0) 0x7f4980003520 con 0x7f4994152060 2024-09-19T06:39:16.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.415+0000 7f498bfff640 1 -- 172.21.15.86:0/1171303452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f499406bd10 msgr2=0x7f49940719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:16.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.415+0000 7f498bfff640 1 --2- 172.21.15.86:0/1171303452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f499406bd10 0x7f49940719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.415+0000 7f498bfff640 1 -- 172.21.15.86:0/1171303452 >> v1:172.21.15.169:6789/0 conn(0x7f49940734a0 legacy=0x7f4994071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:16.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.415+0000 7f498bfff640 1 -- 172.21.15.86:0/1171303452 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4994071070 con 0x7f4994152060 2024-09-19T06:39:16.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.415+0000 7f498bfff640 1 -- 172.21.15.86:0/1171303452 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f4990001670 con 0x7f4994152060 2024-09-19T06:39:16.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.415+0000 7f498bfff640 1 -- 172.21.15.86:0/1171303452 >> v1:172.21.15.86:6789/0 conn(0x7f4994152060 legacy=0x7f4994072d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:16.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.415+0000 7f498bfff640 1 --2- 172.21.15.86:0/1171303452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49800039e0 0x7f4980003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:16.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.415+0000 7f498bfff640 1 --2- 172.21.15.86:0/1171303452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f499406bd10 0x7f4980004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:16.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.415+0000 7f498bfff640 1 --2- 172.21.15.86:0/1171303452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4980004d40 0x7f49800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:16.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.415+0000 7f498bfff640 1 -- 172.21.15.86:0/1171303452 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f49940716c0 con 0x7f4980004d40 2024-09-19T06:39:16.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.415+0000 7f498bfff640 1 -- 172.21.15.86:0/1171303452 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f498000bb00 con 0x7f49800039e0 2024-09-19T06:39:16.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.415+0000 7f498bfff640 1 -- 172.21.15.86:0/1171303452 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f498000bd00 con 0x7f499406bd10 2024-09-19T06:39:16.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.415+0000 7f4999ffb640 1 --2- 172.21.15.86:0/1171303452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4980004d40 0x7f49800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:16.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.415+0000 7f49997fa640 1 --2- 172.21.15.86:0/1171303452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49800039e0 0x7f4980003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:16.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.415+0000 7f4998ff9640 1 --2- 172.21.15.86:0/1171303452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f499406bd10 0x7f4980004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:16.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.415+0000 7f4999ffb640 1 -- 172.21.15.86:0/1171303452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f499406bd10 msgr2=0x7f4980004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:16.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.415+0000 7f4999ffb640 1 --2- 172.21.15.86:0/1171303452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f499406bd10 0x7f4980004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.415+0000 7f4999ffb640 1 -- 172.21.15.86:0/1171303452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49800039e0 msgr2=0x7f4980003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:16.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.415+0000 7f4999ffb640 1 --2- 172.21.15.86:0/1171303452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49800039e0 0x7f4980003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.415+0000 7f4999ffb640 1 -- 172.21.15.86:0/1171303452 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4980003520 con 0x7f4980004d40 2024-09-19T06:39:16.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.416+0000 7f4999ffb640 1 --2- 172.21.15.86:0/1171303452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4980004d40 0x7f49800051c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f498c001a30 tx=0x7f4980005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80545da54450cfdf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:16.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.416+0000 7f498bfff640 1 -- 172.21.15.86:0/1171303452 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498c001a70 con 0x7f4980004d40 2024-09-19T06:39:16.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.416+0000 7f498bfff640 1 -- 172.21.15.86:0/1171303452 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f498c003b70 con 0x7f4980004d40 2024-09-19T06:39:16.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.416+0000 7f498bfff640 1 -- 172.21.15.86:0/1171303452 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498c0050d0 con 0x7f4980004d40 2024-09-19T06:39:16.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.417+0000 7f499ba5e640 1 -- 172.21.15.86:0/1171303452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4980004d40 msgr2=0x7f49800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:16.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.417+0000 7f499ba5e640 1 --2- 172.21.15.86:0/1171303452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4980004d40 0x7f49800051c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f498c001a30 tx=0x7f4980005830 comp rx=0 tx=0).stop 2024-09-19T06:39:16.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.417+0000 7f4999ffb640 1 -- 172.21.15.86:0/1171303452 reap_dead start 2024-09-19T06:39:16.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.417+0000 7f499ba5e640 1 -- 172.21.15.86:0/1171303452 shutdown_connections 2024-09-19T06:39:16.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.417+0000 7f499ba5e640 1 -- 172.21.15.86:0/1171303452 >> 172.21.15.86:0/1171303452 conn(0x7f49940c9280 msgr2=0x7f49940c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:16.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.417+0000 7f499ba5e640 1 -- 172.21.15.86:0/1171303452 shutdown_connections 2024-09-19T06:39:16.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.417+0000 7f499ba5e640 1 -- 172.21.15.86:0/1171303452 wait complete. 2024-09-19T06:39:16.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.418+0000 7f499ba5e640 1 Processor -- start 2024-09-19T06:39:16.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.418+0000 7f499ba5e640 1 -- start start 2024-09-19T06:39:16.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.419+0000 7f499ba5e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4980004d40 0x7f499414bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:16.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.419+0000 7f499ba5e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f499414c630 0x7f499414a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:16.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.419+0000 7f499ba5e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f499406c780 0x7f499406cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:16.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.419+0000 7f499ba5e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f49940c9e10 con 0x7f4980004d40 2024-09-19T06:39:16.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.419+0000 7f499ba5e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4994152440 con 0x7f499414c630 2024-09-19T06:39:16.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.419+0000 7f499ba5e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4994072610 con 0x7f499406c780 2024-09-19T06:39:16.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.419+0000 7f49997fa640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4980004d40 0x7f499414bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:16.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.419+0000 7f49997fa640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4980004d40 0x7f499414bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36728/0 (socket says 172.21.15.86:36728) 2024-09-19T06:39:16.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.419+0000 7f49997fa640 1 -- 172.21.15.86:0/3608978170 learned_addr learned my addr 172.21.15.86:0/3608978170 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:39:16.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.419+0000 7f4998ff9640 1 --2- 172.21.15.86:0/3608978170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f499414c630 0x7f499414a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:16.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.419+0000 7f4999ffb640 1 --2- 172.21.15.86:0/3608978170 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f499406c780 0x7f499406cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:16.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.419+0000 7f49997fa640 1 -- 172.21.15.86:0/3608978170 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f499406c780 msgr2=0x7f499406cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:16.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.419+0000 7f49997fa640 1 --2- 172.21.15.86:0/3608978170 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f499406c780 0x7f499406cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.419+0000 7f49997fa640 1 -- 172.21.15.86:0/3608978170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f499414c630 msgr2=0x7f499414a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:16.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.419+0000 7f49997fa640 1 --2- 172.21.15.86:0/3608978170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f499414c630 0x7f499414a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.419+0000 7f49997fa640 1 -- 172.21.15.86:0/3608978170 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49941f06f0 con 0x7f4980004d40 2024-09-19T06:39:16.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.420+0000 7f49997fa640 1 --2- 172.21.15.86:0/3608978170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4980004d40 0x7f499414bfc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f49900072c0 tx=0x7f49900076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:16.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.420+0000 7f4989ffb640 1 -- 172.21.15.86:0/3608978170 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499000f960 con 0x7f4980004d40 2024-09-19T06:39:16.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.420+0000 7f4989ffb640 1 -- 172.21.15.86:0/3608978170 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4990018070 con 0x7f4980004d40 2024-09-19T06:39:16.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.420+0000 7f499ba5e640 1 -- 172.21.15.86:0/3608978170 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49941dfe40 con 0x7f4980004d40 2024-09-19T06:39:16.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.420+0000 7f4989ffb640 1 -- 172.21.15.86:0/3608978170 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499000fd40 con 0x7f4980004d40 2024-09-19T06:39:16.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.420+0000 7f499ba5e640 1 -- 172.21.15.86:0/3608978170 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49941e0400 con 0x7f4980004d40 2024-09-19T06:39:16.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.421+0000 7f499ba5e640 1 -- 172.21.15.86:0/3608978170 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49940c3680 con 0x7f4980004d40 2024-09-19T06:39:16.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.421+0000 7f4989ffb640 1 -- 172.21.15.86:0/3608978170 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f499001d460 con 0x7f4980004d40 2024-09-19T06:39:16.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.422+0000 7f4989ffb640 1 --2- 172.21.15.86:0/3608978170 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f497806c2e0 0x7f497806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:16.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.422+0000 7f4989ffb640 1 -- 172.21.15.86:0/3608978170 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6821+0+0 (secure 0 0 0) 0x7f499008b9f0 con 0x7f4980004d40 2024-09-19T06:39:16.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.422+0000 7f4998ff9640 1 --2- 172.21.15.86:0/3608978170 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f497806c2e0 0x7f497806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:16.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.422+0000 7f4998ff9640 1 --2- 172.21.15.86:0/3608978170 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f497806c2e0 0x7f497806e7a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f499414bf50 tx=0x7f4984008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:16.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.426+0000 7f4989ffb640 1 -- 172.21.15.86:0/3608978170 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4990059c70 con 0x7f4980004d40 2024-09-19T06:39:16.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.627+0000 7f499ba5e640 1 -- 172.21.15.86:0/3608978170 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f49940c9060 con 0x7f4980004d40 2024-09-19T06:39:16.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.628+0000 7f4989ffb640 1 -- 172.21.15.86:0/3608978170 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6044 (secure 0 0 0) 0x7f4990059570 con 0x7f4980004d40 2024-09-19T06:39:16.630 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:39:16.630 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":10,"btime":"2024-09-19T06:39:15:476406+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:39:15.476402+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":0,"incarnation":10,"state":"up:replay","state_seq":1,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:39:16.630 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 10 2024-09-19T06:39:16.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.630+0000 7f499ba5e640 1 -- 172.21.15.86:0/3608978170 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f497806c2e0 msgr2=0x7f497806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:16.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.630+0000 7f499ba5e640 1 --2- 172.21.15.86:0/3608978170 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f497806c2e0 0x7f497806e7a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f499414bf50 tx=0x7f4984008040 comp rx=0 tx=0).stop 2024-09-19T06:39:16.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.630+0000 7f499ba5e640 1 -- 172.21.15.86:0/3608978170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4980004d40 msgr2=0x7f499414bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:16.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.630+0000 7f499ba5e640 1 --2- 172.21.15.86:0/3608978170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4980004d40 0x7f499414bfc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f49900072c0 tx=0x7f49900076c0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.630+0000 7f499ba5e640 1 -- 172.21.15.86:0/3608978170 shutdown_connections 2024-09-19T06:39:16.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.630+0000 7f499ba5e640 1 --2- 172.21.15.86:0/3608978170 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f497806c2e0 0x7f497806e7a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.630+0000 7f499ba5e640 1 --2- 172.21.15.86:0/3608978170 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f499406c780 0x7f499406cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.630+0000 7f499ba5e640 1 --2- 172.21.15.86:0/3608978170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f499414c630 0x7f499414a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.630+0000 7f499ba5e640 1 --2- 172.21.15.86:0/3608978170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4980004d40 0x7f499414bfc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.630+0000 7f499ba5e640 1 -- 172.21.15.86:0/3608978170 >> 172.21.15.86:0/3608978170 conn(0x7f49940c9280 msgr2=0x7f49941507e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:16.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.630+0000 7f499ba5e640 1 -- 172.21.15.86:0/3608978170 shutdown_connections 2024-09-19T06:39:16.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.630+0000 7f499ba5e640 1 -- 172.21.15.86:0/3608978170 wait complete. 2024-09-19T06:39:16.643 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d down, removed from mdsmap 2024-09-19T06:39:16.643 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-09-19T06:39:16.643 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:39:16.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.740+0000 7f09bfb6f640 1 Processor -- start 2024-09-19T06:39:16.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.741+0000 7f09bfb6f640 1 -- start start 2024-09-19T06:39:16.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.741+0000 7f09bfb6f640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f09b80732b0 0x7f09b8073720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:16.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.741+0000 7f09bfb6f640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09b8073c60 con 0x7f09b813ebe0 2024-09-19T06:39:16.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.741+0000 7f09bfb6f640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09b8071ae0 con 0x7f09b80c6b00 2024-09-19T06:39:16.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.741+0000 7f09bfb6f640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f09b813efc0 con 0x7f09b80732b0 2024-09-19T06:39:16.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.742+0000 7f09bd90b640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f09b813ebe0 0x7f09b80c9890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:59298/0 (socket says 172.21.15.86:59298) 2024-09-19T06:39:16.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.742+0000 7f09bd90b640 1 -- 172.21.15.86:0/2231616850 learned_addr learned my addr 172.21.15.86:0/2231616850 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:39:16.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.742+0000 7f09be10c640 1 --2- 172.21.15.86:0/2231616850 >> v2:172.21.15.169:3300/0 conn(0x7f09b80732b0 0x7f09b8073720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:16.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.742+0000 7f09bc909640 1 -- 172.21.15.86:0/2231616850 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1818244197 0 0) 0x7f09b8073c60 con 0x7f09b813ebe0 2024-09-19T06:39:16.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.742+0000 7f09bc909640 1 -- 172.21.15.86:0/2231616850 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09a0003520 con 0x7f09b813ebe0 2024-09-19T06:39:16.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.742+0000 7f09bc909640 1 -- 172.21.15.86:0/2231616850 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2216430548 0 0) 0x7f09a0003520 con 0x7f09b813ebe0 2024-09-19T06:39:16.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.742+0000 7f09bc909640 1 -- 172.21.15.86:0/2231616850 >> v2:172.21.15.169:3300/0 conn(0x7f09b80732b0 msgr2=0x7f09b8073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:16.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.742+0000 7f09bc909640 1 --2- 172.21.15.86:0/2231616850 >> v2:172.21.15.169:3300/0 conn(0x7f09b80732b0 0x7f09b8073720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.742+0000 7f09bc909640 1 -- 172.21.15.86:0/2231616850 >> v1:172.21.15.169:6789/0 conn(0x7f09b80c6b00 legacy=0x7f09b80c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:16.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.742+0000 7f09bc909640 1 -- 172.21.15.86:0/2231616850 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b8158e90 con 0x7f09b813ebe0 2024-09-19T06:39:16.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.742+0000 7f09bc909640 1 -- 172.21.15.86:0/2231616850 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f09b0001670 con 0x7f09b813ebe0 2024-09-19T06:39:16.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.742+0000 7f09bc909640 1 -- 172.21.15.86:0/2231616850 >> v1:172.21.15.86:6789/0 conn(0x7f09b813ebe0 legacy=0x7f09b80c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:16.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.742+0000 7f09bc909640 1 --2- 172.21.15.86:0/2231616850 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09a0003a00 0x7f09a0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:16.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.742+0000 7f09bc909640 1 --2- 172.21.15.86:0/2231616850 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09a0004800 0x7f09a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:16.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.742+0000 7f09bc909640 1 --2- 172.21.15.86:0/2231616850 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09a00051c0 0x7f09a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:16.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.742+0000 7f09bc909640 1 -- 172.21.15.86:0/2231616850 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f09b813efc0 con 0x7f09a00051c0 2024-09-19T06:39:16.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.742+0000 7f09bc909640 1 -- 172.21.15.86:0/2231616850 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f09a000c0a0 con 0x7f09a0003a00 2024-09-19T06:39:16.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.742+0000 7f09bc909640 1 -- 172.21.15.86:0/2231616850 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f09a000c2a0 con 0x7f09a0004800 2024-09-19T06:39:16.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.742+0000 7f09be10c640 1 --2- 172.21.15.86:0/2231616850 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09a00051c0 0x7f09a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:16.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.742+0000 7f09bd90b640 1 --2- 172.21.15.86:0/2231616850 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09a0003a00 0x7f09a0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:16.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.742+0000 7f09bd10a640 1 --2- 172.21.15.86:0/2231616850 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09a0004800 0x7f09a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:16.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.743+0000 7f09be10c640 1 -- 172.21.15.86:0/2231616850 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09a0004800 msgr2=0x7f09a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:16.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.743+0000 7f09be10c640 1 --2- 172.21.15.86:0/2231616850 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09a0004800 0x7f09a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.743+0000 7f09be10c640 1 -- 172.21.15.86:0/2231616850 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09a0003a00 msgr2=0x7f09a0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:16.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.743+0000 7f09be10c640 1 --2- 172.21.15.86:0/2231616850 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09a0003a00 0x7f09a0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.743+0000 7f09be10c640 1 -- 172.21.15.86:0/2231616850 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a0003520 con 0x7f09a00051c0 2024-09-19T06:39:16.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.743+0000 7f09be10c640 1 -- 172.21.15.86:0/2231616850 reap_dead start 2024-09-19T06:39:16.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.743+0000 7f09be10c640 1 --2- 172.21.15.86:0/2231616850 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09a00051c0 0x7f09a000b9c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009fc0 tx=0x7f09a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e03bf65381e4c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:16.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.743+0000 7f09bc909640 1 -- 172.21.15.86:0/2231616850 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a8035020 con 0x7f09a00051c0 2024-09-19T06:39:16.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.743+0000 7f09bc909640 1 -- 172.21.15.86:0/2231616850 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09a8003bd0 con 0x7f09a00051c0 2024-09-19T06:39:16.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.743+0000 7f09bc909640 1 -- 172.21.15.86:0/2231616850 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a8009c10 con 0x7f09a00051c0 2024-09-19T06:39:16.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.744+0000 7f09bfb6f640 1 -- 172.21.15.86:0/2231616850 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09a00051c0 msgr2=0x7f09a000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:16.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.744+0000 7f09bfb6f640 1 --2- 172.21.15.86:0/2231616850 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09a00051c0 0x7f09a000b9c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009fc0 tx=0x7f09a0005830 comp rx=0 tx=0).stop 2024-09-19T06:39:16.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.744+0000 7f09bfb6f640 1 -- 172.21.15.86:0/2231616850 shutdown_connections 2024-09-19T06:39:16.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.744+0000 7f09bfb6f640 1 --2- 172.21.15.86:0/2231616850 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09a00051c0 0x7f09a000b9c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.744+0000 7f09bfb6f640 1 -- 172.21.15.86:0/2231616850 >> 172.21.15.86:0/2231616850 conn(0x7f09b8070c10 msgr2=0x7f09b8071020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:16.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.744+0000 7f09bfb6f640 1 -- 172.21.15.86:0/2231616850 shutdown_connections 2024-09-19T06:39:16.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.744+0000 7f09bfb6f640 1 -- 172.21.15.86:0/2231616850 wait complete. 2024-09-19T06:39:16.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.745+0000 7f09bfb6f640 1 Processor -- start 2024-09-19T06:39:16.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.745+0000 7f09bfb6f640 1 -- start start 2024-09-19T06:39:16.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.746+0000 7f09bfb6f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09a00051c0 0x7f09b81f0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:16.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.746+0000 7f09bfb6f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09b8154070 0x7f09b813d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:16.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.746+0000 7f09bfb6f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09b8154f30 0x7f09b813aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:16.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.746+0000 7f09bfb6f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f09b8159710 con 0x7f09b8154f30 2024-09-19T06:39:16.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.746+0000 7f09bfb6f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f09b8159430 con 0x7f09a00051c0 2024-09-19T06:39:16.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.746+0000 7f09bfb6f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f09b81599f0 con 0x7f09b8154070 2024-09-19T06:39:16.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.746+0000 7f09be10c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09b8154f30 0x7f09b813aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:16.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.746+0000 7f09be10c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09b8154f30 0x7f09b813aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36732/0 (socket says 172.21.15.86:36732) 2024-09-19T06:39:16.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.746+0000 7f09be10c640 1 -- 172.21.15.86:0/1160416863 learned_addr learned my addr 172.21.15.86:0/1160416863 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:39:16.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.746+0000 7f09bd10a640 1 --2- 172.21.15.86:0/1160416863 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09b8154070 0x7f09b813d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:16.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.746+0000 7f09bd90b640 1 --2- 172.21.15.86:0/1160416863 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09a00051c0 0x7f09b81f0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:16.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.746+0000 7f09be10c640 1 -- 172.21.15.86:0/1160416863 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09b8154070 msgr2=0x7f09b813d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:16.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.746+0000 7f09be10c640 1 --2- 172.21.15.86:0/1160416863 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09b8154070 0x7f09b813d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.746+0000 7f09be10c640 1 -- 172.21.15.86:0/1160416863 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09a00051c0 msgr2=0x7f09b81f0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:16.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.746+0000 7f09be10c640 1 --2- 172.21.15.86:0/1160416863 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09a00051c0 0x7f09b81f0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.746+0000 7f09be10c640 1 -- 172.21.15.86:0/1160416863 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b81e54c0 con 0x7f09b8154f30 2024-09-19T06:39:16.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.746+0000 7f09bd90b640 1 --2- 172.21.15.86:0/1160416863 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09a00051c0 0x7f09b81f0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:16.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.746+0000 7f09be10c640 1 --2- 172.21.15.86:0/1160416863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09b8154f30 0x7f09b813aea0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f09a800e200 tx=0x7f09a8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:16.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.747+0000 7f09b67fc640 1 -- 172.21.15.86:0/1160416863 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a8040070 con 0x7f09b8154f30 2024-09-19T06:39:16.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.747+0000 7f09b67fc640 1 -- 172.21.15.86:0/1160416863 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09a8032eb0 con 0x7f09b8154f30 2024-09-19T06:39:16.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.747+0000 7f09b67fc640 1 -- 172.21.15.86:0/1160416863 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a8035030 con 0x7f09b8154f30 2024-09-19T06:39:16.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.747+0000 7f09bfb6f640 1 -- 172.21.15.86:0/1160416863 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09b806ccd0 con 0x7f09b8154f30 2024-09-19T06:39:16.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.747+0000 7f09bfb6f640 1 -- 172.21.15.86:0/1160416863 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09b806cf70 con 0x7f09b8154f30 2024-09-19T06:39:16.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.748+0000 7f09bfb6f640 1 -- 172.21.15.86:0/1160416863 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09b80c6f20 con 0x7f09b8154f30 2024-09-19T06:39:16.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.748+0000 7f09b67fc640 1 -- 172.21.15.86:0/1160416863 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f09a8043070 con 0x7f09b8154f30 2024-09-19T06:39:16.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.748+0000 7f09b67fc640 1 --2- 172.21.15.86:0/1160416863 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f09a406c2b0 0x7f09a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:16.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.749+0000 7f09bd90b640 1 --2- 172.21.15.86:0/1160416863 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f09a406c2b0 0x7f09a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:16.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.749+0000 7f09b67fc640 1 -- 172.21.15.86:0/1160416863 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6821+0+0 (secure 0 0 0) 0x7f09a80ac8c0 con 0x7f09b8154f30 2024-09-19T06:39:16.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.749+0000 7f09bd90b640 1 --2- 172.21.15.86:0/1160416863 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f09a406c2b0 0x7f09a406e770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f09b0000c00 tx=0x7f09b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:16.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.753+0000 7f09b67fc640 1 -- 172.21.15.86:0/1160416863 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f09a807a610 con 0x7f09b8154f30 2024-09-19T06:39:16.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.951+0000 7f09bfb6f640 1 -- 172.21.15.86:0/1160416863 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09b8153310 con 0x7f09b8154f30 2024-09-19T06:39:16.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.952+0000 7f09b67fc640 1 -- 172.21.15.86:0/1160416863 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6044 (secure 0 0 0) 0x7f09a807e910 con 0x7f09b8154f30 2024-09-19T06:39:16.954 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:39:16.954 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":10,"btime":"2024-09-19T06:39:15:476406+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:39:15.476402+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":0,"incarnation":10,"state":"up:replay","state_seq":1,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:39:16.954 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 10 2024-09-19T06:39:16.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.954+0000 7f09bfb6f640 1 -- 172.21.15.86:0/1160416863 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f09a406c2b0 msgr2=0x7f09a406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:16.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.954+0000 7f09bfb6f640 1 --2- 172.21.15.86:0/1160416863 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f09a406c2b0 0x7f09a406e770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f09b0000c00 tx=0x7f09b0009040 comp rx=0 tx=0).stop 2024-09-19T06:39:16.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.954+0000 7f09bfb6f640 1 -- 172.21.15.86:0/1160416863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09b8154f30 msgr2=0x7f09b813aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:16.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.954+0000 7f09bfb6f640 1 --2- 172.21.15.86:0/1160416863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09b8154f30 0x7f09b813aea0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f09a800e200 tx=0x7f09a8009750 comp rx=0 tx=0).stop 2024-09-19T06:39:16.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.954+0000 7f09bfb6f640 1 -- 172.21.15.86:0/1160416863 shutdown_connections 2024-09-19T06:39:16.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.954+0000 7f09bfb6f640 1 --2- 172.21.15.86:0/1160416863 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f09a406c2b0 0x7f09a406e770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.954+0000 7f09bfb6f640 1 --2- 172.21.15.86:0/1160416863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09b8154f30 0x7f09b813aea0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.954+0000 7f09bfb6f640 1 --2- 172.21.15.86:0/1160416863 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09b8154070 0x7f09b813d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.954+0000 7f09bfb6f640 1 --2- 172.21.15.86:0/1160416863 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09a00051c0 0x7f09b81f0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.954+0000 7f09bfb6f640 1 -- 172.21.15.86:0/1160416863 >> 172.21.15.86:0/1160416863 conn(0x7f09b8070c10 msgr2=0x7f09b81572c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:16.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.954+0000 7f09bfb6f640 1 -- 172.21.15.86:0/1160416863 shutdown_connections 2024-09-19T06:39:16.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:16.954+0000 7f09bfb6f640 1 -- 172.21.15.86:0/1160416863 wait complete. 2024-09-19T06:39:16.967 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "btime": "2024-09-19T06:39:15:476406+0000", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 10, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-19T06:37:08.763572+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 10, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4281": { "addr": "172.21.15.86:6839/1060607293", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6838", "nonce": 1060607293, "type": "v2" }, { "addr": "172.21.15.86:6839", "nonce": 1060607293, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4281, "incarnation": 10, "join_fscid": -1, "name": "e", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-09-19T06:39:15.476402+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4281 } } } ], "standbys": [ { "addr": "172.21.15.86:6837/728803297", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6835", "nonce": 728803297, "type": "v2" }, { "addr": "172.21.15.86:6837", "nonce": 728803297, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4247, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.169:6835/2537509253", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6833", "nonce": 2537509253, "type": "v2" }, { "addr": "172.21.15.169:6835", "nonce": 2537509253, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4262, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.169:6834/1723647527", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6832", "nonce": 1723647527, "type": "v2" }, { "addr": "172.21.15.169:6834", "nonce": 1723647527, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4265, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.86:6836/4135959816", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6834", "nonce": 4135959816, "type": "v2" }, { "addr": "172.21.15.86:6836", "nonce": 4135959816, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4270, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-09-19T06:39:18.968 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:39:19.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.078+0000 7f800b786640 1 Processor -- start 2024-09-19T06:39:19.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.078+0000 7f800b786640 1 -- start start 2024-09-19T06:39:19.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.078+0000 7f800b786640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f80040d0d40 0x7f80040ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:19.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.079+0000 7f800b786640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f800415c9c0 con 0x7f80040d1120 2024-09-19T06:39:19.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.079+0000 7f800b786640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f800415cca0 con 0x7f800415e170 2024-09-19T06:39:19.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.079+0000 7f800b786640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f800415c770 con 0x7f80040d0d40 2024-09-19T06:39:19.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.079+0000 7f8009522640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f80040d0d40 0x7f80040ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:19.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.079+0000 7f8008d21640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f80040d1120 0x7f800415da60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:59306/0 (socket says 172.21.15.86:59306) 2024-09-19T06:39:19.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.079+0000 7f8008d21640 1 -- 172.21.15.86:0/3991693132 learned_addr learned my addr 172.21.15.86:0/3991693132 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:39:19.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.079+0000 7f8009522640 1 -- 172.21.15.86:0/3991693132 >> v1:172.21.15.169:6789/0 conn(0x7f800415e170 legacy=0x7f80040b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:19.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.079+0000 7f8009522640 1 -- 172.21.15.86:0/3991693132 >> v1:172.21.15.86:6789/0 conn(0x7f80040d1120 legacy=0x7f800415da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:19.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.079+0000 7f7ff7fff640 1 -- 172.21.15.86:0/3991693132 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2467317394 0 0) 0x7f800415c9c0 con 0x7f80040d1120 2024-09-19T06:39:19.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.079+0000 7f8009522640 1 -- 172.21.15.86:0/3991693132 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f800415cf80 con 0x7f80040d0d40 2024-09-19T06:39:19.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.080+0000 7f8009522640 1 --2- 172.21.15.86:0/3991693132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80040d0d40 0x7f80040ca6c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f80000097a0 tx=0x7f800002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698579c5cde6f82 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:19.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.080+0000 7f7ff7fff640 1 -- 172.21.15.86:0/3991693132 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8000037070 con 0x7f80040d0d40 2024-09-19T06:39:19.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.080+0000 7f7ff7fff640 1 -- 172.21.15.86:0/3991693132 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8000032440 con 0x7f80040d0d40 2024-09-19T06:39:19.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.080+0000 7f7ff7fff640 1 -- 172.21.15.86:0/3991693132 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8000032810 con 0x7f80040d0d40 2024-09-19T06:39:19.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.080+0000 7f800b786640 1 -- 172.21.15.86:0/3991693132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80040d0d40 msgr2=0x7f80040ca6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:19.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.080+0000 7f800b786640 1 --2- 172.21.15.86:0/3991693132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80040d0d40 0x7f80040ca6c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f80000097a0 tx=0x7f800002a1e0 comp rx=0 tx=0).stop 2024-09-19T06:39:19.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.081+0000 7f800b786640 1 -- 172.21.15.86:0/3991693132 shutdown_connections 2024-09-19T06:39:19.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.081+0000 7f800b786640 1 --2- 172.21.15.86:0/3991693132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80040d0d40 0x7f80040ca6c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:19.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.081+0000 7f800b786640 1 -- 172.21.15.86:0/3991693132 >> 172.21.15.86:0/3991693132 conn(0x7f800406d910 msgr2=0x7f800406dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:19.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.081+0000 7f800b786640 1 -- 172.21.15.86:0/3991693132 shutdown_connections 2024-09-19T06:39:19.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.081+0000 7f800b786640 1 -- 172.21.15.86:0/3991693132 wait complete. 2024-09-19T06:39:19.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.082+0000 7f800b786640 1 Processor -- start 2024-09-19T06:39:19.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.082+0000 7f800b786640 1 -- start start 2024-09-19T06:39:19.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.082+0000 7f800b786640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80040d0d40 0x7f80040c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:19.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.082+0000 7f800b786640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80040d1120 0x7f800415b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:19.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.082+0000 7f800b786640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f800415e170 0x7f800415bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:19.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.082+0000 7f800b786640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f80040cac00 con 0x7f800415e170 2024-09-19T06:39:19.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.082+0000 7f800b786640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f80040b3f20 con 0x7f80040d0d40 2024-09-19T06:39:19.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.082+0000 7f800b786640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f80040cad80 con 0x7f80040d1120 2024-09-19T06:39:19.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.083+0000 7f8009d23640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f800415e170 0x7f800415bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:19.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.083+0000 7f8009d23640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f800415e170 0x7f800415bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36750/0 (socket says 172.21.15.86:36750) 2024-09-19T06:39:19.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.083+0000 7f8009d23640 1 -- 172.21.15.86:0/3591300736 learned_addr learned my addr 172.21.15.86:0/3591300736 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:39:19.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.083+0000 7f8009522640 1 --2- 172.21.15.86:0/3591300736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80040d0d40 0x7f80040c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:19.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.083+0000 7f8008d21640 1 --2- 172.21.15.86:0/3591300736 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80040d1120 0x7f800415b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:19.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.083+0000 7f8009d23640 1 -- 172.21.15.86:0/3591300736 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80040d1120 msgr2=0x7f800415b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:19.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.083+0000 7f8009d23640 1 --2- 172.21.15.86:0/3591300736 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80040d1120 0x7f800415b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:19.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.083+0000 7f8009d23640 1 -- 172.21.15.86:0/3591300736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80040d0d40 msgr2=0x7f80040c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:19.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.083+0000 7f8009d23640 1 --2- 172.21.15.86:0/3591300736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80040d0d40 0x7f80040c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:19.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.083+0000 7f8009d23640 1 -- 172.21.15.86:0/3591300736 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80040c6fa0 con 0x7f800415e170 2024-09-19T06:39:19.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.083+0000 7f8008d21640 1 --2- 172.21.15.86:0/3591300736 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80040d1120 0x7f800415b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:19.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.083+0000 7f8009d23640 1 --2- 172.21.15.86:0/3591300736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f800415e170 0x7f800415bd90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00b970 tx=0x7f7ffc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:19.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.083+0000 7f7ff5ffb640 1 -- 172.21.15.86:0/3591300736 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc019070 con 0x7f800415e170 2024-09-19T06:39:19.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.083+0000 7f7ff5ffb640 1 -- 172.21.15.86:0/3591300736 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ffc00cb40 con 0x7f800415e170 2024-09-19T06:39:19.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.083+0000 7f800b786640 1 -- 172.21.15.86:0/3591300736 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f800415c2d0 con 0x7f800415e170 2024-09-19T06:39:19.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.083+0000 7f7ff5ffb640 1 -- 172.21.15.86:0/3591300736 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc014440 con 0x7f800415e170 2024-09-19T06:39:19.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.084+0000 7f800b786640 1 -- 172.21.15.86:0/3591300736 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80040c7210 con 0x7f800415e170 2024-09-19T06:39:19.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.084+0000 7f800b786640 1 -- 172.21.15.86:0/3591300736 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80040ca6c0 con 0x7f800415e170 2024-09-19T06:39:19.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.085+0000 7f7ff5ffb640 1 -- 172.21.15.86:0/3591300736 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7ffc01c070 con 0x7f800415e170 2024-09-19T06:39:19.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.085+0000 7f7ff5ffb640 1 --2- 172.21.15.86:0/3591300736 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7fe806c2b0 0x7f7fe806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:19.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.085+0000 7f7ff5ffb640 1 -- 172.21.15.86:0/3591300736 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6821+0+0 (secure 0 0 0) 0x7f7ffc08b4b0 con 0x7f800415e170 2024-09-19T06:39:19.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.085+0000 7f8009522640 1 --2- 172.21.15.86:0/3591300736 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7fe806c2b0 0x7f7fe806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:19.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.086+0000 7f8009522640 1 --2- 172.21.15.86:0/3591300736 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7fe806c2b0 0x7f7fe806e770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8000034000 tx=0x7f800002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:19.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.089+0000 7f7ff5ffb640 1 -- 172.21.15.86:0/3591300736 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7ffc0590e0 con 0x7f800415e170 2024-09-19T06:39:19.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.290+0000 7f800b786640 1 -- 172.21.15.86:0/3591300736 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80040b57d0 con 0x7f800415e170 2024-09-19T06:39:19.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.290+0000 7f7ff5ffb640 1 -- 172.21.15.86:0/3591300736 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6044 (secure 0 0 0) 0x7f7ffc05d3e0 con 0x7f800415e170 2024-09-19T06:39:19.292 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:39:19.293 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":10,"btime":"2024-09-19T06:39:15:476406+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:39:15.476402+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":0,"incarnation":10,"state":"up:replay","state_seq":1,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:39:19.293 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 10 2024-09-19T06:39:19.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.292+0000 7f800b786640 1 -- 172.21.15.86:0/3591300736 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7fe806c2b0 msgr2=0x7f7fe806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:19.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.292+0000 7f800b786640 1 --2- 172.21.15.86:0/3591300736 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7fe806c2b0 0x7f7fe806e770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8000034000 tx=0x7f800002e000 comp rx=0 tx=0).stop 2024-09-19T06:39:19.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.292+0000 7f800b786640 1 -- 172.21.15.86:0/3591300736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f800415e170 msgr2=0x7f800415bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:19.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.292+0000 7f800b786640 1 --2- 172.21.15.86:0/3591300736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f800415e170 0x7f800415bd90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00b970 tx=0x7f7ffc00be30 comp rx=0 tx=0).stop 2024-09-19T06:39:19.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.293+0000 7f800b786640 1 -- 172.21.15.86:0/3591300736 shutdown_connections 2024-09-19T06:39:19.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.293+0000 7f800b786640 1 --2- 172.21.15.86:0/3591300736 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7fe806c2b0 0x7f7fe806e770 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:19.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.293+0000 7f800b786640 1 --2- 172.21.15.86:0/3591300736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f800415e170 0x7f800415bd90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:19.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.293+0000 7f800b786640 1 --2- 172.21.15.86:0/3591300736 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80040d1120 0x7f800415b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:19.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.293+0000 7f800b786640 1 --2- 172.21.15.86:0/3591300736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80040d0d40 0x7f80040c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:19.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.293+0000 7f800b786640 1 -- 172.21.15.86:0/3591300736 >> 172.21.15.86:0/3591300736 conn(0x7f800406d910 msgr2=0x7f80040c8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:19.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.293+0000 7f800b786640 1 -- 172.21.15.86:0/3591300736 shutdown_connections 2024-09-19T06:39:19.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:19.293+0000 7f800b786640 1 -- 172.21.15.86:0/3591300736 wait complete. 2024-09-19T06:39:19.305 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:39:21.306 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:39:21.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.407+0000 7f84d61be640 1 Processor -- start 2024-09-19T06:39:21.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.407+0000 7f84d61be640 1 -- start start 2024-09-19T06:39:21.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.408+0000 7f84d61be640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84d015e690 0x7f84d015eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:21.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.408+0000 7f84d61be640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84d015f060 con 0x7f84d0154eb0 2024-09-19T06:39:21.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.408+0000 7f84d61be640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84d015b190 con 0x7f84d006d690 2024-09-19T06:39:21.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.408+0000 7f84d61be640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f84d015b470 con 0x7f84d015e690 2024-09-19T06:39:21.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.408+0000 7f84cf7fe640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f84d0154eb0 0x7f84d00cb930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:59310/0 (socket says 172.21.15.86:59310) 2024-09-19T06:39:21.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.408+0000 7f84cf7fe640 1 -- 172.21.15.86:0/1683480219 learned_addr learned my addr 172.21.15.86:0/1683480219 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:39:21.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.408+0000 7f84cffff640 1 --2- 172.21.15.86:0/1683480219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84d015e690 0x7f84d015eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:21.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.408+0000 7f84ce7fc640 1 -- 172.21.15.86:0/1683480219 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1097480291 0 0) 0x7f84d015f060 con 0x7f84d0154eb0 2024-09-19T06:39:21.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.408+0000 7f84ce7fc640 1 -- 172.21.15.86:0/1683480219 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84b8003520 con 0x7f84d0154eb0 2024-09-19T06:39:21.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.409+0000 7f84ce7fc640 1 -- 172.21.15.86:0/1683480219 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1687024781 0 0) 0x7f84d015b190 con 0x7f84d006d690 2024-09-19T06:39:21.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.409+0000 7f84ce7fc640 1 -- 172.21.15.86:0/1683480219 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84d015f060 con 0x7f84d006d690 2024-09-19T06:39:21.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.409+0000 7f84ce7fc640 1 -- 172.21.15.86:0/1683480219 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4087192187 0 0) 0x7f84b8003520 con 0x7f84d0154eb0 2024-09-19T06:39:21.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.409+0000 7f84cffff640 1 -- 172.21.15.86:0/1683480219 >> v1:172.21.15.169:6789/0 conn(0x7f84d006d690 legacy=0x7f84d0073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:21.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.409+0000 7f84cffff640 1 -- 172.21.15.86:0/1683480219 >> v1:172.21.15.86:6789/0 conn(0x7f84d0154eb0 legacy=0x7f84d00cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:21.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.409+0000 7f84cffff640 1 -- 172.21.15.86:0/1683480219 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d015b750 con 0x7f84d015e690 2024-09-19T06:39:21.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.409+0000 7f84cffff640 1 --2- 172.21.15.86:0/1683480219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84d015e690 0x7f84d015eb20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009dc0 tx=0x7f84c802a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bda2b409132bb6f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:21.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.410+0000 7f84ce7fc640 1 -- 172.21.15.86:0/1683480219 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c0001670 con 0x7f84d015e690 2024-09-19T06:39:21.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.410+0000 7f84ce7fc640 1 -- 172.21.15.86:0/1683480219 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84c802ae50 con 0x7f84d015e690 2024-09-19T06:39:21.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.410+0000 7f84ce7fc640 1 -- 172.21.15.86:0/1683480219 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c8007760 con 0x7f84d015e690 2024-09-19T06:39:21.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.410+0000 7f84d61be640 1 -- 172.21.15.86:0/1683480219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84d015e690 msgr2=0x7f84d015eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:21.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.410+0000 7f84d61be640 1 --2- 172.21.15.86:0/1683480219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84d015e690 0x7f84d015eb20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009dc0 tx=0x7f84c802a6f0 comp rx=0 tx=0).stop 2024-09-19T06:39:21.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.410+0000 7f84d61be640 1 -- 172.21.15.86:0/1683480219 shutdown_connections 2024-09-19T06:39:21.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.410+0000 7f84d61be640 1 --2- 172.21.15.86:0/1683480219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84d015e690 0x7f84d015eb20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:21.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.410+0000 7f84d61be640 1 -- 172.21.15.86:0/1683480219 >> 172.21.15.86:0/1683480219 conn(0x7f84d0070d10 msgr2=0x7f84d00710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:21.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.410+0000 7f84d61be640 1 -- 172.21.15.86:0/1683480219 shutdown_connections 2024-09-19T06:39:21.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.410+0000 7f84d61be640 1 -- 172.21.15.86:0/1683480219 wait complete. 2024-09-19T06:39:21.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.411+0000 7f84d61be640 1 Processor -- start 2024-09-19T06:39:21.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.411+0000 7f84d61be640 1 -- start start 2024-09-19T06:39:21.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.412+0000 7f84d61be640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84d006d690 0x7f84d01f4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:21.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.412+0000 7f84d61be640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84d0154eb0 0x7f84d015d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:21.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.412+0000 7f84d61be640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84d015e690 0x7f84d0144030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:21.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.412+0000 7f84d61be640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f84d00c91a0 con 0x7f84d0154eb0 2024-09-19T06:39:21.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.412+0000 7f84d61be640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f84d015bd10 con 0x7f84d006d690 2024-09-19T06:39:21.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.412+0000 7f84d61be640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f84d00c9320 con 0x7f84d015e690 2024-09-19T06:39:21.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.412+0000 7f84ceffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84d0154eb0 0x7f84d015d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:21.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.412+0000 7f84ceffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84d0154eb0 0x7f84d015d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36758/0 (socket says 172.21.15.86:36758) 2024-09-19T06:39:21.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.412+0000 7f84ceffd640 1 -- 172.21.15.86:0/2830512759 learned_addr learned my addr 172.21.15.86:0/2830512759 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:39:21.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.412+0000 7f84cf7fe640 1 --2- 172.21.15.86:0/2830512759 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84d006d690 0x7f84d01f4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:21.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.412+0000 7f84cffff640 1 --2- 172.21.15.86:0/2830512759 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84d015e690 0x7f84d0144030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:21.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.413+0000 7f84ceffd640 1 -- 172.21.15.86:0/2830512759 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84d015e690 msgr2=0x7f84d0144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:21.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.413+0000 7f84ceffd640 1 --2- 172.21.15.86:0/2830512759 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84d015e690 0x7f84d0144030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:21.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.413+0000 7f84ceffd640 1 -- 172.21.15.86:0/2830512759 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84d006d690 msgr2=0x7f84d01f4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:21.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.413+0000 7f84ceffd640 1 --2- 172.21.15.86:0/2830512759 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84d006d690 0x7f84d01f4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:21.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.413+0000 7f84ceffd640 1 -- 172.21.15.86:0/2830512759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d00c7c20 con 0x7f84d0154eb0 2024-09-19T06:39:21.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.413+0000 7f84cffff640 1 --2- 172.21.15.86:0/2830512759 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84d015e690 0x7f84d0144030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:21.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.413+0000 7f84ceffd640 1 --2- 172.21.15.86:0/2830512759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84d0154eb0 0x7f84d015d420 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f84c400c500 tx=0x7f84c400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:21.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.413+0000 7f84b7fff640 1 -- 172.21.15.86:0/2830512759 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c40052d0 con 0x7f84d0154eb0 2024-09-19T06:39:21.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.413+0000 7f84b7fff640 1 -- 172.21.15.86:0/2830512759 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84c4005490 con 0x7f84d0154eb0 2024-09-19T06:39:21.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.413+0000 7f84b7fff640 1 -- 172.21.15.86:0/2830512759 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c4012870 con 0x7f84d0154eb0 2024-09-19T06:39:21.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.413+0000 7f84d61be640 1 -- 172.21.15.86:0/2830512759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84d01f4eb0 con 0x7f84d0154eb0 2024-09-19T06:39:21.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.413+0000 7f84d61be640 1 -- 172.21.15.86:0/2830512759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84d00cc740 con 0x7f84d0154eb0 2024-09-19T06:39:21.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.414+0000 7f84d61be640 1 -- 172.21.15.86:0/2830512759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84d0155290 con 0x7f84d0154eb0 2024-09-19T06:39:21.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.414+0000 7f84b7fff640 1 -- 172.21.15.86:0/2830512759 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f84c4012a10 con 0x7f84d0154eb0 2024-09-19T06:39:21.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.415+0000 7f84b7fff640 1 --2- 172.21.15.86:0/2830512759 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f84bc06c2b0 0x7f84bc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:21.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.415+0000 7f84b7fff640 1 -- 172.21.15.86:0/2830512759 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6821+0+0 (secure 0 0 0) 0x7f84c408b4a0 con 0x7f84d0154eb0 2024-09-19T06:39:21.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.415+0000 7f84cf7fe640 1 --2- 172.21.15.86:0/2830512759 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f84bc06c2b0 0x7f84bc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:21.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.415+0000 7f84cf7fe640 1 --2- 172.21.15.86:0/2830512759 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f84bc06c2b0 0x7f84bc06e770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f84c0001eb0 tx=0x7f84c00016d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:21.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.419+0000 7f84b7fff640 1 -- 172.21.15.86:0/2830512759 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f84c40597c0 con 0x7f84d0154eb0 2024-09-19T06:39:21.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.621+0000 7f84d61be640 1 -- 172.21.15.86:0/2830512759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f84d00cae50 con 0x7f84d0154eb0 2024-09-19T06:39:21.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.621+0000 7f84b7fff640 1 -- 172.21.15.86:0/2830512759 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6048 (secure 0 0 0) 0x7f84c40590c0 con 0x7f84d0154eb0 2024-09-19T06:39:21.623 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:39:21.623 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":11,"btime":"2024-09-19T06:39:20:721043+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:39:20.687629+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":0,"incarnation":10,"state":"up:reconnect","state_seq":36,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:39:21.623 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 11 2024-09-19T06:39:21.625 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.623+0000 7f84d61be640 1 -- 172.21.15.86:0/2830512759 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f84bc06c2b0 msgr2=0x7f84bc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:21.625 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.623+0000 7f84d61be640 1 --2- 172.21.15.86:0/2830512759 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f84bc06c2b0 0x7f84bc06e770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f84c0001eb0 tx=0x7f84c00016d0 comp rx=0 tx=0).stop 2024-09-19T06:39:21.625 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.623+0000 7f84d61be640 1 -- 172.21.15.86:0/2830512759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84d0154eb0 msgr2=0x7f84d015d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:21.625 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.623+0000 7f84d61be640 1 --2- 172.21.15.86:0/2830512759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84d0154eb0 0x7f84d015d420 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f84c400c500 tx=0x7f84c400c9c0 comp rx=0 tx=0).stop 2024-09-19T06:39:21.625 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.623+0000 7f84d61be640 1 -- 172.21.15.86:0/2830512759 shutdown_connections 2024-09-19T06:39:21.625 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.623+0000 7f84d61be640 1 --2- 172.21.15.86:0/2830512759 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f84bc06c2b0 0x7f84bc06e770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:21.625 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.623+0000 7f84d61be640 1 --2- 172.21.15.86:0/2830512759 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84d015e690 0x7f84d0144030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:21.625 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.623+0000 7f84d61be640 1 --2- 172.21.15.86:0/2830512759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84d0154eb0 0x7f84d015d420 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:21.625 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.623+0000 7f84d61be640 1 --2- 172.21.15.86:0/2830512759 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84d006d690 0x7f84d01f4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:21.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.623+0000 7f84d61be640 1 -- 172.21.15.86:0/2830512759 >> 172.21.15.86:0/2830512759 conn(0x7f84d0070d10 msgr2=0x7f84d014a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:21.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.623+0000 7f84d61be640 1 -- 172.21.15.86:0/2830512759 shutdown_connections 2024-09-19T06:39:21.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:21.623+0000 7f84d61be640 1 -- 172.21.15.86:0/2830512759 wait complete. 2024-09-19T06:39:21.636 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:39:23.636 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:39:23.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.746+0000 7fa6775ef640 1 Processor -- start 2024-09-19T06:39:23.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.746+0000 7fa6775ef640 1 -- start start 2024-09-19T06:39:23.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.747+0000 7fa6775ef640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa670152c20 0x7fa670153000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:23.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.747+0000 7fa6775ef640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa670158d70 con 0x7fa6700c64a0 2024-09-19T06:39:23.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.747+0000 7fa6775ef640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6700c3d20 con 0x7fa6700c68e0 2024-09-19T06:39:23.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.747+0000 7fa6775ef640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa6700c4000 con 0x7fa670152c20 2024-09-19T06:39:23.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.747+0000 7fa674b8a640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa6700c64a0 0x7fa6700c7310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:46292/0 (socket says 172.21.15.86:46292) 2024-09-19T06:39:23.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.747+0000 7fa674b8a640 1 -- 172.21.15.86:0/3482743070 learned_addr learned my addr 172.21.15.86:0/3482743070 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:39:23.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.748+0000 7fa67538b640 1 --2- 172.21.15.86:0/3482743070 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa670152c20 0x7fa670153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:23.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.748+0000 7fa66ffff640 1 -- 172.21.15.86:0/3482743070 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1368092268 0 0) 0x7fa670158d70 con 0x7fa6700c64a0 2024-09-19T06:39:23.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.748+0000 7fa66ffff640 1 -- 172.21.15.86:0/3482743070 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa658003520 con 0x7fa6700c64a0 2024-09-19T06:39:23.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.748+0000 7fa66ffff640 1 -- 172.21.15.86:0/3482743070 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3373117601 0 0) 0x7fa6700c3d20 con 0x7fa6700c68e0 2024-09-19T06:39:23.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.748+0000 7fa66ffff640 1 -- 172.21.15.86:0/3482743070 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa670158d70 con 0x7fa6700c68e0 2024-09-19T06:39:23.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.748+0000 7fa67538b640 1 -- 172.21.15.86:0/3482743070 >> v1:172.21.15.169:6789/0 conn(0x7fa6700c68e0 legacy=0x7fa6700730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:23.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.748+0000 7fa67538b640 1 -- 172.21.15.86:0/3482743070 >> v1:172.21.15.86:6789/0 conn(0x7fa6700c64a0 legacy=0x7fa6700c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:23.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.748+0000 7fa67538b640 1 -- 172.21.15.86:0/3482743070 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6700c42e0 con 0x7fa670152c20 2024-09-19T06:39:23.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.749+0000 7fa67538b640 1 --2- 172.21.15.86:0/3482743070 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa670152c20 0x7fa670153000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa660009dc0 tx=0x7fa66002a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0041352771495ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:23.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.749+0000 7fa66ffff640 1 -- 172.21.15.86:0/3482743070 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa660007740 con 0x7fa670152c20 2024-09-19T06:39:23.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.749+0000 7fa66ffff640 1 -- 172.21.15.86:0/3482743070 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6600078e0 con 0x7fa670152c20 2024-09-19T06:39:23.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.749+0000 7fa66ffff640 1 -- 172.21.15.86:0/3482743070 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa660007cb0 con 0x7fa670152c20 2024-09-19T06:39:23.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.749+0000 7fa6775ef640 1 -- 172.21.15.86:0/3482743070 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa670152c20 msgr2=0x7fa670153000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:23.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.749+0000 7fa6775ef640 1 --2- 172.21.15.86:0/3482743070 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa670152c20 0x7fa670153000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa660009dc0 tx=0x7fa66002a760 comp rx=0 tx=0).stop 2024-09-19T06:39:23.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.750+0000 7fa6775ef640 1 -- 172.21.15.86:0/3482743070 shutdown_connections 2024-09-19T06:39:23.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.750+0000 7fa6775ef640 1 --2- 172.21.15.86:0/3482743070 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa670152c20 0x7fa670153000 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:23.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.750+0000 7fa6775ef640 1 -- 172.21.15.86:0/3482743070 >> 172.21.15.86:0/3482743070 conn(0x7fa6700c9280 msgr2=0x7fa6700c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:23.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.750+0000 7fa6775ef640 1 -- 172.21.15.86:0/3482743070 shutdown_connections 2024-09-19T06:39:23.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.750+0000 7fa6775ef640 1 -- 172.21.15.86:0/3482743070 wait complete. 2024-09-19T06:39:23.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.751+0000 7fa6775ef640 1 Processor -- start 2024-09-19T06:39:23.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.751+0000 7fa6775ef640 1 -- start start 2024-09-19T06:39:23.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.752+0000 7fa6775ef640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6700c64a0 0x7fa670145430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:23.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.752+0000 7fa6775ef640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6700c68e0 0x7fa67014a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:23.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.752+0000 7fa6775ef640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa670152c20 0x7fa6701f11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:23.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.752+0000 7fa6775ef640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa6700c48a0 con 0x7fa6700c68e0 2024-09-19T06:39:23.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.752+0000 7fa6775ef640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa67006d900 con 0x7fa6700c64a0 2024-09-19T06:39:23.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.752+0000 7fa6775ef640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa6700c4a20 con 0x7fa670152c20 2024-09-19T06:39:23.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.752+0000 7fa674b8a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6700c68e0 0x7fa67014a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:23.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.752+0000 7fa674b8a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6700c68e0 0x7fa67014a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58706/0 (socket says 172.21.15.86:58706) 2024-09-19T06:39:23.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.752+0000 7fa674b8a640 1 -- 172.21.15.86:0/2616087383 learned_addr learned my addr 172.21.15.86:0/2616087383 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:39:23.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.752+0000 7fa67538b640 1 --2- 172.21.15.86:0/2616087383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6700c64a0 0x7fa670145430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:23.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.752+0000 7fa675b8c640 1 --2- 172.21.15.86:0/2616087383 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa670152c20 0x7fa6701f11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:23.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.752+0000 7fa674b8a640 1 -- 172.21.15.86:0/2616087383 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa670152c20 msgr2=0x7fa6701f11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:23.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.752+0000 7fa674b8a640 1 --2- 172.21.15.86:0/2616087383 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa670152c20 0x7fa6701f11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:23.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.752+0000 7fa674b8a640 1 -- 172.21.15.86:0/2616087383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6700c64a0 msgr2=0x7fa670145430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:23.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.752+0000 7fa674b8a640 1 --2- 172.21.15.86:0/2616087383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6700c64a0 0x7fa670145430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:23.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.752+0000 7fa674b8a640 1 -- 172.21.15.86:0/2616087383 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6701f2ab0 con 0x7fa6700c68e0 2024-09-19T06:39:23.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.752+0000 7fa674b8a640 1 --2- 172.21.15.86:0/2616087383 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6700c68e0 0x7fa67014a5e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa66400c4d0 tx=0x7fa66400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:23.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.752+0000 7fa66dffb640 1 -- 172.21.15.86:0/2616087383 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa664017070 con 0x7fa6700c68e0 2024-09-19T06:39:23.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.752+0000 7fa66dffb640 1 -- 172.21.15.86:0/2616087383 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa664005ce0 con 0x7fa6700c68e0 2024-09-19T06:39:23.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.752+0000 7fa6775ef640 1 -- 172.21.15.86:0/2616087383 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa670149820 con 0x7fa6700c68e0 2024-09-19T06:39:23.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.752+0000 7fa66dffb640 1 -- 172.21.15.86:0/2616087383 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa664007270 con 0x7fa6700c68e0 2024-09-19T06:39:23.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.753+0000 7fa6775ef640 1 -- 172.21.15.86:0/2616087383 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa670149de0 con 0x7fa6700c68e0 2024-09-19T06:39:23.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.754+0000 7fa6775ef640 1 -- 172.21.15.86:0/2616087383 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa670069630 con 0x7fa6700c68e0 2024-09-19T06:39:23.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.754+0000 7fa66dffb640 1 -- 172.21.15.86:0/2616087383 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa66401a070 con 0x7fa6700c68e0 2024-09-19T06:39:23.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.755+0000 7fa66dffb640 1 --2- 172.21.15.86:0/2616087383 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa65c06c2b0 0x7fa65c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:23.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.755+0000 7fa66dffb640 1 -- 172.21.15.86:0/2616087383 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6821+0+0 (secure 0 0 0) 0x7fa66408ab30 con 0x7fa6700c68e0 2024-09-19T06:39:23.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.755+0000 7fa67538b640 1 --2- 172.21.15.86:0/2616087383 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa65c06c2b0 0x7fa65c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:23.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.755+0000 7fa67538b640 1 --2- 172.21.15.86:0/2616087383 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa65c06c2b0 0x7fa65c06e770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa660034000 tx=0x7fa66002f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:23.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.759+0000 7fa66dffb640 1 -- 172.21.15.86:0/2616087383 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa670069630 con 0x7fa6700c68e0 2024-09-19T06:39:23.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.958+0000 7fa6775ef640 1 -- 172.21.15.86:0/2616087383 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa670153000 con 0x7fa6700c68e0 2024-09-19T06:39:23.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.959+0000 7fa66dffb640 1 -- 172.21.15.86:0/2616087383 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6048 (secure 0 0 0) 0x7fa664058800 con 0x7fa6700c68e0 2024-09-19T06:39:23.960 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:39:23.960 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":11,"btime":"2024-09-19T06:39:20:721043+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:39:20.687629+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":0,"incarnation":10,"state":"up:reconnect","state_seq":36,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:39:23.961 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 11 2024-09-19T06:39:23.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.961+0000 7fa6775ef640 1 -- 172.21.15.86:0/2616087383 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa65c06c2b0 msgr2=0x7fa65c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:23.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.961+0000 7fa6775ef640 1 --2- 172.21.15.86:0/2616087383 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa65c06c2b0 0x7fa65c06e770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa660034000 tx=0x7fa66002f000 comp rx=0 tx=0).stop 2024-09-19T06:39:23.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.961+0000 7fa6775ef640 1 -- 172.21.15.86:0/2616087383 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6700c68e0 msgr2=0x7fa67014a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:23.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.961+0000 7fa6775ef640 1 --2- 172.21.15.86:0/2616087383 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6700c68e0 0x7fa67014a5e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa66400c4d0 tx=0x7fa66400c990 comp rx=0 tx=0).stop 2024-09-19T06:39:23.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.961+0000 7fa6775ef640 1 -- 172.21.15.86:0/2616087383 shutdown_connections 2024-09-19T06:39:23.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.961+0000 7fa6775ef640 1 --2- 172.21.15.86:0/2616087383 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa65c06c2b0 0x7fa65c06e770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:23.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.961+0000 7fa6775ef640 1 --2- 172.21.15.86:0/2616087383 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa670152c20 0x7fa6701f11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:23.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.961+0000 7fa6775ef640 1 --2- 172.21.15.86:0/2616087383 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6700c68e0 0x7fa67014a5e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:23.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.961+0000 7fa6775ef640 1 --2- 172.21.15.86:0/2616087383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6700c64a0 0x7fa670145430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:23.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.961+0000 7fa6775ef640 1 -- 172.21.15.86:0/2616087383 >> 172.21.15.86:0/2616087383 conn(0x7fa6700c9280 msgr2=0x7fa67006bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:23.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.961+0000 7fa6775ef640 1 -- 172.21.15.86:0/2616087383 shutdown_connections 2024-09-19T06:39:23.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:23.961+0000 7fa6775ef640 1 -- 172.21.15.86:0/2616087383 wait complete. 2024-09-19T06:39:23.973 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:39:25.974 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:39:26.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.084+0000 7f99bed28640 1 Processor -- start 2024-09-19T06:39:26.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.084+0000 7f99bed28640 1 -- start start 2024-09-19T06:39:26.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.085+0000 7f99bed28640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f99b8152c20 0x7f99b8153000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:26.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.085+0000 7f99bed28640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99b8158d70 con 0x7f99b80c64a0 2024-09-19T06:39:26.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.085+0000 7f99bed28640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99b80c3d20 con 0x7f99b80c6910 2024-09-19T06:39:26.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.085+0000 7f99bed28640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f99b80c4000 con 0x7f99b8152c20 2024-09-19T06:39:26.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.085+0000 7f99bcac4640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f99b8152c20 0x7f99b8153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:26.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.085+0000 7f99bcac4640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f99b8152c20 0x7f99b8153000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58708/0 (socket says 172.21.15.86:58708) 2024-09-19T06:39:26.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.085+0000 7f99affff640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f99b80c64a0 0x7f99b80c7310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:46296/0 (socket says 172.21.15.86:46296) 2024-09-19T06:39:26.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.085+0000 7f99bcac4640 1 -- 172.21.15.86:0/1276433898 learned_addr learned my addr 172.21.15.86:0/1276433898 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:39:26.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.085+0000 7f99bcac4640 1 -- 172.21.15.86:0/1276433898 >> v1:172.21.15.169:6789/0 conn(0x7f99b80c6910 legacy=0x7f99b80730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:26.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.085+0000 7f99bcac4640 1 -- 172.21.15.86:0/1276433898 >> v1:172.21.15.86:6789/0 conn(0x7f99b80c64a0 legacy=0x7f99b80c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:26.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.085+0000 7f99bcac4640 1 -- 172.21.15.86:0/1276433898 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b80c42e0 con 0x7f99b8152c20 2024-09-19T06:39:26.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.086+0000 7f99bcac4640 1 --2- 172.21.15.86:0/1276433898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b8152c20 0x7f99b8153000 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009870 tx=0x7f99b402a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6068f269929703e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:26.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.086+0000 7f99af7fe640 1 -- 172.21.15.86:0/1276433898 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b4037070 con 0x7f99b8152c20 2024-09-19T06:39:26.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.086+0000 7f99af7fe640 1 -- 172.21.15.86:0/1276433898 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b4032640 con 0x7f99b8152c20 2024-09-19T06:39:26.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.086+0000 7f99af7fe640 1 -- 172.21.15.86:0/1276433898 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b4032a10 con 0x7f99b8152c20 2024-09-19T06:39:26.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.087+0000 7f99bed28640 1 -- 172.21.15.86:0/1276433898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b8152c20 msgr2=0x7f99b8153000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:26.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.087+0000 7f99bed28640 1 --2- 172.21.15.86:0/1276433898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b8152c20 0x7f99b8153000 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009870 tx=0x7f99b402a330 comp rx=0 tx=0).stop 2024-09-19T06:39:26.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.087+0000 7f99bed28640 1 -- 172.21.15.86:0/1276433898 shutdown_connections 2024-09-19T06:39:26.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.087+0000 7f99bed28640 1 --2- 172.21.15.86:0/1276433898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b8152c20 0x7f99b8153000 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:26.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.087+0000 7f99bed28640 1 -- 172.21.15.86:0/1276433898 >> 172.21.15.86:0/1276433898 conn(0x7f99b80c9280 msgr2=0x7f99b80c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:26.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.087+0000 7f99bed28640 1 -- 172.21.15.86:0/1276433898 shutdown_connections 2024-09-19T06:39:26.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.087+0000 7f99bed28640 1 -- 172.21.15.86:0/1276433898 wait complete. 2024-09-19T06:39:26.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.088+0000 7f99bed28640 1 Processor -- start 2024-09-19T06:39:26.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.088+0000 7f99bed28640 1 -- start start 2024-09-19T06:39:26.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.089+0000 7f99bed28640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b80c64a0 0x7f99b81f2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:26.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.089+0000 7f99bed28640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99b80c6910 0x7f99b81eed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:26.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.089+0000 7f99bed28640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99b8152c20 0x7f99b81e28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:26.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.089+0000 7f99bed28640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f99b80c48a0 con 0x7f99b80c64a0 2024-09-19T06:39:26.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.089+0000 7f99bed28640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f99b806d900 con 0x7f99b80c6910 2024-09-19T06:39:26.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.089+0000 7f99bed28640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f99b80c4a20 con 0x7f99b8152c20 2024-09-19T06:39:26.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.089+0000 7f99bcac4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b80c64a0 0x7f99b81f2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:26.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.089+0000 7f99bcac4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b80c64a0 0x7f99b81f2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58720/0 (socket says 172.21.15.86:58720) 2024-09-19T06:39:26.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.089+0000 7f99bcac4640 1 -- 172.21.15.86:0/483871543 learned_addr learned my addr 172.21.15.86:0/483871543 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:39:26.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.089+0000 7f99affff640 1 --2- 172.21.15.86:0/483871543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99b80c6910 0x7f99b81eed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:26.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.089+0000 7f99bd2c5640 1 --2- 172.21.15.86:0/483871543 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99b8152c20 0x7f99b81e28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:26.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.089+0000 7f99bcac4640 1 -- 172.21.15.86:0/483871543 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99b8152c20 msgr2=0x7f99b81e28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:26.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.089+0000 7f99bcac4640 1 --2- 172.21.15.86:0/483871543 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99b8152c20 0x7f99b81e28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:26.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.089+0000 7f99bcac4640 1 -- 172.21.15.86:0/483871543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99b80c6910 msgr2=0x7f99b81eed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:26.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.089+0000 7f99bcac4640 1 --2- 172.21.15.86:0/483871543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99b80c6910 0x7f99b81eed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:26.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.089+0000 7f99bcac4640 1 -- 172.21.15.86:0/483871543 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b81e2e00 con 0x7f99b80c64a0 2024-09-19T06:39:26.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.089+0000 7f99bd2c5640 1 --2- 172.21.15.86:0/483871543 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99b8152c20 0x7f99b81e28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:39:26.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.090+0000 7f99bcac4640 1 --2- 172.21.15.86:0/483871543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b80c64a0 0x7f99b81f2e80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f99b4000c00 tx=0x7f99b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:26.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.090+0000 7f99ad7fa640 1 -- 172.21.15.86:0/483871543 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b4037040 con 0x7f99b80c64a0 2024-09-19T06:39:26.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.090+0000 7f99ad7fa640 1 -- 172.21.15.86:0/483871543 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b4042070 con 0x7f99b80c64a0 2024-09-19T06:39:26.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.090+0000 7f99bed28640 1 -- 172.21.15.86:0/483871543 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99b80cbe80 con 0x7f99b80c64a0 2024-09-19T06:39:26.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.090+0000 7f99ad7fa640 1 -- 172.21.15.86:0/483871543 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b4030bd0 con 0x7f99b80c64a0 2024-09-19T06:39:26.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.090+0000 7f99bed28640 1 -- 172.21.15.86:0/483871543 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99b81f23a0 con 0x7f99b80c64a0 2024-09-19T06:39:26.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.091+0000 7f99bed28640 1 -- 172.21.15.86:0/483871543 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99b8153000 con 0x7f99b80c64a0 2024-09-19T06:39:26.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.091+0000 7f99ad7fa640 1 -- 172.21.15.86:0/483871543 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f99b4032500 con 0x7f99b80c64a0 2024-09-19T06:39:26.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.092+0000 7f99ad7fa640 1 --2- 172.21.15.86:0/483871543 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f99a406c2b0 0x7f99a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:26.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.092+0000 7f99ad7fa640 1 -- 172.21.15.86:0/483871543 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6821+0+0 (secure 0 0 0) 0x7f99b40ac3b0 con 0x7f99b80c64a0 2024-09-19T06:39:26.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.092+0000 7f99affff640 1 --2- 172.21.15.86:0/483871543 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f99a406c2b0 0x7f99a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:26.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.092+0000 7f99affff640 1 --2- 172.21.15.86:0/483871543 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f99a406c2b0 0x7f99a406e770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f99a8007fd0 tx=0x7f99a8007c40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:26.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.096+0000 7f99ad7fa640 1 -- 172.21.15.86:0/483871543 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f99b407a6c0 con 0x7f99b80c64a0 2024-09-19T06:39:26.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.295+0000 7f99bed28640 1 -- 172.21.15.86:0/483871543 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99b814fff0 con 0x7f99b80c64a0 2024-09-19T06:39:26.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.296+0000 7f99ad7fa640 1 -- 172.21.15.86:0/483871543 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6045 (secure 0 0 0) 0x7f99b4079fc0 con 0x7f99b80c64a0 2024-09-19T06:39:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:39:26.297 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":12,"btime":"2024-09-19T06:39:25:825783+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:39:25.726781+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":0,"incarnation":10,"state":"up:rejoin","state_seq":38,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:39:26.297 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 12 2024-09-19T06:39:26.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.298+0000 7f99bed28640 1 -- 172.21.15.86:0/483871543 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f99a406c2b0 msgr2=0x7f99a406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:26.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.298+0000 7f99bed28640 1 --2- 172.21.15.86:0/483871543 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f99a406c2b0 0x7f99a406e770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f99a8007fd0 tx=0x7f99a8007c40 comp rx=0 tx=0).stop 2024-09-19T06:39:26.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.298+0000 7f99bed28640 1 -- 172.21.15.86:0/483871543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b80c64a0 msgr2=0x7f99b81f2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:26.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.298+0000 7f99bed28640 1 --2- 172.21.15.86:0/483871543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b80c64a0 0x7f99b81f2e80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f99b4000c00 tx=0x7f99b40046c0 comp rx=0 tx=0).stop 2024-09-19T06:39:26.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.298+0000 7f99bed28640 1 -- 172.21.15.86:0/483871543 shutdown_connections 2024-09-19T06:39:26.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.298+0000 7f99bed28640 1 --2- 172.21.15.86:0/483871543 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f99a406c2b0 0x7f99a406e770 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:26.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.298+0000 7f99bed28640 1 --2- 172.21.15.86:0/483871543 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99b8152c20 0x7f99b81e28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:26.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.298+0000 7f99bed28640 1 --2- 172.21.15.86:0/483871543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99b80c6910 0x7f99b81eed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:26.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.298+0000 7f99bed28640 1 --2- 172.21.15.86:0/483871543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b80c64a0 0x7f99b81f2e80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:26.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.298+0000 7f99bed28640 1 -- 172.21.15.86:0/483871543 >> 172.21.15.86:0/483871543 conn(0x7f99b80c9280 msgr2=0x7f99b80c82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:26.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.298+0000 7f99bed28640 1 -- 172.21.15.86:0/483871543 shutdown_connections 2024-09-19T06:39:26.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:26.298+0000 7f99bed28640 1 -- 172.21.15.86:0/483871543 wait complete. 2024-09-19T06:39:26.310 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:39:28.311 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:39:28.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.420+0000 7f027aed0640 1 Processor -- start 2024-09-19T06:39:28.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.420+0000 7f027aed0640 1 -- start start 2024-09-19T06:39:28.423 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.421+0000 7f027aed0640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f027406bd10 0x7f02740719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:28.423 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.421+0000 7f027aed0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02740734a0 0x7f0274071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:28.423 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.421+0000 7f027aed0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0274158710 con 0x7f0274152060 2024-09-19T06:39:28.423 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.421+0000 7f027aed0640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f02740716c0 con 0x7f027406bd10 2024-09-19T06:39:28.423 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.421+0000 7f027aed0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0274152440 con 0x7f02740734a0 2024-09-19T06:39:28.423 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.421+0000 7f026bfff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f027406bd10 0x7f02740719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:28.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.421+0000 7f026bfff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f027406bd10 0x7f02740719c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58726/0 (socket says 172.21.15.86:58726) 2024-09-19T06:39:28.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.421+0000 7f026bfff640 1 -- 172.21.15.86:0/3029834954 learned_addr learned my addr 172.21.15.86:0/3029834954 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:39:28.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.421+0000 7f027946d640 1 --2- 172.21.15.86:0/3029834954 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02740734a0 0x7f0274071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:28.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.421+0000 7f026bfff640 1 -- 172.21.15.86:0/3029834954 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02740734a0 msgr2=0x7f0274071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:28.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.421+0000 7f026bfff640 1 --2- 172.21.15.86:0/3029834954 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02740734a0 0x7f0274071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:28.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.421+0000 7f026bfff640 1 -- 172.21.15.86:0/3029834954 >> v1:172.21.15.169:6789/0 conn(0x7f0274152060 legacy=0x7f0274072d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:28.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.421+0000 7f026bfff640 1 -- 172.21.15.86:0/3029834954 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02741589b0 con 0x7f027406bd10 2024-09-19T06:39:28.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.422+0000 7f026bfff640 1 --2- 172.21.15.86:0/3029834954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f027406bd10 0x7f02740719c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0264009870 tx=0x7f026402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1965e2e77a90691f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:28.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.422+0000 7f026b7fe640 1 -- 172.21.15.86:0/3029834954 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264037070 con 0x7f027406bd10 2024-09-19T06:39:28.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.422+0000 7f026b7fe640 1 -- 172.21.15.86:0/3029834954 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f026402ae50 con 0x7f027406bd10 2024-09-19T06:39:28.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.422+0000 7f026b7fe640 1 -- 172.21.15.86:0/3029834954 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264032860 con 0x7f027406bd10 2024-09-19T06:39:28.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.423+0000 7f027aed0640 1 -- 172.21.15.86:0/3029834954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f027406bd10 msgr2=0x7f02740719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:28.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.423+0000 7f027aed0640 1 --2- 172.21.15.86:0/3029834954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f027406bd10 0x7f02740719c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0264009870 tx=0x7f026402a300 comp rx=0 tx=0).stop 2024-09-19T06:39:28.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.423+0000 7f027aed0640 1 -- 172.21.15.86:0/3029834954 shutdown_connections 2024-09-19T06:39:28.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.423+0000 7f027aed0640 1 --2- 172.21.15.86:0/3029834954 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02740734a0 0x7f0274071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:28.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.423+0000 7f027aed0640 1 --2- 172.21.15.86:0/3029834954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f027406bd10 0x7f02740719c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:28.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.423+0000 7f027aed0640 1 -- 172.21.15.86:0/3029834954 >> 172.21.15.86:0/3029834954 conn(0x7f02740c9280 msgr2=0x7f02740c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:28.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.423+0000 7f027aed0640 1 -- 172.21.15.86:0/3029834954 shutdown_connections 2024-09-19T06:39:28.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.423+0000 7f027aed0640 1 -- 172.21.15.86:0/3029834954 wait complete. 2024-09-19T06:39:28.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.424+0000 7f027aed0640 1 Processor -- start 2024-09-19T06:39:28.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.424+0000 7f027aed0640 1 -- start start 2024-09-19T06:39:28.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.425+0000 7f027aed0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f027406bd10 0x7f027414f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:28.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.425+0000 7f027aed0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02740734a0 0x7f0274071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:28.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.425+0000 7f027aed0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0274152060 0x7f02741f11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:28.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.425+0000 7f027aed0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f02740c9e10 con 0x7f02740734a0 2024-09-19T06:39:28.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.425+0000 7f027aed0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0274071350 con 0x7f027406bd10 2024-09-19T06:39:28.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.425+0000 7f027aed0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0274072440 con 0x7f0274152060 2024-09-19T06:39:28.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.425+0000 7f026bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02740734a0 0x7f0274071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:28.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.425+0000 7f026bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02740734a0 0x7f0274071ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58728/0 (socket says 172.21.15.86:58728) 2024-09-19T06:39:28.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.425+0000 7f026bfff640 1 -- 172.21.15.86:0/2322099290 learned_addr learned my addr 172.21.15.86:0/2322099290 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:39:28.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.425+0000 7f027946d640 1 --2- 172.21.15.86:0/2322099290 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0274152060 0x7f02741f11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:28.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.425+0000 7f0278c6c640 1 --2- 172.21.15.86:0/2322099290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f027406bd10 0x7f027414f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:28.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.425+0000 7f026bfff640 1 -- 172.21.15.86:0/2322099290 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0274152060 msgr2=0x7f02741f11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:28.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.425+0000 7f026bfff640 1 --2- 172.21.15.86:0/2322099290 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0274152060 0x7f02741f11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:28.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.425+0000 7f026bfff640 1 -- 172.21.15.86:0/2322099290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f027406bd10 msgr2=0x7f027414f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:28.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.425+0000 7f026bfff640 1 --2- 172.21.15.86:0/2322099290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f027406bd10 0x7f027414f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:28.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.425+0000 7f026bfff640 1 -- 172.21.15.86:0/2322099290 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02741f4f50 con 0x7f02740734a0 2024-09-19T06:39:28.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.425+0000 7f026bfff640 1 --2- 172.21.15.86:0/2322099290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02740734a0 0x7f0274071ae0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f02640097c0 tx=0x7f02640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:28.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.426+0000 7f02697fa640 1 -- 172.21.15.86:0/2322099290 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264041020 con 0x7f02740734a0 2024-09-19T06:39:28.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.426+0000 7f02697fa640 1 -- 172.21.15.86:0/2322099290 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f026403c870 con 0x7f02740734a0 2024-09-19T06:39:28.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.426+0000 7f027aed0640 1 -- 172.21.15.86:0/2322099290 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02741e2190 con 0x7f02740734a0 2024-09-19T06:39:28.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.426+0000 7f02697fa640 1 -- 172.21.15.86:0/2322099290 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264037040 con 0x7f02740734a0 2024-09-19T06:39:28.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.426+0000 7f027aed0640 1 -- 172.21.15.86:0/2322099290 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02741f5230 con 0x7f02740734a0 2024-09-19T06:39:28.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.427+0000 7f027aed0640 1 -- 172.21.15.86:0/2322099290 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02740c3680 con 0x7f02740734a0 2024-09-19T06:39:28.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.427+0000 7f02697fa640 1 -- 172.21.15.86:0/2322099290 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0264044020 con 0x7f02740734a0 2024-09-19T06:39:28.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.428+0000 7f02697fa640 1 --2- 172.21.15.86:0/2322099290 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f026006c2b0 0x7f026006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:28.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.428+0000 7f02697fa640 1 -- 172.21.15.86:0/2322099290 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6821+0+0 (secure 0 0 0) 0x7f02640ac070 con 0x7f02740734a0 2024-09-19T06:39:28.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.428+0000 7f0278c6c640 1 --2- 172.21.15.86:0/2322099290 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f026006c2b0 0x7f026006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:28.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.428+0000 7f0278c6c640 1 --2- 172.21.15.86:0/2322099290 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f026006c2b0 0x7f026006e770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0270000f60 tx=0x7f0270009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:28.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.432+0000 7f02697fa640 1 -- 172.21.15.86:0/2322099290 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f026404b030 con 0x7f02740734a0 2024-09-19T06:39:28.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.631+0000 7f027aed0640 1 -- 172.21.15.86:0/2322099290 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02740c9060 con 0x7f02740734a0 2024-09-19T06:39:28.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.632+0000 7f02697fa640 1 -- 172.21.15.86:0/2322099290 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6045 (secure 0 0 0) 0x7f0264079ca0 con 0x7f02740734a0 2024-09-19T06:39:28.633 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:39:28.634 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":12,"btime":"2024-09-19T06:39:25:825783+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:39:25.726781+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":0,"incarnation":10,"state":"up:rejoin","state_seq":38,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:39:28.634 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 12 2024-09-19T06:39:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.634+0000 7f027aed0640 1 -- 172.21.15.86:0/2322099290 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f026006c2b0 msgr2=0x7f026006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.634+0000 7f027aed0640 1 --2- 172.21.15.86:0/2322099290 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f026006c2b0 0x7f026006e770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0270000f60 tx=0x7f0270009040 comp rx=0 tx=0).stop 2024-09-19T06:39:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.634+0000 7f027aed0640 1 -- 172.21.15.86:0/2322099290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02740734a0 msgr2=0x7f0274071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.634+0000 7f027aed0640 1 --2- 172.21.15.86:0/2322099290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02740734a0 0x7f0274071ae0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f02640097c0 tx=0x7f02640046c0 comp rx=0 tx=0).stop 2024-09-19T06:39:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.634+0000 7f027aed0640 1 -- 172.21.15.86:0/2322099290 shutdown_connections 2024-09-19T06:39:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.634+0000 7f027aed0640 1 --2- 172.21.15.86:0/2322099290 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f026006c2b0 0x7f026006e770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.634+0000 7f027aed0640 1 --2- 172.21.15.86:0/2322099290 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0274152060 0x7f02741f11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.634+0000 7f027aed0640 1 --2- 172.21.15.86:0/2322099290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02740734a0 0x7f0274071ae0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.634+0000 7f027aed0640 1 --2- 172.21.15.86:0/2322099290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f027406bd10 0x7f027414f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.634+0000 7f027aed0640 1 -- 172.21.15.86:0/2322099290 >> 172.21.15.86:0/2322099290 conn(0x7f02740c9280 msgr2=0x7f027406cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.634+0000 7f027aed0640 1 -- 172.21.15.86:0/2322099290 shutdown_connections 2024-09-19T06:39:28.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:28.634+0000 7f027aed0640 1 -- 172.21.15.86:0/2322099290 wait complete. 2024-09-19T06:39:28.647 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "btime": "2024-09-19T06:39:25:825783+0000", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 12, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-19T06:37:08.763572+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 12, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4281": { "addr": "172.21.15.86:6839/1060607293", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6838", "nonce": 1060607293, "type": "v2" }, { "addr": "172.21.15.86:6839", "nonce": 1060607293, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4281, "incarnation": 10, "join_fscid": -1, "name": "e", "rank": 0, "state": "up:rejoin", "state_seq": 38 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-09-19T06:39:25.726781+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4281 } } } ], "standbys": [ { "addr": "172.21.15.86:6837/728803297", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6835", "nonce": 728803297, "type": "v2" }, { "addr": "172.21.15.86:6837", "nonce": 728803297, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4247, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.169:6835/2537509253", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6833", "nonce": 2537509253, "type": "v2" }, { "addr": "172.21.15.169:6835", "nonce": 2537509253, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4262, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.169:6834/1723647527", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6832", "nonce": 1723647527, "type": "v2" }, { "addr": "172.21.15.169:6834", "nonce": 1723647527, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4265, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.86:6836/4135959816", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6834", "nonce": 4135959816, "type": "v2" }, { "addr": "172.21.15.86:6836", "nonce": 4135959816, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4270, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-09-19T06:39:30.648 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:39:30.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.753+0000 7f4961c0a640 1 Processor -- start 2024-09-19T06:39:30.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.753+0000 7f4961c0a640 1 -- start start 2024-09-19T06:39:30.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.754+0000 7f4961c0a640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f495c154ed0 0x7f495c0c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.754+0000 7f4961c0a640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f495c06bbc0 0x7f495c06d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.754+0000 7f4961c0a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f495c15e560 0x7f495c15e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.754+0000 7f4961c0a640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f495c06d210 con 0x7f495c06bbc0 2024-09-19T06:39:30.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.754+0000 7f4961c0a640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f495c072b40 con 0x7f495c154ed0 2024-09-19T06:39:30.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.754+0000 7f4961c0a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f495c072da0 con 0x7f495c15e560 2024-09-19T06:39:30.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.754+0000 7f495affd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f495c06bbc0 0x7f495c06d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.754+0000 7f495affd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f495c06bbc0 0x7f495c06d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58730/0 (socket says 172.21.15.86:58730) 2024-09-19T06:39:30.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.754+0000 7f495affd640 1 -- 172.21.15.86:0/2837934722 learned_addr learned my addr 172.21.15.86:0/2837934722 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:39:30.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.754+0000 7f495affd640 1 -- 172.21.15.86:0/2837934722 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f495c15e560 msgr2=0x7f495c15e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:30.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.754+0000 7f495affd640 1 --2- 172.21.15.86:0/2837934722 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f495c15e560 0x7f495c15e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.754+0000 7f495affd640 1 -- 172.21.15.86:0/2837934722 >> v2:172.21.15.169:3300/0 conn(0x7f495c154ed0 msgr2=0x7f495c0c9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:30.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.754+0000 7f495affd640 1 --2- 172.21.15.86:0/2837934722 >> v2:172.21.15.169:3300/0 conn(0x7f495c154ed0 0x7f495c0c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.754+0000 7f495affd640 1 -- 172.21.15.86:0/2837934722 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495c073040 con 0x7f495c06bbc0 2024-09-19T06:39:30.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.755+0000 7f495affd640 1 --2- 172.21.15.86:0/2837934722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f495c06bbc0 0x7f495c06d6a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f495c070960 tx=0x7f495002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c093b63b4117072 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:30.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.755+0000 7f495a7fc640 1 -- 172.21.15.86:0/2837934722 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4950037070 con 0x7f495c06bbc0 2024-09-19T06:39:30.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.755+0000 7f495a7fc640 1 -- 172.21.15.86:0/2837934722 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4950032440 con 0x7f495c06bbc0 2024-09-19T06:39:30.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.755+0000 7f495a7fc640 1 -- 172.21.15.86:0/2837934722 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4950032810 con 0x7f495c06bbc0 2024-09-19T06:39:30.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.756+0000 7f4961c0a640 1 -- 172.21.15.86:0/2837934722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f495c06bbc0 msgr2=0x7f495c06d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:30.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.756+0000 7f4961c0a640 1 --2- 172.21.15.86:0/2837934722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f495c06bbc0 0x7f495c06d6a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f495c070960 tx=0x7f495002a140 comp rx=0 tx=0).stop 2024-09-19T06:39:30.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.756+0000 7f4961c0a640 1 -- 172.21.15.86:0/2837934722 shutdown_connections 2024-09-19T06:39:30.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.756+0000 7f4961c0a640 1 --2- 172.21.15.86:0/2837934722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f495c06bbc0 0x7f495c06d6a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.756+0000 7f4961c0a640 1 --2- 172.21.15.86:0/2837934722 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f495c15e560 0x7f495c15e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.756+0000 7f4961c0a640 1 --2- 172.21.15.86:0/2837934722 >> v2:172.21.15.169:3300/0 conn(0x7f495c154ed0 0x7f495c0c9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.756+0000 7f4961c0a640 1 -- 172.21.15.86:0/2837934722 >> 172.21.15.86:0/2837934722 conn(0x7f495c0ca320 msgr2=0x7f495c0ca730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:30.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.756+0000 7f4961c0a640 1 -- 172.21.15.86:0/2837934722 shutdown_connections 2024-09-19T06:39:30.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.756+0000 7f4961c0a640 1 -- 172.21.15.86:0/2837934722 wait complete. 2024-09-19T06:39:30.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.757+0000 7f4961c0a640 1 Processor -- start 2024-09-19T06:39:30.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.757+0000 7f4961c0a640 1 -- start start 2024-09-19T06:39:30.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.758+0000 7f4961c0a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f495c06bbc0 0x7f495c15d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.758+0000 7f4961c0a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f495c154ed0 0x7f495c0c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.758+0000 7f4961c0a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f495c15e560 0x7f495c0c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.758+0000 7f4961c0a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f495c1552b0 con 0x7f495c154ed0 2024-09-19T06:39:30.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.758+0000 7f4961c0a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f495c0c8220 con 0x7f495c15e560 2024-09-19T06:39:30.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.758+0000 7f4961c0a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f495c0caed0 con 0x7f495c06bbc0 2024-09-19T06:39:30.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.758+0000 7f495affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f495c154ed0 0x7f495c0c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.758+0000 7f495affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f495c154ed0 0x7f495c0c52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58738/0 (socket says 172.21.15.86:58738) 2024-09-19T06:39:30.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.758+0000 7f495affd640 1 -- 172.21.15.86:0/873612543 learned_addr learned my addr 172.21.15.86:0/873612543 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:39:30.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.758+0000 7f495b7fe640 1 --2- 172.21.15.86:0/873612543 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f495c06bbc0 0x7f495c15d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.758+0000 7f495bfff640 1 --2- 172.21.15.86:0/873612543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f495c15e560 0x7f495c0c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.758+0000 7f495affd640 1 -- 172.21.15.86:0/873612543 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f495c06bbc0 msgr2=0x7f495c15d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:30.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.758+0000 7f495affd640 1 --2- 172.21.15.86:0/873612543 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f495c06bbc0 0x7f495c15d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.758+0000 7f495affd640 1 -- 172.21.15.86:0/873612543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f495c15e560 msgr2=0x7f495c0c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:30.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.758+0000 7f495affd640 1 --2- 172.21.15.86:0/873612543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f495c15e560 0x7f495c0c5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.758+0000 7f495affd640 1 -- 172.21.15.86:0/873612543 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495c0c76e0 con 0x7f495c154ed0 2024-09-19T06:39:30.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.758+0000 7f495bfff640 1 --2- 172.21.15.86:0/873612543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f495c15e560 0x7f495c0c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:30.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.758+0000 7f495affd640 1 --2- 172.21.15.86:0/873612543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f495c154ed0 0x7f495c0c52c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4950000c00 tx=0x7f49500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:30.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.758+0000 7f4943fff640 1 -- 172.21.15.86:0/873612543 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4950041070 con 0x7f495c154ed0 2024-09-19T06:39:30.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.759+0000 7f4943fff640 1 -- 172.21.15.86:0/873612543 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f495003c870 con 0x7f495c154ed0 2024-09-19T06:39:30.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.759+0000 7f4943fff640 1 -- 172.21.15.86:0/873612543 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4950037040 con 0x7f495c154ed0 2024-09-19T06:39:30.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.759+0000 7f4961c0a640 1 -- 172.21.15.86:0/873612543 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f495c0c79c0 con 0x7f495c154ed0 2024-09-19T06:39:30.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.759+0000 7f4961c0a640 1 -- 172.21.15.86:0/873612543 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f495c1f1b00 con 0x7f495c154ed0 2024-09-19T06:39:30.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.760+0000 7f4961c0a640 1 -- 172.21.15.86:0/873612543 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f495c0c9de0 con 0x7f495c154ed0 2024-09-19T06:39:30.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.760+0000 7f4943fff640 1 -- 172.21.15.86:0/873612543 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4950044070 con 0x7f495c154ed0 2024-09-19T06:39:30.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.760+0000 7f4943fff640 1 --2- 172.21.15.86:0/873612543 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f494806c2b0 0x7f494806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.760+0000 7f4943fff640 1 -- 172.21.15.86:0/873612543 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6821+0+0 (secure 0 0 0) 0x7f49500ac540 con 0x7f495c154ed0 2024-09-19T06:39:30.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.760+0000 7f495b7fe640 1 --2- 172.21.15.86:0/873612543 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f494806c2b0 0x7f494806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.761+0000 7f495b7fe640 1 --2- 172.21.15.86:0/873612543 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f494806c2b0 0x7f494806e770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f494c009990 tx=0x7f494c009110 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:30.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.765+0000 7f4943fff640 1 -- 172.21.15.86:0/873612543 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f495007a970 con 0x7f495c154ed0 2024-09-19T06:39:30.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.969+0000 7f4961c0a640 1 -- 172.21.15.86:0/873612543 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f495c0c8a50 con 0x7f495c154ed0 2024-09-19T06:39:30.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.970+0000 7f4943fff640 1 -- 172.21.15.86:0/873612543 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6045 (secure 0 0 0) 0x7f495007a270 con 0x7f495c154ed0 2024-09-19T06:39:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:39:30.971 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":12,"btime":"2024-09-19T06:39:25:825783+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:39:25.726781+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":0,"incarnation":10,"state":"up:rejoin","state_seq":38,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:39:30.972 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 12 2024-09-19T06:39:30.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.971+0000 7f4961c0a640 1 -- 172.21.15.86:0/873612543 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f494806c2b0 msgr2=0x7f494806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:30.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.971+0000 7f4961c0a640 1 --2- 172.21.15.86:0/873612543 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f494806c2b0 0x7f494806e770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f494c009990 tx=0x7f494c009110 comp rx=0 tx=0).stop 2024-09-19T06:39:30.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.971+0000 7f4961c0a640 1 -- 172.21.15.86:0/873612543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f495c154ed0 msgr2=0x7f495c0c52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:30.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.971+0000 7f4961c0a640 1 --2- 172.21.15.86:0/873612543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f495c154ed0 0x7f495c0c52c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4950000c00 tx=0x7f49500046c0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.972+0000 7f4961c0a640 1 -- 172.21.15.86:0/873612543 shutdown_connections 2024-09-19T06:39:30.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.972+0000 7f4961c0a640 1 --2- 172.21.15.86:0/873612543 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f494806c2b0 0x7f494806e770 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.972+0000 7f4961c0a640 1 --2- 172.21.15.86:0/873612543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f495c15e560 0x7f495c0c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.972+0000 7f4961c0a640 1 --2- 172.21.15.86:0/873612543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f495c154ed0 0x7f495c0c52c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.972+0000 7f4961c0a640 1 --2- 172.21.15.86:0/873612543 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f495c06bbc0 0x7f495c15d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.972+0000 7f4961c0a640 1 -- 172.21.15.86:0/873612543 >> 172.21.15.86:0/873612543 conn(0x7f495c0ca320 msgr2=0x7f495c151a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:30.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.972+0000 7f4961c0a640 1 -- 172.21.15.86:0/873612543 shutdown_connections 2024-09-19T06:39:30.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:30.972+0000 7f4961c0a640 1 -- 172.21.15.86:0/873612543 wait complete. 2024-09-19T06:39:30.984 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:39:32.985 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:39:33.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.093+0000 7feb07c2e640 1 Processor -- start 2024-09-19T06:39:33.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.094+0000 7feb07c2e640 1 -- start start 2024-09-19T06:39:33.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.094+0000 7feb07c2e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb00152c20 0x7feb00153000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:33.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.094+0000 7feb07c2e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7feb000c64a0 0x7feb000c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:33.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.095+0000 7feb07c2e640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7feb000c7310 0x7feb000c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:33.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.095+0000 7feb07c2e640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7feb00158d70 con 0x7feb000c7310 2024-09-19T06:39:33.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.095+0000 7feb07c2e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7feb000c3d20 con 0x7feb000c64a0 2024-09-19T06:39:33.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.095+0000 7feb07c2e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7feb000c4000 con 0x7feb00152c20 2024-09-19T06:39:33.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.095+0000 7feb061cb640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7feb000c7310 0x7feb000c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:33.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.095+0000 7feb061cb640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7feb000c7310 0x7feb000c7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49718/0 (socket says 172.21.15.86:49718) 2024-09-19T06:39:33.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.095+0000 7feb061cb640 1 -- 172.21.15.86:0/2963750386 learned_addr learned my addr 172.21.15.86:0/2963750386 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:39:33.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.095+0000 7feb059ca640 1 --2- 172.21.15.86:0/2963750386 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb00152c20 0x7feb00153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:33.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.095+0000 7feb051c9640 1 --2- 172.21.15.86:0/2963750386 >> v2:172.21.15.169:3300/0 conn(0x7feb000c64a0 0x7feb000c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:33.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.095+0000 7feb061cb640 1 -- 172.21.15.86:0/2963750386 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb00152c20 msgr2=0x7feb00153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:33.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.095+0000 7feb061cb640 1 --2- 172.21.15.86:0/2963750386 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb00152c20 0x7feb00153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.095+0000 7feb061cb640 1 -- 172.21.15.86:0/2963750386 >> v2:172.21.15.169:3300/0 conn(0x7feb000c64a0 msgr2=0x7feb000c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:33.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.095+0000 7feb061cb640 1 --2- 172.21.15.86:0/2963750386 >> v2:172.21.15.169:3300/0 conn(0x7feb000c64a0 0x7feb000c68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.095+0000 7feb061cb640 1 -- 172.21.15.86:0/2963750386 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb000c42e0 con 0x7feb000c7310 2024-09-19T06:39:33.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.095+0000 7feb059ca640 1 --2- 172.21.15.86:0/2963750386 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb00152c20 0x7feb00153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:33.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.095+0000 7feb051c9640 1 --2- 172.21.15.86:0/2963750386 >> v2:172.21.15.169:3300/0 conn(0x7feb000c64a0 0x7feb000c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:33.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.096+0000 7feb061cb640 1 --2- 172.21.15.86:0/2963750386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb000c7310 0x7feb000c7780 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7feb000c4dd0 tx=0x7feaf802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbce8518f7d218a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:33.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.096+0000 7feb049c8640 1 -- 172.21.15.86:0/2963750386 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf8036070 con 0x7feb000c7310 2024-09-19T06:39:33.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.096+0000 7feb049c8640 1 -- 172.21.15.86:0/2963750386 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaf8031600 con 0x7feb000c7310 2024-09-19T06:39:33.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.096+0000 7feb049c8640 1 -- 172.21.15.86:0/2963750386 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf80319d0 con 0x7feb000c7310 2024-09-19T06:39:33.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.096+0000 7feb07c2e640 1 -- 172.21.15.86:0/2963750386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb000c7310 msgr2=0x7feb000c7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:33.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.096+0000 7feb07c2e640 1 --2- 172.21.15.86:0/2963750386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb000c7310 0x7feb000c7780 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7feb000c4dd0 tx=0x7feaf802a730 comp rx=0 tx=0).stop 2024-09-19T06:39:33.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.097+0000 7feb07c2e640 1 -- 172.21.15.86:0/2963750386 shutdown_connections 2024-09-19T06:39:33.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.097+0000 7feb07c2e640 1 --2- 172.21.15.86:0/2963750386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb000c7310 0x7feb000c7780 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.097+0000 7feb07c2e640 1 --2- 172.21.15.86:0/2963750386 >> v2:172.21.15.169:3300/0 conn(0x7feb000c64a0 0x7feb000c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.097+0000 7feb07c2e640 1 --2- 172.21.15.86:0/2963750386 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb00152c20 0x7feb00153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.097+0000 7feb07c2e640 1 -- 172.21.15.86:0/2963750386 >> 172.21.15.86:0/2963750386 conn(0x7feb000c9280 msgr2=0x7feb000c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:33.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.097+0000 7feb07c2e640 1 -- 172.21.15.86:0/2963750386 shutdown_connections 2024-09-19T06:39:33.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.097+0000 7feb07c2e640 1 -- 172.21.15.86:0/2963750386 wait complete. 2024-09-19T06:39:33.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.098+0000 7feb07c2e640 1 Processor -- start 2024-09-19T06:39:33.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.098+0000 7feb07c2e640 1 -- start start 2024-09-19T06:39:33.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.098+0000 7feb07c2e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb000c64a0 0x7feb00071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:33.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.098+0000 7feb07c2e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb000c7310 0x7feb00159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:33.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.098+0000 7feb07c2e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb00152c20 0x7feb000cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:33.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.098+0000 7feb07c2e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7feb000c48a0 con 0x7feb00152c20 2024-09-19T06:39:33.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.098+0000 7feb07c2e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feb0006d900 con 0x7feb000c7310 2024-09-19T06:39:33.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.098+0000 7feb07c2e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7feb000c4a20 con 0x7feb000c64a0 2024-09-19T06:39:33.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.099+0000 7feb061cb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb00152c20 0x7feb000cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:33.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.099+0000 7feb061cb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb00152c20 0x7feb000cb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49722/0 (socket says 172.21.15.86:49722) 2024-09-19T06:39:33.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.099+0000 7feb061cb640 1 -- 172.21.15.86:0/3738145379 learned_addr learned my addr 172.21.15.86:0/3738145379 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:39:33.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.099+0000 7feb059ca640 1 --2- 172.21.15.86:0/3738145379 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb000c64a0 0x7feb00071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:33.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.099+0000 7feb051c9640 1 --2- 172.21.15.86:0/3738145379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb000c7310 0x7feb00159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:33.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.099+0000 7feb061cb640 1 -- 172.21.15.86:0/3738145379 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb000c64a0 msgr2=0x7feb00071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:33.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.099+0000 7feb061cb640 1 --2- 172.21.15.86:0/3738145379 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb000c64a0 0x7feb00071fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.099+0000 7feb061cb640 1 -- 172.21.15.86:0/3738145379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb000c7310 msgr2=0x7feb00159370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:33.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.099+0000 7feb061cb640 1 --2- 172.21.15.86:0/3738145379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb000c7310 0x7feb00159370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.099+0000 7feb061cb640 1 -- 172.21.15.86:0/3738145379 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb001523a0 con 0x7feb00152c20 2024-09-19T06:39:33.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.099+0000 7feb061cb640 1 --2- 172.21.15.86:0/3738145379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb00152c20 0x7feb000cb940 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7feaf8034040 tx=0x7feaf8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:33.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.099+0000 7feaf27fc640 1 -- 172.21.15.86:0/3738145379 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf8036050 con 0x7feb00152c20 2024-09-19T06:39:33.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.099+0000 7feaf27fc640 1 -- 172.21.15.86:0/3738145379 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaf8042070 con 0x7feb00152c20 2024-09-19T06:39:33.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.099+0000 7feb07c2e640 1 -- 172.21.15.86:0/3738145379 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb000724e0 con 0x7feb00152c20 2024-09-19T06:39:33.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.099+0000 7feaf27fc640 1 -- 172.21.15.86:0/3738145379 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf8009510 con 0x7feb00152c20 2024-09-19T06:39:33.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.099+0000 7feb07c2e640 1 -- 172.21.15.86:0/3738145379 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb00072d70 con 0x7feb00152c20 2024-09-19T06:39:33.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.100+0000 7feb07c2e640 1 -- 172.21.15.86:0/3738145379 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb000c68e0 con 0x7feb00152c20 2024-09-19T06:39:33.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.101+0000 7feaf27fc640 1 -- 172.21.15.86:0/3738145379 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7feaf8007bf0 con 0x7feb00152c20 2024-09-19T06:39:33.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.101+0000 7feaf27fc640 1 --2- 172.21.15.86:0/3738145379 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7feae406c2b0 0x7feae406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:33.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.101+0000 7feaf27fc640 1 -- 172.21.15.86:0/3738145379 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6821+0+0 (secure 0 0 0) 0x7feaf80ac4c0 con 0x7feb00152c20 2024-09-19T06:39:33.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.101+0000 7feb059ca640 1 --2- 172.21.15.86:0/3738145379 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7feae406c2b0 0x7feae406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:33.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.102+0000 7feb059ca640 1 --2- 172.21.15.86:0/3738145379 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7feae406c2b0 0x7feae406e770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7feaf4006fd0 tx=0x7feaf4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:33.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.106+0000 7feaf27fc640 1 -- 172.21.15.86:0/3738145379 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7feaf807a180 con 0x7feb00152c20 2024-09-19T06:39:33.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.307+0000 7feb07c2e640 1 -- 172.21.15.86:0/3738145379 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb000c6e10 con 0x7feb00152c20 2024-09-19T06:39:33.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.308+0000 7feaf27fc640 1 -- 172.21.15.86:0/3738145379 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6052 (secure 0 0 0) 0x7feaf807e480 con 0x7feb00152c20 2024-09-19T06:39:33.310 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:39:33.310 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":13,"btime":"2024-09-19T06:39:31:837131+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:39:31.837125+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":0,"incarnation":10,"state":"up:active","state_seq":40,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-09-19T06:39:33.310 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 13 2024-09-19T06:39:33.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.310+0000 7feb07c2e640 1 -- 172.21.15.86:0/3738145379 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7feae406c2b0 msgr2=0x7feae406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:33.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.310+0000 7feb07c2e640 1 --2- 172.21.15.86:0/3738145379 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7feae406c2b0 0x7feae406e770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7feaf4006fd0 tx=0x7feaf4008040 comp rx=0 tx=0).stop 2024-09-19T06:39:33.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.310+0000 7feb07c2e640 1 -- 172.21.15.86:0/3738145379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb00152c20 msgr2=0x7feb000cb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:33.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.310+0000 7feb07c2e640 1 --2- 172.21.15.86:0/3738145379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb00152c20 0x7feb000cb940 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7feaf8034040 tx=0x7feaf8004a40 comp rx=0 tx=0).stop 2024-09-19T06:39:33.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.310+0000 7feb07c2e640 1 -- 172.21.15.86:0/3738145379 shutdown_connections 2024-09-19T06:39:33.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.310+0000 7feb07c2e640 1 --2- 172.21.15.86:0/3738145379 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7feae406c2b0 0x7feae406e770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.310+0000 7feb07c2e640 1 --2- 172.21.15.86:0/3738145379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb00152c20 0x7feb000cb940 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.310+0000 7feb07c2e640 1 --2- 172.21.15.86:0/3738145379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb000c7310 0x7feb00159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.310+0000 7feb07c2e640 1 --2- 172.21.15.86:0/3738145379 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb000c64a0 0x7feb00071fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.310+0000 7feb07c2e640 1 -- 172.21.15.86:0/3738145379 >> 172.21.15.86:0/3738145379 conn(0x7feb000c9280 msgr2=0x7feb0014b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:33.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.310+0000 7feb07c2e640 1 -- 172.21.15.86:0/3738145379 shutdown_connections 2024-09-19T06:39:33.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:33.310+0000 7feb07c2e640 1 -- 172.21.15.86:0/3738145379 wait complete. 2024-09-19T06:39:33.323 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e has gained rank=0, replacing gid=4285 2024-09-19T06:39:33.323 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 9 secs before reviving mds.d 2024-09-19T06:39:37.733 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:39:37.736 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:39:39.406 INFO:tasks.ceph.mds.e.smithi086.stderr:2024-09-19T06:39:39.404+0000 7f773969a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T06:39:42.324 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.d 2024-09-19T06:39:42.324 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T06:39:42.324 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T06:39:42.328 INFO:tasks.ceph.mds.d:Started 2024-09-19T06:39:42.328 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:39:42.455 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2024-09-19T06:39:42.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.566+0000 7fb88b277640 1 Processor -- start 2024-09-19T06:39:42.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.567+0000 7fb88b277640 1 -- start start 2024-09-19T06:39:42.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.569+0000 7fb88b277640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb8840c7d30 0x7fb88406bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:42.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.569+0000 7fb88b277640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8840c7700 con 0x7fb884159480 2024-09-19T06:39:42.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.569+0000 7fb88b277640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8840c79c0 con 0x7fb884159860 2024-09-19T06:39:42.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.569+0000 7fb88b277640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fb884073d20 con 0x7fb8840c7d30 2024-09-19T06:39:42.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.570+0000 7fb889013640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb884159480 0x7fb8840c84d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:47218/0 (socket says 172.21.15.86:47218) 2024-09-19T06:39:42.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.570+0000 7fb889013640 1 -- 172.21.15.86:0/1604413370 learned_addr learned my addr 172.21.15.86:0/1604413370 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:39:42.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.571+0000 7fb87bfff640 1 -- 172.21.15.86:0/1604413370 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3543368022 0 0) 0x7fb8840c7700 con 0x7fb884159480 2024-09-19T06:39:42.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.571+0000 7fb889814640 1 --2- 172.21.15.86:0/1604413370 >> v2:172.21.15.169:3300/0 conn(0x7fb8840c7d30 0x7fb88406bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:42.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.571+0000 7fb87bfff640 1 -- 172.21.15.86:0/1604413370 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb870003520 con 0x7fb884159480 2024-09-19T06:39:42.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.573+0000 7fb87bfff640 1 -- 172.21.15.86:0/1604413370 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 570330137 0 0) 0x7fb870003520 con 0x7fb884159480 2024-09-19T06:39:42.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.573+0000 7fb87bfff640 1 -- 172.21.15.86:0/1604413370 >> v2:172.21.15.169:3300/0 conn(0x7fb8840c7d30 msgr2=0x7fb88406bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:42.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.573+0000 7fb87bfff640 1 --2- 172.21.15.86:0/1604413370 >> v2:172.21.15.169:3300/0 conn(0x7fb8840c7d30 0x7fb88406bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:42.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.573+0000 7fb87bfff640 1 -- 172.21.15.86:0/1604413370 >> v1:172.21.15.169:6789/0 conn(0x7fb884159860 legacy=0x7fb884167c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:42.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.573+0000 7fb87bfff640 1 -- 172.21.15.86:0/1604413370 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb884071be0 con 0x7fb884159480 2024-09-19T06:39:42.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.573+0000 7fb87bfff640 1 -- 172.21.15.86:0/1604413370 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7fb874001670 con 0x7fb884159480 2024-09-19T06:39:42.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.573+0000 7fb87bfff640 1 -- 172.21.15.86:0/1604413370 >> v1:172.21.15.86:6789/0 conn(0x7fb884159480 legacy=0x7fb8840c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:42.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.573+0000 7fb87bfff640 1 --2- 172.21.15.86:0/1604413370 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8700039b0 0x7fb870003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:42.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.573+0000 7fb87bfff640 1 --2- 172.21.15.86:0/1604413370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb870004800 0x7fb870004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:42.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.573+0000 7fb87bfff640 1 --2- 172.21.15.86:0/1604413370 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8700051c0 0x7fb87000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:42.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.573+0000 7fb87bfff640 1 -- 172.21.15.86:0/1604413370 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb87000c0c0 con 0x7fb8700039b0 2024-09-19T06:39:42.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.573+0000 7fb87bfff640 1 -- 172.21.15.86:0/1604413370 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb87000c270 con 0x7fb870004800 2024-09-19T06:39:42.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.573+0000 7fb87bfff640 1 -- 172.21.15.86:0/1604413370 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb87000c470 con 0x7fb8700051c0 2024-09-19T06:39:42.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.574+0000 7fb888812640 1 --2- 172.21.15.86:0/1604413370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb870004800 0x7fb870004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:42.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.574+0000 7fb889013640 1 --2- 172.21.15.86:0/1604413370 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8700039b0 0x7fb870003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:42.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.574+0000 7fb889814640 1 --2- 172.21.15.86:0/1604413370 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8700051c0 0x7fb87000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:42.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.575+0000 7fb889013640 1 -- 172.21.15.86:0/1604413370 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8700051c0 msgr2=0x7fb87000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:42.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.575+0000 7fb889013640 1 --2- 172.21.15.86:0/1604413370 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8700051c0 0x7fb87000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:42.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.575+0000 7fb889013640 1 -- 172.21.15.86:0/1604413370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb870004800 msgr2=0x7fb870004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:42.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.575+0000 7fb889013640 1 --2- 172.21.15.86:0/1604413370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb870004800 0x7fb870004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:42.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.575+0000 7fb889013640 1 -- 172.21.15.86:0/1604413370 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb884071be0 con 0x7fb8700039b0 2024-09-19T06:39:42.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.575+0000 7fb889814640 1 -- 172.21.15.86:0/1604413370 reap_dead start 2024-09-19T06:39:42.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.576+0000 7fb889013640 1 --2- 172.21.15.86:0/1604413370 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8700039b0 0x7fb870003db0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb87400c260 tx=0x7fb870005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2589d9ac643c9985 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:42.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.577+0000 7fb87bfff640 1 -- 172.21.15.86:0/1604413370 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87402e070 con 0x7fb8700039b0 2024-09-19T06:39:42.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.577+0000 7fb87bfff640 1 -- 172.21.15.86:0/1604413370 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb874005ad0 con 0x7fb8700039b0 2024-09-19T06:39:42.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.578+0000 7fb88b277640 1 -- 172.21.15.86:0/1604413370 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8700039b0 msgr2=0x7fb870003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:42.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.578+0000 7fb88b277640 1 --2- 172.21.15.86:0/1604413370 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8700039b0 0x7fb870003db0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb87400c260 tx=0x7fb870005830 comp rx=0 tx=0).stop 2024-09-19T06:39:42.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.579+0000 7fb88b277640 1 -- 172.21.15.86:0/1604413370 shutdown_connections 2024-09-19T06:39:42.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.579+0000 7fb88b277640 1 --2- 172.21.15.86:0/1604413370 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8700039b0 0x7fb870003db0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:42.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.579+0000 7fb88b277640 1 -- 172.21.15.86:0/1604413370 >> 172.21.15.86:0/1604413370 conn(0x7fb8840c9280 msgr2=0x7fb8840c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:42.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.581+0000 7fb88b277640 1 -- 172.21.15.86:0/1604413370 shutdown_connections 2024-09-19T06:39:42.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.582+0000 7fb88b277640 1 -- 172.21.15.86:0/1604413370 wait complete. 2024-09-19T06:39:42.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.584+0000 7fb88b277640 1 Processor -- start 2024-09-19T06:39:42.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.585+0000 7fb88b277640 1 -- start start 2024-09-19T06:39:42.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.587+0000 7fb88b277640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8700039b0 0x7fb88414fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:42.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.587+0000 7fb88b277640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8841609c0 0x7fb884150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:42.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.587+0000 7fb88b277640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8840c42a0 0x7fb8840c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:42.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.587+0000 7fb88b277640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb8840721a0 con 0x7fb8841609c0 2024-09-19T06:39:42.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.587+0000 7fb88b277640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb884071990 con 0x7fb8840c42a0 2024-09-19T06:39:42.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.587+0000 7fb88b277640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb884070ed0 con 0x7fb8700039b0 2024-09-19T06:39:42.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.588+0000 7fb888812640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8841609c0 0x7fb884150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:42.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.588+0000 7fb888812640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8841609c0 0x7fb884150010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43882/0 (socket says 172.21.15.86:43882) 2024-09-19T06:39:42.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.588+0000 7fb888812640 1 -- 172.21.15.86:0/179597940 learned_addr learned my addr 172.21.15.86:0/179597940 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:39:42.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.588+0000 7fb888812640 1 -- 172.21.15.86:0/179597940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8700039b0 msgr2=0x7fb88414fad0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:39:42.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.588+0000 7fb888812640 1 --2- 172.21.15.86:0/179597940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8700039b0 0x7fb88414fad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:42.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.588+0000 7fb888812640 1 -- 172.21.15.86:0/179597940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8840c42a0 msgr2=0x7fb8840c5a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:39:42.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.588+0000 7fb888812640 1 --2- 172.21.15.86:0/179597940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8840c42a0 0x7fb8840c5a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:42.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.588+0000 7fb888812640 1 -- 172.21.15.86:0/179597940 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8841f8350 con 0x7fb8841609c0 2024-09-19T06:39:42.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.589+0000 7fb888812640 1 --2- 172.21.15.86:0/179597940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8841609c0 0x7fb884150010 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb87c00f920 tx=0x7fb87c00fde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:42.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.589+0000 7fb879ffb640 1 -- 172.21.15.86:0/179597940 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c017020 con 0x7fb8841609c0 2024-09-19T06:39:42.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.589+0000 7fb879ffb640 1 -- 172.21.15.86:0/179597940 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb87c00da00 con 0x7fb8841609c0 2024-09-19T06:39:42.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.589+0000 7fb879ffb640 1 -- 172.21.15.86:0/179597940 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c00ddf0 con 0x7fb8841609c0 2024-09-19T06:39:42.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.589+0000 7fb88b277640 1 -- 172.21.15.86:0/179597940 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8841f8630 con 0x7fb8841609c0 2024-09-19T06:39:42.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.590+0000 7fb88b277640 1 -- 172.21.15.86:0/179597940 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8841f8bf0 con 0x7fb8841609c0 2024-09-19T06:39:42.596 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.593+0000 7fb879ffb640 1 -- 172.21.15.86:0/179597940 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb87c01a020 con 0x7fb8841609c0 2024-09-19T06:39:42.596 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.594+0000 7fb88b277640 1 -- 172.21.15.86:0/179597940 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb88406bbc0 con 0x7fb8841609c0 2024-09-19T06:39:42.596 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.594+0000 7fb879ffb640 1 --2- 172.21.15.86:0/179597940 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb86806c3b0 0x7fb86806e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:42.596 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.595+0000 7fb879ffb640 1 -- 172.21.15.86:0/179597940 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6821+0+0 (secure 0 0 0) 0x7fb87c08bc20 con 0x7fb8841609c0 2024-09-19T06:39:42.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.597+0000 7fb889013640 1 --2- 172.21.15.86:0/179597940 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb86806c3b0 0x7fb86806e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:42.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.598+0000 7fb889013640 1 --2- 172.21.15.86:0/179597940 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb86806c3b0 0x7fb86806e870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb874033000 tx=0x7fb87402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:42.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:42.605+0000 7fb879ffb640 1 -- 172.21.15.86:0/179597940 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb87c021020 con 0x7fb8841609c0 2024-09-19T06:39:43.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:43.084+0000 7fb88b277640 1 -- 172.21.15.86:0/179597940 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8840c8eb0 con 0x7fb8841609c0 2024-09-19T06:39:43.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:43.085+0000 7fb879ffb640 1 -- 172.21.15.86:0/179597940 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6880 (secure 0 0 0) 0x7fb87c059f10 con 0x7fb8841609c0 2024-09-19T06:39:43.089 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:39:43.089 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":14,"btime":"2024-09-19T06:39:42:855448+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2213887583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2213887583},{"type":"v1","addr":"172.21.15.169:6837","nonce":2213887583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:39:31.837125+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":0,"incarnation":10,"state":"up:active","state_seq":40,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-09-19T06:39:43.090 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 14 2024-09-19T06:39:43.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:43.092+0000 7fb88b277640 1 -- 172.21.15.86:0/179597940 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb86806c3b0 msgr2=0x7fb86806e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:43.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:43.092+0000 7fb88b277640 1 --2- 172.21.15.86:0/179597940 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb86806c3b0 0x7fb86806e870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb874033000 tx=0x7fb87402e000 comp rx=0 tx=0).stop 2024-09-19T06:39:43.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:43.093+0000 7fb88b277640 1 -- 172.21.15.86:0/179597940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8841609c0 msgr2=0x7fb884150010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:43.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:43.093+0000 7fb88b277640 1 --2- 172.21.15.86:0/179597940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8841609c0 0x7fb884150010 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb87c00f920 tx=0x7fb87c00fde0 comp rx=0 tx=0).stop 2024-09-19T06:39:43.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:43.094+0000 7fb88b277640 1 -- 172.21.15.86:0/179597940 shutdown_connections 2024-09-19T06:39:43.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:43.094+0000 7fb88b277640 1 --2- 172.21.15.86:0/179597940 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb86806c3b0 0x7fb86806e870 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:43.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:43.094+0000 7fb88b277640 1 --2- 172.21.15.86:0/179597940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8840c42a0 0x7fb8840c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:43.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:43.095+0000 7fb88b277640 1 --2- 172.21.15.86:0/179597940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8841609c0 0x7fb884150010 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:43.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:43.095+0000 7fb88b277640 1 --2- 172.21.15.86:0/179597940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8700039b0 0x7fb88414fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:43.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:43.095+0000 7fb88b277640 1 -- 172.21.15.86:0/179597940 >> 172.21.15.86:0/179597940 conn(0x7fb8840c9280 msgr2=0x7fb88406bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:43.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:43.095+0000 7fb88b277640 1 -- 172.21.15.86:0/179597940 shutdown_connections 2024-09-19T06:39:43.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:39:43.095+0000 7fb88b277640 1 -- 172.21.15.86:0/179597940 wait complete. 2024-09-19T06:39:43.121 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d reported in up:standby state 2024-09-19T06:39:43.121 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 59 secs before thrashing 2024-09-19T06:39:55.491 INFO:tasks.workunit.client.0.smithi086.stdout:fs setup took 53 secs 2024-09-19T06:39:59.541 INFO:tasks.workunit.client.0.smithi086.stdout:Syncing()...4 sec 2024-09-19T06:39:59.542 INFO:tasks.workunit.client.0.smithi086.stdout:Starting Actual Benchmark At: Thu Sep 19 06:39:59 2024 2024-09-19T06:39:59.542 INFO:tasks.workunit.client.0.smithi086.stdout: 2024-09-19T06:40:07.878 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:40:07.881 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:40:38.260 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:40:38.264 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:40:42.122 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:40:42.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.307+0000 7fd6e5bb7640 1 Processor -- start 2024-09-19T06:40:42.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.307+0000 7fd6e5bb7640 1 -- start start 2024-09-19T06:40:42.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.308+0000 7fd6e5bb7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6e006de50 0x7fd6e00c2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:42.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.308+0000 7fd6e5bb7640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6e0067aa0 con 0x7fd6e0159660 2024-09-19T06:40:42.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.308+0000 7fd6e5bb7640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6e0067d80 con 0x7fd6e0073f30 2024-09-19T06:40:42.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.308+0000 7fd6e5bb7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd6e006ccf0 con 0x7fd6e006de50 2024-09-19T06:40:42.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.309+0000 7fd6dffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6e006de50 0x7fd6e00c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:42.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.309+0000 7fd6dffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6e006de50 0x7fd6e00c2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:51362/0 (socket says 172.21.15.86:51362) 2024-09-19T06:40:42.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.309+0000 7fd6dffff640 1 -- 172.21.15.86:0/901039544 learned_addr learned my addr 172.21.15.86:0/901039544 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:40:42.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.310+0000 7fd6dffff640 1 -- 172.21.15.86:0/901039544 >> v1:172.21.15.169:6789/0 conn(0x7fd6e0073f30 legacy=0x7fd6e015f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:42.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.310+0000 7fd6dffff640 1 -- 172.21.15.86:0/901039544 >> v1:172.21.15.86:6789/0 conn(0x7fd6e0159660 legacy=0x7fd6e006d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:42.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.310+0000 7fd6dffff640 1 -- 172.21.15.86:0/901039544 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e006cf40 con 0x7fd6e006de50 2024-09-19T06:40:42.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.313+0000 7fd6dffff640 1 --2- 172.21.15.86:0/901039544 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6e006de50 0x7fd6e00c2dc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80098a0 tx=0x7fd6c802a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffae3bb990f14a2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:42.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.315+0000 7fd6de7fc640 1 -- 172.21.15.86:0/901039544 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8037070 con 0x7fd6e006de50 2024-09-19T06:40:42.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.315+0000 7fd6de7fc640 1 -- 172.21.15.86:0/901039544 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6c8032440 con 0x7fd6e006de50 2024-09-19T06:40:42.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.315+0000 7fd6de7fc640 1 -- 172.21.15.86:0/901039544 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8032810 con 0x7fd6e006de50 2024-09-19T06:40:42.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.317+0000 7fd6e5bb7640 1 -- 172.21.15.86:0/901039544 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6e006de50 msgr2=0x7fd6e00c2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:42.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.317+0000 7fd6e5bb7640 1 --2- 172.21.15.86:0/901039544 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6e006de50 0x7fd6e00c2dc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80098a0 tx=0x7fd6c802a1e0 comp rx=0 tx=0).stop 2024-09-19T06:40:42.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.317+0000 7fd6e5bb7640 1 -- 172.21.15.86:0/901039544 shutdown_connections 2024-09-19T06:40:42.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.317+0000 7fd6e5bb7640 1 --2- 172.21.15.86:0/901039544 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6e006de50 0x7fd6e00c2dc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:42.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.317+0000 7fd6e5bb7640 1 -- 172.21.15.86:0/901039544 >> 172.21.15.86:0/901039544 conn(0x7fd6e006bbc0 msgr2=0x7fd6e006bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:42.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.319+0000 7fd6e5bb7640 1 -- 172.21.15.86:0/901039544 shutdown_connections 2024-09-19T06:40:42.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.319+0000 7fd6e5bb7640 1 -- 172.21.15.86:0/901039544 wait complete. 2024-09-19T06:40:42.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.320+0000 7fd6e5bb7640 1 Processor -- start 2024-09-19T06:40:42.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.321+0000 7fd6e5bb7640 1 -- start start 2024-09-19T06:40:42.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.322+0000 7fd6e5bb7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6e006de50 0x7fd6e00b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:42.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.322+0000 7fd6e5bb7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6e0073f30 0x7fd6e01ff140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:42.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.322+0000 7fd6e5bb7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6e0159660 0x7fd6e01ff680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:42.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.322+0000 7fd6deffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6e0073f30 0x7fd6e01ff140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:42.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.322+0000 7fd6deffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6e0073f30 0x7fd6e01ff140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35598/0 (socket says 172.21.15.86:35598) 2024-09-19T06:40:42.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.322+0000 7fd6df7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6e006de50 0x7fd6e00b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:42.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.323+0000 7fd6df7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6e006de50 0x7fd6e00b1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:51370/0 (socket says 172.21.15.86:51370) 2024-09-19T06:40:42.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.323+0000 7fd6deffd640 1 -- 172.21.15.86:0/986548126 learned_addr learned my addr 172.21.15.86:0/986548126 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:40:42.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.323+0000 7fd6e5bb7640 1 -- 172.21.15.86:0/986548126 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e015fbb0 con 0x7fd6e0073f30 2024-09-19T06:40:42.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.323+0000 7fd6e5bb7640 1 -- 172.21.15.86:0/986548126 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e006d2b0 con 0x7fd6e0159660 2024-09-19T06:40:42.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.323+0000 7fd6e5bb7640 1 -- 172.21.15.86:0/986548126 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd6e015fd30 con 0x7fd6e006de50 2024-09-19T06:40:42.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.324+0000 7fd6deffd640 1 -- 172.21.15.86:0/986548126 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6e006de50 msgr2=0x7fd6e00b1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:42.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.324+0000 7fd6deffd640 1 --2- 172.21.15.86:0/986548126 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6e006de50 0x7fd6e00b1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:42.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.324+0000 7fd6deffd640 1 -- 172.21.15.86:0/986548126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6e0159660 msgr2=0x7fd6e01ff680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:42.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.324+0000 7fd6deffd640 1 --2- 172.21.15.86:0/986548126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6e0159660 0x7fd6e01ff680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:42.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.324+0000 7fd6deffd640 1 -- 172.21.15.86:0/986548126 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e00afba0 con 0x7fd6e0073f30 2024-09-19T06:40:42.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.324+0000 7fd6deffd640 1 --2- 172.21.15.86:0/986548126 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6e0073f30 0x7fd6e01ff140 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd6d000c790 tx=0x7fd6d000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:42.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.325+0000 7fd6d7fff640 1 -- 172.21.15.86:0/986548126 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0003b70 con 0x7fd6e0073f30 2024-09-19T06:40:42.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.326+0000 7fd6d7fff640 1 -- 172.21.15.86:0/986548126 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6d0003d30 con 0x7fd6e0073f30 2024-09-19T06:40:42.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.326+0000 7fd6d7fff640 1 -- 172.21.15.86:0/986548126 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d000aa90 con 0x7fd6e0073f30 2024-09-19T06:40:42.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.326+0000 7fd6e5bb7640 1 -- 172.21.15.86:0/986548126 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6e00b0b90 con 0x7fd6e0073f30 2024-09-19T06:40:42.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.326+0000 7fd6e5bb7640 1 -- 172.21.15.86:0/986548126 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6e00b1150 con 0x7fd6e0073f30 2024-09-19T06:40:42.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.327+0000 7fd6df7fe640 1 --2- 172.21.15.86:0/986548126 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6e006de50 0x7fd6e00b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-19T06:40:42.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.330+0000 7fd6e5bb7640 1 -- 172.21.15.86:0/986548126 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6c4005290 con 0x7fd6e0073f30 2024-09-19T06:40:42.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.330+0000 7fd6d7fff640 1 -- 172.21.15.86:0/986548126 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd6d000ac30 con 0x7fd6e0073f30 2024-09-19T06:40:42.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.331+0000 7fd6d7fff640 1 --2- 172.21.15.86:0/986548126 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd6c006c380 0x7fd6c006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:42.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.332+0000 7fd6df7fe640 1 --2- 172.21.15.86:0/986548126 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd6c006c380 0x7fd6c006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:42.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.332+0000 7fd6d7fff640 1 -- 172.21.15.86:0/986548126 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6821+0+0 (secure 0 0 0) 0x7fd6d008b7a0 con 0x7fd6e0073f30 2024-09-19T06:40:42.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.332+0000 7fd6df7fe640 1 --2- 172.21.15.86:0/986548126 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd6c006c380 0x7fd6c006e840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8007fd0 tx=0x7fd6d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:42.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.340+0000 7fd6d7fff640 1 -- 172.21.15.86:0/986548126 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd6d0059b20 con 0x7fd6e0073f30 2024-09-19T06:40:42.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.792+0000 7fd6e5bb7640 1 -- 172.21.15.86:0/986548126 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6c4005580 con 0x7fd6e0073f30 2024-09-19T06:40:42.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.794+0000 7fd6d7fff640 1 -- 172.21.15.86:0/986548126 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6880 (secure 0 0 0) 0x7fd6d0059420 con 0x7fd6e0073f30 2024-09-19T06:40:42.795 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:40:42.796 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":14,"btime":"2024-09-19T06:39:42:855448+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2213887583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2213887583},{"type":"v1","addr":"172.21.15.169:6837","nonce":2213887583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:39:31.837125+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":0,"incarnation":10,"state":"up:active","state_seq":40,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-09-19T06:40:42.796 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 14 2024-09-19T06:40:42.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.798+0000 7fd6e5bb7640 1 -- 172.21.15.86:0/986548126 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd6c006c380 msgr2=0x7fd6c006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:42.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.798+0000 7fd6e5bb7640 1 --2- 172.21.15.86:0/986548126 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd6c006c380 0x7fd6c006e840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8007fd0 tx=0x7fd6d8009040 comp rx=0 tx=0).stop 2024-09-19T06:40:42.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.798+0000 7fd6e5bb7640 1 -- 172.21.15.86:0/986548126 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6e0073f30 msgr2=0x7fd6e01ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:42.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.798+0000 7fd6e5bb7640 1 --2- 172.21.15.86:0/986548126 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6e0073f30 0x7fd6e01ff140 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd6d000c790 tx=0x7fd6d000cc50 comp rx=0 tx=0).stop 2024-09-19T06:40:42.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.798+0000 7fd6e5bb7640 1 -- 172.21.15.86:0/986548126 shutdown_connections 2024-09-19T06:40:42.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.798+0000 7fd6e5bb7640 1 --2- 172.21.15.86:0/986548126 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd6c006c380 0x7fd6c006e840 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:42.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.798+0000 7fd6e5bb7640 1 --2- 172.21.15.86:0/986548126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6e0159660 0x7fd6e01ff680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:42.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.798+0000 7fd6e5bb7640 1 --2- 172.21.15.86:0/986548126 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6e0073f30 0x7fd6e01ff140 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:42.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.798+0000 7fd6e5bb7640 1 --2- 172.21.15.86:0/986548126 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6e006de50 0x7fd6e00b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:42.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.798+0000 7fd6e5bb7640 1 -- 172.21.15.86:0/986548126 >> 172.21.15.86:0/986548126 conn(0x7fd6e006bbc0 msgr2=0x7fd6e006d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:42.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.798+0000 7fd6e5bb7640 1 -- 172.21.15.86:0/986548126 shutdown_connections 2024-09-19T06:40:42.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:42.798+0000 7fd6e5bb7640 1 -- 172.21.15.86:0/986548126 wait complete. 2024-09-19T06:40:42.826 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.e (rank=0) 2024-09-19T06:40:42.827 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-09-19T06:40:42.827 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:40:42.849 INFO:tasks.ceph.mds.e:Stopped 2024-09-19T06:40:42.849 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:40:43.076 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.074+0000 7fe101c5c640 1 Processor -- start 2024-09-19T06:40:43.076 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.074+0000 7fe101c5c640 1 -- start start 2024-09-19T06:40:43.078 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.076+0000 7fe101c5c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe0fc15e6f0 0x7fe0fc0d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:43.078 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.076+0000 7fe101c5c640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0fc15ec50 con 0x7fe0fc1553a0 2024-09-19T06:40:43.078 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.076+0000 7fe101c5c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0fc15ef30 con 0x7fe0fc0d0ff0 2024-09-19T06:40:43.078 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.076+0000 7fe101c5c640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fe0fc15f210 con 0x7fe0fc15e6f0 2024-09-19T06:40:43.078 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.076+0000 7fe0fb7fe640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe0fc1553a0 0x7fe0fc0cbaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:59864/0 (socket says 172.21.15.86:59864) 2024-09-19T06:40:43.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.076+0000 7fe0fb7fe640 1 -- 172.21.15.86:0/3204348669 learned_addr learned my addr 172.21.15.86:0/3204348669 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:40:43.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.076+0000 7fe0faffd640 1 --2- 172.21.15.86:0/3204348669 >> v2:172.21.15.86:3300/0 conn(0x7fe0fc15e6f0 0x7fe0fc0d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:43.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.076+0000 7fe0fa7fc640 1 -- 172.21.15.86:0/3204348669 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3516732891 0 0) 0x7fe0fc15ec50 con 0x7fe0fc1553a0 2024-09-19T06:40:43.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.077+0000 7fe0fa7fc640 1 -- 172.21.15.86:0/3204348669 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0e8003520 con 0x7fe0fc1553a0 2024-09-19T06:40:43.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.077+0000 7fe0fa7fc640 1 -- 172.21.15.86:0/3204348669 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2104596397 0 0) 0x7fe0fc15ef30 con 0x7fe0fc0d0ff0 2024-09-19T06:40:43.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.077+0000 7fe0fa7fc640 1 -- 172.21.15.86:0/3204348669 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0fc15ec50 con 0x7fe0fc0d0ff0 2024-09-19T06:40:43.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.077+0000 7fe0fa7fc640 1 -- 172.21.15.86:0/3204348669 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1798053240 0 0) 0x7fe0fc15ec50 con 0x7fe0fc0d0ff0 2024-09-19T06:40:43.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.077+0000 7fe0fa7fc640 1 -- 172.21.15.86:0/3204348669 >> v2:172.21.15.86:3300/0 conn(0x7fe0fc15e6f0 msgr2=0x7fe0fc0d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:43.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.077+0000 7fe0fa7fc640 1 --2- 172.21.15.86:0/3204348669 >> v2:172.21.15.86:3300/0 conn(0x7fe0fc15e6f0 0x7fe0fc0d0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:43.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.077+0000 7fe0fa7fc640 1 -- 172.21.15.86:0/3204348669 >> v1:172.21.15.86:6789/0 conn(0x7fe0fc1553a0 legacy=0x7fe0fc0cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:43.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.077+0000 7fe0fa7fc640 1 -- 172.21.15.86:0/3204348669 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0fc15f4f0 con 0x7fe0fc0d0ff0 2024-09-19T06:40:43.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.077+0000 7fe0fa7fc640 1 -- 172.21.15.86:0/3204348669 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7fe0f4001920 con 0x7fe0fc0d0ff0 2024-09-19T06:40:43.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.077+0000 7fe0fa7fc640 1 -- 172.21.15.86:0/3204348669 >> v1:172.21.15.169:6789/0 conn(0x7fe0fc0d0ff0 legacy=0x7fe0fc0c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:43.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.077+0000 7fe0fa7fc640 1 --2- 172.21.15.86:0/3204348669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0e8004c40 0x7fe0e8005040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:43.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.077+0000 7fe0fa7fc640 1 --2- 172.21.15.86:0/3204348669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0e80037a0 0x7fe0e8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:43.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.077+0000 7fe0fa7fc640 1 --2- 172.21.15.86:0/3204348669 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0e8004160 0x7fe0e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:43.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.077+0000 7fe0fa7fc640 1 -- 172.21.15.86:0/3204348669 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc15f210 con 0x7fe0e80037a0 2024-09-19T06:40:43.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.077+0000 7fe0fa7fc640 1 -- 172.21.15.86:0/3204348669 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e800c030 con 0x7fe0e8004c40 2024-09-19T06:40:43.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.077+0000 7fe0fa7fc640 1 -- 172.21.15.86:0/3204348669 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e800c230 con 0x7fe0e8004160 2024-09-19T06:40:43.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.077+0000 7fe0fbfff640 1 --2- 172.21.15.86:0/3204348669 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0e8004160 0x7fe0e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:43.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.078+0000 7fe0fb7fe640 1 --2- 172.21.15.86:0/3204348669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0e8004c40 0x7fe0e8005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:43.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.078+0000 7fe0faffd640 1 --2- 172.21.15.86:0/3204348669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0e80037a0 0x7fe0e8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:43.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.078+0000 7fe0fbfff640 1 -- 172.21.15.86:0/3204348669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0e8004c40 msgr2=0x7fe0e8005040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:43.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.078+0000 7fe0fbfff640 1 --2- 172.21.15.86:0/3204348669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0e8004c40 0x7fe0e8005040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:43.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.078+0000 7fe0fbfff640 1 -- 172.21.15.86:0/3204348669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0e80037a0 msgr2=0x7fe0e8003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:43.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.078+0000 7fe0fbfff640 1 --2- 172.21.15.86:0/3204348669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0e80037a0 0x7fe0e8003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:43.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.078+0000 7fe0fbfff640 1 -- 172.21.15.86:0/3204348669 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0fc15ec50 con 0x7fe0e8004160 2024-09-19T06:40:43.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.079+0000 7fe0fbfff640 1 -- 172.21.15.86:0/3204348669 reap_dead start 2024-09-19T06:40:43.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.079+0000 7fe0faffd640 1 --2- 172.21.15.86:0/3204348669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0e80037a0 0x7fe0e8003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:40:43.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.079+0000 7fe0fb7fe640 1 --2- 172.21.15.86:0/3204348669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0e8004c40 0x7fe0e8005040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:40:43.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.080+0000 7fe0fbfff640 1 --2- 172.21.15.86:0/3204348669 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0e8004160 0x7fe0e800b9c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400c2a0 tx=0x7fe0e8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccde27ec66a8f27f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:43.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.080+0000 7fe0fa7fc640 1 -- 172.21.15.86:0/3204348669 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4001ff0 con 0x7fe0e8004160 2024-09-19T06:40:43.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.080+0000 7fe0fa7fc640 1 -- 172.21.15.86:0/3204348669 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f4031460 con 0x7fe0e8004160 2024-09-19T06:40:43.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.080+0000 7fe0fa7fc640 1 -- 172.21.15.86:0/3204348669 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4031870 con 0x7fe0e8004160 2024-09-19T06:40:43.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.081+0000 7fe101c5c640 1 -- 172.21.15.86:0/3204348669 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0e8004160 msgr2=0x7fe0e800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:43.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.081+0000 7fe101c5c640 1 --2- 172.21.15.86:0/3204348669 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0e8004160 0x7fe0e800b9c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400c2a0 tx=0x7fe0e8005830 comp rx=0 tx=0).stop 2024-09-19T06:40:43.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.082+0000 7fe101c5c640 1 -- 172.21.15.86:0/3204348669 shutdown_connections 2024-09-19T06:40:43.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.082+0000 7fe101c5c640 1 --2- 172.21.15.86:0/3204348669 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0e8004160 0x7fe0e800b9c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:43.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.082+0000 7fe101c5c640 1 -- 172.21.15.86:0/3204348669 >> 172.21.15.86:0/3204348669 conn(0x7fe0fc067890 msgr2=0x7fe0fc067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:43.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.082+0000 7fe101c5c640 1 -- 172.21.15.86:0/3204348669 shutdown_connections 2024-09-19T06:40:43.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.083+0000 7fe101c5c640 1 -- 172.21.15.86:0/3204348669 wait complete. 2024-09-19T06:40:43.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.085+0000 7fe101c5c640 1 Processor -- start 2024-09-19T06:40:43.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.086+0000 7fe101c5c640 1 -- start start 2024-09-19T06:40:43.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.087+0000 7fe101c5c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0e8004160 0x7fe0fc15d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:43.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.088+0000 7fe101c5c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0fc1e6960 0x7fe0fc1f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:43.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.088+0000 7fe0fb7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0e8004160 0x7fe0fc15d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:43.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.089+0000 7fe0fb7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0e8004160 0x7fe0fc15d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:48970/0 (socket says 172.21.15.86:48970) 2024-09-19T06:40:43.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.089+0000 7fe101c5c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0fc14d1d0 0x7fe0fc1f4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:43.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.089+0000 7fe101c5c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc0cc2d0 con 0x7fe0fc1e6960 2024-09-19T06:40:43.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.089+0000 7fe101c5c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc0c66d0 con 0x7fe0e8004160 2024-09-19T06:40:43.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.089+0000 7fe101c5c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe0fc155780 con 0x7fe0fc14d1d0 2024-09-19T06:40:43.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.089+0000 7fe0fb7fe640 1 -- 172.21.15.86:0/425534446 learned_addr learned my addr 172.21.15.86:0/425534446 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:40:43.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.089+0000 7fe0faffd640 1 --2- 172.21.15.86:0/425534446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0fc1e6960 0x7fe0fc1f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:43.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.089+0000 7fe0faffd640 1 -- 172.21.15.86:0/425534446 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0fc14d1d0 msgr2=0x7fe0fc1f4a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:40:43.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.089+0000 7fe0faffd640 1 --2- 172.21.15.86:0/425534446 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0fc14d1d0 0x7fe0fc1f4a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:43.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.090+0000 7fe0faffd640 1 -- 172.21.15.86:0/425534446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0e8004160 msgr2=0x7fe0fc15d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:43.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.090+0000 7fe0faffd640 1 --2- 172.21.15.86:0/425534446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0e8004160 0x7fe0fc15d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:43.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.090+0000 7fe0faffd640 1 -- 172.21.15.86:0/425534446 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0fc14e510 con 0x7fe0fc1e6960 2024-09-19T06:40:43.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.090+0000 7fe0faffd640 1 --2- 172.21.15.86:0/425534446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0fc1e6960 0x7fe0fc1f4500 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc0695d0 tx=0x7fe0e4010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:43.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.091+0000 7fe0f3fff640 1 -- 172.21.15.86:0/425534446 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e400f040 con 0x7fe0fc1e6960 2024-09-19T06:40:43.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.091+0000 7fe0f3fff640 1 -- 172.21.15.86:0/425534446 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0e400e950 con 0x7fe0fc1e6960 2024-09-19T06:40:43.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.091+0000 7fe101c5c640 1 -- 172.21.15.86:0/425534446 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0fc1f12e0 con 0x7fe0fc1e6960 2024-09-19T06:40:43.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.091+0000 7fe101c5c640 1 -- 172.21.15.86:0/425534446 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0fc1f18a0 con 0x7fe0fc1e6960 2024-09-19T06:40:43.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.091+0000 7fe0f3fff640 1 -- 172.21.15.86:0/425534446 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e400ed20 con 0x7fe0fc1e6960 2024-09-19T06:40:43.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.094+0000 7fe0f3fff640 1 -- 172.21.15.86:0/425534446 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe0e401c400 con 0x7fe0fc1e6960 2024-09-19T06:40:43.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.095+0000 7fe101c5c640 1 -- 172.21.15.86:0/425534446 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e0005290 con 0x7fe0fc1e6960 2024-09-19T06:40:43.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.100+0000 7fe0f3fff640 1 --2- 172.21.15.86:0/425534446 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe0dc06c380 0x7fe0dc06e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:43.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.101+0000 7fe0f3fff640 1 -- 172.21.15.86:0/425534446 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6821+0+0 (secure 0 0 0) 0x7fe0e408bda0 con 0x7fe0fc1e6960 2024-09-19T06:40:43.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.101+0000 7fe0fb7fe640 1 --2- 172.21.15.86:0/425534446 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe0dc06c380 0x7fe0dc06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:43.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.102+0000 7fe0fb7fe640 1 --2- 172.21.15.86:0/425534446 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe0dc06c380 0x7fe0dc06e840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec007a50 tx=0x7fe0ec007e50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:43.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.104+0000 7fe0f3fff640 1 -- 172.21.15.86:0/425534446 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe0e4018030 con 0x7fe0fc1e6960 2024-09-19T06:40:43.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.551+0000 7fe101c5c640 1 -- 172.21.15.86:0/425534446 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0e0005580 con 0x7fe0fc1e6960 2024-09-19T06:40:43.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.553+0000 7fe0f3fff640 1 -- 172.21.15.86:0/425534446 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6880 (secure 0 0 0) 0x7fe0e405a000 con 0x7fe0fc1e6960 2024-09-19T06:40:43.556 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:40:43.556 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":14,"btime":"2024-09-19T06:39:42:855448+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2213887583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2213887583},{"type":"v1","addr":"172.21.15.169:6837","nonce":2213887583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:39:31.837125+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":0,"incarnation":10,"state":"up:active","state_seq":40,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-09-19T06:40:43.556 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 14 2024-09-19T06:40:43.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.557+0000 7fe101c5c640 1 -- 172.21.15.86:0/425534446 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe0dc06c380 msgr2=0x7fe0dc06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:43.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.557+0000 7fe101c5c640 1 --2- 172.21.15.86:0/425534446 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe0dc06c380 0x7fe0dc06e840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec007a50 tx=0x7fe0ec007e50 comp rx=0 tx=0).stop 2024-09-19T06:40:43.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.557+0000 7fe101c5c640 1 -- 172.21.15.86:0/425534446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0fc1e6960 msgr2=0x7fe0fc1f4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:43.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.558+0000 7fe101c5c640 1 --2- 172.21.15.86:0/425534446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0fc1e6960 0x7fe0fc1f4500 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc0695d0 tx=0x7fe0e4010c20 comp rx=0 tx=0).stop 2024-09-19T06:40:43.560 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.559+0000 7fe101c5c640 1 -- 172.21.15.86:0/425534446 shutdown_connections 2024-09-19T06:40:43.560 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.559+0000 7fe101c5c640 1 --2- 172.21.15.86:0/425534446 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe0dc06c380 0x7fe0dc06e840 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:43.560 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.559+0000 7fe101c5c640 1 --2- 172.21.15.86:0/425534446 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0fc14d1d0 0x7fe0fc1f4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:43.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.559+0000 7fe101c5c640 1 --2- 172.21.15.86:0/425534446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0fc1e6960 0x7fe0fc1f4500 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:43.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.559+0000 7fe101c5c640 1 --2- 172.21.15.86:0/425534446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0e8004160 0x7fe0fc15d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:43.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.559+0000 7fe101c5c640 1 -- 172.21.15.86:0/425534446 >> 172.21.15.86:0/425534446 conn(0x7fe0fc067890 msgr2=0x7fe0fc0c5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:43.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.559+0000 7fe101c5c640 1 -- 172.21.15.86:0/425534446 shutdown_connections 2024-09-19T06:40:43.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:43.559+0000 7fe101c5c640 1 -- 172.21.15.86:0/425534446 wait complete. 2024-09-19T06:40:43.579 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-09-19T06:40:45.580 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:40:45.781 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.778+0000 7fc333fff640 1 Processor -- start 2024-09-19T06:40:45.781 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.778+0000 7fc333fff640 1 -- start start 2024-09-19T06:40:45.781 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.779+0000 7fc333fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc32c0dce30 0x7fc32c007570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:45.781 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.779+0000 7fc333fff640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc32c046bf0 con 0x7fc32c007ab0 2024-09-19T06:40:45.781 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.779+0000 7fc333fff640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc32c046e90 con 0x7fc32c046230 2024-09-19T06:40:45.781 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.779+0000 7fc333fff640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fc32c0e6f00 con 0x7fc32c0dce30 2024-09-19T06:40:45.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.780+0000 7fc3337fe640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fc32c046230 0x7fc32c0e67f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:35678/0 (socket says 172.21.15.86:35678) 2024-09-19T06:40:45.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.780+0000 7fc3337fe640 1 -- 172.21.15.86:0/1354302125 learned_addr learned my addr 172.21.15.86:0/1354302125 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:40:45.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.780+0000 7fc332ffd640 1 --2- 172.21.15.86:0/1354302125 >> v2:172.21.15.86:3300/0 conn(0x7fc32c0dce30 0x7fc32c007570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:45.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.781+0000 7fc331ffb640 1 -- 172.21.15.86:0/1354302125 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4245430753 0 0) 0x7fc32c046e90 con 0x7fc32c046230 2024-09-19T06:40:45.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.781+0000 7fc331ffb640 1 -- 172.21.15.86:0/1354302125 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc31c003520 con 0x7fc32c046230 2024-09-19T06:40:45.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.781+0000 7fc332ffd640 1 -- 172.21.15.86:0/1354302125 >> v1:172.21.15.169:6789/0 conn(0x7fc32c046230 legacy=0x7fc32c0e67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:45.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.781+0000 7fc332ffd640 1 -- 172.21.15.86:0/1354302125 >> v1:172.21.15.86:6789/0 conn(0x7fc32c007ab0 legacy=0x7fc32c0e60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:45.785 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.781+0000 7fc332ffd640 1 -- 172.21.15.86:0/1354302125 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc32c047150 con 0x7fc32c0dce30 2024-09-19T06:40:45.785 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.782+0000 7fc332ffd640 1 --2- 172.21.15.86:0/1354302125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc32c0dce30 0x7fc32c007570 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc3240097a0 tx=0x7fc32402a090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3a30aad9bb4ab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:45.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.786+0000 7fc331ffb640 1 -- 172.21.15.86:0/1354302125 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc324037070 con 0x7fc32c0dce30 2024-09-19T06:40:45.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.786+0000 7fc331ffb640 1 -- 172.21.15.86:0/1354302125 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc32402ad20 con 0x7fc32c0dce30 2024-09-19T06:40:45.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.786+0000 7fc331ffb640 1 -- 172.21.15.86:0/1354302125 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc324032660 con 0x7fc32c0dce30 2024-09-19T06:40:45.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.787+0000 7fc333fff640 1 -- 172.21.15.86:0/1354302125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc32c0dce30 msgr2=0x7fc32c007570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:45.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.787+0000 7fc333fff640 1 --2- 172.21.15.86:0/1354302125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc32c0dce30 0x7fc32c007570 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc3240097a0 tx=0x7fc32402a090 comp rx=0 tx=0).stop 2024-09-19T06:40:45.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.787+0000 7fc333fff640 1 -- 172.21.15.86:0/1354302125 shutdown_connections 2024-09-19T06:40:45.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.787+0000 7fc333fff640 1 --2- 172.21.15.86:0/1354302125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc32c0dce30 0x7fc32c007570 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:45.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.787+0000 7fc333fff640 1 -- 172.21.15.86:0/1354302125 >> 172.21.15.86:0/1354302125 conn(0x7fc32c04d830 msgr2=0x7fc32c04dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:45.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.787+0000 7fc333fff640 1 -- 172.21.15.86:0/1354302125 shutdown_connections 2024-09-19T06:40:45.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.787+0000 7fc333fff640 1 -- 172.21.15.86:0/1354302125 wait complete. 2024-09-19T06:40:45.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.789+0000 7fc333fff640 1 Processor -- start 2024-09-19T06:40:45.791 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.790+0000 7fc333fff640 1 -- start start 2024-09-19T06:40:45.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.792+0000 7fc333fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc32c007ab0 0x7fc32c0cf790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:45.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.792+0000 7fc333fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc32c046230 0x7fc32c033910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:45.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.792+0000 7fc333fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc32c0dce30 0x7fc32c0346b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:45.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.792+0000 7fc3327fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc32c046230 0x7fc32c033910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:45.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.792+0000 7fc332ffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc32c007ab0 0x7fc32c0cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:45.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.793+0000 7fc3327fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc32c046230 0x7fc32c033910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35646/0 (socket says 172.21.15.86:35646) 2024-09-19T06:40:45.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.793+0000 7fc332ffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc32c007ab0 0x7fc32c0cf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:51378/0 (socket says 172.21.15.86:51378) 2024-09-19T06:40:45.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.793+0000 7fc3327fc640 1 -- 172.21.15.86:0/3569211025 learned_addr learned my addr 172.21.15.86:0/3569211025 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:40:45.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.793+0000 7fc333fff640 1 -- 172.21.15.86:0/3569211025 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c047c60 con 0x7fc32c046230 2024-09-19T06:40:45.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.794+0000 7fc3337fe640 1 --2- 172.21.15.86:0/3569211025 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc32c0dce30 0x7fc32c0346b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:45.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.794+0000 7fc333fff640 1 -- 172.21.15.86:0/3569211025 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c047730 con 0x7fc32c0dce30 2024-09-19T06:40:45.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.794+0000 7fc333fff640 1 -- 172.21.15.86:0/3569211025 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc32c0dd210 con 0x7fc32c007ab0 2024-09-19T06:40:45.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.797+0000 7fc3327fc640 1 -- 172.21.15.86:0/3569211025 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc32c007ab0 msgr2=0x7fc32c0cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:45.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.797+0000 7fc3327fc640 1 --2- 172.21.15.86:0/3569211025 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc32c007ab0 0x7fc32c0cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:45.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.797+0000 7fc3327fc640 1 -- 172.21.15.86:0/3569211025 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc32c0dce30 msgr2=0x7fc32c0346b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:45.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.797+0000 7fc3327fc640 1 --2- 172.21.15.86:0/3569211025 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc32c0dce30 0x7fc32c0346b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:45.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.797+0000 7fc3327fc640 1 -- 172.21.15.86:0/3569211025 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc32c0e62a0 con 0x7fc32c046230 2024-09-19T06:40:45.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.797+0000 7fc332ffd640 1 --2- 172.21.15.86:0/3569211025 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc32c007ab0 0x7fc32c0cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:40:45.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.798+0000 7fc3337fe640 1 --2- 172.21.15.86:0/3569211025 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc32c0dce30 0x7fc32c0346b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:40:45.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.798+0000 7fc3327fc640 1 --2- 172.21.15.86:0/3569211025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc32c046230 0x7fc32c033910 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc32800c5a0 tx=0x7fc32800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:45.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.799+0000 7fc31bfff640 1 -- 172.21.15.86:0/3569211025 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc328017070 con 0x7fc32c046230 2024-09-19T06:40:45.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.800+0000 7fc333fff640 1 -- 172.21.15.86:0/3569211025 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc32c0cfd90 con 0x7fc32c046230 2024-09-19T06:40:45.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.800+0000 7fc333fff640 1 -- 172.21.15.86:0/3569211025 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc32c0e6540 con 0x7fc32c046230 2024-09-19T06:40:45.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.801+0000 7fc333fff640 1 -- 172.21.15.86:0/3569211025 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc32c04b730 con 0x7fc32c046230 2024-09-19T06:40:45.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.802+0000 7fc31bfff640 1 -- 172.21.15.86:0/3569211025 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3280052d0 con 0x7fc32c046230 2024-09-19T06:40:45.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.802+0000 7fc31bfff640 1 -- 172.21.15.86:0/3569211025 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc328012870 con 0x7fc32c046230 2024-09-19T06:40:45.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.805+0000 7fc31bfff640 1 -- 172.21.15.86:0/3569211025 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc32801a070 con 0x7fc32c046230 2024-09-19T06:40:45.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.808+0000 7fc31bfff640 1 --2- 172.21.15.86:0/3569211025 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc32006c380 0x7fc32006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:45.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.809+0000 7fc332ffd640 1 --2- 172.21.15.86:0/3569211025 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc32006c380 0x7fc32006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:45.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.810+0000 7fc31bfff640 1 -- 172.21.15.86:0/3569211025 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6821+0+0 (secure 0 0 0) 0x7fc32808b210 con 0x7fc32c046230 2024-09-19T06:40:45.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.810+0000 7fc332ffd640 1 --2- 172.21.15.86:0/3569211025 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc32006c380 0x7fc32006e840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc324034000 tx=0x7fc32402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:45.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:45.812+0000 7fc31bfff640 1 -- 172.21.15.86:0/3569211025 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc328021020 con 0x7fc32c046230 2024-09-19T06:40:46.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:46.255+0000 7fc333fff640 1 -- 172.21.15.86:0/3569211025 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc32c0469d0 con 0x7fc32c046230 2024-09-19T06:40:46.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:46.258+0000 7fc31bfff640 1 -- 172.21.15.86:0/3569211025 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6880 (secure 0 0 0) 0x7fc328059470 con 0x7fc32c046230 2024-09-19T06:40:46.260 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:40:46.260 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":14,"btime":"2024-09-19T06:39:42:855448+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2213887583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2213887583},{"type":"v1","addr":"172.21.15.169:6837","nonce":2213887583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:39:31.837125+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":0,"incarnation":10,"state":"up:active","state_seq":40,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-09-19T06:40:46.260 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 14 2024-09-19T06:40:46.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:46.262+0000 7fc319ffb640 1 -- 172.21.15.86:0/3569211025 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc32006c380 msgr2=0x7fc32006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:46.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:46.262+0000 7fc319ffb640 1 --2- 172.21.15.86:0/3569211025 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc32006c380 0x7fc32006e840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc324034000 tx=0x7fc32402e000 comp rx=0 tx=0).stop 2024-09-19T06:40:46.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:46.262+0000 7fc319ffb640 1 -- 172.21.15.86:0/3569211025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc32c046230 msgr2=0x7fc32c033910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:46.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:46.262+0000 7fc319ffb640 1 --2- 172.21.15.86:0/3569211025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc32c046230 0x7fc32c033910 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc32800c5a0 tx=0x7fc32800ca60 comp rx=0 tx=0).stop 2024-09-19T06:40:46.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:46.262+0000 7fc319ffb640 1 -- 172.21.15.86:0/3569211025 shutdown_connections 2024-09-19T06:40:46.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:46.262+0000 7fc319ffb640 1 --2- 172.21.15.86:0/3569211025 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc32006c380 0x7fc32006e840 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:46.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:46.262+0000 7fc319ffb640 1 --2- 172.21.15.86:0/3569211025 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc32c0dce30 0x7fc32c0346b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:46.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:46.262+0000 7fc319ffb640 1 --2- 172.21.15.86:0/3569211025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc32c046230 0x7fc32c033910 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:46.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:46.262+0000 7fc319ffb640 1 --2- 172.21.15.86:0/3569211025 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc32c007ab0 0x7fc32c0cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:46.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:46.262+0000 7fc319ffb640 1 -- 172.21.15.86:0/3569211025 >> 172.21.15.86:0/3569211025 conn(0x7fc32c04d830 msgr2=0x7fc32c036970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:46.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:46.263+0000 7fc319ffb640 1 -- 172.21.15.86:0/3569211025 shutdown_connections 2024-09-19T06:40:46.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:46.263+0000 7fc319ffb640 1 -- 172.21.15.86:0/3569211025 wait complete. 2024-09-19T06:40:46.285 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-09-19T06:40:48.286 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:40:48.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.473+0000 7f9ecd69b640 1 Processor -- start 2024-09-19T06:40:48.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.473+0000 7f9ecd69b640 1 -- start start 2024-09-19T06:40:48.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.474+0000 7f9ecd69b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9ec8159ae0 0x7f9ec80b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:48.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.474+0000 7f9ecd69b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9ec80c81f0 0x7f9ec806dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:48.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.474+0000 7f9ecd69b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ec80c1e90 con 0x7f9ec806e280 2024-09-19T06:40:48.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.474+0000 7f9ecd69b640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f9ec806d8b0 con 0x7f9ec8159ae0 2024-09-19T06:40:48.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.474+0000 7f9ecd69b640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f9ec80c86e0 con 0x7f9ec80c81f0 2024-09-19T06:40:48.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.475+0000 7f9ec67fc640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9ec80c81f0 0x7f9ec806dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:48.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.475+0000 7f9ec6ffd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9ec8159ae0 0x7f9ec80b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:48.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.475+0000 7f9ec67fc640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9ec80c81f0 0x7f9ec806dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:49002/0 (socket says 172.21.15.86:49002) 2024-09-19T06:40:48.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.475+0000 7f9ec67fc640 1 -- 172.21.15.86:0/917973099 learned_addr learned my addr 172.21.15.86:0/917973099 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:40:48.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.475+0000 7f9ec6ffd640 1 -- 172.21.15.86:0/917973099 >> v2:172.21.15.169:3300/0 conn(0x7f9ec80c81f0 msgr2=0x7f9ec806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:48.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.475+0000 7f9ec6ffd640 1 --2- 172.21.15.86:0/917973099 >> v2:172.21.15.169:3300/0 conn(0x7f9ec80c81f0 0x7f9ec806dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:48.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.475+0000 7f9ec6ffd640 1 -- 172.21.15.86:0/917973099 >> v1:172.21.15.169:6789/0 conn(0x7f9ec806e280 legacy=0x7f9ec8162b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:40:48.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.475+0000 7f9ec6ffd640 1 -- 172.21.15.86:0/917973099 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec80c89c0 con 0x7f9ec8159ae0 2024-09-19T06:40:48.478 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.477+0000 7f9ec6ffd640 1 --2- 172.21.15.86:0/917973099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ec8159ae0 0x7f9ec80b2ae0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80ca900 tx=0x7f9eb802a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d55202f8a3a31a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:48.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.481+0000 7f9ec5ffb640 1 -- 172.21.15.86:0/917973099 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8037070 con 0x7f9ec8159ae0 2024-09-19T06:40:48.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.481+0000 7f9ec5ffb640 1 -- 172.21.15.86:0/917973099 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eb802ae30 con 0x7f9ec8159ae0 2024-09-19T06:40:48.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.481+0000 7f9ec5ffb640 1 -- 172.21.15.86:0/917973099 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8032640 con 0x7f9ec8159ae0 2024-09-19T06:40:48.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.482+0000 7f9ecd69b640 1 -- 172.21.15.86:0/917973099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ec8159ae0 msgr2=0x7f9ec80b2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:48.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.482+0000 7f9ecd69b640 1 --2- 172.21.15.86:0/917973099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ec8159ae0 0x7f9ec80b2ae0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80ca900 tx=0x7f9eb802a330 comp rx=0 tx=0).stop 2024-09-19T06:40:48.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.482+0000 7f9ecd69b640 1 -- 172.21.15.86:0/917973099 shutdown_connections 2024-09-19T06:40:48.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.482+0000 7f9ecd69b640 1 --2- 172.21.15.86:0/917973099 >> v2:172.21.15.169:3300/0 conn(0x7f9ec80c81f0 0x7f9ec806dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:48.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.482+0000 7f9ecd69b640 1 --2- 172.21.15.86:0/917973099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ec8159ae0 0x7f9ec80b2ae0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:48.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.482+0000 7f9ecd69b640 1 -- 172.21.15.86:0/917973099 >> 172.21.15.86:0/917973099 conn(0x7f9ec806eb60 msgr2=0x7f9ec806ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:48.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.482+0000 7f9ecd69b640 1 -- 172.21.15.86:0/917973099 shutdown_connections 2024-09-19T06:40:48.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.482+0000 7f9ecd69b640 1 -- 172.21.15.86:0/917973099 wait complete. 2024-09-19T06:40:48.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.484+0000 7f9ecd69b640 1 Processor -- start 2024-09-19T06:40:48.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.485+0000 7f9ecd69b640 1 -- start start 2024-09-19T06:40:48.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.487+0000 7f9ecd69b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9ec806e280 0x7f9ec80c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:48.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.487+0000 7f9ecd69b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ec80c81f0 0x7f9ec8159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:48.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.487+0000 7f9ecd69b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ec8159ae0 0x7f9ec81628a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:48.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.487+0000 7f9ecd69b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec806d540 con 0x7f9ec80c81f0 2024-09-19T06:40:48.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.487+0000 7f9ecd69b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec806d260 con 0x7f9ec8159ae0 2024-09-19T06:40:48.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.487+0000 7f9ecd69b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9ec81637c0 con 0x7f9ec806e280 2024-09-19T06:40:48.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.487+0000 7f9ec6ffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9ec806e280 0x7f9ec80c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:48.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.487+0000 7f9ec6ffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9ec806e280 0x7f9ec80c4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:51394/0 (socket says 172.21.15.86:51394) 2024-09-19T06:40:48.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.487+0000 7f9ec6ffd640 1 -- 172.21.15.86:0/1412601058 learned_addr learned my addr 172.21.15.86:0/1412601058 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:40:48.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.487+0000 7f9ec67fc640 1 --2- 172.21.15.86:0/1412601058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ec80c81f0 0x7f9ec8159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:48.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.487+0000 7f9ec77fe640 1 --2- 172.21.15.86:0/1412601058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ec8159ae0 0x7f9ec81628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:48.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.488+0000 7f9ec6ffd640 1 -- 172.21.15.86:0/1412601058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ec8159ae0 msgr2=0x7f9ec81628a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:48.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.488+0000 7f9ec6ffd640 1 --2- 172.21.15.86:0/1412601058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ec8159ae0 0x7f9ec81628a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:48.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.488+0000 7f9ec6ffd640 1 -- 172.21.15.86:0/1412601058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ec80c81f0 msgr2=0x7f9ec8159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:48.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.488+0000 7f9ec6ffd640 1 --2- 172.21.15.86:0/1412601058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ec80c81f0 0x7f9ec8159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:48.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.488+0000 7f9ec6ffd640 1 -- 172.21.15.86:0/1412601058 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec8201fe0 con 0x7f9ec806e280 2024-09-19T06:40:48.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.490+0000 7f9ec6ffd640 1 --2- 172.21.15.86:0/1412601058 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9ec806e280 0x7f9ec80c4890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9eb802a920 tx=0x7f9eb80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:48.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.491+0000 7f9eaf7fe640 1 -- 172.21.15.86:0/1412601058 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8037040 con 0x7f9ec806e280 2024-09-19T06:40:48.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.491+0000 7f9eaf7fe640 1 -- 172.21.15.86:0/1412601058 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eb8003cc0 con 0x7f9ec806e280 2024-09-19T06:40:48.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.491+0000 7f9eaf7fe640 1 -- 172.21.15.86:0/1412601058 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb803d690 con 0x7f9ec806e280 2024-09-19T06:40:48.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.494+0000 7f9ecd69b640 1 -- 172.21.15.86:0/1412601058 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ec80c4200 con 0x7f9ec806e280 2024-09-19T06:40:48.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.494+0000 7f9ecd69b640 1 -- 172.21.15.86:0/1412601058 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ec8162380 con 0x7f9ec806e280 2024-09-19T06:40:48.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.497+0000 7f9eaf7fe640 1 -- 172.21.15.86:0/1412601058 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9eb803d830 con 0x7f9ec806e280 2024-09-19T06:40:48.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.497+0000 7f9ecd69b640 1 -- 172.21.15.86:0/1412601058 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ec8162580 con 0x7f9ec806e280 2024-09-19T06:40:48.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.500+0000 7f9eaf7fe640 1 --2- 172.21.15.86:0/1412601058 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9eb406c2b0 0x7f9eb406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:48.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.500+0000 7f9eaf7fe640 1 -- 172.21.15.86:0/1412601058 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6821+0+0 (secure 0 0 0) 0x7f9eb80ac450 con 0x7f9ec806e280 2024-09-19T06:40:48.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.500+0000 7f9ec67fc640 1 --2- 172.21.15.86:0/1412601058 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9eb406c2b0 0x7f9eb406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:48.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.501+0000 7f9ec67fc640 1 --2- 172.21.15.86:0/1412601058 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9eb406c2b0 0x7f9eb406e770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8158210 tx=0x7f9ec0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:48.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.508+0000 7f9eaf7fe640 1 -- 172.21.15.86:0/1412601058 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9eb807a5b0 con 0x7f9ec806e280 2024-09-19T06:40:48.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.975+0000 7f9ecd69b640 1 -- 172.21.15.86:0/1412601058 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ec8162170 con 0x7f9ec806e280 2024-09-19T06:40:48.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.978+0000 7f9eaf7fe640 1 -- 172.21.15.86:0/1412601058 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6880 (secure 0 0 0) 0x7f9eb8079eb0 con 0x7f9ec806e280 2024-09-19T06:40:48.980 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:40:48.980 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":14,"btime":"2024-09-19T06:39:42:855448+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2213887583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2213887583},{"type":"v1","addr":"172.21.15.169:6837","nonce":2213887583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:39:31.837125+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":0,"incarnation":10,"state":"up:active","state_seq":40,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-09-19T06:40:48.980 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 14 2024-09-19T06:40:48.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.983+0000 7f9ead7fa640 1 -- 172.21.15.86:0/1412601058 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9eb406c2b0 msgr2=0x7f9eb406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:48.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.983+0000 7f9ead7fa640 1 --2- 172.21.15.86:0/1412601058 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9eb406c2b0 0x7f9eb406e770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8158210 tx=0x7f9ec0009040 comp rx=0 tx=0).stop 2024-09-19T06:40:48.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.983+0000 7f9ead7fa640 1 -- 172.21.15.86:0/1412601058 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9ec806e280 msgr2=0x7f9ec80c4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:48.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.983+0000 7f9ead7fa640 1 --2- 172.21.15.86:0/1412601058 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9ec806e280 0x7f9ec80c4890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9eb802a920 tx=0x7f9eb80046c0 comp rx=0 tx=0).stop 2024-09-19T06:40:48.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.986+0000 7f9ead7fa640 1 -- 172.21.15.86:0/1412601058 shutdown_connections 2024-09-19T06:40:48.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.986+0000 7f9ead7fa640 1 --2- 172.21.15.86:0/1412601058 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9eb406c2b0 0x7f9eb406e770 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:48.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.986+0000 7f9ead7fa640 1 --2- 172.21.15.86:0/1412601058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ec8159ae0 0x7f9ec81628a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:48.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.986+0000 7f9ead7fa640 1 --2- 172.21.15.86:0/1412601058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ec80c81f0 0x7f9ec8159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:48.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.986+0000 7f9ead7fa640 1 --2- 172.21.15.86:0/1412601058 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9ec806e280 0x7f9ec80c4890 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:48.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.986+0000 7f9ead7fa640 1 -- 172.21.15.86:0/1412601058 >> 172.21.15.86:0/1412601058 conn(0x7f9ec806eb60 msgr2=0x7f9ec80b2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:48.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.986+0000 7f9ead7fa640 1 -- 172.21.15.86:0/1412601058 shutdown_connections 2024-09-19T06:40:48.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:48.986+0000 7f9ead7fa640 1 -- 172.21.15.86:0/1412601058 wait complete. 2024-09-19T06:40:49.008 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-09-19T06:40:51.009 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:40:51.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.210+0000 7fe7c4fbd640 1 Processor -- start 2024-09-19T06:40:51.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.211+0000 7fe7c4fbd640 1 -- start start 2024-09-19T06:40:51.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.212+0000 7fe7c4fbd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe7c0151270 0x7fe7c015af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:51.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.212+0000 7fe7c4fbd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7c00c32b0 0x7fe7c00c7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:51.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.212+0000 7fe7c4fbd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe7c00c7ac0 0x7fe7c0072260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:51.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.212+0000 7fe7c4fbd640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fe7c00718e0 con 0x7fe7c0151270 2024-09-19T06:40:51.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.213+0000 7fe7c4fbd640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe7c00c8bc0 con 0x7fe7c00c7ac0 2024-09-19T06:40:51.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.213+0000 7fe7c4fbd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe7c00c8ea0 con 0x7fe7c00c32b0 2024-09-19T06:40:51.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.213+0000 7fe7bed9d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe7c00c7ac0 0x7fe7c0072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:51.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.213+0000 7fe7bed9d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe7c00c7ac0 0x7fe7c0072260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:49020/0 (socket says 172.21.15.86:49020) 2024-09-19T06:40:51.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.213+0000 7fe7bed9d640 1 -- 172.21.15.86:0/1656426259 learned_addr learned my addr 172.21.15.86:0/1656426259 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:40:51.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.214+0000 7fe7bed9d640 1 -- 172.21.15.86:0/1656426259 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7c00c32b0 msgr2=0x7fe7c00c7580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:40:51.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.214+0000 7fe7bed9d640 1 --2- 172.21.15.86:0/1656426259 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7c00c32b0 0x7fe7c00c7580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:51.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.214+0000 7fe7bed9d640 1 -- 172.21.15.86:0/1656426259 >> v2:172.21.15.86:3300/0 conn(0x7fe7c0151270 msgr2=0x7fe7c015af50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:40:51.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.214+0000 7fe7bed9d640 1 --2- 172.21.15.86:0/1656426259 >> v2:172.21.15.86:3300/0 conn(0x7fe7c0151270 0x7fe7c015af50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:51.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.214+0000 7fe7bed9d640 1 -- 172.21.15.86:0/1656426259 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c0071320 con 0x7fe7c00c7ac0 2024-09-19T06:40:51.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.216+0000 7fe7bed9d640 1 --2- 172.21.15.86:0/1656426259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7c00c7ac0 0x7fe7c0072260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0076060 tx=0x7fe7b802eb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc1cf8983398b3bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:51.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.221+0000 7fe7bd59a640 1 -- 172.21.15.86:0/1656426259 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b80306c0 con 0x7fe7c00c7ac0 2024-09-19T06:40:51.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.221+0000 7fe7bd59a640 1 -- 172.21.15.86:0/1656426259 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7b8030860 con 0x7fe7c00c7ac0 2024-09-19T06:40:51.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.222+0000 7fe7c4fbd640 1 -- 172.21.15.86:0/1656426259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7c00c7ac0 msgr2=0x7fe7c0072260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:51.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.222+0000 7fe7c4fbd640 1 --2- 172.21.15.86:0/1656426259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7c00c7ac0 0x7fe7c0072260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0076060 tx=0x7fe7b802eb70 comp rx=0 tx=0).stop 2024-09-19T06:40:51.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.225+0000 7fe7c4fbd640 1 -- 172.21.15.86:0/1656426259 shutdown_connections 2024-09-19T06:40:51.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.225+0000 7fe7c4fbd640 1 --2- 172.21.15.86:0/1656426259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7c00c7ac0 0x7fe7c0072260 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:51.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.225+0000 7fe7c4fbd640 1 --2- 172.21.15.86:0/1656426259 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7c00c32b0 0x7fe7c00c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:51.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.225+0000 7fe7c4fbd640 1 --2- 172.21.15.86:0/1656426259 >> v2:172.21.15.86:3300/0 conn(0x7fe7c0151270 0x7fe7c015af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:51.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.225+0000 7fe7c4fbd640 1 -- 172.21.15.86:0/1656426259 >> 172.21.15.86:0/1656426259 conn(0x7fe7c00c9280 msgr2=0x7fe7c00c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:51.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.230+0000 7fe7c4fbd640 1 -- 172.21.15.86:0/1656426259 shutdown_connections 2024-09-19T06:40:51.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.231+0000 7fe7c4fbd640 1 -- 172.21.15.86:0/1656426259 wait complete. 2024-09-19T06:40:51.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.233+0000 7fe7c4fbd640 1 Processor -- start 2024-09-19T06:40:51.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.233+0000 7fe7c4fbd640 1 -- start start 2024-09-19T06:40:51.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.235+0000 7fe7c4fbd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7c00c32b0 0x7fe7c0140470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:51.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.235+0000 7fe7c4fbd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7c00c7ac0 0x7fe7c0144f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:51.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.235+0000 7fe7be59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7c00c32b0 0x7fe7c0140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:51.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.235+0000 7fe7be59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7c00c32b0 0x7fe7c0140470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:49022/0 (socket says 172.21.15.86:49022) 2024-09-19T06:40:51.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.235+0000 7fe7c4fbd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7c0151270 0x7fe7c0149e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:51.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.236+0000 7fe7bdd9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7c00c7ac0 0x7fe7c0144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:51.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.236+0000 7fe7c4fbd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c00c3890 con 0x7fe7c0151270 2024-09-19T06:40:51.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.236+0000 7fe7bed9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7c0151270 0x7fe7c0149e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:51.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.236+0000 7fe7be59c640 1 -- 172.21.15.86:0/3891992025 learned_addr learned my addr 172.21.15.86:0/3891992025 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:40:51.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.236+0000 7fe7c4fbd640 1 -- 172.21.15.86:0/3891992025 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c0071d40 con 0x7fe7c00c32b0 2024-09-19T06:40:51.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.236+0000 7fe7c4fbd640 1 -- 172.21.15.86:0/3891992025 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe7c0151650 con 0x7fe7c00c7ac0 2024-09-19T06:40:51.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.236+0000 7fe7bdd9b640 1 -- 172.21.15.86:0/3891992025 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7c00c32b0 msgr2=0x7fe7c0140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:51.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.236+0000 7fe7bdd9b640 1 --2- 172.21.15.86:0/3891992025 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7c00c32b0 0x7fe7c0140470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:51.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.236+0000 7fe7bdd9b640 1 -- 172.21.15.86:0/3891992025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7c0151270 msgr2=0x7fe7c0149e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:51.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.236+0000 7fe7bdd9b640 1 --2- 172.21.15.86:0/3891992025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7c0151270 0x7fe7c0149e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:51.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.236+0000 7fe7bdd9b640 1 -- 172.21.15.86:0/3891992025 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c01454a0 con 0x7fe7c00c7ac0 2024-09-19T06:40:51.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.237+0000 7fe7bdd9b640 1 --2- 172.21.15.86:0/3891992025 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7c00c7ac0 0x7fe7c0144f60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000b3e0 tx=0x7fe7b000b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:51.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.239+0000 7fe7aeffd640 1 -- 172.21.15.86:0/3891992025 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0015020 con 0x7fe7c00c7ac0 2024-09-19T06:40:51.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.240+0000 7fe7aeffd640 1 -- 172.21.15.86:0/3891992025 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7b0011830 con 0x7fe7c00c7ac0 2024-09-19T06:40:51.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.240+0000 7fe7c4fbd640 1 -- 172.21.15.86:0/3891992025 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7c01f0530 con 0x7fe7c00c7ac0 2024-09-19T06:40:51.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.240+0000 7fe7c4fbd640 1 -- 172.21.15.86:0/3891992025 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7c01f0af0 con 0x7fe7c00c7ac0 2024-09-19T06:40:51.242 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.241+0000 7fe7aeffd640 1 -- 172.21.15.86:0/3891992025 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0011c40 con 0x7fe7c00c7ac0 2024-09-19T06:40:51.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.242+0000 7fe7c4fbd640 1 -- 172.21.15.86:0/3891992025 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7a4005290 con 0x7fe7c00c7ac0 2024-09-19T06:40:51.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.243+0000 7fe7aeffd640 1 -- 172.21.15.86:0/3891992025 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe7b0018020 con 0x7fe7c00c7ac0 2024-09-19T06:40:51.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.244+0000 7fe7aeffd640 1 --2- 172.21.15.86:0/3891992025 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe7a006c380 0x7fe7a006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:51.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.244+0000 7fe7be59c640 1 --2- 172.21.15.86:0/3891992025 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe7a006c380 0x7fe7a006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:51.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.245+0000 7fe7aeffd640 1 -- 172.21.15.86:0/3891992025 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6821+0+0 (secure 0 0 0) 0x7fe7b008b610 con 0x7fe7c00c7ac0 2024-09-19T06:40:51.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.245+0000 7fe7be59c640 1 --2- 172.21.15.86:0/3891992025 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe7a006c380 0x7fe7a006e840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4009a40 tx=0x7fe7b40090e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:51.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.250+0000 7fe7aeffd640 1 -- 172.21.15.86:0/3891992025 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe7b001f020 con 0x7fe7c00c7ac0 2024-09-19T06:40:51.683 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.682+0000 7fe7c4fbd640 1 -- 172.21.15.86:0/3891992025 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7a4005580 con 0x7fe7c00c7ac0 2024-09-19T06:40:51.685 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.683+0000 7fe7aeffd640 1 -- 172.21.15.86:0/3891992025 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6880 (secure 0 0 0) 0x7fe7b0059220 con 0x7fe7c00c7ac0 2024-09-19T06:40:51.686 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:40:51.686 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":14,"btime":"2024-09-19T06:39:42:855448+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2213887583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2213887583},{"type":"v1","addr":"172.21.15.169:6837","nonce":2213887583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:39:31.837125+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":0,"incarnation":10,"state":"up:active","state_seq":40,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-09-19T06:40:51.687 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 14 2024-09-19T06:40:51.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.688+0000 7fe7c4fbd640 1 -- 172.21.15.86:0/3891992025 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe7a006c380 msgr2=0x7fe7a006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:51.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.688+0000 7fe7c4fbd640 1 --2- 172.21.15.86:0/3891992025 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe7a006c380 0x7fe7a006e840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4009a40 tx=0x7fe7b40090e0 comp rx=0 tx=0).stop 2024-09-19T06:40:51.690 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.688+0000 7fe7c4fbd640 1 -- 172.21.15.86:0/3891992025 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7c00c7ac0 msgr2=0x7fe7c0144f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:51.690 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.688+0000 7fe7c4fbd640 1 --2- 172.21.15.86:0/3891992025 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7c00c7ac0 0x7fe7c0144f60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000b3e0 tx=0x7fe7b000b8a0 comp rx=0 tx=0).stop 2024-09-19T06:40:51.690 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.688+0000 7fe7c4fbd640 1 -- 172.21.15.86:0/3891992025 shutdown_connections 2024-09-19T06:40:51.690 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.688+0000 7fe7c4fbd640 1 --2- 172.21.15.86:0/3891992025 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe7a006c380 0x7fe7a006e840 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:51.690 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.688+0000 7fe7c4fbd640 1 --2- 172.21.15.86:0/3891992025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7c0151270 0x7fe7c0149e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:51.690 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.689+0000 7fe7c4fbd640 1 --2- 172.21.15.86:0/3891992025 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7c00c7ac0 0x7fe7c0144f60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:51.690 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.689+0000 7fe7c4fbd640 1 --2- 172.21.15.86:0/3891992025 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7c00c32b0 0x7fe7c0140470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:51.690 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.689+0000 7fe7c4fbd640 1 -- 172.21.15.86:0/3891992025 >> 172.21.15.86:0/3891992025 conn(0x7fe7c00c9280 msgr2=0x7fe7c00cb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:51.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.691+0000 7fe7c4fbd640 1 -- 172.21.15.86:0/3891992025 shutdown_connections 2024-09-19T06:40:51.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:51.691+0000 7fe7c4fbd640 1 -- 172.21.15.86:0/3891992025 wait complete. 2024-09-19T06:40:51.711 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-09-19T06:40:53.712 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:40:53.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.841+0000 7ff538b9a640 1 Processor -- start 2024-09-19T06:40:53.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.844+0000 7ff538b9a640 1 -- start start 2024-09-19T06:40:53.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.845+0000 7ff538b9a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5340ca530 0x7ff5340ca960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:53.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.845+0000 7ff538b9a640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff534158040 con 0x7ff534157bf0 2024-09-19T06:40:53.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.845+0000 7ff538b9a640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff534158310 con 0x7ff534152050 2024-09-19T06:40:53.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.846+0000 7ff532d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5340ca530 0x7ff5340ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:53.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.846+0000 7ff532d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5340ca530 0x7ff5340ca960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:43626/0 (socket says 172.21.15.86:43626) 2024-09-19T06:40:53.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.846+0000 7ff532d9d640 1 -- 172.21.15.86:0/2393929986 learned_addr learned my addr 172.21.15.86:0/2393929986 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:40:53.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.846+0000 7ff538b9a640 1 -- 172.21.15.86:0/2393929986 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff534158bb0 con 0x7ff5340ca530 2024-09-19T06:40:53.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.847+0000 7ff531d9b640 1 -- 172.21.15.86:0/2393929986 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3523643620 0 0) 0x7ff534158040 con 0x7ff534157bf0 2024-09-19T06:40:53.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.847+0000 7ff531d9b640 1 -- 172.21.15.86:0/2393929986 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff520003520 con 0x7ff534157bf0 2024-09-19T06:40:53.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.848+0000 7ff532d9d640 1 -- 172.21.15.86:0/2393929986 >> v1:172.21.15.169:6789/0 conn(0x7ff534152050 legacy=0x7ff53415bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:53.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.848+0000 7ff532d9d640 1 -- 172.21.15.86:0/2393929986 >> v1:172.21.15.86:6789/0 conn(0x7ff534157bf0 legacy=0x7ff5340c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:53.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.848+0000 7ff532d9d640 1 -- 172.21.15.86:0/2393929986 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5341585f0 con 0x7ff5340ca530 2024-09-19T06:40:53.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.849+0000 7ff532d9d640 1 --2- 172.21.15.86:0/2393929986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5340ca530 0x7ff5340ca960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00d180 tx=0x7ff52c02c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77da7f63745a8072 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:53.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.853+0000 7ff531d9b640 1 -- 172.21.15.86:0/2393929986 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c038070 con 0x7ff5340ca530 2024-09-19T06:40:53.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.853+0000 7ff531d9b640 1 -- 172.21.15.86:0/2393929986 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff52c009600 con 0x7ff5340ca530 2024-09-19T06:40:53.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.853+0000 7ff531d9b640 1 -- 172.21.15.86:0/2393929986 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c0099d0 con 0x7ff5340ca530 2024-09-19T06:40:53.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.855+0000 7ff538b9a640 1 -- 172.21.15.86:0/2393929986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5340ca530 msgr2=0x7ff5340ca960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:53.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.855+0000 7ff538b9a640 1 --2- 172.21.15.86:0/2393929986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5340ca530 0x7ff5340ca960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00d180 tx=0x7ff52c02c830 comp rx=0 tx=0).stop 2024-09-19T06:40:53.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.857+0000 7ff538b9a640 1 -- 172.21.15.86:0/2393929986 shutdown_connections 2024-09-19T06:40:53.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.857+0000 7ff538b9a640 1 --2- 172.21.15.86:0/2393929986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5340ca530 0x7ff5340ca960 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:53.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.857+0000 7ff538b9a640 1 -- 172.21.15.86:0/2393929986 >> 172.21.15.86:0/2393929986 conn(0x7ff53406fd60 msgr2=0x7ff534070140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:53.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.858+0000 7ff538b9a640 1 -- 172.21.15.86:0/2393929986 shutdown_connections 2024-09-19T06:40:53.861 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.858+0000 7ff538b9a640 1 -- 172.21.15.86:0/2393929986 wait complete. 2024-09-19T06:40:53.861 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.860+0000 7ff538b9a640 1 Processor -- start 2024-09-19T06:40:53.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.860+0000 7ff538b9a640 1 -- start start 2024-09-19T06:40:53.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.862+0000 7ff538b9a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5340ca530 0x7ff53406d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:53.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.862+0000 7ff538b9a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff534152050 0x7ff53415a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:53.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.862+0000 7ff538b9a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff534157bf0 0x7ff5341eff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:53.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.862+0000 7ff538b9a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff53415b5f0 con 0x7ff534152050 2024-09-19T06:40:53.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.862+0000 7ff538b9a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff53415b310 con 0x7ff534157bf0 2024-09-19T06:40:53.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.862+0000 7ff538b9a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff5340c4810 con 0x7ff5340ca530 2024-09-19T06:40:53.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.862+0000 7ff532d9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff534157bf0 0x7ff5341eff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:53.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.862+0000 7ff532d9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff534157bf0 0x7ff5341eff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:46124/0 (socket says 172.21.15.86:46124) 2024-09-19T06:40:53.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.862+0000 7ff532d9d640 1 -- 172.21.15.86:0/203246726 learned_addr learned my addr 172.21.15.86:0/203246726 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:40:53.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.862+0000 7ff52bfff640 1 --2- 172.21.15.86:0/203246726 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff534152050 0x7ff53415a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:53.865 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.863+0000 7ff53259c640 1 --2- 172.21.15.86:0/203246726 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5340ca530 0x7ff53406d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:53.865 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.864+0000 7ff52bfff640 1 -- 172.21.15.86:0/203246726 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5340ca530 msgr2=0x7ff53406d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:53.865 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.864+0000 7ff52bfff640 1 --2- 172.21.15.86:0/203246726 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5340ca530 0x7ff53406d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:53.865 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.864+0000 7ff52bfff640 1 -- 172.21.15.86:0/203246726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff534157bf0 msgr2=0x7ff5341eff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:53.865 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.864+0000 7ff52bfff640 1 --2- 172.21.15.86:0/203246726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff534157bf0 0x7ff5341eff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:53.865 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.864+0000 7ff52bfff640 1 -- 172.21.15.86:0/203246726 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff534150d90 con 0x7ff534152050 2024-09-19T06:40:53.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.864+0000 7ff52bfff640 1 --2- 172.21.15.86:0/203246726 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff534152050 0x7ff53415a5a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff52400c400 tx=0x7ff52400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:53.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.865+0000 7ff52affd640 1 -- 172.21.15.86:0/203246726 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff524017070 con 0x7ff534152050 2024-09-19T06:40:53.868 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.865+0000 7ff538b9a640 1 -- 172.21.15.86:0/203246726 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff53414fac0 con 0x7ff534152050 2024-09-19T06:40:53.868 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.865+0000 7ff538b9a640 1 -- 172.21.15.86:0/203246726 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5341efa70 con 0x7ff534152050 2024-09-19T06:40:53.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.868+0000 7ff538b9a640 1 -- 172.21.15.86:0/203246726 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5340c8360 con 0x7ff534152050 2024-09-19T06:40:53.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.873+0000 7ff52affd640 1 -- 172.21.15.86:0/203246726 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5240052d0 con 0x7ff534152050 2024-09-19T06:40:53.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.873+0000 7ff52affd640 1 -- 172.21.15.86:0/203246726 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff524003810 con 0x7ff534152050 2024-09-19T06:40:53.881 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.876+0000 7ff52affd640 1 -- 172.21.15.86:0/203246726 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff52401a070 con 0x7ff534152050 2024-09-19T06:40:53.881 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.877+0000 7ff52affd640 1 --2- 172.21.15.86:0/203246726 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff51406c380 0x7ff51406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:53.881 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.877+0000 7ff52affd640 1 -- 172.21.15.86:0/203246726 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6821+0+0 (secure 0 0 0) 0x7ff52408ae50 con 0x7ff534152050 2024-09-19T06:40:53.881 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.877+0000 7ff53259c640 1 --2- 172.21.15.86:0/203246726 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff51406c380 0x7ff51406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:53.881 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.878+0000 7ff53259c640 1 --2- 172.21.15.86:0/203246726 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff51406c380 0x7ff51406e840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff51c001860 tx=0x7ff51c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:53.881 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:53.880+0000 7ff52affd640 1 -- 172.21.15.86:0/203246726 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff524021080 con 0x7ff534152050 2024-09-19T06:40:54.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:54.308+0000 7ff538b9a640 1 -- 172.21.15.86:0/203246726 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5340caf20 con 0x7ff534152050 2024-09-19T06:40:54.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:54.311+0000 7ff52affd640 1 -- 172.21.15.86:0/203246726 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6880 (secure 0 0 0) 0x7ff5340caf20 con 0x7ff534152050 2024-09-19T06:40:54.313 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:40:54.313 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":14,"btime":"2024-09-19T06:39:42:855448+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2213887583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2213887583},{"type":"v1","addr":"172.21.15.169:6837","nonce":2213887583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:39:31.837125+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":0,"incarnation":10,"state":"up:active","state_seq":40,"addr":"172.21.15.86:6839/1060607293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1060607293},{"type":"v1","addr":"172.21.15.86:6839","nonce":1060607293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-09-19T06:40:54.313 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 14 2024-09-19T06:40:54.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:54.315+0000 7ff538b9a640 1 -- 172.21.15.86:0/203246726 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff51406c380 msgr2=0x7ff51406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:54.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:54.315+0000 7ff538b9a640 1 --2- 172.21.15.86:0/203246726 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff51406c380 0x7ff51406e840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff51c001860 tx=0x7ff51c009040 comp rx=0 tx=0).stop 2024-09-19T06:40:54.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:54.316+0000 7ff538b9a640 1 -- 172.21.15.86:0/203246726 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff534152050 msgr2=0x7ff53415a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:54.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:54.316+0000 7ff538b9a640 1 --2- 172.21.15.86:0/203246726 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff534152050 0x7ff53415a5a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff52400c400 tx=0x7ff52400c8c0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:54.316+0000 7ff538b9a640 1 -- 172.21.15.86:0/203246726 shutdown_connections 2024-09-19T06:40:54.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:54.316+0000 7ff538b9a640 1 --2- 172.21.15.86:0/203246726 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff51406c380 0x7ff51406e840 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:54.316+0000 7ff538b9a640 1 --2- 172.21.15.86:0/203246726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff534157bf0 0x7ff5341eff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:54.316+0000 7ff538b9a640 1 --2- 172.21.15.86:0/203246726 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff534152050 0x7ff53415a5a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:54.316+0000 7ff538b9a640 1 --2- 172.21.15.86:0/203246726 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5340ca530 0x7ff53406d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:54.316+0000 7ff538b9a640 1 -- 172.21.15.86:0/203246726 >> 172.21.15.86:0/203246726 conn(0x7ff53406fd60 msgr2=0x7ff534072920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:54.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:54.316+0000 7ff538b9a640 1 -- 172.21.15.86:0/203246726 shutdown_connections 2024-09-19T06:40:54.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:54.316+0000 7ff538b9a640 1 -- 172.21.15.86:0/203246726 wait complete. 2024-09-19T06:40:54.339 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-09-19T06:40:56.341 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:40:56.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.539+0000 7fe48b3a6640 1 Processor -- start 2024-09-19T06:40:56.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.539+0000 7fe48b3a6640 1 -- start start 2024-09-19T06:40:56.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.541+0000 7fe48b3a6640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe4840c9da0 0x7fe484157b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:56.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.541+0000 7fe48b3a6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe48406cc60 0x7fe48406d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:56.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.541+0000 7fe48b3a6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe484150f70 0x7fe4841513e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:56.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.541+0000 7fe48b3a6640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fe484071200 con 0x7fe4840c9da0 2024-09-19T06:40:56.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.541+0000 7fe48b3a6640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe4841580a0 con 0x7fe48406cc60 2024-09-19T06:40:56.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.541+0000 7fe48b3a6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe4840c7e30 con 0x7fe484150f70 2024-09-19T06:40:56.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.541+0000 7fe489943640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe484150f70 0x7fe4841513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:56.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.541+0000 7fe489943640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe484150f70 0x7fe4841513e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:43644/0 (socket says 172.21.15.86:43644) 2024-09-19T06:40:56.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.541+0000 7fe489943640 1 -- 172.21.15.86:0/3431405288 learned_addr learned my addr 172.21.15.86:0/3431405288 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:40:56.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.542+0000 7fe489943640 1 -- 172.21.15.86:0/3431405288 >> v2:172.21.15.169:3300/0 conn(0x7fe48406cc60 msgr2=0x7fe48406d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:56.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.542+0000 7fe488941640 1 --2- 172.21.15.86:0/3431405288 >> v2:172.21.15.169:3300/0 conn(0x7fe48406cc60 0x7fe48406d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:56.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.542+0000 7fe489943640 1 --2- 172.21.15.86:0/3431405288 >> v2:172.21.15.169:3300/0 conn(0x7fe48406cc60 0x7fe48406d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.542+0000 7fe489943640 1 -- 172.21.15.86:0/3431405288 >> v2:172.21.15.86:3300/0 conn(0x7fe4840c9da0 msgr2=0x7fe484157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:56.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.542+0000 7fe489142640 1 --2- 172.21.15.86:0/3431405288 >> v2:172.21.15.86:3300/0 conn(0x7fe4840c9da0 0x7fe484157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:56.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.543+0000 7fe489943640 1 --2- 172.21.15.86:0/3431405288 >> v2:172.21.15.86:3300/0 conn(0x7fe4840c9da0 0x7fe484157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.543+0000 7fe489943640 1 -- 172.21.15.86:0/3431405288 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48406bbc0 con 0x7fe484150f70 2024-09-19T06:40:56.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.543+0000 7fe488941640 1 --2- 172.21.15.86:0/3431405288 >> v2:172.21.15.169:3300/0 conn(0x7fe48406cc60 0x7fe48406d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:40:56.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.544+0000 7fe489142640 1 --2- 172.21.15.86:0/3431405288 >> v2:172.21.15.86:3300/0 conn(0x7fe4840c9da0 0x7fe484157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:40:56.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.544+0000 7fe489943640 1 --2- 172.21.15.86:0/3431405288 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe484150f70 0x7fe4841513e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe4840708b0 tx=0x7fe48002a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eeb80675ac83c577 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:56.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.544+0000 7fe47bfff640 1 -- 172.21.15.86:0/3431405288 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe480037070 con 0x7fe484150f70 2024-09-19T06:40:56.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.544+0000 7fe47bfff640 1 -- 172.21.15.86:0/3431405288 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe480032440 con 0x7fe484150f70 2024-09-19T06:40:56.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.545+0000 7fe47bfff640 1 -- 172.21.15.86:0/3431405288 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe480032810 con 0x7fe484150f70 2024-09-19T06:40:56.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.545+0000 7fe48b3a6640 1 -- 172.21.15.86:0/3431405288 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe484150f70 msgr2=0x7fe4841513e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:56.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.546+0000 7fe48b3a6640 1 --2- 172.21.15.86:0/3431405288 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe484150f70 0x7fe4841513e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe4840708b0 tx=0x7fe48002a200 comp rx=0 tx=0).stop 2024-09-19T06:40:56.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.546+0000 7fe48b3a6640 1 -- 172.21.15.86:0/3431405288 shutdown_connections 2024-09-19T06:40:56.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.546+0000 7fe48b3a6640 1 --2- 172.21.15.86:0/3431405288 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe484150f70 0x7fe4841513e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.546+0000 7fe48b3a6640 1 --2- 172.21.15.86:0/3431405288 >> v2:172.21.15.169:3300/0 conn(0x7fe48406cc60 0x7fe48406d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.546+0000 7fe48b3a6640 1 --2- 172.21.15.86:0/3431405288 >> v2:172.21.15.86:3300/0 conn(0x7fe4840c9da0 0x7fe484157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.546+0000 7fe48b3a6640 1 -- 172.21.15.86:0/3431405288 >> 172.21.15.86:0/3431405288 conn(0x7fe4840c9280 msgr2=0x7fe4840c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:56.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.546+0000 7fe48b3a6640 1 -- 172.21.15.86:0/3431405288 shutdown_connections 2024-09-19T06:40:56.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.546+0000 7fe48b3a6640 1 -- 172.21.15.86:0/3431405288 wait complete. 2024-09-19T06:40:56.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.548+0000 7fe48b3a6640 1 Processor -- start 2024-09-19T06:40:56.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.549+0000 7fe48b3a6640 1 -- start start 2024-09-19T06:40:56.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.550+0000 7fe48b3a6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe48406cc60 0x7fe4841411e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:56.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.550+0000 7fe48b3a6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4840c9da0 0x7fe484156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:56.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.550+0000 7fe48b3a6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe484150f70 0x7fe4841566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:56.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.551+0000 7fe488941640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4840c9da0 0x7fe484156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:56.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.551+0000 7fe488941640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4840c9da0 0x7fe484156190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:43650/0 (socket says 172.21.15.86:43650) 2024-09-19T06:40:56.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.551+0000 7fe488941640 1 -- 172.21.15.86:0/2429438867 learned_addr learned my addr 172.21.15.86:0/2429438867 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:40:56.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.551+0000 7fe489943640 1 --2- 172.21.15.86:0/2429438867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe484150f70 0x7fe4841566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:56.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.551+0000 7fe48b3a6640 1 -- 172.21.15.86:0/2429438867 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe48406c460 con 0x7fe484150f70 2024-09-19T06:40:56.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.551+0000 7fe48b3a6640 1 -- 172.21.15.86:0/2429438867 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe48406c180 con 0x7fe48406cc60 2024-09-19T06:40:56.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.551+0000 7fe48b3a6640 1 -- 172.21.15.86:0/2429438867 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe4840c79f0 con 0x7fe4840c9da0 2024-09-19T06:40:56.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.551+0000 7fe489142640 1 --2- 172.21.15.86:0/2429438867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe48406cc60 0x7fe4841411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:56.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.552+0000 7fe489142640 1 -- 172.21.15.86:0/2429438867 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4840c9da0 msgr2=0x7fe484156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:56.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.553+0000 7fe489142640 1 --2- 172.21.15.86:0/2429438867 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4840c9da0 0x7fe484156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.553+0000 7fe489142640 1 -- 172.21.15.86:0/2429438867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe484150f70 msgr2=0x7fe4841566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:56.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.553+0000 7fe489142640 1 --2- 172.21.15.86:0/2429438867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe484150f70 0x7fe4841566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.553+0000 7fe489142640 1 -- 172.21.15.86:0/2429438867 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe484151cd0 con 0x7fe48406cc60 2024-09-19T06:40:56.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.553+0000 7fe488941640 1 --2- 172.21.15.86:0/2429438867 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4840c9da0 0x7fe484156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:56.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.553+0000 7fe489142640 1 --2- 172.21.15.86:0/2429438867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe48406cc60 0x7fe4841411e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe47400c610 tx=0x7fe47400cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:56.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.554+0000 7fe479ffb640 1 -- 172.21.15.86:0/2429438867 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe474015070 con 0x7fe48406cc60 2024-09-19T06:40:56.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.554+0000 7fe48b3a6640 1 -- 172.21.15.86:0/2429438867 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe484145c90 con 0x7fe48406cc60 2024-09-19T06:40:56.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.555+0000 7fe48b3a6640 1 -- 172.21.15.86:0/2429438867 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe48415b430 con 0x7fe48406cc60 2024-09-19T06:40:56.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.556+0000 7fe479ffb640 1 -- 172.21.15.86:0/2429438867 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe474011800 con 0x7fe48406cc60 2024-09-19T06:40:56.560 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.556+0000 7fe479ffb640 1 -- 172.21.15.86:0/2429438867 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe474011bd0 con 0x7fe48406cc60 2024-09-19T06:40:56.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.556+0000 7fe48b3a6640 1 -- 172.21.15.86:0/2429438867 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe48406d090 con 0x7fe48406cc60 2024-09-19T06:40:56.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.559+0000 7fe479ffb640 1 -- 172.21.15.86:0/2429438867 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe474018070 con 0x7fe48406cc60 2024-09-19T06:40:56.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.559+0000 7fe479ffb640 1 --2- 172.21.15.86:0/2429438867 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe46806c380 0x7fe46806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:56.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.560+0000 7fe479ffb640 1 -- 172.21.15.86:0/2429438867 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6907+0+0 (secure 0 0 0) 0x7fe47408bc90 con 0x7fe48406cc60 2024-09-19T06:40:56.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.560+0000 7fe488941640 1 --2- 172.21.15.86:0/2429438867 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe46806c380 0x7fe46806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:56.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.561+0000 7fe488941640 1 --2- 172.21.15.86:0/2429438867 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe46806c380 0x7fe46806e840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe47c007fd0 tx=0x7fe47c0077c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:56.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:56.567+0000 7fe479ffb640 1 -- 172.21.15.86:0/2429438867 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe474059850 con 0x7fe48406cc60 2024-09-19T06:40:57.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.000+0000 7fe48b3a6640 1 -- 172.21.15.86:0/2429438867 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe484141aa0 con 0x7fe48406cc60 2024-09-19T06:40:57.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.002+0000 7fe479ffb640 1 -- 172.21.15.86:0/2429438867 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6047 (secure 0 0 0) 0x7fe47405db50 con 0x7fe48406cc60 2024-09-19T06:40:57.004 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:40:57.004 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":15,"btime":"2024-09-19T06:40:55:493881+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:40:55.493878+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4762},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4762":{"gid":4762,"name":"d","rank":0,"incarnation":15,"state":"up:replay","state_seq":1,"addr":"172.21.15.169:6837/2213887583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2213887583},{"type":"v1","addr":"172.21.15.169:6837","nonce":2213887583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:40:57.004 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 15 2024-09-19T06:40:57.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.005+0000 7fe48b3a6640 1 -- 172.21.15.86:0/2429438867 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe46806c380 msgr2=0x7fe46806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:57.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.005+0000 7fe48b3a6640 1 --2- 172.21.15.86:0/2429438867 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe46806c380 0x7fe46806e840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe47c007fd0 tx=0x7fe47c0077c0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.005+0000 7fe48b3a6640 1 -- 172.21.15.86:0/2429438867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe48406cc60 msgr2=0x7fe4841411e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:57.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.005+0000 7fe48b3a6640 1 --2- 172.21.15.86:0/2429438867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe48406cc60 0x7fe4841411e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe47400c610 tx=0x7fe47400cad0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.006+0000 7fe48b3a6640 1 -- 172.21.15.86:0/2429438867 shutdown_connections 2024-09-19T06:40:57.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.006+0000 7fe48b3a6640 1 --2- 172.21.15.86:0/2429438867 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe46806c380 0x7fe46806e840 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.006+0000 7fe48b3a6640 1 --2- 172.21.15.86:0/2429438867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe484150f70 0x7fe4841566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.006+0000 7fe48b3a6640 1 --2- 172.21.15.86:0/2429438867 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4840c9da0 0x7fe484156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.006+0000 7fe48b3a6640 1 --2- 172.21.15.86:0/2429438867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe48406cc60 0x7fe4841411e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.006+0000 7fe48b3a6640 1 -- 172.21.15.86:0/2429438867 >> 172.21.15.86:0/2429438867 conn(0x7fe4840c9280 msgr2=0x7fe4840c4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:57.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.006+0000 7fe48b3a6640 1 -- 172.21.15.86:0/2429438867 shutdown_connections 2024-09-19T06:40:57.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.006+0000 7fe48b3a6640 1 -- 172.21.15.86:0/2429438867 wait complete. 2024-09-19T06:40:57.024 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e down, removed from mdsmap 2024-09-19T06:40:57.024 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-09-19T06:40:57.024 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:40:57.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.207+0000 7f6f0759e640 1 Processor -- start 2024-09-19T06:40:57.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.208+0000 7f6f0759e640 1 -- start start 2024-09-19T06:40:57.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.210+0000 7f6f0759e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f000dcd90 0x7f6f00045d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.210+0000 7f6f0759e640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6f0004a680 0x7f6f0004aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.210+0000 7f6f0759e640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f000e6d30 con 0x7f6f000e5f30 2024-09-19T06:40:57.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.210+0000 7f6f0759e640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f6f00044d40 con 0x7f6f0004a680 2024-09-19T06:40:57.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.210+0000 7f6f0759e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6f000dd170 con 0x7f6f000dcd90 2024-09-19T06:40:57.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.210+0000 7f6f06d9d640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6f000e5f30 0x7f6f000e63c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:50660/0 (socket says 172.21.15.86:50660) 2024-09-19T06:40:57.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.210+0000 7f6f06d9d640 1 -- 172.21.15.86:0/3286694332 learned_addr learned my addr 172.21.15.86:0/3286694332 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:40:57.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.211+0000 7f6f05d9b640 1 --2- 172.21.15.86:0/3286694332 >> v2:172.21.15.86:3300/0 conn(0x7f6f0004a680 0x7f6f0004aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:57.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.211+0000 7f6f0659c640 1 --2- 172.21.15.86:0/3286694332 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f000dcd90 0x7f6f00045d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:57.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.211+0000 7f6f0559a640 1 -- 172.21.15.86:0/3286694332 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2374356448 0 0) 0x7f6f000e6d30 con 0x7f6f000e5f30 2024-09-19T06:40:57.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.211+0000 7f6f0559a640 1 -- 172.21.15.86:0/3286694332 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ef0003520 con 0x7f6f000e5f30 2024-09-19T06:40:57.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.211+0000 7f6f05d9b640 1 -- 172.21.15.86:0/3286694332 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f000dcd90 msgr2=0x7f6f00045d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:57.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.211+0000 7f6f05d9b640 1 --2- 172.21.15.86:0/3286694332 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f000dcd90 0x7f6f00045d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.211+0000 7f6f05d9b640 1 -- 172.21.15.86:0/3286694332 >> v1:172.21.15.86:6789/0 conn(0x7f6f000e5f30 legacy=0x7f6f000e63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:57.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.211+0000 7f6f05d9b640 1 -- 172.21.15.86:0/3286694332 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f00044f90 con 0x7f6f0004a680 2024-09-19T06:40:57.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.213+0000 7f6f05d9b640 1 --2- 172.21.15.86:0/3286694332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f0004a680 0x7f6f0004aa80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6ef80097a0 tx=0x7f6ef802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74fbc606a721e8c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:57.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.213+0000 7f6f0559a640 1 -- 172.21.15.86:0/3286694332 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8037070 con 0x7f6f0004a680 2024-09-19T06:40:57.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.213+0000 7f6f0559a640 1 -- 172.21.15.86:0/3286694332 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ef8032440 con 0x7f6f0004a680 2024-09-19T06:40:57.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.214+0000 7f6f0759e640 1 -- 172.21.15.86:0/3286694332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f0004a680 msgr2=0x7f6f0004aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:57.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.214+0000 7f6f0759e640 1 --2- 172.21.15.86:0/3286694332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f0004a680 0x7f6f0004aa80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6ef80097a0 tx=0x7f6ef802a1c0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.215+0000 7f6f0759e640 1 -- 172.21.15.86:0/3286694332 shutdown_connections 2024-09-19T06:40:57.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.215+0000 7f6f0759e640 1 --2- 172.21.15.86:0/3286694332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f0004a680 0x7f6f0004aa80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.215+0000 7f6f0759e640 1 --2- 172.21.15.86:0/3286694332 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f000dcd90 0x7f6f00045d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.215+0000 7f6f0759e640 1 -- 172.21.15.86:0/3286694332 >> 172.21.15.86:0/3286694332 conn(0x7f6f0004fc50 msgr2=0x7f6f00050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:57.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.217+0000 7f6f0759e640 1 -- 172.21.15.86:0/3286694332 shutdown_connections 2024-09-19T06:40:57.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.217+0000 7f6f0759e640 1 -- 172.21.15.86:0/3286694332 wait complete. 2024-09-19T06:40:57.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.220+0000 7f6f0759e640 1 Processor -- start 2024-09-19T06:40:57.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.220+0000 7f6f0759e640 1 -- start start 2024-09-19T06:40:57.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.221+0000 7f6f0759e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f0004a680 0x7f6f0004ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.221+0000 7f6f0759e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f000dcd90 0x7f6f00184ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.221+0000 7f6f0759e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f000e5f30 0x7f6f00181410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.221+0000 7f6f0759e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6f00045550 con 0x7f6f000dcd90 2024-09-19T06:40:57.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.222+0000 7f6f0759e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6f000e6ad0 con 0x7f6f0004a680 2024-09-19T06:40:57.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.222+0000 7f6f05d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f000dcd90 0x7f6f00184ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:57.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.222+0000 7f6f06d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f000e5f30 0x7f6f00181410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:57.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.222+0000 7f6f05d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f000dcd90 0x7f6f00184ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53890/0 (socket says 172.21.15.86:53890) 2024-09-19T06:40:57.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.222+0000 7f6f05d9b640 1 -- 172.21.15.86:0/1379987877 learned_addr learned my addr 172.21.15.86:0/1379987877 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:40:57.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.222+0000 7f6f0759e640 1 -- 172.21.15.86:0/1379987877 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6f00045830 con 0x7f6f000e5f30 2024-09-19T06:40:57.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.222+0000 7f6f0659c640 1 --2- 172.21.15.86:0/1379987877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f0004a680 0x7f6f0004ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:57.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.223+0000 7f6f06d9d640 1 -- 172.21.15.86:0/1379987877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f0004a680 msgr2=0x7f6f0004ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:57.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.223+0000 7f6f06d9d640 1 --2- 172.21.15.86:0/1379987877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f0004a680 0x7f6f0004ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.223+0000 7f6f06d9d640 1 -- 172.21.15.86:0/1379987877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f000dcd90 msgr2=0x7f6f00184ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:57.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.223+0000 7f6f06d9d640 1 --2- 172.21.15.86:0/1379987877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f000dcd90 0x7f6f00184ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.223+0000 7f6f06d9d640 1 -- 172.21.15.86:0/1379987877 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f000dc880 con 0x7f6f000e5f30 2024-09-19T06:40:57.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.223+0000 7f6f06d9d640 1 --2- 172.21.15.86:0/1379987877 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f000e5f30 0x7f6f00181410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6f08051220 tx=0x7f6f080692f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:57.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.223+0000 7f6ef6ffd640 1 -- 172.21.15.86:0/1379987877 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0806bbc0 con 0x7f6f000e5f30 2024-09-19T06:40:57.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.224+0000 7f6f0759e640 1 -- 172.21.15.86:0/1379987877 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f000dd470 con 0x7f6f000e5f30 2024-09-19T06:40:57.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.224+0000 7f6f0759e640 1 -- 172.21.15.86:0/1379987877 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f000dda30 con 0x7f6f000e5f30 2024-09-19T06:40:57.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.224+0000 7f6ef6ffd640 1 -- 172.21.15.86:0/1379987877 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f08093070 con 0x7f6f000e5f30 2024-09-19T06:40:57.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.224+0000 7f6ef6ffd640 1 -- 172.21.15.86:0/1379987877 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f080744f0 con 0x7f6f000e5f30 2024-09-19T06:40:57.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.225+0000 7f6f05d9b640 1 --2- 172.21.15.86:0/1379987877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f000dcd90 0x7f6f00184ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:40:57.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.226+0000 7f6ef6ffd640 1 -- 172.21.15.86:0/1379987877 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6f08074750 con 0x7f6f000e5f30 2024-09-19T06:40:57.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.227+0000 7f6ef6ffd640 1 --2- 172.21.15.86:0/1379987877 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6ee806c2b0 0x7f6ee806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.227+0000 7f6ef6ffd640 1 -- 172.21.15.86:0/1379987877 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 6907+0+0 (secure 0 0 0) 0x7f6f08107830 con 0x7f6f000e5f30 2024-09-19T06:40:57.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.227+0000 7f6f0659c640 1 --2- 172.21.15.86:0/1379987877 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6ee806c2b0 0x7f6ee806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:57.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.228+0000 7f6f0659c640 1 --2- 172.21.15.86:0/1379987877 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6ee806c2b0 0x7f6ee806e770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6efc009b10 tx=0x7f6efc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:57.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.229+0000 7f6f0759e640 1 -- 172.21.15.86:0/1379987877 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eec005290 con 0x7f6f000e5f30 2024-09-19T06:40:57.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.238+0000 7f6ef6ffd640 1 -- 172.21.15.86:0/1379987877 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6f080d5a50 con 0x7f6f000e5f30 2024-09-19T06:40:57.690 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.689+0000 7f6f0759e640 1 -- 172.21.15.86:0/1379987877 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6eec005580 con 0x7f6f000e5f30 2024-09-19T06:40:57.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.691+0000 7f6ef6ffd640 1 -- 172.21.15.86:0/1379987877 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6047 (secure 0 0 0) 0x7f6f080d5350 con 0x7f6f000e5f30 2024-09-19T06:40:57.711 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:40:57.711 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":15,"btime":"2024-09-19T06:40:55:493881+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:40:55.493878+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4762},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4762":{"gid":4762,"name":"d","rank":0,"incarnation":15,"state":"up:replay","state_seq":1,"addr":"172.21.15.169:6837/2213887583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2213887583},{"type":"v1","addr":"172.21.15.169:6837","nonce":2213887583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:40:57.712 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 15 2024-09-19T06:40:57.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.696+0000 7f6f0759e640 1 -- 172.21.15.86:0/1379987877 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6ee806c2b0 msgr2=0x7f6ee806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:57.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.696+0000 7f6f0759e640 1 --2- 172.21.15.86:0/1379987877 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6ee806c2b0 0x7f6ee806e770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6efc009b10 tx=0x7f6efc009190 comp rx=0 tx=0).stop 2024-09-19T06:40:57.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.696+0000 7f6f0759e640 1 -- 172.21.15.86:0/1379987877 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f000e5f30 msgr2=0x7f6f00181410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:57.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.696+0000 7f6f0759e640 1 --2- 172.21.15.86:0/1379987877 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f000e5f30 0x7f6f00181410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6f08051220 tx=0x7f6f080692f0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.697+0000 7f6f0759e640 1 -- 172.21.15.86:0/1379987877 shutdown_connections 2024-09-19T06:40:57.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.697+0000 7f6f0759e640 1 --2- 172.21.15.86:0/1379987877 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6ee806c2b0 0x7f6ee806e770 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.697+0000 7f6f0759e640 1 --2- 172.21.15.86:0/1379987877 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f000e5f30 0x7f6f00181410 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.697+0000 7f6f0759e640 1 --2- 172.21.15.86:0/1379987877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f000dcd90 0x7f6f00184ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.697+0000 7f6f0759e640 1 --2- 172.21.15.86:0/1379987877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f0004a680 0x7f6f0004ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.697+0000 7f6f0759e640 1 -- 172.21.15.86:0/1379987877 >> 172.21.15.86:0/1379987877 conn(0x7f6f0004fc50 msgr2=0x7f6f0004cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:57.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.697+0000 7f6f0759e640 1 -- 172.21.15.86:0/1379987877 shutdown_connections 2024-09-19T06:40:57.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:40:57.697+0000 7f6f0759e640 1 -- 172.21.15.86:0/1379987877 wait complete. 2024-09-19T06:40:57.720 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "btime": "2024-09-19T06:40:55:493881+0000", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 15, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-19T06:37:08.763572+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 15, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4762": { "addr": "172.21.15.169:6837/2213887583", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6836", "nonce": 2213887583, "type": "v2" }, { "addr": "172.21.15.169:6837", "nonce": 2213887583, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4762, "incarnation": 15, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 30, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-09-19T06:40:55.493878+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4762 } } } ], "standbys": [ { "addr": "172.21.15.86:6837/728803297", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6835", "nonce": 728803297, "type": "v2" }, { "addr": "172.21.15.86:6837", "nonce": 728803297, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4247, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.169:6835/2537509253", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6833", "nonce": 2537509253, "type": "v2" }, { "addr": "172.21.15.169:6835", "nonce": 2537509253, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4262, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.169:6834/1723647527", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6832", "nonce": 1723647527, "type": "v2" }, { "addr": "172.21.15.169:6834", "nonce": 1723647527, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4265, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.86:6836/4135959816", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6834", "nonce": 4135959816, "type": "v2" }, { "addr": "172.21.15.86:6836", "nonce": 4135959816, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4270, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-09-19T06:40:59.721 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:41:06.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.022+0000 7f33b4bef640 1 Processor -- start 2024-09-19T06:41:06.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.023+0000 7f33b4bef640 1 -- start start 2024-09-19T06:41:06.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.024+0000 7f33b4bef640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33b00734a0 0x7f33b00720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:06.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.024+0000 7f33b4bef640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33b0158710 con 0x7f33b006bd10 2024-09-19T06:41:06.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.024+0000 7f33b4bef640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33b01589b0 con 0x7f33b0152060 2024-09-19T06:41:06.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.024+0000 7f33b4bef640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f33b00716c0 con 0x7f33b00734a0 2024-09-19T06:41:06.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.025+0000 7f33add9b640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f33b006bd10 0x7f33b00719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:41766/0 (socket says 172.21.15.86:41766) 2024-09-19T06:41:06.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.025+0000 7f33add9b640 1 -- 172.21.15.86:0/1065465279 learned_addr learned my addr 172.21.15.86:0/1065465279 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:41:06.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.025+0000 7f33ad59a640 1 -- 172.21.15.86:0/1065465279 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 624275879 0 0) 0x7f33b0158710 con 0x7f33b006bd10 2024-09-19T06:41:06.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.025+0000 7f33ad59a640 1 -- 172.21.15.86:0/1065465279 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3398003520 con 0x7f33b006bd10 2024-09-19T06:41:06.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.026+0000 7f33ad59a640 1 -- 172.21.15.86:0/1065465279 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2123880689 0 0) 0x7f3398003520 con 0x7f33b006bd10 2024-09-19T06:41:06.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.026+0000 7f33ad59a640 1 -- 172.21.15.86:0/1065465279 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33b00734a0 msgr2=0x7f33b00720d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:41:06.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.026+0000 7f33ad59a640 1 --2- 172.21.15.86:0/1065465279 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33b00734a0 0x7f33b00720d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:06.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.026+0000 7f33ad59a640 1 -- 172.21.15.86:0/1065465279 >> v1:172.21.15.169:6789/0 conn(0x7f33b0152060 legacy=0x7f33b0072d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:06.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.026+0000 7f33ad59a640 1 -- 172.21.15.86:0/1065465279 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b0071070 con 0x7f33b006bd10 2024-09-19T06:41:06.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.026+0000 7f33ad59a640 1 -- 172.21.15.86:0/1065465279 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f33a4001690 con 0x7f33b006bd10 2024-09-19T06:41:06.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.026+0000 7f33ad59a640 1 -- 172.21.15.86:0/1065465279 >> v1:172.21.15.86:6789/0 conn(0x7f33b006bd10 legacy=0x7f33b00719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:06.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.026+0000 7f33ad59a640 1 --2- 172.21.15.86:0/1065465279 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33b00734a0 0x7f3398003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:06.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.026+0000 7f33ad59a640 1 --2- 172.21.15.86:0/1065465279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3398004110 0x7f3398004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:06.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.026+0000 7f33ad59a640 1 --2- 172.21.15.86:0/1065465279 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3398004e60 0x7f339800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:06.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.026+0000 7f33ad59a640 1 -- 172.21.15.86:0/1065465279 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f33b00716c0 con 0x7f3398004e60 2024-09-19T06:41:06.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.026+0000 7f33ad59a640 1 -- 172.21.15.86:0/1065465279 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f33980055f0 con 0x7f3398004110 2024-09-19T06:41:06.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.026+0000 7f33ad59a640 1 -- 172.21.15.86:0/1065465279 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f339800bf00 con 0x7f33b00734a0 2024-09-19T06:41:06.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.026+0000 7f33add9b640 1 --2- 172.21.15.86:0/1065465279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3398004110 0x7f3398004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:06.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.026+0000 7f33add9b640 1 -- 172.21.15.86:0/1065465279 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33b00734a0 msgr2=0x7f3398003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:06.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.026+0000 7f33add9b640 1 --2- 172.21.15.86:0/1065465279 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33b00734a0 0x7f3398003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:06.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.026+0000 7f33add9b640 1 -- 172.21.15.86:0/1065465279 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3398004e60 msgr2=0x7f339800b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:41:06.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.026+0000 7f33add9b640 1 --2- 172.21.15.86:0/1065465279 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3398004e60 0x7f339800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:06.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.027+0000 7f33add9b640 1 -- 172.21.15.86:0/1065465279 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b0071070 con 0x7f3398004110 2024-09-19T06:41:06.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.029+0000 7f33add9b640 1 --2- 172.21.15.86:0/1065465279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3398004110 0x7f3398004800 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f33b006c110 tx=0x7f3398005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2560e99165c4df0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:06.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.031+0000 7f33ad59a640 1 -- 172.21.15.86:0/1065465279 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a4007db0 con 0x7f3398004110 2024-09-19T06:41:06.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.031+0000 7f33ad59a640 1 -- 172.21.15.86:0/1065465279 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a4037070 con 0x7f3398004110 2024-09-19T06:41:06.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.031+0000 7f33ad59a640 1 -- 172.21.15.86:0/1065465279 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a4033e20 con 0x7f3398004110 2024-09-19T06:41:06.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.032+0000 7f33b4bef640 1 -- 172.21.15.86:0/1065465279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3398004110 msgr2=0x7f3398004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:06.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.032+0000 7f33b4bef640 1 --2- 172.21.15.86:0/1065465279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3398004110 0x7f3398004800 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f33b006c110 tx=0x7f3398005830 comp rx=0 tx=0).stop 2024-09-19T06:41:06.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.032+0000 7f33aed9d640 1 -- 172.21.15.86:0/1065465279 reap_dead start 2024-09-19T06:41:06.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.032+0000 7f33b4bef640 1 -- 172.21.15.86:0/1065465279 shutdown_connections 2024-09-19T06:41:06.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.032+0000 7f33b4bef640 1 -- 172.21.15.86:0/1065465279 >> 172.21.15.86:0/1065465279 conn(0x7f33b00c9280 msgr2=0x7f33b00c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:06.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.032+0000 7f33b4bef640 1 -- 172.21.15.86:0/1065465279 shutdown_connections 2024-09-19T06:41:06.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.032+0000 7f33b4bef640 1 -- 172.21.15.86:0/1065465279 wait complete. 2024-09-19T06:41:06.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.034+0000 7f33b4bef640 1 Processor -- start 2024-09-19T06:41:06.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.035+0000 7f33b4bef640 1 -- start start 2024-09-19T06:41:06.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.036+0000 7f33b4bef640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3398004110 0x7f33b0154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:06.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.036+0000 7f33b4bef640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f33b01558f0 0x7f33b00cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:06.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.036+0000 7f33add9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f33b01558f0 0x7f33b00cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:06.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.036+0000 7f33add9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f33b01558f0 0x7f33b00cafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38832/0 (socket says 172.21.15.86:38832) 2024-09-19T06:41:06.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.036+0000 7f33ae59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3398004110 0x7f33b0154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:06.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.036+0000 7f33ae59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3398004110 0x7f33b0154100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:35152/0 (socket says 172.21.15.86:35152) 2024-09-19T06:41:06.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.036+0000 7f33b4bef640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33b0150920 0x7f33b0150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:06.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.036+0000 7f33add9b640 1 -- 172.21.15.86:0/4112872124 learned_addr learned my addr 172.21.15.86:0/4112872124 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:41:06.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.036+0000 7f33b4bef640 1 -- 172.21.15.86:0/4112872124 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f33b00c9e10 con 0x7f33b01558f0 2024-09-19T06:41:06.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.036+0000 7f33aed9d640 1 --2- 172.21.15.86:0/4112872124 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33b0150920 0x7f33b0150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:06.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.036+0000 7f33b4bef640 1 -- 172.21.15.86:0/4112872124 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f33b0152440 con 0x7f3398004110 2024-09-19T06:41:06.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.036+0000 7f33b4bef640 1 -- 172.21.15.86:0/4112872124 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f33b00c3680 con 0x7f33b0150920 2024-09-19T06:41:06.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.037+0000 7f33add9b640 1 -- 172.21.15.86:0/4112872124 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33b0150920 msgr2=0x7f33b0150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:06.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.037+0000 7f33add9b640 1 --2- 172.21.15.86:0/4112872124 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33b0150920 0x7f33b0150da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:06.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.037+0000 7f33add9b640 1 -- 172.21.15.86:0/4112872124 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3398004110 msgr2=0x7f33b0154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:06.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.037+0000 7f33add9b640 1 --2- 172.21.15.86:0/4112872124 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3398004110 0x7f33b0154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:06.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.037+0000 7f33add9b640 1 -- 172.21.15.86:0/4112872124 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b00cb900 con 0x7f33b01558f0 2024-09-19T06:41:06.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.038+0000 7f33add9b640 1 --2- 172.21.15.86:0/4112872124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f33b01558f0 0x7f33b00cafb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f33b01588e0 tx=0x7f33a4001990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:06.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.038+0000 7f339effd640 1 -- 172.21.15.86:0/4112872124 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a4007070 con 0x7f33b01558f0 2024-09-19T06:41:06.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.038+0000 7f339effd640 1 -- 172.21.15.86:0/4112872124 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a404c070 con 0x7f33b01558f0 2024-09-19T06:41:06.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.038+0000 7f339effd640 1 -- 172.21.15.86:0/4112872124 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a4007410 con 0x7f33b01558f0 2024-09-19T06:41:06.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.039+0000 7f33b4bef640 1 -- 172.21.15.86:0/4112872124 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33b0155fa0 con 0x7f33b01558f0 2024-09-19T06:41:06.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.040+0000 7f33b4bef640 1 -- 172.21.15.86:0/4112872124 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33b0154e80 con 0x7f33b01558f0 2024-09-19T06:41:06.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.041+0000 7f33b4bef640 1 -- 172.21.15.86:0/4112872124 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33b0069220 con 0x7f33b01558f0 2024-09-19T06:41:06.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.041+0000 7f339effd640 1 -- 172.21.15.86:0/4112872124 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f33a40075b0 con 0x7f33b01558f0 2024-09-19T06:41:06.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.042+0000 7f339effd640 1 --2- 172.21.15.86:0/4112872124 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f339006c300 0x7f339006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:06.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.042+0000 7f339effd640 1 -- 172.21.15.86:0/4112872124 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6907+0+0 (secure 0 0 0) 0x7f33a40b4220 con 0x7f33b01558f0 2024-09-19T06:41:06.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.043+0000 7f33ae59c640 1 --2- 172.21.15.86:0/4112872124 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f339006c300 0x7f339006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:06.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.044+0000 7f33ae59c640 1 --2- 172.21.15.86:0/4112872124 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f339006c300 0x7f339006e7c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f33a00017e0 tx=0x7f33a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:06.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.049+0000 7f339effd640 1 -- 172.21.15.86:0/4112872124 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f33a4081e70 con 0x7f33b01558f0 2024-09-19T06:41:06.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.443+0000 7f33b4bef640 1 -- 172.21.15.86:0/4112872124 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33b00c9060 con 0x7f33b01558f0 2024-09-19T06:41:06.446 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:41:06.446 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":16,"btime":"2024-09-19T06:41:03:530398+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:41:03.293806+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4762},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4762":{"gid":4762,"name":"d","rank":0,"incarnation":15,"state":"up:reconnect","state_seq":22,"addr":"172.21.15.169:6837/2213887583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2213887583},{"type":"v1","addr":"172.21.15.169:6837","nonce":2213887583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:41:06.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.444+0000 7f339effd640 1 -- 172.21.15.86:0/4112872124 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6051 (secure 0 0 0) 0x7f33a4086170 con 0x7f33b01558f0 2024-09-19T06:41:06.447 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 16 2024-09-19T06:41:06.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.448+0000 7f33b4bef640 1 -- 172.21.15.86:0/4112872124 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f339006c300 msgr2=0x7f339006e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:06.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.448+0000 7f33b4bef640 1 --2- 172.21.15.86:0/4112872124 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f339006c300 0x7f339006e7c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f33a00017e0 tx=0x7f33a0009040 comp rx=0 tx=0).stop 2024-09-19T06:41:06.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.448+0000 7f33b4bef640 1 -- 172.21.15.86:0/4112872124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f33b01558f0 msgr2=0x7f33b00cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:06.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.448+0000 7f33b4bef640 1 --2- 172.21.15.86:0/4112872124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f33b01558f0 0x7f33b00cafb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f33b01588e0 tx=0x7f33a4001990 comp rx=0 tx=0).stop 2024-09-19T06:41:06.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.448+0000 7f33b4bef640 1 -- 172.21.15.86:0/4112872124 shutdown_connections 2024-09-19T06:41:06.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.448+0000 7f33b4bef640 1 --2- 172.21.15.86:0/4112872124 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f339006c300 0x7f339006e7c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:06.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.448+0000 7f33b4bef640 1 --2- 172.21.15.86:0/4112872124 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33b0150920 0x7f33b0150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:06.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.448+0000 7f33b4bef640 1 --2- 172.21.15.86:0/4112872124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f33b01558f0 0x7f33b00cafb0 secure :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f33b01588e0 tx=0x7f33a4001990 comp rx=0 tx=0).stop 2024-09-19T06:41:06.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.448+0000 7f33b4bef640 1 --2- 172.21.15.86:0/4112872124 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3398004110 0x7f33b0154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:06.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.448+0000 7f33b4bef640 1 -- 172.21.15.86:0/4112872124 >> 172.21.15.86:0/4112872124 conn(0x7f33b00c9280 msgr2=0x7f33b0072d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:06.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.448+0000 7f33b4bef640 1 -- 172.21.15.86:0/4112872124 shutdown_connections 2024-09-19T06:41:06.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:06.448+0000 7f33b4bef640 1 -- 172.21.15.86:0/4112872124 wait complete. 2024-09-19T06:41:06.555 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:41:08.556 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:41:08.751 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:41:08.755 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:41:09.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.254+0000 7f6c6e36d640 1 Processor -- start 2024-09-19T06:41:09.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.254+0000 7f6c6e36d640 1 -- start start 2024-09-19T06:41:09.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.255+0000 7f6c6e36d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6c68159480 0x7f6c6806bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:09.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.255+0000 7f6c6e36d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c68159860 0x7f6c6815fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:09.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.256+0000 7f6c67fff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6c68159480 0x7f6c6806bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:09.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.256+0000 7f6c67fff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6c68159480 0x7f6c6806bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:35166/0 (socket says 172.21.15.86:35166) 2024-09-19T06:41:09.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.256+0000 7f6c6c90a640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6c680c7d30 0x7f6c680c84d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:41776/0 (socket says 172.21.15.86:41776) 2024-09-19T06:41:09.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.256+0000 7f6c67fff640 1 -- 172.21.15.86:0/1886440774 learned_addr learned my addr 172.21.15.86:0/1886440774 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:41:09.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.256+0000 7f6c677fe640 1 --2- 172.21.15.86:0/1886440774 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c68159860 0x7f6c6815fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:09.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.256+0000 7f6c6e36d640 1 -- 172.21.15.86:0/1886440774 --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c680c7700 con 0x7f6c680c7d30 2024-09-19T06:41:09.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.257+0000 7f6c6e36d640 1 -- 172.21.15.86:0/1886440774 --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f6c68073d20 con 0x7f6c68159480 2024-09-19T06:41:09.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.257+0000 7f6c6e36d640 1 -- 172.21.15.86:0/1886440774 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6c68071990 con 0x7f6c68159860 2024-09-19T06:41:09.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.257+0000 7f6c66ffd640 1 -- 172.21.15.86:0/1886440774 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2732001460 0 0) 0x7f6c680c7700 con 0x7f6c680c7d30 2024-09-19T06:41:09.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.257+0000 7f6c66ffd640 1 -- 172.21.15.86:0/1886440774 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c50003520 con 0x7f6c680c7d30 2024-09-19T06:41:09.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.257+0000 7f6c66ffd640 1 -- 172.21.15.86:0/1886440774 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2766242226 0 0) 0x7f6c50003520 con 0x7f6c680c7d30 2024-09-19T06:41:09.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.257+0000 7f6c66ffd640 1 -- 172.21.15.86:0/1886440774 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c68159860 msgr2=0x7f6c6815fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:09.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.257+0000 7f6c66ffd640 1 --2- 172.21.15.86:0/1886440774 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c68159860 0x7f6c6815fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:09.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.257+0000 7f6c66ffd640 1 -- 172.21.15.86:0/1886440774 >> v2:172.21.15.169:3300/0 conn(0x7f6c68159480 msgr2=0x7f6c6806bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:09.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.257+0000 7f6c66ffd640 1 --2- 172.21.15.86:0/1886440774 >> v2:172.21.15.169:3300/0 conn(0x7f6c68159480 0x7f6c6806bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:09.260 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.257+0000 7f6c66ffd640 1 -- 172.21.15.86:0/1886440774 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c680c79c0 con 0x7f6c680c7d30 2024-09-19T06:41:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.258+0000 7f6c67fff640 1 --2- 172.21.15.86:0/1886440774 >> v2:172.21.15.169:3300/0 conn(0x7f6c68159480 0x7f6c6806bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.258+0000 7f6c66ffd640 1 -- 172.21.15.86:0/1886440774 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f6c600019f0 con 0x7f6c680c7d30 2024-09-19T06:41:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.258+0000 7f6c66ffd640 1 -- 172.21.15.86:0/1886440774 >> v1:172.21.15.86:6789/0 conn(0x7f6c680c7d30 legacy=0x7f6c680c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.258+0000 7f6c66ffd640 1 --2- 172.21.15.86:0/1886440774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c50003a30 0x7f6c50003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.258+0000 7f6c66ffd640 1 --2- 172.21.15.86:0/1886440774 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c50004800 0x7f6c50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.258+0000 7f6c66ffd640 1 --2- 172.21.15.86:0/1886440774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c500051c0 0x7f6c5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.258+0000 7f6c66ffd640 1 -- 172.21.15.86:0/1886440774 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6c68071990 con 0x7f6c50003a30 2024-09-19T06:41:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.258+0000 7f6c66ffd640 1 -- 172.21.15.86:0/1886440774 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5000c140 con 0x7f6c500051c0 2024-09-19T06:41:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.258+0000 7f6c66ffd640 1 -- 172.21.15.86:0/1886440774 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6c5000c340 con 0x7f6c50004800 2024-09-19T06:41:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.258+0000 7f6c677fe640 1 --2- 172.21.15.86:0/1886440774 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c68159860 0x7f6c6815fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:41:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.258+0000 7f6c677fe640 1 --2- 172.21.15.86:0/1886440774 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c50004800 0x7f6c50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.258+0000 7f6c67fff640 1 --2- 172.21.15.86:0/1886440774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c50003a30 0x7f6c50003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.258+0000 7f6c6c90a640 1 --2- 172.21.15.86:0/1886440774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c500051c0 0x7f6c5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:09.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.259+0000 7f6c67fff640 1 -- 172.21.15.86:0/1886440774 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c50004800 msgr2=0x7f6c50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:09.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.259+0000 7f6c67fff640 1 --2- 172.21.15.86:0/1886440774 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c50004800 0x7f6c50004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:09.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.259+0000 7f6c67fff640 1 -- 172.21.15.86:0/1886440774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c500051c0 msgr2=0x7f6c5000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:09.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.259+0000 7f6c67fff640 1 --2- 172.21.15.86:0/1886440774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c500051c0 0x7f6c5000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:09.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.259+0000 7f6c67fff640 1 -- 172.21.15.86:0/1886440774 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c50003520 con 0x7f6c50003a30 2024-09-19T06:41:09.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.260+0000 7f6c67fff640 1 --2- 172.21.15.86:0/1886440774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c50003a30 0x7f6c50003e10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6c58009990 tx=0x7f6c50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1501d9ce04fdb6bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:09.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.261+0000 7f6c66ffd640 1 -- 172.21.15.86:0/1886440774 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c58037070 con 0x7f6c50003a30 2024-09-19T06:41:09.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.261+0000 7f6c66ffd640 1 -- 172.21.15.86:0/1886440774 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c5802ae00 con 0x7f6c50003a30 2024-09-19T06:41:09.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.261+0000 7f6c66ffd640 1 -- 172.21.15.86:0/1886440774 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5800f040 con 0x7f6c50003a30 2024-09-19T06:41:09.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.262+0000 7f6c6e36d640 1 -- 172.21.15.86:0/1886440774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c50003a30 msgr2=0x7f6c50003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:09.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.262+0000 7f6c6e36d640 1 --2- 172.21.15.86:0/1886440774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c50003a30 0x7f6c50003e10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6c58009990 tx=0x7f6c50005830 comp rx=0 tx=0).stop 2024-09-19T06:41:09.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.262+0000 7f6c6c90a640 1 -- 172.21.15.86:0/1886440774 reap_dead start 2024-09-19T06:41:09.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.262+0000 7f6c6e36d640 1 -- 172.21.15.86:0/1886440774 shutdown_connections 2024-09-19T06:41:09.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.262+0000 7f6c6e36d640 1 -- 172.21.15.86:0/1886440774 >> 172.21.15.86:0/1886440774 conn(0x7f6c680c9280 msgr2=0x7f6c680c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:09.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.263+0000 7f6c6e36d640 1 -- 172.21.15.86:0/1886440774 shutdown_connections 2024-09-19T06:41:09.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.263+0000 7f6c6e36d640 1 -- 172.21.15.86:0/1886440774 wait complete. 2024-09-19T06:41:09.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.265+0000 7f6c6e36d640 1 Processor -- start 2024-09-19T06:41:09.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.265+0000 7f6c6e36d640 1 -- start start 2024-09-19T06:41:09.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.266+0000 7f6c6e36d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c6815c3e0 0x7f6c6815c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:09.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.266+0000 7f6c6e36d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c6815e350 0x7f6c68152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:09.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.266+0000 7f6c6e36d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c68152f80 0x7f6c6815ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:09.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.267+0000 7f6c6c90a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c68152f80 0x7f6c6815ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:09.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.267+0000 7f6c6c90a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c68152f80 0x7f6c6815ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38846/0 (socket says 172.21.15.86:38846) 2024-09-19T06:41:09.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.267+0000 7f6c67fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c6815c3e0 0x7f6c6815c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:09.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.267+0000 7f6c67fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c6815c3e0 0x7f6c6815c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:47160/0 (socket says 172.21.15.86:47160) 2024-09-19T06:41:09.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.267+0000 7f6c677fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c6815e350 0x7f6c68152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:09.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.267+0000 7f6c677fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c6815e350 0x7f6c68152a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:35182/0 (socket says 172.21.15.86:35182) 2024-09-19T06:41:09.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.267+0000 7f6c6c90a640 1 -- 172.21.15.86:0/1955818858 learned_addr learned my addr 172.21.15.86:0/1955818858 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:41:09.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.267+0000 7f6c6e36d640 1 -- 172.21.15.86:0/1955818858 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6c680721a0 con 0x7f6c68152f80 2024-09-19T06:41:09.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.267+0000 7f6c6e36d640 1 -- 172.21.15.86:0/1955818858 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6c68071ec0 con 0x7f6c6815e350 2024-09-19T06:41:09.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.267+0000 7f6c6e36d640 1 -- 172.21.15.86:0/1955818858 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6c68070ed0 con 0x7f6c6815c3e0 2024-09-19T06:41:09.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.268+0000 7f6c6c90a640 1 -- 172.21.15.86:0/1955818858 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c6815c3e0 msgr2=0x7f6c6815c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:09.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.268+0000 7f6c6c90a640 1 --2- 172.21.15.86:0/1955818858 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c6815c3e0 0x7f6c6815c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:09.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.268+0000 7f6c6c90a640 1 -- 172.21.15.86:0/1955818858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c6815e350 msgr2=0x7f6c68152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:09.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.268+0000 7f6c6c90a640 1 --2- 172.21.15.86:0/1955818858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c6815e350 0x7f6c68152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:09.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.268+0000 7f6c6c90a640 1 -- 172.21.15.86:0/1955818858 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6815cd00 con 0x7f6c68152f80 2024-09-19T06:41:09.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.269+0000 7f6c6c90a640 1 --2- 172.21.15.86:0/1955818858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c68152f80 0x7f6c6815ef80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6c6806d680 tx=0x7f6c600105a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:09.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.269+0000 7f6c677fe640 1 --2- 172.21.15.86:0/1955818858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c6815e350 0x7f6c68152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:41:09.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.269+0000 7f6c64ff9640 1 -- 172.21.15.86:0/1955818858 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c60010b80 con 0x7f6c68152f80 2024-09-19T06:41:09.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.270+0000 7f6c64ff9640 1 -- 172.21.15.86:0/1955818858 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c60019070 con 0x7f6c68152f80 2024-09-19T06:41:09.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.270+0000 7f6c64ff9640 1 -- 172.21.15.86:0/1955818858 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c600143f0 con 0x7f6c68152f80 2024-09-19T06:41:09.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.270+0000 7f6c6e36d640 1 -- 172.21.15.86:0/1955818858 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c6815e140 con 0x7f6c68152f80 2024-09-19T06:41:09.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.271+0000 7f6c6e36d640 1 -- 172.21.15.86:0/1955818858 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c681570d0 con 0x7f6c68152f80 2024-09-19T06:41:09.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.273+0000 7f6c64ff9640 1 -- 172.21.15.86:0/1955818858 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6c60014590 con 0x7f6c68152f80 2024-09-19T06:41:09.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.273+0000 7f6c64ff9640 1 --2- 172.21.15.86:0/1955818858 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6c5406c380 0x7f6c5406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:09.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.274+0000 7f6c67fff640 1 --2- 172.21.15.86:0/1955818858 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6c5406c380 0x7f6c5406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:09.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.275+0000 7f6c67fff640 1 --2- 172.21.15.86:0/1955818858 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6c5406c380 0x7f6c5406e840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6c58034000 tx=0x7f6c5802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:09.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.275+0000 7f6c6e36d640 1 -- 172.21.15.86:0/1955818858 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c68072d80 con 0x7f6c68152f80 2024-09-19T06:41:09.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.279+0000 7f6c64ff9640 1 -- 172.21.15.86:0/1955818858 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6907+0+0 (secure 0 0 0) 0x7f6c6008bbb0 con 0x7f6c68152f80 2024-09-19T06:41:09.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.287+0000 7f6c64ff9640 1 -- 172.21.15.86:0/1955818858 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6c68072d80 con 0x7f6c68152f80 2024-09-19T06:41:09.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.725+0000 7f6c6e36d640 1 -- 172.21.15.86:0/1955818858 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c6806bbc0 con 0x7f6c68152f80 2024-09-19T06:41:09.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.726+0000 7f6c64ff9640 1 -- 172.21.15.86:0/1955818858 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6048 (secure 0 0 0) 0x7f6c60059e50 con 0x7f6c68152f80 2024-09-19T06:41:09.729 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:41:09.729 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":17,"btime":"2024-09-19T06:41:08:572124+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:41:08.558587+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4762},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4762":{"gid":4762,"name":"d","rank":0,"incarnation":15,"state":"up:rejoin","state_seq":24,"addr":"172.21.15.169:6837/2213887583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2213887583},{"type":"v1","addr":"172.21.15.169:6837","nonce":2213887583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:41:09.729 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 17 2024-09-19T06:41:09.736 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.734+0000 7f6c6e36d640 1 -- 172.21.15.86:0/1955818858 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6c5406c380 msgr2=0x7f6c5406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:09.736 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.734+0000 7f6c6e36d640 1 --2- 172.21.15.86:0/1955818858 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6c5406c380 0x7f6c5406e840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6c58034000 tx=0x7f6c5802e000 comp rx=0 tx=0).stop 2024-09-19T06:41:09.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.734+0000 7f6c6e36d640 1 -- 172.21.15.86:0/1955818858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c68152f80 msgr2=0x7f6c6815ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:09.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.734+0000 7f6c6e36d640 1 --2- 172.21.15.86:0/1955818858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c68152f80 0x7f6c6815ef80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6c6806d680 tx=0x7f6c600105a0 comp rx=0 tx=0).stop 2024-09-19T06:41:09.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.735+0000 7f6c6e36d640 1 -- 172.21.15.86:0/1955818858 shutdown_connections 2024-09-19T06:41:09.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.735+0000 7f6c6e36d640 1 --2- 172.21.15.86:0/1955818858 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6c5406c380 0x7f6c5406e840 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:09.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.735+0000 7f6c6e36d640 1 --2- 172.21.15.86:0/1955818858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c68152f80 0x7f6c6815ef80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:09.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.735+0000 7f6c6e36d640 1 --2- 172.21.15.86:0/1955818858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c6815e350 0x7f6c68152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:09.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.735+0000 7f6c6e36d640 1 --2- 172.21.15.86:0/1955818858 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c6815c3e0 0x7f6c6815c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:09.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.735+0000 7f6c6e36d640 1 -- 172.21.15.86:0/1955818858 >> 172.21.15.86:0/1955818858 conn(0x7f6c680c9280 msgr2=0x7f6c68158190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:09.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.735+0000 7f6c6e36d640 1 -- 172.21.15.86:0/1955818858 shutdown_connections 2024-09-19T06:41:09.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:09.735+0000 7f6c6e36d640 1 -- 172.21.15.86:0/1955818858 wait complete. 2024-09-19T06:41:09.759 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:41:11.760 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:41:11.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.873+0000 7f61757f1640 1 Processor -- start 2024-09-19T06:41:11.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.873+0000 7f61757f1640 1 -- start start 2024-09-19T06:41:11.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.874+0000 7f61757f1640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6170152050 0x7f6170157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:11.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.874+0000 7f61757f1640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f617015bb10 0x7f61700c8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:11.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.874+0000 7f61757f1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61700ca530 0x7f61700ca960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:11.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.874+0000 7f61757f1640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f6170158bb0 con 0x7f6170152050 2024-09-19T06:41:11.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.874+0000 7f61757f1640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f6170158310 con 0x7f617015bb10 2024-09-19T06:41:11.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.874+0000 7f61757f1640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f61701585f0 con 0x7f61700ca530 2024-09-19T06:41:11.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.874+0000 7f616effd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6170152050 0x7f6170157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:11.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.874+0000 7f616effd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6170152050 0x7f6170157bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38848/0 (socket says 172.21.15.86:38848) 2024-09-19T06:41:11.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.874+0000 7f616effd640 1 -- 172.21.15.86:0/3944405987 learned_addr learned my addr 172.21.15.86:0/3944405987 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:41:11.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.875+0000 7f616f7fe640 1 --2- 172.21.15.86:0/3944405987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61700ca530 0x7f61700ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:11.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.875+0000 7f61667fc640 1 --2- 172.21.15.86:0/3944405987 >> v2:172.21.15.169:3300/0 conn(0x7f617015bb10 0x7f61700c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:11.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.875+0000 7f616effd640 1 -- 172.21.15.86:0/3944405987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61700ca530 msgr2=0x7f61700ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:11.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.875+0000 7f616effd640 1 --2- 172.21.15.86:0/3944405987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61700ca530 0x7f61700ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:11.878 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.875+0000 7f616effd640 1 -- 172.21.15.86:0/3944405987 >> v2:172.21.15.169:3300/0 conn(0x7f617015bb10 msgr2=0x7f61700c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:11.878 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.875+0000 7f616effd640 1 --2- 172.21.15.86:0/3944405987 >> v2:172.21.15.169:3300/0 conn(0x7f617015bb10 0x7f61700c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:11.878 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.875+0000 7f616effd640 1 -- 172.21.15.86:0/3944405987 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61701588d0 con 0x7f6170152050 2024-09-19T06:41:11.878 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.875+0000 7f61667fc640 1 --2- 172.21.15.86:0/3944405987 >> v2:172.21.15.169:3300/0 conn(0x7f617015bb10 0x7f61700c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:11.878 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.875+0000 7f616f7fe640 1 --2- 172.21.15.86:0/3944405987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61700ca530 0x7f61700ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:11.878 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.875+0000 7f616effd640 1 --2- 172.21.15.86:0/3944405987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6170152050 0x7f6170157bf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f61700cb5f0 tx=0x7f616002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57aed9edd24dae6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:11.881 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.876+0000 7f616e7fc640 1 -- 172.21.15.86:0/3944405987 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6160037070 con 0x7f6170152050 2024-09-19T06:41:11.881 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.876+0000 7f616e7fc640 1 -- 172.21.15.86:0/3944405987 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6160032440 con 0x7f6170152050 2024-09-19T06:41:11.881 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.876+0000 7f616e7fc640 1 -- 172.21.15.86:0/3944405987 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6160032810 con 0x7f6170152050 2024-09-19T06:41:11.881 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.876+0000 7f61757f1640 1 -- 172.21.15.86:0/3944405987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6170152050 msgr2=0x7f6170157bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:11.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.876+0000 7f61757f1640 1 --2- 172.21.15.86:0/3944405987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6170152050 0x7f6170157bf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f61700cb5f0 tx=0x7f616002a140 comp rx=0 tx=0).stop 2024-09-19T06:41:11.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.876+0000 7f61757f1640 1 -- 172.21.15.86:0/3944405987 shutdown_connections 2024-09-19T06:41:11.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.876+0000 7f61757f1640 1 --2- 172.21.15.86:0/3944405987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61700ca530 0x7f61700ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:11.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.876+0000 7f61757f1640 1 --2- 172.21.15.86:0/3944405987 >> v2:172.21.15.169:3300/0 conn(0x7f617015bb10 0x7f61700c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:11.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.876+0000 7f61757f1640 1 --2- 172.21.15.86:0/3944405987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6170152050 0x7f6170157bf0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:11.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.876+0000 7f61757f1640 1 -- 172.21.15.86:0/3944405987 >> 172.21.15.86:0/3944405987 conn(0x7f617006fd60 msgr2=0x7f6170070140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:11.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.876+0000 7f61757f1640 1 -- 172.21.15.86:0/3944405987 shutdown_connections 2024-09-19T06:41:11.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.876+0000 7f61757f1640 1 -- 172.21.15.86:0/3944405987 wait complete. 2024-09-19T06:41:11.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.877+0000 7f61757f1640 1 Processor -- start 2024-09-19T06:41:11.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.878+0000 7f61757f1640 1 -- start start 2024-09-19T06:41:11.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.878+0000 7f61757f1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61700ca530 0x7f6170159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:11.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.878+0000 7f61757f1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6170152050 0x7f6170163c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:11.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.878+0000 7f61757f1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f617015bb10 0x7f61701641a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:11.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.878+0000 7f61757f1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f61700c4810 con 0x7f6170152050 2024-09-19T06:41:11.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.878+0000 7f61757f1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f617015b5f0 con 0x7f61700ca530 2024-09-19T06:41:11.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.878+0000 7f61757f1640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f61700c8d70 con 0x7f617015bb10 2024-09-19T06:41:11.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.878+0000 7f61667fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6170152050 0x7f6170163c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:11.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.878+0000 7f61667fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6170152050 0x7f6170163c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38852/0 (socket says 172.21.15.86:38852) 2024-09-19T06:41:11.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.879+0000 7f61667fc640 1 -- 172.21.15.86:0/1305432081 learned_addr learned my addr 172.21.15.86:0/1305432081 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:41:11.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.879+0000 7f616effd640 1 --2- 172.21.15.86:0/1305432081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61700ca530 0x7f6170159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:11.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.879+0000 7f616f7fe640 1 --2- 172.21.15.86:0/1305432081 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f617015bb10 0x7f61701641a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:11.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.879+0000 7f61667fc640 1 -- 172.21.15.86:0/1305432081 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f617015bb10 msgr2=0x7f61701641a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:11.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.879+0000 7f61667fc640 1 --2- 172.21.15.86:0/1305432081 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f617015bb10 0x7f61701641a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:11.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.879+0000 7f61667fc640 1 -- 172.21.15.86:0/1305432081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61700ca530 msgr2=0x7f6170159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:11.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.879+0000 7f61667fc640 1 --2- 172.21.15.86:0/1305432081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61700ca530 0x7f6170159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:11.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.879+0000 7f61667fc640 1 -- 172.21.15.86:0/1305432081 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6170157b20 con 0x7f6170152050 2024-09-19T06:41:11.884 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.879+0000 7f616effd640 1 --2- 172.21.15.86:0/1305432081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61700ca530 0x7f6170159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:11.884 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.879+0000 7f61667fc640 1 --2- 172.21.15.86:0/1305432081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6170152050 0x7f6170163c60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f615800d800 tx=0x7f615800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:11.884 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.879+0000 7f6167fff640 1 -- 172.21.15.86:0/1305432081 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6158004030 con 0x7f6170152050 2024-09-19T06:41:11.884 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.879+0000 7f6167fff640 1 -- 172.21.15.86:0/1305432081 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61580041d0 con 0x7f6170152050 2024-09-19T06:41:11.884 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.879+0000 7f6167fff640 1 -- 172.21.15.86:0/1305432081 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61580096a0 con 0x7f6170152050 2024-09-19T06:41:11.884 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.879+0000 7f61757f1640 1 -- 172.21.15.86:0/1305432081 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6170162f00 con 0x7f6170152050 2024-09-19T06:41:11.884 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.879+0000 7f61757f1640 1 -- 172.21.15.86:0/1305432081 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6170163740 con 0x7f6170152050 2024-09-19T06:41:11.884 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.880+0000 7f61757f1640 1 -- 172.21.15.86:0/1305432081 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6170162b50 con 0x7f6170152050 2024-09-19T06:41:11.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.881+0000 7f6167fff640 1 -- 172.21.15.86:0/1305432081 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6158009840 con 0x7f6170152050 2024-09-19T06:41:11.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.881+0000 7f6167fff640 1 --2- 172.21.15.86:0/1305432081 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f615006c2e0 0x7f615006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:11.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.881+0000 7f6167fff640 1 -- 172.21.15.86:0/1305432081 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6907+0+0 (secure 0 0 0) 0x7f615808bb40 con 0x7f6170152050 2024-09-19T06:41:11.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.881+0000 7f616effd640 1 --2- 172.21.15.86:0/1305432081 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f615006c2e0 0x7f615006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:11.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.882+0000 7f616effd640 1 --2- 172.21.15.86:0/1305432081 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f615006c2e0 0x7f615006e7a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6160034000 tx=0x7f616002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:11.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:11.886+0000 7f6167fff640 1 -- 172.21.15.86:0/1305432081 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6170162b50 con 0x7f6170152050 2024-09-19T06:41:12.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:12.088+0000 7f61757f1640 1 -- 172.21.15.86:0/1305432081 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f617015bf60 con 0x7f6170152050 2024-09-19T06:41:12.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:12.088+0000 7f6167fff640 1 -- 172.21.15.86:0/1305432081 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6048 (secure 0 0 0) 0x7f6170162f00 con 0x7f6170152050 2024-09-19T06:41:12.090 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:41:12.090 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":17,"btime":"2024-09-19T06:41:08:572124+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:41:08.558587+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4762},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4762":{"gid":4762,"name":"d","rank":0,"incarnation":15,"state":"up:rejoin","state_seq":24,"addr":"172.21.15.169:6837/2213887583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2213887583},{"type":"v1","addr":"172.21.15.169:6837","nonce":2213887583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:41:12.090 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 17 2024-09-19T06:41:12.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:12.090+0000 7f61757f1640 1 -- 172.21.15.86:0/1305432081 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f615006c2e0 msgr2=0x7f615006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:12.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:12.090+0000 7f61757f1640 1 --2- 172.21.15.86:0/1305432081 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f615006c2e0 0x7f615006e7a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6160034000 tx=0x7f616002e000 comp rx=0 tx=0).stop 2024-09-19T06:41:12.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:12.090+0000 7f61757f1640 1 -- 172.21.15.86:0/1305432081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6170152050 msgr2=0x7f6170163c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:12.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:12.090+0000 7f61757f1640 1 --2- 172.21.15.86:0/1305432081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6170152050 0x7f6170163c60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f615800d800 tx=0x7f615800dcc0 comp rx=0 tx=0).stop 2024-09-19T06:41:12.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:12.090+0000 7f61757f1640 1 -- 172.21.15.86:0/1305432081 shutdown_connections 2024-09-19T06:41:12.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:12.090+0000 7f61757f1640 1 --2- 172.21.15.86:0/1305432081 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f615006c2e0 0x7f615006e7a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:12.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:12.090+0000 7f61757f1640 1 --2- 172.21.15.86:0/1305432081 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f617015bb10 0x7f61701641a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:12.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:12.090+0000 7f61757f1640 1 --2- 172.21.15.86:0/1305432081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6170152050 0x7f6170163c60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:12.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:12.090+0000 7f61757f1640 1 --2- 172.21.15.86:0/1305432081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61700ca530 0x7f6170159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:12.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:12.090+0000 7f61757f1640 1 -- 172.21.15.86:0/1305432081 >> 172.21.15.86:0/1305432081 conn(0x7f617006fd60 msgr2=0x7f61700cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:12.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:12.090+0000 7f61757f1640 1 -- 172.21.15.86:0/1305432081 shutdown_connections 2024-09-19T06:41:12.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:12.090+0000 7f61757f1640 1 -- 172.21.15.86:0/1305432081 wait complete. 2024-09-19T06:41:12.103 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:41:14.104 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:41:14.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.310+0000 7fd4b69ea640 1 Processor -- start 2024-09-19T06:41:14.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.311+0000 7fd4b69ea640 1 -- start start 2024-09-19T06:41:14.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.312+0000 7fd4b69ea640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd4b00c84f0 0x7fd4b01582b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:14.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.312+0000 7fd4b69ea640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd4b00c7e20 0x7fd4b0150c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:14.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.312+0000 7fd4b69ea640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd4b00c88d0 0x7fd4b0151170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:14.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.312+0000 7fd4b69ea640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fd4b01587f0 con 0x7fd4b00c7e20 2024-09-19T06:41:14.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.312+0000 7fd4b69ea640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fd4b015b0b0 con 0x7fd4b00c88d0 2024-09-19T06:41:14.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.312+0000 7fd4b69ea640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd4b00c7060 con 0x7fd4b00c84f0 2024-09-19T06:41:14.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.312+0000 7fd4b61e9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd4b00c88d0 0x7fd4b0151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:14.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.312+0000 7fd4b61e9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd4b00c88d0 0x7fd4b0151170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:50950/0 (socket says 172.21.15.86:50950) 2024-09-19T06:41:14.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.312+0000 7fd4b61e9640 1 -- 172.21.15.86:0/1154480457 learned_addr learned my addr 172.21.15.86:0/1154480457 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:41:14.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.312+0000 7fd4b59e8640 1 --2- 172.21.15.86:0/1154480457 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd4b00c84f0 0x7fd4b01582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:14.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.313+0000 7fd4b51e7640 1 --2- 172.21.15.86:0/1154480457 >> v2:172.21.15.86:3300/0 conn(0x7fd4b00c7e20 0x7fd4b0150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:14.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.313+0000 7fd4b61e9640 1 -- 172.21.15.86:0/1154480457 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd4b00c84f0 msgr2=0x7fd4b01582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:14.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.313+0000 7fd4b61e9640 1 --2- 172.21.15.86:0/1154480457 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd4b00c84f0 0x7fd4b01582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:14.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.313+0000 7fd4b61e9640 1 -- 172.21.15.86:0/1154480457 >> v2:172.21.15.86:3300/0 conn(0x7fd4b00c7e20 msgr2=0x7fd4b0150c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:14.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.313+0000 7fd4b61e9640 1 --2- 172.21.15.86:0/1154480457 >> v2:172.21.15.86:3300/0 conn(0x7fd4b00c7e20 0x7fd4b0150c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:14.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.313+0000 7fd4b61e9640 1 -- 172.21.15.86:0/1154480457 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b00c7340 con 0x7fd4b00c88d0 2024-09-19T06:41:14.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.314+0000 7fd4b51e7640 1 --2- 172.21.15.86:0/1154480457 >> v2:172.21.15.86:3300/0 conn(0x7fd4b00c7e20 0x7fd4b0150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:14.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.317+0000 7fd4b61e9640 1 --2- 172.21.15.86:0/1154480457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4b00c88d0 0x7fd4b0151170 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00c9d40 tx=0x7fd4a802a760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50bcb925694d0ec1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:14.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.319+0000 7fd4b49e6640 1 -- 172.21.15.86:0/1154480457 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8036070 con 0x7fd4b00c88d0 2024-09-19T06:41:14.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.319+0000 7fd4b49e6640 1 -- 172.21.15.86:0/1154480457 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4a8031600 con 0x7fd4b00c88d0 2024-09-19T06:41:14.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.319+0000 7fd4b49e6640 1 -- 172.21.15.86:0/1154480457 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8031a10 con 0x7fd4b00c88d0 2024-09-19T06:41:14.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.320+0000 7fd4b69ea640 1 -- 172.21.15.86:0/1154480457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4b00c88d0 msgr2=0x7fd4b0151170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:14.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.320+0000 7fd4b69ea640 1 --2- 172.21.15.86:0/1154480457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4b00c88d0 0x7fd4b0151170 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00c9d40 tx=0x7fd4a802a760 comp rx=0 tx=0).stop 2024-09-19T06:41:14.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.320+0000 7fd4b69ea640 1 -- 172.21.15.86:0/1154480457 shutdown_connections 2024-09-19T06:41:14.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.320+0000 7fd4b69ea640 1 --2- 172.21.15.86:0/1154480457 >> v2:172.21.15.86:3300/0 conn(0x7fd4b00c7e20 0x7fd4b0150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:14.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.320+0000 7fd4b69ea640 1 --2- 172.21.15.86:0/1154480457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4b00c88d0 0x7fd4b0151170 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:14.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.320+0000 7fd4b69ea640 1 --2- 172.21.15.86:0/1154480457 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd4b00c84f0 0x7fd4b01582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:14.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.320+0000 7fd4b69ea640 1 -- 172.21.15.86:0/1154480457 >> 172.21.15.86:0/1154480457 conn(0x7fd4b006bda0 msgr2=0x7fd4b006c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:14.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.321+0000 7fd4b69ea640 1 -- 172.21.15.86:0/1154480457 shutdown_connections 2024-09-19T06:41:14.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.321+0000 7fd4b69ea640 1 -- 172.21.15.86:0/1154480457 wait complete. 2024-09-19T06:41:14.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.323+0000 7fd4b69ea640 1 Processor -- start 2024-09-19T06:41:14.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.323+0000 7fd4b69ea640 1 -- start start 2024-09-19T06:41:14.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.324+0000 7fd4b69ea640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4b00c7e20 0x7fd4b014adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:14.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.324+0000 7fd4b69ea640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4b00c84f0 0x7fd4b015c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:14.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.324+0000 7fd4b69ea640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd4b00c88d0 0x7fd4b0200e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:14.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.324+0000 7fd4b69ea640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b0157030 con 0x7fd4b00c84f0 2024-09-19T06:41:14.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.324+0000 7fd4b69ea640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b00c7900 con 0x7fd4b00c7e20 2024-09-19T06:41:14.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.324+0000 7fd4b69ea640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd4b01571b0 con 0x7fd4b00c88d0 2024-09-19T06:41:14.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.325+0000 7fd4b61e9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd4b00c88d0 0x7fd4b0200e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:14.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.325+0000 7fd4b61e9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd4b00c88d0 0x7fd4b0200e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:45066/0 (socket says 172.21.15.86:45066) 2024-09-19T06:41:14.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.325+0000 7fd4b61e9640 1 -- 172.21.15.86:0/1410239943 learned_addr learned my addr 172.21.15.86:0/1410239943 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:41:14.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.325+0000 7fd4b59e8640 1 --2- 172.21.15.86:0/1410239943 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4b00c7e20 0x7fd4b014adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:14.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.325+0000 7fd4b51e7640 1 --2- 172.21.15.86:0/1410239943 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4b00c84f0 0x7fd4b015c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:14.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.326+0000 7fd4b61e9640 1 -- 172.21.15.86:0/1410239943 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4b00c7e20 msgr2=0x7fd4b014adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:14.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.326+0000 7fd4b61e9640 1 --2- 172.21.15.86:0/1410239943 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4b00c7e20 0x7fd4b014adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:14.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.326+0000 7fd4b61e9640 1 -- 172.21.15.86:0/1410239943 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4b00c84f0 msgr2=0x7fd4b015c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:14.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.326+0000 7fd4b61e9640 1 --2- 172.21.15.86:0/1410239943 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4b00c84f0 0x7fd4b015c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:14.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.326+0000 7fd4b61e9640 1 -- 172.21.15.86:0/1410239943 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b0156a10 con 0x7fd4b00c88d0 2024-09-19T06:41:14.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.326+0000 7fd4b51e7640 1 --2- 172.21.15.86:0/1410239943 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4b00c84f0 0x7fd4b015c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:14.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.326+0000 7fd4b61e9640 1 --2- 172.21.15.86:0/1410239943 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd4b00c88d0 0x7fd4b0200e40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009f10 tx=0x7fd4a8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:14.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.327+0000 7fd4a67fc640 1 -- 172.21.15.86:0/1410239943 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8041030 con 0x7fd4b00c88d0 2024-09-19T06:41:14.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.327+0000 7fd4b69ea640 1 -- 172.21.15.86:0/1410239943 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b01f0490 con 0x7fd4b00c88d0 2024-09-19T06:41:14.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.327+0000 7fd4b69ea640 1 -- 172.21.15.86:0/1410239943 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b01f17b0 con 0x7fd4b00c88d0 2024-09-19T06:41:14.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.327+0000 7fd4a67fc640 1 -- 172.21.15.86:0/1410239943 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4a8031400 con 0x7fd4b00c88d0 2024-09-19T06:41:14.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.327+0000 7fd4a67fc640 1 -- 172.21.15.86:0/1410239943 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8036040 con 0x7fd4b00c88d0 2024-09-19T06:41:14.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.330+0000 7fd4b69ea640 1 -- 172.21.15.86:0/1410239943 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd498005290 con 0x7fd4b00c88d0 2024-09-19T06:41:14.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.335+0000 7fd4a67fc640 1 -- 172.21.15.86:0/1410239943 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd4a8044070 con 0x7fd4b00c88d0 2024-09-19T06:41:14.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.336+0000 7fd4a67fc640 1 --2- 172.21.15.86:0/1410239943 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd49406c380 0x7fd49406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:14.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.336+0000 7fd4b59e8640 1 --2- 172.21.15.86:0/1410239943 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd49406c380 0x7fd49406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:14.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.337+0000 7fd4a67fc640 1 -- 172.21.15.86:0/1410239943 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 6907+0+0 (secure 0 0 0) 0x7fd4a80abf90 con 0x7fd4b00c88d0 2024-09-19T06:41:14.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.340+0000 7fd4b59e8640 1 --2- 172.21.15.86:0/1410239943 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd49406c380 0x7fd49406e840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac0079a0 tx=0x7fd4ac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:14.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.342+0000 7fd4a67fc640 1 -- 172.21.15.86:0/1410239943 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd4a8079cb0 con 0x7fd4b00c88d0 2024-09-19T06:41:14.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.809+0000 7fd4b69ea640 1 -- 172.21.15.86:0/1410239943 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd498005580 con 0x7fd4b00c88d0 2024-09-19T06:41:14.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.811+0000 7fd4a67fc640 1 -- 172.21.15.86:0/1410239943 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6055 (secure 0 0 0) 0x7fd4a807dfb0 con 0x7fd4b00c88d0 2024-09-19T06:41:14.813 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:41:14.813 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":18,"btime":"2024-09-19T06:41:14:610629+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:41:14.610623+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4762},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4762":{"gid":4762,"name":"d","rank":0,"incarnation":15,"state":"up:active","state_seq":26,"addr":"172.21.15.169:6837/2213887583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2213887583},{"type":"v1","addr":"172.21.15.169:6837","nonce":2213887583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4762,"qdb_cluster":[4762]},"id":1}]} 2024-09-19T06:41:14.813 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 18 2024-09-19T06:41:14.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.816+0000 7fd493fff640 1 -- 172.21.15.86:0/1410239943 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd49406c380 msgr2=0x7fd49406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:14.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.816+0000 7fd493fff640 1 --2- 172.21.15.86:0/1410239943 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd49406c380 0x7fd49406e840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac0079a0 tx=0x7fd4ac008040 comp rx=0 tx=0).stop 2024-09-19T06:41:14.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.816+0000 7fd493fff640 1 -- 172.21.15.86:0/1410239943 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd4b00c88d0 msgr2=0x7fd4b0200e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:14.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.816+0000 7fd493fff640 1 --2- 172.21.15.86:0/1410239943 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd4b00c88d0 0x7fd4b0200e40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009f10 tx=0x7fd4a8004a40 comp rx=0 tx=0).stop 2024-09-19T06:41:14.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.816+0000 7fd493fff640 1 -- 172.21.15.86:0/1410239943 shutdown_connections 2024-09-19T06:41:14.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.816+0000 7fd493fff640 1 --2- 172.21.15.86:0/1410239943 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd49406c380 0x7fd49406e840 secure :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac0079a0 tx=0x7fd4ac008040 comp rx=0 tx=0).stop 2024-09-19T06:41:14.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.816+0000 7fd493fff640 1 --2- 172.21.15.86:0/1410239943 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd4b00c88d0 0x7fd4b0200e40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:14.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.816+0000 7fd493fff640 1 --2- 172.21.15.86:0/1410239943 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4b00c84f0 0x7fd4b015c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:14.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.816+0000 7fd493fff640 1 --2- 172.21.15.86:0/1410239943 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4b00c7e20 0x7fd4b014adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:14.819 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.816+0000 7fd493fff640 1 -- 172.21.15.86:0/1410239943 >> 172.21.15.86:0/1410239943 conn(0x7fd4b006bda0 msgr2=0x7fd4b00cc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:14.819 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.817+0000 7fd493fff640 1 -- 172.21.15.86:0/1410239943 shutdown_connections 2024-09-19T06:41:14.819 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:14.817+0000 7fd493fff640 1 -- 172.21.15.86:0/1410239943 wait complete. 2024-09-19T06:41:14.840 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d has gained rank=0, replacing gid=4281 2024-09-19T06:41:14.840 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 4 secs before reviving mds.e 2024-09-19T06:41:18.841 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.e 2024-09-19T06:41:18.841 INFO:tasks.ceph.mds.e:Restarting daemon 2024-09-19T06:41:18.842 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-09-19T06:41:18.845 INFO:tasks.ceph.mds.e:Started 2024-09-19T06:41:18.845 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:41:18.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.952+0000 7f785d998640 1 Processor -- start 2024-09-19T06:41:18.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.952+0000 7f785d998640 1 -- start start 2024-09-19T06:41:18.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.953+0000 7f785d998640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f78580d0d40 0x7f78580ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.953+0000 7f785d998640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f78580d1120 0x7f78580cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.953+0000 7f785d998640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f785815c9c0 con 0x7f785815da60 2024-09-19T06:41:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.953+0000 7f785d998640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f785815c770 con 0x7f78580d1120 2024-09-19T06:41:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.953+0000 7f785d998640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f78580b3f20 con 0x7f78580d0d40 2024-09-19T06:41:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.953+0000 7f784e7fc640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f78580d1120 0x7f78580cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.953+0000 7f784e7fc640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f78580d1120 0x7f78580cac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57488/0 (socket says 172.21.15.86:57488) 2024-09-19T06:41:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.953+0000 7f784e7fc640 1 -- 172.21.15.86:0/3007647591 learned_addr learned my addr 172.21.15.86:0/3007647591 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:41:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.953+0000 7f7856ffd640 1 --2- 172.21.15.86:0/3007647591 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f78580d0d40 0x7f78580ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.953+0000 7f784e7fc640 1 -- 172.21.15.86:0/3007647591 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f78580d0d40 msgr2=0x7f78580ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.953+0000 7f784e7fc640 1 --2- 172.21.15.86:0/3007647591 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f78580d0d40 0x7f78580ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.953+0000 7f784e7fc640 1 -- 172.21.15.86:0/3007647591 >> v1:172.21.15.169:6789/0 conn(0x7f785815da60 legacy=0x7f78580b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:18.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.953+0000 7f784e7fc640 1 -- 172.21.15.86:0/3007647591 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f785815cca0 con 0x7f78580d1120 2024-09-19T06:41:18.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.954+0000 7f784e7fc640 1 --2- 172.21.15.86:0/3007647591 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78580d1120 0x7f78580cac00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7840009870 tx=0x7f784002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee07297bf8503823 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:18.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.954+0000 7f78567fc640 1 -- 172.21.15.86:0/3007647591 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7840037070 con 0x7f78580d1120 2024-09-19T06:41:18.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.954+0000 7f78567fc640 1 -- 172.21.15.86:0/3007647591 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7840032440 con 0x7f78580d1120 2024-09-19T06:41:18.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.954+0000 7f78567fc640 1 -- 172.21.15.86:0/3007647591 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7840032810 con 0x7f78580d1120 2024-09-19T06:41:18.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.955+0000 7f785d998640 1 -- 172.21.15.86:0/3007647591 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78580d1120 msgr2=0x7f78580cac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:18.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.955+0000 7f785d998640 1 --2- 172.21.15.86:0/3007647591 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78580d1120 0x7f78580cac00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7840009870 tx=0x7f784002a270 comp rx=0 tx=0).stop 2024-09-19T06:41:18.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.955+0000 7f785d998640 1 -- 172.21.15.86:0/3007647591 shutdown_connections 2024-09-19T06:41:18.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.955+0000 7f785d998640 1 --2- 172.21.15.86:0/3007647591 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78580d1120 0x7f78580cac00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:18.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.955+0000 7f785d998640 1 --2- 172.21.15.86:0/3007647591 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f78580d0d40 0x7f78580ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:18.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.955+0000 7f785d998640 1 -- 172.21.15.86:0/3007647591 >> 172.21.15.86:0/3007647591 conn(0x7f785806d910 msgr2=0x7f785806dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:18.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.955+0000 7f785d998640 1 -- 172.21.15.86:0/3007647591 shutdown_connections 2024-09-19T06:41:18.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.955+0000 7f785d998640 1 -- 172.21.15.86:0/3007647591 wait complete. 2024-09-19T06:41:18.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.956+0000 7f785d998640 1 Processor -- start 2024-09-19T06:41:18.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.956+0000 7f785d998640 1 -- start start 2024-09-19T06:41:18.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.957+0000 7f785d998640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78580d0d40 0x7f78580c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:18.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.957+0000 7f785d998640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f78580d1120 0x7f7858157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:18.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.957+0000 7f785d998640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f785815da60 0x7f7858156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:18.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.957+0000 7f785d998640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f785815df10 con 0x7f78580d0d40 2024-09-19T06:41:18.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.957+0000 7f785d998640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f785815d260 con 0x7f785815da60 2024-09-19T06:41:18.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.957+0000 7f785d998640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f785815e090 con 0x7f78580d1120 2024-09-19T06:41:18.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.957+0000 7f7856ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78580d0d40 0x7f78580c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:18.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.957+0000 7f7856ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78580d0d40 0x7f78580c6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57496/0 (socket says 172.21.15.86:57496) 2024-09-19T06:41:18.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.957+0000 7f7856ffd640 1 -- 172.21.15.86:0/3725909856 learned_addr learned my addr 172.21.15.86:0/3725909856 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:41:18.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.957+0000 7f784e7fc640 1 --2- 172.21.15.86:0/3725909856 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f78580d1120 0x7f7858157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:18.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.957+0000 7f78577fe640 1 --2- 172.21.15.86:0/3725909856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f785815da60 0x7f7858156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:18.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.957+0000 7f7856ffd640 1 -- 172.21.15.86:0/3725909856 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f78580d1120 msgr2=0x7f7858157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:18.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.957+0000 7f7856ffd640 1 --2- 172.21.15.86:0/3725909856 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f78580d1120 0x7f7858157e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:18.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.957+0000 7f7856ffd640 1 -- 172.21.15.86:0/3725909856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f785815da60 msgr2=0x7f7858156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:18.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.957+0000 7f7856ffd640 1 --2- 172.21.15.86:0/3725909856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f785815da60 0x7f7858156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:18.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.957+0000 7f7856ffd640 1 -- 172.21.15.86:0/3725909856 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7858155fe0 con 0x7f78580d0d40 2024-09-19T06:41:18.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.957+0000 7f784e7fc640 1 --2- 172.21.15.86:0/3725909856 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f78580d1120 0x7f7858157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:18.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.957+0000 7f78577fe640 1 --2- 172.21.15.86:0/3725909856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f785815da60 0x7f7858156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:18.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.957+0000 7f7856ffd640 1 --2- 172.21.15.86:0/3725909856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78580d0d40 0x7f78580c6ec0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f784800d830 tx=0x7f784800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:18.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.958+0000 7f7854ff9640 1 -- 172.21.15.86:0/3725909856 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784800b6c0 con 0x7f78580d0d40 2024-09-19T06:41:18.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.958+0000 7f7854ff9640 1 -- 172.21.15.86:0/3725909856 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7848019070 con 0x7f78580d0d40 2024-09-19T06:41:18.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.958+0000 7f785d998640 1 -- 172.21.15.86:0/3725909856 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7858156280 con 0x7f78580d0d40 2024-09-19T06:41:18.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.958+0000 7f7854ff9640 1 -- 172.21.15.86:0/3725909856 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784800ba80 con 0x7f78580d0d40 2024-09-19T06:41:18.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.958+0000 7f785d998640 1 -- 172.21.15.86:0/3725909856 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78581e8300 con 0x7f78580d0d40 2024-09-19T06:41:18.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.959+0000 7f785d998640 1 -- 172.21.15.86:0/3725909856 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78580cecd0 con 0x7f78580d0d40 2024-09-19T06:41:18.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.959+0000 7f7854ff9640 1 -- 172.21.15.86:0/3725909856 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f784800bc20 con 0x7f78580d0d40 2024-09-19T06:41:18.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.960+0000 7f7854ff9640 1 --2- 172.21.15.86:0/3725909856 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f783806c2b0 0x7f783806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:18.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.960+0000 7f784e7fc640 1 --2- 172.21.15.86:0/3725909856 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f783806c2b0 0x7f783806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:18.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.960+0000 7f7854ff9640 1 -- 172.21.15.86:0/3725909856 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6907+0+0 (secure 0 0 0) 0x7f784808bdb0 con 0x7f78580d0d40 2024-09-19T06:41:18.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.960+0000 7f784e7fc640 1 --2- 172.21.15.86:0/3725909856 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f783806c2b0 0x7f783806e770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7840034000 tx=0x7f784002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:18.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:18.964+0000 7f7854ff9640 1 -- 172.21.15.86:0/3725909856 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f78580cecd0 con 0x7f78580d0d40 2024-09-19T06:41:19.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:19.183+0000 7f785d998640 1 -- 172.21.15.86:0/3725909856 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78580ca6c0 con 0x7f78580d0d40 2024-09-19T06:41:19.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:19.184+0000 7f7854ff9640 1 -- 172.21.15.86:0/3725909856 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6055 (secure 0 0 0) 0x7f784801c360 con 0x7f78580d0d40 2024-09-19T06:41:19.186 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:41:19.186 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":18,"btime":"2024-09-19T06:41:14:610629+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:41:14.610623+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4762},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4762":{"gid":4762,"name":"d","rank":0,"incarnation":15,"state":"up:active","state_seq":26,"addr":"172.21.15.169:6837/2213887583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2213887583},{"type":"v1","addr":"172.21.15.169:6837","nonce":2213887583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4762,"qdb_cluster":[4762]},"id":1}]} 2024-09-19T06:41:19.186 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 18 2024-09-19T06:41:19.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:19.186+0000 7f785d998640 1 -- 172.21.15.86:0/3725909856 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f783806c2b0 msgr2=0x7f783806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:19.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:19.186+0000 7f785d998640 1 --2- 172.21.15.86:0/3725909856 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f783806c2b0 0x7f783806e770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7840034000 tx=0x7f784002e000 comp rx=0 tx=0).stop 2024-09-19T06:41:19.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:19.186+0000 7f785d998640 1 -- 172.21.15.86:0/3725909856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78580d0d40 msgr2=0x7f78580c6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:19.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:19.186+0000 7f785d998640 1 --2- 172.21.15.86:0/3725909856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78580d0d40 0x7f78580c6ec0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f784800d830 tx=0x7f784800dcf0 comp rx=0 tx=0).stop 2024-09-19T06:41:19.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:19.186+0000 7f785d998640 1 -- 172.21.15.86:0/3725909856 shutdown_connections 2024-09-19T06:41:19.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:19.186+0000 7f785d998640 1 --2- 172.21.15.86:0/3725909856 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f783806c2b0 0x7f783806e770 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:19.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:19.186+0000 7f785d998640 1 --2- 172.21.15.86:0/3725909856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f785815da60 0x7f7858156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:19.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:19.186+0000 7f785d998640 1 --2- 172.21.15.86:0/3725909856 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f78580d1120 0x7f7858157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:19.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:19.186+0000 7f785d998640 1 --2- 172.21.15.86:0/3725909856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78580d0d40 0x7f78580c6ec0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:19.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:19.186+0000 7f785d998640 1 -- 172.21.15.86:0/3725909856 >> 172.21.15.86:0/3725909856 conn(0x7f785806d910 msgr2=0x7f78580cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:19.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:19.186+0000 7f785d998640 1 -- 172.21.15.86:0/3725909856 shutdown_connections 2024-09-19T06:41:19.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:19.186+0000 7f785d998640 1 -- 172.21.15.86:0/3725909856 wait complete. 2024-09-19T06:41:19.199 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is in active, standby or standby-replay 2024-09-19T06:41:19.525 INFO:tasks.ceph.mds.e.smithi086.stdout:starting mds.e at 2024-09-19T06:41:21.200 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:41:21.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.379+0000 7fd1a7352640 1 Processor -- start 2024-09-19T06:41:21.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.379+0000 7fd1a7352640 1 -- start start 2024-09-19T06:41:21.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.381+0000 7fd1a7352640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd1a0165280 0x7fd1a00c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:21.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.381+0000 7fd1a7352640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1a00c3760 con 0x7fd1a0072150 2024-09-19T06:41:21.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.381+0000 7fd1a7352640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1a0167ad0 con 0x7fd1a0068850 2024-09-19T06:41:21.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.381+0000 7fd1a7352640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fd1a00c6fc0 con 0x7fd1a0165280 2024-09-19T06:41:21.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.381+0000 7fd1a48ed640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fd1a0072150 0x7fd1a00c7450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:37748/0 (socket says 172.21.15.86:37748) 2024-09-19T06:41:21.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.381+0000 7fd1a48ed640 1 -- 172.21.15.86:0/848021311 learned_addr learned my addr 172.21.15.86:0/848021311 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:41:21.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.382+0000 7fd1a50ee640 1 --2- 172.21.15.86:0/848021311 >> v2:172.21.15.86:3300/0 conn(0x7fd1a0165280 0x7fd1a00c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:21.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.382+0000 7fd1a50ee640 1 -- 172.21.15.86:0/848021311 >> v1:172.21.15.169:6789/0 conn(0x7fd1a0068850 legacy=0x7fd1a0172370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:21.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.382+0000 7fd1a50ee640 1 -- 172.21.15.86:0/848021311 >> v1:172.21.15.86:6789/0 conn(0x7fd1a0072150 legacy=0x7fd1a00c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:21.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.382+0000 7fd1a50ee640 1 -- 172.21.15.86:0/848021311 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a0165660 con 0x7fd1a0165280 2024-09-19T06:41:21.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.384+0000 7fd1a50ee640 1 --2- 172.21.15.86:0/848021311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd1a0165280 0x7fd1a00c84e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd19c006d10 tx=0x7fd19c02e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7124439c4353656 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:21.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.382+0000 7fd197fff640 1 -- 172.21.15.86:0/848021311 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 958629794 0 0) 0x7fd1a00c3760 con 0x7fd1a0072150 2024-09-19T06:41:21.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.384+0000 7fd197fff640 1 -- 172.21.15.86:0/848021311 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19c03b070 con 0x7fd1a0165280 2024-09-19T06:41:21.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.384+0000 7fd197fff640 1 -- 172.21.15.86:0/848021311 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd19c036670 con 0x7fd1a0165280 2024-09-19T06:41:21.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.385+0000 7fd1a7352640 1 -- 172.21.15.86:0/848021311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd1a0165280 msgr2=0x7fd1a00c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:21.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.385+0000 7fd1a7352640 1 --2- 172.21.15.86:0/848021311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd1a0165280 0x7fd1a00c84e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd19c006d10 tx=0x7fd19c02e880 comp rx=0 tx=0).stop 2024-09-19T06:41:21.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.388+0000 7fd1a7352640 1 -- 172.21.15.86:0/848021311 shutdown_connections 2024-09-19T06:41:21.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.388+0000 7fd1a7352640 1 --2- 172.21.15.86:0/848021311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd1a0165280 0x7fd1a00c84e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:21.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.388+0000 7fd1a7352640 1 -- 172.21.15.86:0/848021311 >> 172.21.15.86:0/848021311 conn(0x7fd1a006e820 msgr2=0x7fd1a006ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:21.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.392+0000 7fd1a7352640 1 -- 172.21.15.86:0/848021311 shutdown_connections 2024-09-19T06:41:21.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.392+0000 7fd1a7352640 1 -- 172.21.15.86:0/848021311 wait complete. 2024-09-19T06:41:21.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.394+0000 7fd1a7352640 1 Processor -- start 2024-09-19T06:41:21.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.394+0000 7fd1a7352640 1 -- start start 2024-09-19T06:41:21.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.395+0000 7fd1a7352640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd1a0068850 0x7fd1a016b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:21.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.395+0000 7fd1a7352640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd1a0165280 0x7fd1a0169400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:21.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.395+0000 7fd1a7352640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd1a016ad50 0x7fd1a0169940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:21.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.395+0000 7fd1a7352640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a0168330 con 0x7fd1a0165280 2024-09-19T06:41:21.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.395+0000 7fd1a7352640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a0168050 con 0x7fd1a016ad50 2024-09-19T06:41:21.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.395+0000 7fd1a7352640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd1a0168610 con 0x7fd1a0068850 2024-09-19T06:41:21.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.395+0000 7fd1a48ed640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd1a0165280 0x7fd1a0169400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:21.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.395+0000 7fd1a48ed640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd1a0165280 0x7fd1a0169400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57528/0 (socket says 172.21.15.86:57528) 2024-09-19T06:41:21.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.396+0000 7fd1a48ed640 1 -- 172.21.15.86:0/891632701 learned_addr learned my addr 172.21.15.86:0/891632701 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:41:21.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.396+0000 7fd1a48ed640 1 -- 172.21.15.86:0/891632701 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd1a0068850 msgr2=0x7fd1a016b8c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:41:21.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.396+0000 7fd1a48ed640 1 --2- 172.21.15.86:0/891632701 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd1a0068850 0x7fd1a016b8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:21.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.396+0000 7fd1a48ed640 1 -- 172.21.15.86:0/891632701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd1a016ad50 msgr2=0x7fd1a0169940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:41:21.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.396+0000 7fd1a48ed640 1 --2- 172.21.15.86:0/891632701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd1a016ad50 0x7fd1a0169940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:21.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.396+0000 7fd1a48ed640 1 -- 172.21.15.86:0/891632701 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a00c6120 con 0x7fd1a0165280 2024-09-19T06:41:21.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.397+0000 7fd1a48ed640 1 --2- 172.21.15.86:0/891632701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd1a0165280 0x7fd1a0169400 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd19800c7c0 tx=0x7fd19800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:21.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.397+0000 7fd195ffb640 1 -- 172.21.15.86:0/891632701 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd198018070 con 0x7fd1a0165280 2024-09-19T06:41:21.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.398+0000 7fd1a7352640 1 -- 172.21.15.86:0/891632701 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1a00c4ac0 con 0x7fd1a0165280 2024-09-19T06:41:21.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.398+0000 7fd1a7352640 1 -- 172.21.15.86:0/891632701 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1a00c5e40 con 0x7fd1a0165280 2024-09-19T06:41:21.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.402+0000 7fd195ffb640 1 -- 172.21.15.86:0/891632701 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd19800a640 con 0x7fd1a0165280 2024-09-19T06:41:21.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.402+0000 7fd195ffb640 1 -- 172.21.15.86:0/891632701 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19800aa30 con 0x7fd1a0165280 2024-09-19T06:41:21.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.402+0000 7fd195ffb640 1 -- 172.21.15.86:0/891632701 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd19801b070 con 0x7fd1a0165280 2024-09-19T06:41:21.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.403+0000 7fd195ffb640 1 --2- 172.21.15.86:0/891632701 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd18406c3b0 0x7fd18406e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:21.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.403+0000 7fd1a7352640 1 -- 172.21.15.86:0/891632701 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd180005290 con 0x7fd1a0165280 2024-09-19T06:41:21.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.405+0000 7fd195ffb640 1 -- 172.21.15.86:0/891632701 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6907+0+0 (secure 0 0 0) 0x7fd19808b230 con 0x7fd1a0165280 2024-09-19T06:41:21.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.410+0000 7fd1a50ee640 1 --2- 172.21.15.86:0/891632701 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd18406c3b0 0x7fd18406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:21.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.411+0000 7fd1a50ee640 1 --2- 172.21.15.86:0/891632701 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd18406c3b0 0x7fd18406e870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd19c038000 tx=0x7fd19c009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:21.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.414+0000 7fd195ffb640 1 -- 172.21.15.86:0/891632701 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd198059440 con 0x7fd1a0165280 2024-09-19T06:41:21.868 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.866+0000 7fd1a7352640 1 -- 172.21.15.86:0/891632701 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd180005580 con 0x7fd1a0165280 2024-09-19T06:41:21.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.868+0000 7fd195ffb640 1 -- 172.21.15.86:0/891632701 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6880 (secure 0 0 0) 0x7fd198058d40 con 0x7fd1a0165280 2024-09-19T06:41:21.870 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:41:21.870 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":19,"btime":"2024-09-19T06:41:19:619629+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4998,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1006149510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1006149510},{"type":"v1","addr":"172.21.15.86:6839","nonce":1006149510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:41:14.610623+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4762},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4762":{"gid":4762,"name":"d","rank":0,"incarnation":15,"state":"up:active","state_seq":26,"addr":"172.21.15.169:6837/2213887583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2213887583},{"type":"v1","addr":"172.21.15.169:6837","nonce":2213887583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4762,"qdb_cluster":[4762]},"id":1}]} 2024-09-19T06:41:21.870 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 19 2024-09-19T06:41:21.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.875+0000 7fd1a7352640 1 -- 172.21.15.86:0/891632701 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd18406c3b0 msgr2=0x7fd18406e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:21.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.875+0000 7fd1a7352640 1 --2- 172.21.15.86:0/891632701 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd18406c3b0 0x7fd18406e870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd19c038000 tx=0x7fd19c009000 comp rx=0 tx=0).stop 2024-09-19T06:41:21.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.875+0000 7fd1a7352640 1 -- 172.21.15.86:0/891632701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd1a0165280 msgr2=0x7fd1a0169400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:21.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.875+0000 7fd1a7352640 1 --2- 172.21.15.86:0/891632701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd1a0165280 0x7fd1a0169400 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd19800c7c0 tx=0x7fd19800cc80 comp rx=0 tx=0).stop 2024-09-19T06:41:21.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.877+0000 7fd1a7352640 1 -- 172.21.15.86:0/891632701 shutdown_connections 2024-09-19T06:41:21.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.877+0000 7fd1a7352640 1 --2- 172.21.15.86:0/891632701 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd18406c3b0 0x7fd18406e870 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:21.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.877+0000 7fd1a7352640 1 --2- 172.21.15.86:0/891632701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd1a016ad50 0x7fd1a0169940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:21.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.877+0000 7fd1a7352640 1 --2- 172.21.15.86:0/891632701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd1a0165280 0x7fd1a0169400 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:21.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.877+0000 7fd1a7352640 1 --2- 172.21.15.86:0/891632701 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd1a0068850 0x7fd1a016b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:21.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.877+0000 7fd1a7352640 1 -- 172.21.15.86:0/891632701 >> 172.21.15.86:0/891632701 conn(0x7fd1a006e820 msgr2=0x7fd1a0162cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:21.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.878+0000 7fd1a7352640 1 -- 172.21.15.86:0/891632701 shutdown_connections 2024-09-19T06:41:21.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:21.878+0000 7fd1a7352640 1 -- 172.21.15.86:0/891632701 wait complete. 2024-09-19T06:41:21.899 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e reported in up:standby state 2024-09-19T06:41:21.900 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 28 secs before thrashing 2024-09-19T06:41:22.877 INFO:tasks.ceph.mds.d.smithi169.stderr:2024-09-19T06:41:22.876+0000 7fac6fcfb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T06:41:39.370 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:41:39.377 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:41:49.901 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:41:50.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3ffcd0640 1 Processor -- start 2024-09-19T06:41:50.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3ffcd0640 1 -- start start 2024-09-19T06:41:50.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3ffcd0640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe3f8072850 0x7fe3f8162830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3ffcd0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3f8072c80 0x7fe3f8162d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3ffcd0640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3f806bf00 con 0x7fe3f8155b80 2024-09-19T06:41:50.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3ffcd0640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe3f806cc10 con 0x7fe3f8072850 2024-09-19T06:41:50.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3ffcd0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe3f806c1e0 con 0x7fe3f8072c80 2024-09-19T06:41:50.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3fda6c640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe3f8155b80 0x7fe3f806d940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:47370/0 (socket says 172.21.15.86:47370) 2024-09-19T06:41:50.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3fda6c640 1 -- 172.21.15.86:0/2881769514 learned_addr learned my addr 172.21.15.86:0/2881769514 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:41:50.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3fca6a640 1 -- 172.21.15.86:0/2881769514 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 525734688 0 0) 0x7fe3f806bf00 con 0x7fe3f8155b80 2024-09-19T06:41:50.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3fca6a640 1 -- 172.21.15.86:0/2881769514 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3e4003520 con 0x7fe3f8155b80 2024-09-19T06:41:50.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3fca6a640 1 -- 172.21.15.86:0/2881769514 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3580636988 0 0) 0x7fe3e4003520 con 0x7fe3f8155b80 2024-09-19T06:41:50.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3fca6a640 1 -- 172.21.15.86:0/2881769514 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3f8072c80 msgr2=0x7fe3f8162d70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:41:50.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3fca6a640 1 --2- 172.21.15.86:0/2881769514 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3f8072c80 0x7fe3f8162d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3fca6a640 1 -- 172.21.15.86:0/2881769514 >> v2:172.21.15.169:3300/0 conn(0x7fe3f8072850 msgr2=0x7fe3f8162830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:41:50.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3fca6a640 1 --2- 172.21.15.86:0/2881769514 >> v2:172.21.15.169:3300/0 conn(0x7fe3f8072850 0x7fe3f8162830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3fca6a640 1 -- 172.21.15.86:0/2881769514 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f806ce60 con 0x7fe3f8155b80 2024-09-19T06:41:50.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3fca6a640 1 -- 172.21.15.86:0/2881769514 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7fe3f4001670 con 0x7fe3f8155b80 2024-09-19T06:41:50.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3fca6a640 1 -- 172.21.15.86:0/2881769514 >> v1:172.21.15.86:6789/0 conn(0x7fe3f8155b80 legacy=0x7fe3f806d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:50.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3fca6a640 1 --2- 172.21.15.86:0/2881769514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3e40039b0 0x7fe3e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3fca6a640 1 --2- 172.21.15.86:0/2881769514 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3e4004800 0x7fe3e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3fca6a640 1 --2- 172.21.15.86:0/2881769514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3e4005210 0x7fe3e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3fca6a640 1 -- 172.21.15.86:0/2881769514 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f806cc10 con 0x7fe3e4005210 2024-09-19T06:41:50.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3fca6a640 1 -- 172.21.15.86:0/2881769514 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f806c1e0 con 0x7fe3e40039b0 2024-09-19T06:41:50.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3fca6a640 1 -- 172.21.15.86:0/2881769514 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe3e400c1c0 con 0x7fe3e4004800 2024-09-19T06:41:50.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3fe26d640 1 --2- 172.21.15.86:0/2881769514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3e4005210 0x7fe3e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:50.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3fda6c640 1 --2- 172.21.15.86:0/2881769514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3e40039b0 0x7fe3e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:50.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3fe26d640 1 -- 172.21.15.86:0/2881769514 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3e4004800 msgr2=0x7fe3e4004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:41:50.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3fe26d640 1 --2- 172.21.15.86:0/2881769514 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3e4004800 0x7fe3e4004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3fe26d640 1 -- 172.21.15.86:0/2881769514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3e40039b0 msgr2=0x7fe3e4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:50.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3fe26d640 1 --2- 172.21.15.86:0/2881769514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3e40039b0 0x7fe3e4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3fe26d640 1 -- 172.21.15.86:0/2881769514 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f806ce60 con 0x7fe3e4005210 2024-09-19T06:41:50.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.378+0000 7fe3fda6c640 1 --2- 172.21.15.86:0/2881769514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3e40039b0 0x7fe3e4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:50.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.383+0000 7fe3fe26d640 1 --2- 172.21.15.86:0/2881769514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3e4005210 0x7fe3e400b9c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe3f815cda0 tx=0x7fe3e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4019fedbd517892 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:50.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.383+0000 7fe3fca6a640 1 -- 172.21.15.86:0/2881769514 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0009a30 con 0x7fe3e4005210 2024-09-19T06:41:50.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.383+0000 7fe3fca6a640 1 -- 172.21.15.86:0/2881769514 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3f0036070 con 0x7fe3e4005210 2024-09-19T06:41:50.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.383+0000 7fe3fca6a640 1 -- 172.21.15.86:0/2881769514 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0031920 con 0x7fe3e4005210 2024-09-19T06:41:50.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.384+0000 7fe3ffcd0640 1 -- 172.21.15.86:0/2881769514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3e4005210 msgr2=0x7fe3e400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:50.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.384+0000 7fe3ffcd0640 1 --2- 172.21.15.86:0/2881769514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3e4005210 0x7fe3e400b9c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe3f815cda0 tx=0x7fe3e4005830 comp rx=0 tx=0).stop 2024-09-19T06:41:50.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.384+0000 7fe3fe26d640 1 -- 172.21.15.86:0/2881769514 reap_dead start 2024-09-19T06:41:50.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.385+0000 7fe3ffcd0640 1 -- 172.21.15.86:0/2881769514 shutdown_connections 2024-09-19T06:41:50.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.385+0000 7fe3ffcd0640 1 -- 172.21.15.86:0/2881769514 >> 172.21.15.86:0/2881769514 conn(0x7fe3f80ca120 msgr2=0x7fe3f80ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:50.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.385+0000 7fe3ffcd0640 1 -- 172.21.15.86:0/2881769514 shutdown_connections 2024-09-19T06:41:50.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.386+0000 7fe3ffcd0640 1 -- 172.21.15.86:0/2881769514 wait complete. 2024-09-19T06:41:50.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.388+0000 7fe3ffcd0640 1 Processor -- start 2024-09-19T06:41:50.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.388+0000 7fe3ffcd0640 1 -- start start 2024-09-19T06:41:50.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.389+0000 7fe3ffcd0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3e4005210 0x7fe3f80c7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.389+0000 7fe3ffcd0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3f815f9e0 0x7fe3f80c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.389+0000 7fe3ffcd0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3f8150e80 0x7fe3f815e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.389+0000 7fe3ffcd0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f806bbc0 con 0x7fe3f815f9e0 2024-09-19T06:41:50.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.389+0000 7fe3ffcd0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f806d420 con 0x7fe3f8150e80 2024-09-19T06:41:50.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.389+0000 7fe3ffcd0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe3f8155f60 con 0x7fe3e4005210 2024-09-19T06:41:50.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.390+0000 7fe3fda6c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3e4005210 0x7fe3f80c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:50.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.390+0000 7fe3fda6c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3e4005210 0x7fe3f80c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:41878/0 (socket says 172.21.15.86:41878) 2024-09-19T06:41:50.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.390+0000 7fe3fda6c640 1 -- 172.21.15.86:0/1683014051 learned_addr learned my addr 172.21.15.86:0/1683014051 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:41:50.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.390+0000 7fe3fe26d640 1 --2- 172.21.15.86:0/1683014051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3f8150e80 0x7fe3f815e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:50.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.390+0000 7fe3fd26b640 1 --2- 172.21.15.86:0/1683014051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3f815f9e0 0x7fe3f80c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:50.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.390+0000 7fe3fe26d640 1 -- 172.21.15.86:0/1683014051 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3e4005210 msgr2=0x7fe3f80c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:50.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.390+0000 7fe3fe26d640 1 --2- 172.21.15.86:0/1683014051 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3e4005210 0x7fe3f80c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.390+0000 7fe3fe26d640 1 -- 172.21.15.86:0/1683014051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3f815f9e0 msgr2=0x7fe3f80c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:50.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.390+0000 7fe3fe26d640 1 --2- 172.21.15.86:0/1683014051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3f815f9e0 0x7fe3f80c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.390+0000 7fe3fe26d640 1 -- 172.21.15.86:0/1683014051 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f8152aa0 con 0x7fe3f8150e80 2024-09-19T06:41:50.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.390+0000 7fe3fd26b640 1 --2- 172.21.15.86:0/1683014051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3f815f9e0 0x7fe3f80c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:50.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.391+0000 7fe3fe26d640 1 --2- 172.21.15.86:0/1683014051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3f8150e80 0x7fe3f815e200 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe3e400c110 tx=0x7fe3f0004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:50.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.391+0000 7fe3ee7fc640 1 -- 172.21.15.86:0/1683014051 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0045430 con 0x7fe3f8150e80 2024-09-19T06:41:50.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.391+0000 7fe3ee7fc640 1 -- 172.21.15.86:0/1683014051 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3f00455d0 con 0x7fe3f8150e80 2024-09-19T06:41:50.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.391+0000 7fe3ee7fc640 1 -- 172.21.15.86:0/1683014051 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f00459a0 con 0x7fe3f8150e80 2024-09-19T06:41:50.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.391+0000 7fe3ffcd0640 1 -- 172.21.15.86:0/1683014051 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3f8152d70 con 0x7fe3f8150e80 2024-09-19T06:41:50.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.392+0000 7fe3ffcd0640 1 -- 172.21.15.86:0/1683014051 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3f81503a0 con 0x7fe3f8150e80 2024-09-19T06:41:50.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.395+0000 7fe3ee7fc640 1 -- 172.21.15.86:0/1683014051 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe3f003c410 con 0x7fe3f8150e80 2024-09-19T06:41:50.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.395+0000 7fe3ee7fc640 1 --2- 172.21.15.86:0/1683014051 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe3dc06c3b0 0x7fe3dc06e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.396+0000 7fe3ffcd0640 1 -- 172.21.15.86:0/1683014051 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3f806bf00 con 0x7fe3f8150e80 2024-09-19T06:41:50.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.400+0000 7fe3fda6c640 1 --2- 172.21.15.86:0/1683014051 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe3dc06c3b0 0x7fe3dc06e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:50.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.402+0000 7fe3ee7fc640 1 -- 172.21.15.86:0/1683014051 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6907+0+0 (secure 0 0 0) 0x7fe3f00ace60 con 0x7fe3f8150e80 2024-09-19T06:41:50.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.403+0000 7fe3fda6c640 1 --2- 172.21.15.86:0/1683014051 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe3dc06c3b0 0x7fe3dc06e870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe3f40017e0 tx=0x7fe3f4007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:50.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.406+0000 7fe3ee7fc640 1 -- 172.21.15.86:0/1683014051 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe3f806bf00 con 0x7fe3f8150e80 2024-09-19T06:41:50.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.846+0000 7fe3ffcd0640 1 -- 172.21.15.86:0/1683014051 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3f8150190 con 0x7fe3f8150e80 2024-09-19T06:41:50.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.848+0000 7fe3ee7fc640 1 -- 172.21.15.86:0/1683014051 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6880 (secure 0 0 0) 0x7fe3f004b060 con 0x7fe3f8150e80 2024-09-19T06:41:50.850 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:41:50.850 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":19,"btime":"2024-09-19T06:41:19:619629+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4998,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1006149510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1006149510},{"type":"v1","addr":"172.21.15.86:6839","nonce":1006149510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:41:14.610623+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4762},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4762":{"gid":4762,"name":"d","rank":0,"incarnation":15,"state":"up:active","state_seq":26,"addr":"172.21.15.169:6837/2213887583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2213887583},{"type":"v1","addr":"172.21.15.169:6837","nonce":2213887583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4762,"qdb_cluster":[4762]},"id":1}]} 2024-09-19T06:41:50.850 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 19 2024-09-19T06:41:50.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.853+0000 7fe3ffcd0640 1 -- 172.21.15.86:0/1683014051 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe3dc06c3b0 msgr2=0x7fe3dc06e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:50.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.853+0000 7fe3ffcd0640 1 --2- 172.21.15.86:0/1683014051 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe3dc06c3b0 0x7fe3dc06e870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe3f40017e0 tx=0x7fe3f4007040 comp rx=0 tx=0).stop 2024-09-19T06:41:50.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.853+0000 7fe3ffcd0640 1 -- 172.21.15.86:0/1683014051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3f8150e80 msgr2=0x7fe3f815e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:50.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.853+0000 7fe3ffcd0640 1 --2- 172.21.15.86:0/1683014051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3f8150e80 0x7fe3f815e200 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe3e400c110 tx=0x7fe3f0004ab0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.853+0000 7fe3ffcd0640 1 -- 172.21.15.86:0/1683014051 shutdown_connections 2024-09-19T06:41:50.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.853+0000 7fe3ffcd0640 1 --2- 172.21.15.86:0/1683014051 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe3dc06c3b0 0x7fe3dc06e870 secure :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe3f40017e0 tx=0x7fe3f4007040 comp rx=0 tx=0).stop 2024-09-19T06:41:50.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.853+0000 7fe3ffcd0640 1 --2- 172.21.15.86:0/1683014051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3f8150e80 0x7fe3f815e200 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.853+0000 7fe3ffcd0640 1 --2- 172.21.15.86:0/1683014051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3f815f9e0 0x7fe3f80c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.853+0000 7fe3ffcd0640 1 --2- 172.21.15.86:0/1683014051 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3e4005210 0x7fe3f80c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.853+0000 7fe3ffcd0640 1 -- 172.21.15.86:0/1683014051 >> 172.21.15.86:0/1683014051 conn(0x7fe3f80ca120 msgr2=0x7fe3f80cc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:50.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.853+0000 7fe3ffcd0640 1 -- 172.21.15.86:0/1683014051 shutdown_connections 2024-09-19T06:41:50.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:50.853+0000 7fe3ffcd0640 1 -- 172.21.15.86:0/1683014051 wait complete. 2024-09-19T06:41:50.877 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.d (rank=0) 2024-09-19T06:41:50.877 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T06:41:50.877 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:41:50.900 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T06:41:50.900 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:41:51.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.081+0000 7f41cb65e640 1 Processor -- start 2024-09-19T06:41:51.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.082+0000 7f41cb65e640 1 -- start start 2024-09-19T06:41:51.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.083+0000 7f41cb65e640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f41c406bbc0 0x7f41c4156e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:51.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.083+0000 7f41cb65e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f41c40c8a00 0x7f41c40c7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:51.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.083+0000 7f41cb65e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41c41515a0 con 0x7f41c41511c0 2024-09-19T06:41:51.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.083+0000 7f41cb65e640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f41c4071e30 con 0x7f41c406bbc0 2024-09-19T06:41:51.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.083+0000 7f41cb65e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f41c4157780 con 0x7f41c40c8a00 2024-09-19T06:41:51.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.084+0000 7f41c93fa640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f41c41511c0 0x7f41c40722c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:36672/0 (socket says 172.21.15.86:36672) 2024-09-19T06:41:51.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.084+0000 7f41c93fa640 1 -- 172.21.15.86:0/2045581493 learned_addr learned my addr 172.21.15.86:0/2045581493 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:41:51.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.084+0000 7f41c8bf9640 1 --2- 172.21.15.86:0/2045581493 >> v2:172.21.15.86:3300/0 conn(0x7f41c406bbc0 0x7f41c4156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:51.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.084+0000 7f41c9bfb640 1 --2- 172.21.15.86:0/2045581493 >> v2:172.21.15.169:3300/0 conn(0x7f41c40c8a00 0x7f41c40c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:51.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.085+0000 7f41c8bf9640 1 -- 172.21.15.86:0/2045581493 >> v2:172.21.15.169:3300/0 conn(0x7f41c40c8a00 msgr2=0x7f41c40c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:51.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.085+0000 7f41c8bf9640 1 --2- 172.21.15.86:0/2045581493 >> v2:172.21.15.169:3300/0 conn(0x7f41c40c8a00 0x7f41c40c7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.085+0000 7f41c8bf9640 1 -- 172.21.15.86:0/2045581493 >> v1:172.21.15.169:6789/0 conn(0x7f41c41511c0 legacy=0x7f41c40722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:51.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.085+0000 7f41c8bf9640 1 -- 172.21.15.86:0/2045581493 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c4157a60 con 0x7f41c406bbc0 2024-09-19T06:41:51.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.086+0000 7f41c8bf9640 1 --2- 172.21.15.86:0/2045581493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41c406bbc0 0x7f41c4156e60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f41c40c8e90 tx=0x7f41b402a3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d87ad3b96de37b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:51.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.086+0000 7f41bbfff640 1 -- 172.21.15.86:0/2045581493 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b4037070 con 0x7f41c406bbc0 2024-09-19T06:41:51.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.087+0000 7f41bbfff640 1 -- 172.21.15.86:0/2045581493 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b4032440 con 0x7f41c406bbc0 2024-09-19T06:41:51.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.088+0000 7f41cb65e640 1 -- 172.21.15.86:0/2045581493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41c406bbc0 msgr2=0x7f41c4156e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:51.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.088+0000 7f41cb65e640 1 --2- 172.21.15.86:0/2045581493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41c406bbc0 0x7f41c4156e60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f41c40c8e90 tx=0x7f41b402a3b0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.088+0000 7f41cb65e640 1 -- 172.21.15.86:0/2045581493 shutdown_connections 2024-09-19T06:41:51.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.088+0000 7f41cb65e640 1 --2- 172.21.15.86:0/2045581493 >> v2:172.21.15.169:3300/0 conn(0x7f41c40c8a00 0x7f41c40c7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.088+0000 7f41cb65e640 1 --2- 172.21.15.86:0/2045581493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41c406bbc0 0x7f41c4156e60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.088+0000 7f41cb65e640 1 -- 172.21.15.86:0/2045581493 >> 172.21.15.86:0/2045581493 conn(0x7f41c406e820 msgr2=0x7f41c406ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:51.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.089+0000 7f41cb65e640 1 -- 172.21.15.86:0/2045581493 shutdown_connections 2024-09-19T06:41:51.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.090+0000 7f41cb65e640 1 -- 172.21.15.86:0/2045581493 wait complete. 2024-09-19T06:41:51.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.091+0000 7f41cb65e640 1 Processor -- start 2024-09-19T06:41:51.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.092+0000 7f41cb65e640 1 -- start start 2024-09-19T06:41:51.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.093+0000 7f41cb65e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41c40c8a00 0x7f41c41ef2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:51.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.093+0000 7f41cb65e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41c41511c0 0x7f41c41efa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:51.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.093+0000 7f41cb65e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41c4156050 0x7f41c4200a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:51.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.093+0000 7f41cb65e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f41c4071ac0 con 0x7f41c40c8a00 2024-09-19T06:41:51.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.093+0000 7f41cb65e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f41c40717e0 con 0x7f41c41511c0 2024-09-19T06:41:51.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.093+0000 7f41cb65e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f41c4071390 con 0x7f41c4156050 2024-09-19T06:41:51.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.093+0000 7f41c9bfb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41c4156050 0x7f41c4200a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:51.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.093+0000 7f41c9bfb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41c4156050 0x7f41c4200a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:41884/0 (socket says 172.21.15.86:41884) 2024-09-19T06:41:51.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.094+0000 7f41c9bfb640 1 -- 172.21.15.86:0/1632908507 learned_addr learned my addr 172.21.15.86:0/1632908507 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:41:51.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.094+0000 7f41c93fa640 1 --2- 172.21.15.86:0/1632908507 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41c40c8a00 0x7f41c41ef2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:51.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.094+0000 7f41c9bfb640 1 -- 172.21.15.86:0/1632908507 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41c41511c0 msgr2=0x7f41c41efa50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:41:51.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.094+0000 7f41c9bfb640 1 --2- 172.21.15.86:0/1632908507 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41c41511c0 0x7f41c41efa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.094+0000 7f41c9bfb640 1 -- 172.21.15.86:0/1632908507 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41c40c8a00 msgr2=0x7f41c41ef2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:51.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.095+0000 7f41c9bfb640 1 --2- 172.21.15.86:0/1632908507 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41c40c8a00 0x7f41c41ef2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.095+0000 7f41c9bfb640 1 -- 172.21.15.86:0/1632908507 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c4151870 con 0x7f41c4156050 2024-09-19T06:41:51.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.095+0000 7f41c93fa640 1 --2- 172.21.15.86:0/1632908507 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41c40c8a00 0x7f41c41ef2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:51.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.096+0000 7f41c9bfb640 1 --2- 172.21.15.86:0/1632908507 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41c4156050 0x7f41c4200a30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00d360 tx=0x7f41bc00d820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:51.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.100+0000 7f41b9ffb640 1 -- 172.21.15.86:0/1632908507 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc00a7d0 con 0x7f41c4156050 2024-09-19T06:41:51.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.100+0000 7f41b9ffb640 1 -- 172.21.15.86:0/1632908507 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41bc00de50 con 0x7f41c4156050 2024-09-19T06:41:51.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.100+0000 7f41b9ffb640 1 -- 172.21.15.86:0/1632908507 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc00abd0 con 0x7f41c4156050 2024-09-19T06:41:51.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.100+0000 7f41cb65e640 1 -- 172.21.15.86:0/1632908507 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41c4155570 con 0x7f41c4156050 2024-09-19T06:41:51.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.101+0000 7f41cb65e640 1 -- 172.21.15.86:0/1632908507 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f41c41f36b0 con 0x7f41c4156050 2024-09-19T06:41:51.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.104+0000 7f41cb65e640 1 -- 172.21.15.86:0/1632908507 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41a4005290 con 0x7f41c4156050 2024-09-19T06:41:51.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.106+0000 7f41b9ffb640 1 -- 172.21.15.86:0/1632908507 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f41bc03b5d0 con 0x7f41c4156050 2024-09-19T06:41:51.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.107+0000 7f41b9ffb640 1 --2- 172.21.15.86:0/1632908507 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f41a806c300 0x7f41a806e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:51.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.107+0000 7f41c93fa640 1 --2- 172.21.15.86:0/1632908507 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f41a806c300 0x7f41a806e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:51.109 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.107+0000 7f41b9ffb640 1 -- 172.21.15.86:0/1632908507 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 6907+0+0 (secure 0 0 0) 0x7f41bc08c7f0 con 0x7f41c4156050 2024-09-19T06:41:51.109 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.108+0000 7f41c93fa640 1 --2- 172.21.15.86:0/1632908507 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f41a806c300 0x7f41a806e7c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f41c0006110 tx=0x7f41c0006020 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:51.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.115+0000 7f41b9ffb640 1 -- 172.21.15.86:0/1632908507 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f41bc05ab20 con 0x7f41c4156050 2024-09-19T06:41:51.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.561+0000 7f41cb65e640 1 -- 172.21.15.86:0/1632908507 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41a4005580 con 0x7f41c4156050 2024-09-19T06:41:51.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.562+0000 7f41b9ffb640 1 -- 172.21.15.86:0/1632908507 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6880 (secure 0 0 0) 0x7f41bc00b440 con 0x7f41c4156050 2024-09-19T06:41:51.566 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:41:51.566 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":19,"btime":"2024-09-19T06:41:19:619629+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4998,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1006149510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1006149510},{"type":"v1","addr":"172.21.15.86:6839","nonce":1006149510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:41:14.610623+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4762},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4762":{"gid":4762,"name":"d","rank":0,"incarnation":15,"state":"up:active","state_seq":26,"addr":"172.21.15.169:6837/2213887583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2213887583},{"type":"v1","addr":"172.21.15.169:6837","nonce":2213887583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4762,"qdb_cluster":[4762]},"id":1}]} 2024-09-19T06:41:51.567 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 19 2024-09-19T06:41:51.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.568+0000 7f41cb65e640 1 -- 172.21.15.86:0/1632908507 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f41a806c300 msgr2=0x7f41a806e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:51.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.568+0000 7f41cb65e640 1 --2- 172.21.15.86:0/1632908507 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f41a806c300 0x7f41a806e7c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f41c0006110 tx=0x7f41c0006020 comp rx=0 tx=0).stop 2024-09-19T06:41:51.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.568+0000 7f41cb65e640 1 -- 172.21.15.86:0/1632908507 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41c4156050 msgr2=0x7f41c4200a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:51.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.568+0000 7f41cb65e640 1 --2- 172.21.15.86:0/1632908507 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41c4156050 0x7f41c4200a30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00d360 tx=0x7f41bc00d820 comp rx=0 tx=0).stop 2024-09-19T06:41:51.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.570+0000 7f41cb65e640 1 -- 172.21.15.86:0/1632908507 shutdown_connections 2024-09-19T06:41:51.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.570+0000 7f41cb65e640 1 --2- 172.21.15.86:0/1632908507 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f41a806c300 0x7f41a806e7c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.570+0000 7f41cb65e640 1 --2- 172.21.15.86:0/1632908507 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41c4156050 0x7f41c4200a30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.570+0000 7f41cb65e640 1 --2- 172.21.15.86:0/1632908507 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41c41511c0 0x7f41c41efa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.570+0000 7f41cb65e640 1 --2- 172.21.15.86:0/1632908507 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41c40c8a00 0x7f41c41ef2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.570+0000 7f41cb65e640 1 -- 172.21.15.86:0/1632908507 >> 172.21.15.86:0/1632908507 conn(0x7f41c406e820 msgr2=0x7f41c414f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:51.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.570+0000 7f41cb65e640 1 -- 172.21.15.86:0/1632908507 shutdown_connections 2024-09-19T06:41:51.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:51.570+0000 7f41cb65e640 1 -- 172.21.15.86:0/1632908507 wait complete. 2024-09-19T06:41:51.603 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-09-19T06:41:53.604 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:41:53.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.788+0000 7fa7e3326640 1 Processor -- start 2024-09-19T06:41:53.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.788+0000 7fa7e3326640 1 -- start start 2024-09-19T06:41:53.791 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.789+0000 7fa7e3326640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa7dc152050 0x7fa7dc157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:53.791 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.789+0000 7fa7e3326640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa7dc15bb10 0x7fa7dc0c8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:53.791 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.789+0000 7fa7e3326640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7dc158310 con 0x7fa7dc0ca530 2024-09-19T06:41:53.791 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.789+0000 7fa7e3326640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fa7dc158bb0 con 0x7fa7dc15bb10 2024-09-19T06:41:53.791 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.789+0000 7fa7e3326640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fa7dc1585f0 con 0x7fa7dc152050 2024-09-19T06:41:53.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.790+0000 7fa7e18c3640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fa7dc0ca530 0x7fa7dc06ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:55426/0 (socket says 172.21.15.86:55426) 2024-09-19T06:41:53.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.790+0000 7fa7e08c1640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa7dc15bb10 0x7fa7dc0c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:53.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.790+0000 7fa7e08c1640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa7dc15bb10 0x7fa7dc0c8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60760/0 (socket says 172.21.15.86:60760) 2024-09-19T06:41:53.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.790+0000 7fa7e08c1640 1 -- 172.21.15.86:0/2315630562 learned_addr learned my addr 172.21.15.86:0/2315630562 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:41:53.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.790+0000 7fa7e10c2640 1 --2- 172.21.15.86:0/2315630562 >> v2:172.21.15.169:3300/0 conn(0x7fa7dc152050 0x7fa7dc157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:53.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.790+0000 7fa7e08c1640 1 -- 172.21.15.86:0/2315630562 >> v2:172.21.15.169:3300/0 conn(0x7fa7dc152050 msgr2=0x7fa7dc157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:53.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.790+0000 7fa7e08c1640 1 --2- 172.21.15.86:0/2315630562 >> v2:172.21.15.169:3300/0 conn(0x7fa7dc152050 0x7fa7dc157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:53.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.790+0000 7fa7e08c1640 1 -- 172.21.15.86:0/2315630562 >> v1:172.21.15.169:6789/0 conn(0x7fa7dc0ca530 legacy=0x7fa7dc06ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:53.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.791+0000 7fa7e08c1640 1 -- 172.21.15.86:0/2315630562 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7dc1588d0 con 0x7fa7dc15bb10 2024-09-19T06:41:53.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.792+0000 7fa7e08c1640 1 --2- 172.21.15.86:0/2315630562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7dc15bb10 0x7fa7dc0c8830 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc0cb260 tx=0x7fa7d402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918858d356e04876 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:53.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.792+0000 7fa7d3fff640 1 -- 172.21.15.86:0/2315630562 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4036070 con 0x7fa7dc15bb10 2024-09-19T06:41:53.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.792+0000 7fa7d3fff640 1 -- 172.21.15.86:0/2315630562 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7d4031600 con 0x7fa7dc15bb10 2024-09-19T06:41:53.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.793+0000 7fa7e3326640 1 -- 172.21.15.86:0/2315630562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7dc15bb10 msgr2=0x7fa7dc0c8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:53.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.793+0000 7fa7d3fff640 1 -- 172.21.15.86:0/2315630562 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4036070 con 0x7fa7dc15bb10 2024-09-19T06:41:53.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.793+0000 7fa7e3326640 1 --2- 172.21.15.86:0/2315630562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7dc15bb10 0x7fa7dc0c8830 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc0cb260 tx=0x7fa7d402a6a0 comp rx=0 tx=0).stop 2024-09-19T06:41:53.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.796+0000 7fa7e3326640 1 -- 172.21.15.86:0/2315630562 shutdown_connections 2024-09-19T06:41:53.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.796+0000 7fa7e3326640 1 --2- 172.21.15.86:0/2315630562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7dc15bb10 0x7fa7dc0c8830 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:53.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.796+0000 7fa7e3326640 1 --2- 172.21.15.86:0/2315630562 >> v2:172.21.15.169:3300/0 conn(0x7fa7dc152050 0x7fa7dc157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:53.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.796+0000 7fa7e3326640 1 -- 172.21.15.86:0/2315630562 >> 172.21.15.86:0/2315630562 conn(0x7fa7dc06fd60 msgr2=0x7fa7dc070140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:53.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.797+0000 7fa7e3326640 1 -- 172.21.15.86:0/2315630562 shutdown_connections 2024-09-19T06:41:53.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.797+0000 7fa7e3326640 1 -- 172.21.15.86:0/2315630562 wait complete. 2024-09-19T06:41:53.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.797+0000 7fa7e3326640 1 Processor -- start 2024-09-19T06:41:53.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.797+0000 7fa7e3326640 1 -- start start 2024-09-19T06:41:53.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.797+0000 7fa7e3326640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7dc0ca530 0x7fa7dc1418f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:53.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.797+0000 7fa7e3326640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa7dc152050 0x7fa7dc071eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:53.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.797+0000 7fa7e3326640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7dc15bb10 0x7fa7dc159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:53.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.797+0000 7fa7e3326640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa7dc0c4810 con 0x7fa7dc0ca530 2024-09-19T06:41:53.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.797+0000 7fa7e3326640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa7dc15b5f0 con 0x7fa7dc15bb10 2024-09-19T06:41:53.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.797+0000 7fa7e3326640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa7dc0c8d70 con 0x7fa7dc152050 2024-09-19T06:41:53.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.797+0000 7fa7e10c2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7dc0ca530 0x7fa7dc1418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:53.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.797+0000 7fa7e10c2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7dc0ca530 0x7fa7dc1418f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60768/0 (socket says 172.21.15.86:60768) 2024-09-19T06:41:53.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.797+0000 7fa7e10c2640 1 -- 172.21.15.86:0/1278694693 learned_addr learned my addr 172.21.15.86:0/1278694693 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:41:53.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.797+0000 7fa7e10c2640 1 -- 172.21.15.86:0/1278694693 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa7dc152050 msgr2=0x7fa7dc071eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:53.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.797+0000 7fa7e10c2640 1 --2- 172.21.15.86:0/1278694693 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa7dc152050 0x7fa7dc071eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:53.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.797+0000 7fa7e10c2640 1 -- 172.21.15.86:0/1278694693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7dc15bb10 msgr2=0x7fa7dc159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:53.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.797+0000 7fa7e10c2640 1 --2- 172.21.15.86:0/1278694693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7dc15bb10 0x7fa7dc159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:53.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.797+0000 7fa7e10c2640 1 -- 172.21.15.86:0/1278694693 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7dc150540 con 0x7fa7dc0ca530 2024-09-19T06:41:53.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.797+0000 7fa7e10c2640 1 --2- 172.21.15.86:0/1278694693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7dc0ca530 0x7fa7dc1418f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8007e90 tx=0x7fa7d800dbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:53.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.803+0000 7fa7d1ffb640 1 -- 172.21.15.86:0/1278694693 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d800ba50 con 0x7fa7dc0ca530 2024-09-19T06:41:53.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.803+0000 7fa7d1ffb640 1 -- 172.21.15.86:0/1278694693 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7d800bbf0 con 0x7fa7dc0ca530 2024-09-19T06:41:53.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.805+0000 7fa7e3326640 1 -- 172.21.15.86:0/1278694693 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7dc150d60 con 0x7fa7dc0ca530 2024-09-19T06:41:53.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.805+0000 7fa7e3326640 1 -- 172.21.15.86:0/1278694693 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7dc151320 con 0x7fa7dc0ca530 2024-09-19T06:41:53.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.805+0000 7fa7d1ffb640 1 -- 172.21.15.86:0/1278694693 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d800de20 con 0x7fa7dc0ca530 2024-09-19T06:41:53.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.805+0000 7fa7d1ffb640 1 -- 172.21.15.86:0/1278694693 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa7d80125e0 con 0x7fa7dc0ca530 2024-09-19T06:41:53.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.805+0000 7fa7d1ffb640 1 --2- 172.21.15.86:0/1278694693 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa7c006c300 0x7fa7c006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:53.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.805+0000 7fa7d1ffb640 1 -- 172.21.15.86:0/1278694693 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6907+0+0 (secure 0 0 0) 0x7fa7d808fc20 con 0x7fa7dc0ca530 2024-09-19T06:41:53.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.805+0000 7fa7e08c1640 1 --2- 172.21.15.86:0/1278694693 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa7c006c300 0x7fa7c006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:53.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.810+0000 7fa7e08c1640 1 --2- 172.21.15.86:0/1278694693 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa7c006c300 0x7fa7c006e7c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4033000 tx=0x7fa7d402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:53.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.810+0000 7fa7e3326640 1 -- 172.21.15.86:0/1278694693 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7dc15bf60 con 0x7fa7dc0ca530 2024-09-19T06:41:53.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:53.823+0000 7fa7d1ffb640 1 -- 172.21.15.86:0/1278694693 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa7d805ded0 con 0x7fa7dc0ca530 2024-09-19T06:41:54.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:54.262+0000 7fa7e3326640 1 -- 172.21.15.86:0/1278694693 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7dc0c99c0 con 0x7fa7dc0ca530 2024-09-19T06:41:54.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:54.263+0000 7fa7d1ffb640 1 -- 172.21.15.86:0/1278694693 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6880 (secure 0 0 0) 0x7fa7d805d7d0 con 0x7fa7dc0ca530 2024-09-19T06:41:54.267 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:41:54.267 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":19,"btime":"2024-09-19T06:41:19:619629+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4998,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1006149510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1006149510},{"type":"v1","addr":"172.21.15.86:6839","nonce":1006149510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:41:14.610623+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4762},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4762":{"gid":4762,"name":"d","rank":0,"incarnation":15,"state":"up:active","state_seq":26,"addr":"172.21.15.169:6837/2213887583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2213887583},{"type":"v1","addr":"172.21.15.169:6837","nonce":2213887583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4762,"qdb_cluster":[4762]},"id":1}]} 2024-09-19T06:41:54.268 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 19 2024-09-19T06:41:54.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:54.266+0000 7fa7e3326640 1 -- 172.21.15.86:0/1278694693 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa7c006c300 msgr2=0x7fa7c006e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:54.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:54.266+0000 7fa7e3326640 1 --2- 172.21.15.86:0/1278694693 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa7c006c300 0x7fa7c006e7c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4033000 tx=0x7fa7d402e000 comp rx=0 tx=0).stop 2024-09-19T06:41:54.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:54.266+0000 7fa7e3326640 1 -- 172.21.15.86:0/1278694693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7dc0ca530 msgr2=0x7fa7dc1418f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:54.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:54.266+0000 7fa7e3326640 1 --2- 172.21.15.86:0/1278694693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7dc0ca530 0x7fa7dc1418f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8007e90 tx=0x7fa7d800dbd0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:54.268+0000 7fa7e3326640 1 -- 172.21.15.86:0/1278694693 shutdown_connections 2024-09-19T06:41:54.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:54.268+0000 7fa7e3326640 1 --2- 172.21.15.86:0/1278694693 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa7c006c300 0x7fa7c006e7c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:54.268+0000 7fa7e3326640 1 --2- 172.21.15.86:0/1278694693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7dc15bb10 0x7fa7dc159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:54.268+0000 7fa7e3326640 1 --2- 172.21.15.86:0/1278694693 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa7dc152050 0x7fa7dc071eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:54.268+0000 7fa7e3326640 1 --2- 172.21.15.86:0/1278694693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7dc0ca530 0x7fa7dc1418f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:54.268+0000 7fa7e3326640 1 -- 172.21.15.86:0/1278694693 >> 172.21.15.86:0/1278694693 conn(0x7fa7dc06fd60 msgr2=0x7fa7dc0cbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:54.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:54.271+0000 7fa7e3326640 1 -- 172.21.15.86:0/1278694693 shutdown_connections 2024-09-19T06:41:54.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:54.271+0000 7fa7e3326640 1 -- 172.21.15.86:0/1278694693 wait complete. 2024-09-19T06:41:54.294 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-09-19T06:41:56.296 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:41:56.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.474+0000 7f85d4d49640 1 Processor -- start 2024-09-19T06:41:56.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.474+0000 7f85d4d49640 1 -- start start 2024-09-19T06:41:56.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.476+0000 7f85d4d49640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85d00c8050 0x7f85d00c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:56.478 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.476+0000 7f85d4d49640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f85d00c8430 0x7f85d00c2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:56.478 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.476+0000 7f85d4d49640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85d0158560 con 0x7f85d00c9010 2024-09-19T06:41:56.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.477+0000 7f85ced9d640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f85d00c9010 0x7f85d0151460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:55436/0 (socket says 172.21.15.86:55436) 2024-09-19T06:41:56.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.477+0000 7f85ced9d640 1 -- 172.21.15.86:0/3563926772 learned_addr learned my addr 172.21.15.86:0/3563926772 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:41:56.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.477+0000 7f85d4d49640 1 -- 172.21.15.86:0/3563926772 --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f85d006ce10 con 0x7f85d00c8430 2024-09-19T06:41:56.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.477+0000 7f85d4d49640 1 -- 172.21.15.86:0/3563926772 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f85d006d0f0 con 0x7f85d00c8050 2024-09-19T06:41:56.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.479+0000 7f85ce59c640 1 --2- 172.21.15.86:0/3563926772 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85d00c8050 0x7f85d00c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:56.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.479+0000 7f85cd59a640 1 -- 172.21.15.86:0/3563926772 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1628258833 0 0) 0x7f85d0158560 con 0x7f85d00c9010 2024-09-19T06:41:56.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.479+0000 7f85cd59a640 1 -- 172.21.15.86:0/3563926772 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85b8004630 con 0x7f85d00c9010 2024-09-19T06:41:56.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.479+0000 7f85ce59c640 1 -- 172.21.15.86:0/3563926772 >> v2:172.21.15.169:3300/0 conn(0x7f85d00c8430 msgr2=0x7f85d00c2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:56.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.479+0000 7f85cd59a640 1 -- 172.21.15.86:0/3563926772 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 801226299 0 0) 0x7f85b8004630 con 0x7f85d00c9010 2024-09-19T06:41:56.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.481+0000 7f85cdd9b640 1 --2- 172.21.15.86:0/3563926772 >> v2:172.21.15.169:3300/0 conn(0x7f85d00c8430 0x7f85d00c2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:56.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.481+0000 7f85ce59c640 1 --2- 172.21.15.86:0/3563926772 >> v2:172.21.15.169:3300/0 conn(0x7f85d00c8430 0x7f85d00c2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:56.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.481+0000 7f85ce59c640 1 -- 172.21.15.86:0/3563926772 >> v1:172.21.15.169:6789/0 conn(0x7f85d00c9010 legacy=0x7f85d0151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:56.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.481+0000 7f85ce59c640 1 -- 172.21.15.86:0/3563926772 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d006d3d0 con 0x7f85d00c8050 2024-09-19T06:41:56.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.483+0000 7f85ce59c640 1 --2- 172.21.15.86:0/3563926772 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85d00c8050 0x7f85d00c2050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f85c00097a0 tx=0x7f85c002a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdb2e670e1a53f70 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:56.487 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.485+0000 7f85cd59a640 1 -- 172.21.15.86:0/3563926772 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c0037070 con 0x7f85d00c8050 2024-09-19T06:41:56.487 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.485+0000 7f85cd59a640 1 -- 172.21.15.86:0/3563926772 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85c002abc0 con 0x7f85d00c8050 2024-09-19T06:41:56.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.485+0000 7f85cd59a640 1 -- 172.21.15.86:0/3563926772 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c80019f0 con 0x7f85d00c8050 2024-09-19T06:41:56.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.486+0000 7f85d4d49640 1 -- 172.21.15.86:0/3563926772 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85d00c8050 msgr2=0x7f85d00c2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:56.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.486+0000 7f85d4d49640 1 --2- 172.21.15.86:0/3563926772 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85d00c8050 0x7f85d00c2050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f85c00097a0 tx=0x7f85c002a130 comp rx=0 tx=0).stop 2024-09-19T06:41:56.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.486+0000 7f85d4d49640 1 -- 172.21.15.86:0/3563926772 shutdown_connections 2024-09-19T06:41:56.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.486+0000 7f85d4d49640 1 --2- 172.21.15.86:0/3563926772 >> v2:172.21.15.169:3300/0 conn(0x7f85d00c8430 0x7f85d00c2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:56.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.486+0000 7f85d4d49640 1 --2- 172.21.15.86:0/3563926772 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85d00c8050 0x7f85d00c2050 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f85c00097a0 tx=0x7f85c002a130 comp rx=0 tx=0).stop 2024-09-19T06:41:56.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.486+0000 7f85d4d49640 1 -- 172.21.15.86:0/3563926772 >> 172.21.15.86:0/3563926772 conn(0x7f85d00cd030 msgr2=0x7f85d00cd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:56.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.488+0000 7f85d4d49640 1 -- 172.21.15.86:0/3563926772 shutdown_connections 2024-09-19T06:41:56.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.488+0000 7f85d4d49640 1 -- 172.21.15.86:0/3563926772 wait complete. 2024-09-19T06:41:56.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.490+0000 7f85d4d49640 1 Processor -- start 2024-09-19T06:41:56.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.490+0000 7f85d4d49640 1 -- start start 2024-09-19T06:41:56.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.491+0000 7f85d4d49640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85d00c8430 0x7f85d01589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:56.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.491+0000 7f85d4d49640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85d00c9010 0x7f85d014e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:56.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.491+0000 7f85d4d49640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85d0157f40 0x7f85d014ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:56.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.492+0000 7f85d4d49640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f85d0073f80 con 0x7f85d0157f40 2024-09-19T06:41:56.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.492+0000 7f85d4d49640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f85d006d990 con 0x7f85d00c8430 2024-09-19T06:41:56.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.492+0000 7f85d4d49640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f85d0074100 con 0x7f85d00c9010 2024-09-19T06:41:56.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.492+0000 7f85ced9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85d0157f40 0x7f85d014ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:56.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.492+0000 7f85ced9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85d0157f40 0x7f85d014ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60784/0 (socket says 172.21.15.86:60784) 2024-09-19T06:41:56.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.492+0000 7f85ced9d640 1 -- 172.21.15.86:0/1175376789 learned_addr learned my addr 172.21.15.86:0/1175376789 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:41:56.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.493+0000 7f85ced9d640 1 -- 172.21.15.86:0/1175376789 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85d00c9010 msgr2=0x7f85d014e840 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:41:56.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.493+0000 7f85ced9d640 1 --2- 172.21.15.86:0/1175376789 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85d00c9010 0x7f85d014e840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:56.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.493+0000 7f85ced9d640 1 -- 172.21.15.86:0/1175376789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85d00c8430 msgr2=0x7f85d01589a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:41:56.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.493+0000 7f85ced9d640 1 --2- 172.21.15.86:0/1175376789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85d00c8430 0x7f85d01589a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:56.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.493+0000 7f85ced9d640 1 -- 172.21.15.86:0/1175376789 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d0154f70 con 0x7f85d0157f40 2024-09-19T06:41:56.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.493+0000 7f85ced9d640 1 --2- 172.21.15.86:0/1175376789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85d0157f40 0x7f85d014ed80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f85c800cc00 tx=0x7f85c800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:56.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.494+0000 7f85beffd640 1 -- 172.21.15.86:0/1175376789 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c8017070 con 0x7f85d0157f40 2024-09-19T06:41:56.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.494+0000 7f85beffd640 1 -- 172.21.15.86:0/1175376789 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85c800aca0 con 0x7f85d0157f40 2024-09-19T06:41:56.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.494+0000 7f85beffd640 1 -- 172.21.15.86:0/1175376789 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c8012600 con 0x7f85d0157f40 2024-09-19T06:41:56.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.494+0000 7f85d4d49640 1 -- 172.21.15.86:0/1175376789 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d0156ad0 con 0x7f85d0157f40 2024-09-19T06:41:56.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.494+0000 7f85d4d49640 1 -- 172.21.15.86:0/1175376789 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d0157090 con 0x7f85d0157f40 2024-09-19T06:41:56.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.497+0000 7f85beffd640 1 -- 172.21.15.86:0/1175376789 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f85c801a070 con 0x7f85d0157f40 2024-09-19T06:41:56.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.497+0000 7f85d4d49640 1 -- 172.21.15.86:0/1175376789 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85b4005290 con 0x7f85d0157f40 2024-09-19T06:41:56.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.498+0000 7f85beffd640 1 --2- 172.21.15.86:0/1175376789 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f85b006c3b0 0x7f85b006e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:56.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.507+0000 7f85ce59c640 1 --2- 172.21.15.86:0/1175376789 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f85b006c3b0 0x7f85b006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:56.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.508+0000 7f85beffd640 1 -- 172.21.15.86:0/1175376789 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6907+0+0 (secure 0 0 0) 0x7f85c808b5f0 con 0x7f85d0157f40 2024-09-19T06:41:56.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.508+0000 7f85beffd640 1 -- 172.21.15.86:0/1175376789 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f85c80592d0 con 0x7f85d0157f40 2024-09-19T06:41:56.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.508+0000 7f85ce59c640 1 --2- 172.21.15.86:0/1175376789 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f85b006c3b0 0x7f85b006e870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f85c0034000 tx=0x7f85c002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:56.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.939+0000 7f85d4d49640 1 -- 172.21.15.86:0/1175376789 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85b4005580 con 0x7f85d0157f40 2024-09-19T06:41:56.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.941+0000 7f85beffd640 1 -- 172.21.15.86:0/1175376789 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6880 (secure 0 0 0) 0x7f85c805d5d0 con 0x7f85d0157f40 2024-09-19T06:41:56.944 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:41:56.944 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":19,"btime":"2024-09-19T06:41:19:619629+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4998,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1006149510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1006149510},{"type":"v1","addr":"172.21.15.86:6839","nonce":1006149510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:41:14.610623+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4762},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4762":{"gid":4762,"name":"d","rank":0,"incarnation":15,"state":"up:active","state_seq":26,"addr":"172.21.15.169:6837/2213887583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2213887583},{"type":"v1","addr":"172.21.15.169:6837","nonce":2213887583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4762,"qdb_cluster":[4762]},"id":1}]} 2024-09-19T06:41:56.944 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 19 2024-09-19T06:41:56.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.945+0000 7f85d4d49640 1 -- 172.21.15.86:0/1175376789 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f85b006c3b0 msgr2=0x7f85b006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:56.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.945+0000 7f85d4d49640 1 --2- 172.21.15.86:0/1175376789 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f85b006c3b0 0x7f85b006e870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f85c0034000 tx=0x7f85c002e000 comp rx=0 tx=0).stop 2024-09-19T06:41:56.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.945+0000 7f85d4d49640 1 -- 172.21.15.86:0/1175376789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85d0157f40 msgr2=0x7f85d014ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:56.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.945+0000 7f85d4d49640 1 --2- 172.21.15.86:0/1175376789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85d0157f40 0x7f85d014ed80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f85c800cc00 tx=0x7f85c800a060 comp rx=0 tx=0).stop 2024-09-19T06:41:56.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.946+0000 7f85d4d49640 1 -- 172.21.15.86:0/1175376789 shutdown_connections 2024-09-19T06:41:56.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.946+0000 7f85d4d49640 1 --2- 172.21.15.86:0/1175376789 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f85b006c3b0 0x7f85b006e870 secure :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f85c0034000 tx=0x7f85c002e000 comp rx=0 tx=0).stop 2024-09-19T06:41:56.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.946+0000 7f85d4d49640 1 --2- 172.21.15.86:0/1175376789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85d0157f40 0x7f85d014ed80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:56.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.946+0000 7f85d4d49640 1 --2- 172.21.15.86:0/1175376789 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85d00c9010 0x7f85d014e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:56.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.946+0000 7f85d4d49640 1 --2- 172.21.15.86:0/1175376789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85d00c8430 0x7f85d01589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:56.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.946+0000 7f85d4d49640 1 -- 172.21.15.86:0/1175376789 >> 172.21.15.86:0/1175376789 conn(0x7f85d00cd030 msgr2=0x7f85d00c2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:56.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.949+0000 7f85d4d49640 1 -- 172.21.15.86:0/1175376789 shutdown_connections 2024-09-19T06:41:56.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:56.949+0000 7f85d4d49640 1 -- 172.21.15.86:0/1175376789 wait complete. 2024-09-19T06:41:56.970 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-09-19T06:41:58.971 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:41:59.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.145+0000 7fdf86e58640 1 Processor -- start 2024-09-19T06:41:59.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.146+0000 7fdf86e58640 1 -- start start 2024-09-19T06:41:59.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.147+0000 7fdf86e58640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fdf78047a80 0x7fdf780e6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:59.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.147+0000 7fdf86e58640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf780dc3a0 con 0x7fdf7804d310 2024-09-19T06:41:59.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.147+0000 7fdf86e58640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf780dc0c0 con 0x7fdf780d5850 2024-09-19T06:41:59.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.147+0000 7fdf86e58640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fdf780dbe90 con 0x7fdf78047a80 2024-09-19T06:41:59.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.148+0000 7fdf85655640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fdf7804d310 0x7fdf78045d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:50158/0 (socket says 172.21.15.86:50158) 2024-09-19T06:41:59.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.148+0000 7fdf85655640 1 -- 172.21.15.86:0/2540755907 learned_addr learned my addr 172.21.15.86:0/2540755907 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:41:59.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.148+0000 7fdf86657640 1 --2- 172.21.15.86:0/2540755907 >> v2:172.21.15.169:3300/0 conn(0x7fdf78047a80 0x7fdf780e6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:59.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.148+0000 7fdf84e54640 1 -- 172.21.15.86:0/2540755907 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4183131641 0 0) 0x7fdf780dc0c0 con 0x7fdf780d5850 2024-09-19T06:41:59.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.148+0000 7fdf84e54640 1 -- 172.21.15.86:0/2540755907 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf6c003520 con 0x7fdf780d5850 2024-09-19T06:41:59.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.148+0000 7fdf84e54640 1 -- 172.21.15.86:0/2540755907 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 121459419 0 0) 0x7fdf780dc3a0 con 0x7fdf7804d310 2024-09-19T06:41:59.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.148+0000 7fdf84e54640 1 -- 172.21.15.86:0/2540755907 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf780dc0c0 con 0x7fdf7804d310 2024-09-19T06:41:59.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.149+0000 7fdf84e54640 1 -- 172.21.15.86:0/2540755907 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2378468441 0 0) 0x7fdf6c003520 con 0x7fdf780d5850 2024-09-19T06:41:59.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.149+0000 7fdf86657640 1 -- 172.21.15.86:0/2540755907 >> v1:172.21.15.169:6789/0 conn(0x7fdf780d5850 legacy=0x7fdf78007730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:59.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.149+0000 7fdf86657640 1 -- 172.21.15.86:0/2540755907 >> v1:172.21.15.86:6789/0 conn(0x7fdf7804d310 legacy=0x7fdf78045d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:59.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.149+0000 7fdf86657640 1 -- 172.21.15.86:0/2540755907 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf78046cc0 con 0x7fdf78047a80 2024-09-19T06:41:59.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.161+0000 7fdf86657640 1 --2- 172.21.15.86:0/2540755907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf78047a80 0x7fdf780e6da0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdf700097a0 tx=0x7fdf7002a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f40d6ec8eb96ad93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:59.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.162+0000 7fdf84e54640 1 -- 172.21.15.86:0/2540755907 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf70037070 con 0x7fdf78047a80 2024-09-19T06:41:59.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.162+0000 7fdf84e54640 1 -- 172.21.15.86:0/2540755907 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf7002ab10 con 0x7fdf78047a80 2024-09-19T06:41:59.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.162+0000 7fdf84e54640 1 -- 172.21.15.86:0/2540755907 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c0014a0 con 0x7fdf78047a80 2024-09-19T06:41:59.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.164+0000 7fdf86e58640 1 -- 172.21.15.86:0/2540755907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf78047a80 msgr2=0x7fdf780e6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:59.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.164+0000 7fdf86e58640 1 --2- 172.21.15.86:0/2540755907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf78047a80 0x7fdf780e6da0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdf700097a0 tx=0x7fdf7002a080 comp rx=0 tx=0).stop 2024-09-19T06:41:59.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.166+0000 7fdf86e58640 1 -- 172.21.15.86:0/2540755907 shutdown_connections 2024-09-19T06:41:59.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.166+0000 7fdf86e58640 1 --2- 172.21.15.86:0/2540755907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf78047a80 0x7fdf780e6da0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.166+0000 7fdf86e58640 1 -- 172.21.15.86:0/2540755907 >> 172.21.15.86:0/2540755907 conn(0x7fdf7804d830 msgr2=0x7fdf7804dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:59.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.166+0000 7fdf86e58640 1 -- 172.21.15.86:0/2540755907 shutdown_connections 2024-09-19T06:41:59.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.167+0000 7fdf86e58640 1 -- 172.21.15.86:0/2540755907 wait complete. 2024-09-19T06:41:59.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.168+0000 7fdf86e58640 1 Processor -- start 2024-09-19T06:41:59.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.169+0000 7fdf86e58640 1 -- start start 2024-09-19T06:41:59.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.170+0000 7fdf86e58640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf78047a80 0x7fdf780dac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:59.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.170+0000 7fdf86e58640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf7804d310 0x7fdf78049840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:59.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.170+0000 7fdf86e58640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf780d5850 0x7fdf78049d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:59.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.170+0000 7fdf86e58640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdf78047560 con 0x7fdf7804d310 2024-09-19T06:41:59.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.170+0000 7fdf86e58640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdf78047280 con 0x7fdf78047a80 2024-09-19T06:41:59.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.170+0000 7fdf86e58640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fdf780468c0 con 0x7fdf780d5850 2024-09-19T06:41:59.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.171+0000 7fdf85655640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf7804d310 0x7fdf78049840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:59.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.171+0000 7fdf85655640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf7804d310 0x7fdf78049840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60790/0 (socket says 172.21.15.86:60790) 2024-09-19T06:41:59.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.171+0000 7fdf85655640 1 -- 172.21.15.86:0/1960091294 learned_addr learned my addr 172.21.15.86:0/1960091294 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:41:59.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.171+0000 7fdf85e56640 1 --2- 172.21.15.86:0/1960091294 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf78047a80 0x7fdf780dac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:59.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.172+0000 7fdf85655640 1 -- 172.21.15.86:0/1960091294 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf780d5850 msgr2=0x7fdf78049d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:41:59.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.172+0000 7fdf85655640 1 --2- 172.21.15.86:0/1960091294 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf780d5850 0x7fdf78049d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.172+0000 7fdf85655640 1 -- 172.21.15.86:0/1960091294 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf78047a80 msgr2=0x7fdf780dac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:59.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.172+0000 7fdf85655640 1 --2- 172.21.15.86:0/1960091294 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf78047a80 0x7fdf780dac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.172+0000 7fdf85655640 1 -- 172.21.15.86:0/1960091294 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf78008910 con 0x7fdf7804d310 2024-09-19T06:41:59.175 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.173+0000 7fdf85655640 1 --2- 172.21.15.86:0/1960091294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf7804d310 0x7fdf78049840 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c00c890 tx=0x7fdf7c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:59.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.174+0000 7fdf767fc640 1 -- 172.21.15.86:0/1960091294 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c018070 con 0x7fdf7804d310 2024-09-19T06:41:59.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.175+0000 7fdf86e58640 1 -- 172.21.15.86:0/1960091294 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf78181d30 con 0x7fdf7804d310 2024-09-19T06:41:59.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.175+0000 7fdf86e58640 1 -- 172.21.15.86:0/1960091294 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf7804ac80 con 0x7fdf7804d310 2024-09-19T06:41:59.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.176+0000 7fdf86e58640 1 -- 172.21.15.86:0/1960091294 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf7804c5f0 con 0x7fdf7804d310 2024-09-19T06:41:59.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.177+0000 7fdf767fc640 1 -- 172.21.15.86:0/1960091294 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf7c0072f0 con 0x7fdf7804d310 2024-09-19T06:41:59.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.177+0000 7fdf767fc640 1 -- 172.21.15.86:0/1960091294 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c0047e0 con 0x7fdf7804d310 2024-09-19T06:41:59.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.179+0000 7fdf767fc640 1 -- 172.21.15.86:0/1960091294 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdf7c01b070 con 0x7fdf7804d310 2024-09-19T06:41:59.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.179+0000 7fdf767fc640 1 --2- 172.21.15.86:0/1960091294 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fdf6406c3b0 0x7fdf6406e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:59.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.179+0000 7fdf767fc640 1 -- 172.21.15.86:0/1960091294 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6907+0+0 (secure 0 0 0) 0x7fdf7c08ad90 con 0x7fdf7804d310 2024-09-19T06:41:59.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.187+0000 7fdf85e56640 1 --2- 172.21.15.86:0/1960091294 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fdf6406c3b0 0x7fdf6406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:59.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.187+0000 7fdf767fc640 1 -- 172.21.15.86:0/1960091294 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fdf7c058bc0 con 0x7fdf7804d310 2024-09-19T06:41:59.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.188+0000 7fdf85e56640 1 --2- 172.21.15.86:0/1960091294 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fdf6406c3b0 0x7fdf6406e870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdf80068d10 tx=0x7fdf80063770 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:59.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.641+0000 7fdf86e58640 1 -- 172.21.15.86:0/1960091294 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf7804c970 con 0x7fdf7804d310 2024-09-19T06:41:59.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.642+0000 7fdf767fc640 1 -- 172.21.15.86:0/1960091294 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6880 (secure 0 0 0) 0x7fdf7c05cec0 con 0x7fdf7804d310 2024-09-19T06:41:59.644 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:41:59.644 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":19,"btime":"2024-09-19T06:41:19:619629+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4998,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1006149510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1006149510},{"type":"v1","addr":"172.21.15.86:6839","nonce":1006149510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:41:14.610623+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4762},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4762":{"gid":4762,"name":"d","rank":0,"incarnation":15,"state":"up:active","state_seq":26,"addr":"172.21.15.169:6837/2213887583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2213887583},{"type":"v1","addr":"172.21.15.169:6837","nonce":2213887583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4762,"qdb_cluster":[4762]},"id":1}]} 2024-09-19T06:41:59.644 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 19 2024-09-19T06:41:59.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.646+0000 7fdf86e58640 1 -- 172.21.15.86:0/1960091294 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fdf6406c3b0 msgr2=0x7fdf6406e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:59.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.646+0000 7fdf86e58640 1 --2- 172.21.15.86:0/1960091294 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fdf6406c3b0 0x7fdf6406e870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdf80068d10 tx=0x7fdf80063770 comp rx=0 tx=0).stop 2024-09-19T06:41:59.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.646+0000 7fdf86e58640 1 -- 172.21.15.86:0/1960091294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf7804d310 msgr2=0x7fdf78049840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:59.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.646+0000 7fdf86e58640 1 --2- 172.21.15.86:0/1960091294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf7804d310 0x7fdf78049840 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c00c890 tx=0x7fdf7c00cd50 comp rx=0 tx=0).stop 2024-09-19T06:41:59.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.646+0000 7fdf86e58640 1 -- 172.21.15.86:0/1960091294 shutdown_connections 2024-09-19T06:41:59.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.646+0000 7fdf86e58640 1 --2- 172.21.15.86:0/1960091294 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fdf6406c3b0 0x7fdf6406e870 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.646+0000 7fdf86e58640 1 --2- 172.21.15.86:0/1960091294 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf780d5850 0x7fdf78049d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.646+0000 7fdf86e58640 1 --2- 172.21.15.86:0/1960091294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf7804d310 0x7fdf78049840 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.646+0000 7fdf86e58640 1 --2- 172.21.15.86:0/1960091294 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf78047a80 0x7fdf780dac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.646+0000 7fdf86e58640 1 -- 172.21.15.86:0/1960091294 >> 172.21.15.86:0/1960091294 conn(0x7fdf7804d830 msgr2=0x7fdf78045d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:59.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.646+0000 7fdf86e58640 1 -- 172.21.15.86:0/1960091294 shutdown_connections 2024-09-19T06:41:59.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:41:59.646+0000 7fdf86e58640 1 -- 172.21.15.86:0/1960091294 wait complete. 2024-09-19T06:41:59.673 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-09-19T06:42:01.675 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:42:01.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.878+0000 7f554f59e640 1 Processor -- start 2024-09-19T06:42:01.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.886+0000 7f554f59e640 1 -- start start 2024-09-19T06:42:01.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.887+0000 7f554f59e640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f55480d5690 0x7f55480dbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:01.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.887+0000 7f554f59e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55480087d0 0x7f5548008bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:01.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.887+0000 7f554f59e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f554804cac0 0x7f554804cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:01.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.887+0000 7f554f59e640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f5548045c40 con 0x7f55480d5690 2024-09-19T06:42:01.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.887+0000 7f554f59e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f5548007770 con 0x7f554804cac0 2024-09-19T06:42:01.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.887+0000 7f554f59e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5548007a10 con 0x7f55480087d0 2024-09-19T06:42:01.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.888+0000 7f554ed9d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f554804cac0 0x7f554804cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:01.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.888+0000 7f554ed9d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f554804cac0 0x7f554804cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:44038/0 (socket says 172.21.15.86:44038) 2024-09-19T06:42:01.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.888+0000 7f554ed9d640 1 -- 172.21.15.86:0/1237611212 learned_addr learned my addr 172.21.15.86:0/1237611212 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:42:01.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.888+0000 7f554dd9b640 1 --2- 172.21.15.86:0/1237611212 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55480087d0 0x7f5548008bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:01.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.889+0000 7f554dd9b640 1 -- 172.21.15.86:0/1237611212 >> v2:172.21.15.169:3300/0 conn(0x7f554804cac0 msgr2=0x7f554804cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:01.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.889+0000 7f554dd9b640 1 --2- 172.21.15.86:0/1237611212 >> v2:172.21.15.169:3300/0 conn(0x7f554804cac0 0x7f554804cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:01.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.889+0000 7f554dd9b640 1 -- 172.21.15.86:0/1237611212 >> v2:172.21.15.86:3300/0 conn(0x7f55480d5690 msgr2=0x7f55480dbdd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:42:01.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.889+0000 7f554dd9b640 1 --2- 172.21.15.86:0/1237611212 >> v2:172.21.15.86:3300/0 conn(0x7f55480d5690 0x7f55480dbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:01.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.889+0000 7f554dd9b640 1 -- 172.21.15.86:0/1237611212 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5548007cf0 con 0x7f55480087d0 2024-09-19T06:42:01.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.891+0000 7f554dd9b640 1 --2- 172.21.15.86:0/1237611212 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55480087d0 0x7f5548008bb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f554804ec10 tx=0x7f554002a120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be66b4d8983e2239 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:01.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.891+0000 7f554d59a640 1 -- 172.21.15.86:0/1237611212 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5540037070 con 0x7f55480087d0 2024-09-19T06:42:01.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.891+0000 7f554d59a640 1 -- 172.21.15.86:0/1237611212 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5540032440 con 0x7f55480087d0 2024-09-19T06:42:01.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.891+0000 7f554d59a640 1 -- 172.21.15.86:0/1237611212 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5540032850 con 0x7f55480087d0 2024-09-19T06:42:01.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.892+0000 7f554f59e640 1 -- 172.21.15.86:0/1237611212 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55480087d0 msgr2=0x7f5548008bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:01.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.892+0000 7f554f59e640 1 --2- 172.21.15.86:0/1237611212 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55480087d0 0x7f5548008bb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f554804ec10 tx=0x7f554002a120 comp rx=0 tx=0).stop 2024-09-19T06:42:01.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.895+0000 7f554f59e640 1 -- 172.21.15.86:0/1237611212 shutdown_connections 2024-09-19T06:42:01.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.895+0000 7f554f59e640 1 --2- 172.21.15.86:0/1237611212 >> v2:172.21.15.169:3300/0 conn(0x7f554804cac0 0x7f554804cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:01.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.895+0000 7f554f59e640 1 --2- 172.21.15.86:0/1237611212 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55480087d0 0x7f5548008bb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:01.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.895+0000 7f554f59e640 1 --2- 172.21.15.86:0/1237611212 >> v2:172.21.15.86:3300/0 conn(0x7f55480d5690 0x7f55480dbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:01.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.895+0000 7f554f59e640 1 -- 172.21.15.86:0/1237611212 >> 172.21.15.86:0/1237611212 conn(0x7f5548050d60 msgr2=0x7f5548051170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:01.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.901+0000 7f554f59e640 1 -- 172.21.15.86:0/1237611212 shutdown_connections 2024-09-19T06:42:01.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.901+0000 7f554f59e640 1 -- 172.21.15.86:0/1237611212 wait complete. 2024-09-19T06:42:01.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.903+0000 7f554f59e640 1 Processor -- start 2024-09-19T06:42:01.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.903+0000 7f554f59e640 1 -- start start 2024-09-19T06:42:01.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.904+0000 7f554f59e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55480087d0 0x7f5548046830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:01.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.904+0000 7f554f59e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f554804cac0 0x7f55481958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:01.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.905+0000 7f554dd9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f554804cac0 0x7f55481958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:01.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.905+0000 7f554dd9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f554804cac0 0x7f55481958a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60812/0 (socket says 172.21.15.86:60812) 2024-09-19T06:42:01.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.905+0000 7f554e59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55480087d0 0x7f5548046830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:01.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.905+0000 7f554e59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55480087d0 0x7f5548046830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:44044/0 (socket says 172.21.15.86:44044) 2024-09-19T06:42:01.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.905+0000 7f554dd9b640 1 -- 172.21.15.86:0/1034211823 learned_addr learned my addr 172.21.15.86:0/1034211823 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:42:01.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.905+0000 7f554f59e640 1 --2- 172.21.15.86:0/1034211823 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55480d5690 0x7f5548195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:01.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.905+0000 7f554f59e640 1 -- 172.21.15.86:0/1034211823 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f554804bae0 con 0x7f554804cac0 2024-09-19T06:42:01.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.905+0000 7f554f59e640 1 -- 172.21.15.86:0/1034211823 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f554804d580 con 0x7f55480087d0 2024-09-19T06:42:01.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.905+0000 7f554f59e640 1 -- 172.21.15.86:0/1034211823 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f554804bc60 con 0x7f55480d5690 2024-09-19T06:42:01.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.906+0000 7f554dd9b640 1 -- 172.21.15.86:0/1034211823 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55480d5690 msgr2=0x7f5548195de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:01.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.906+0000 7f554dd9b640 1 --2- 172.21.15.86:0/1034211823 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55480d5690 0x7f5548195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:01.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.906+0000 7f554dd9b640 1 -- 172.21.15.86:0/1034211823 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55480087d0 msgr2=0x7f5548046830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:01.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.906+0000 7f554dd9b640 1 --2- 172.21.15.86:0/1034211823 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55480087d0 0x7f5548046830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:01.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.906+0000 7f554dd9b640 1 -- 172.21.15.86:0/1034211823 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55480d5e50 con 0x7f554804cac0 2024-09-19T06:42:01.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.906+0000 7f554dd9b640 1 --2- 172.21.15.86:0/1034211823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f554804cac0 0x7f55481958a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5540000c00 tx=0x7f55400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:01.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.907+0000 7f554e59c640 1 --2- 172.21.15.86:0/1034211823 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55480087d0 0x7f5548046830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:42:01.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.907+0000 7f553effd640 1 -- 172.21.15.86:0/1034211823 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5540037050 con 0x7f554804cac0 2024-09-19T06:42:01.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.907+0000 7f553effd640 1 -- 172.21.15.86:0/1034211823 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5540043070 con 0x7f554804cac0 2024-09-19T06:42:01.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.908+0000 7f553effd640 1 -- 172.21.15.86:0/1034211823 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5540030bd0 con 0x7f554804cac0 2024-09-19T06:42:01.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.908+0000 7f554f59e640 1 -- 172.21.15.86:0/1034211823 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55480ccc30 con 0x7f554804cac0 2024-09-19T06:42:01.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.911+0000 7f554f59e640 1 -- 172.21.15.86:0/1034211823 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55480d63f0 con 0x7f554804cac0 2024-09-19T06:42:01.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.912+0000 7f553effd640 1 -- 172.21.15.86:0/1034211823 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5540048460 con 0x7f554804cac0 2024-09-19T06:42:01.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.912+0000 7f553effd640 1 --2- 172.21.15.86:0/1034211823 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f553006c330 0x7f553006e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:01.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.916+0000 7f553effd640 1 -- 172.21.15.86:0/1034211823 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6907+0+0 (secure 0 0 0) 0x7f5540077e20 con 0x7f554804cac0 2024-09-19T06:42:01.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.916+0000 7f554e59c640 1 --2- 172.21.15.86:0/1034211823 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f553006c330 0x7f553006e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:01.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.917+0000 7f554e59c640 1 --2- 172.21.15.86:0/1034211823 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f553006c330 0x7f553006e7f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f554400a870 tx=0x7f5544008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:01.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.917+0000 7f554f59e640 1 -- 172.21.15.86:0/1034211823 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5548000e40 con 0x7f554804cac0 2024-09-19T06:42:01.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:01.926+0000 7f553effd640 1 -- 172.21.15.86:0/1034211823 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5548000e40 con 0x7f554804cac0 2024-09-19T06:42:02.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:02.360+0000 7f554f59e640 1 -- 172.21.15.86:0/1034211823 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5548008bb0 con 0x7f554804cac0 2024-09-19T06:42:02.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:02.362+0000 7f553effd640 1 -- 172.21.15.86:0/1034211823 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6880 (secure 0 0 0) 0x7f554007a480 con 0x7f554804cac0 2024-09-19T06:42:02.367 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:42:02.367 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":19,"btime":"2024-09-19T06:41:19:619629+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4998,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1006149510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1006149510},{"type":"v1","addr":"172.21.15.86:6839","nonce":1006149510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:41:14.610623+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4762},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4762":{"gid":4762,"name":"d","rank":0,"incarnation":15,"state":"up:active","state_seq":26,"addr":"172.21.15.169:6837/2213887583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2213887583},{"type":"v1","addr":"172.21.15.169:6837","nonce":2213887583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4762,"qdb_cluster":[4762]},"id":1}]} 2024-09-19T06:42:02.367 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 19 2024-09-19T06:42:02.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:02.369+0000 7f554f59e640 1 -- 172.21.15.86:0/1034211823 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f553006c330 msgr2=0x7f553006e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:02.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:02.369+0000 7f554f59e640 1 --2- 172.21.15.86:0/1034211823 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f553006c330 0x7f553006e7f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f554400a870 tx=0x7f5544008040 comp rx=0 tx=0).stop 2024-09-19T06:42:02.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:02.369+0000 7f554f59e640 1 -- 172.21.15.86:0/1034211823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f554804cac0 msgr2=0x7f55481958a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:02.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:02.369+0000 7f554f59e640 1 --2- 172.21.15.86:0/1034211823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f554804cac0 0x7f55481958a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5540000c00 tx=0x7f55400046c0 comp rx=0 tx=0).stop 2024-09-19T06:42:02.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:02.370+0000 7f554f59e640 1 -- 172.21.15.86:0/1034211823 shutdown_connections 2024-09-19T06:42:02.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:02.370+0000 7f554f59e640 1 --2- 172.21.15.86:0/1034211823 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f553006c330 0x7f553006e7f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:02.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:02.370+0000 7f554f59e640 1 --2- 172.21.15.86:0/1034211823 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55480d5690 0x7f5548195de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:02.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:02.370+0000 7f554f59e640 1 --2- 172.21.15.86:0/1034211823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f554804cac0 0x7f55481958a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:02.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:02.370+0000 7f554f59e640 1 --2- 172.21.15.86:0/1034211823 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55480087d0 0x7f5548046830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:02.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:02.370+0000 7f554f59e640 1 -- 172.21.15.86:0/1034211823 >> 172.21.15.86:0/1034211823 conn(0x7f5548050d60 msgr2=0x7f55480d4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:02.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:02.372+0000 7f554f59e640 1 -- 172.21.15.86:0/1034211823 shutdown_connections 2024-09-19T06:42:02.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:02.372+0000 7f554f59e640 1 -- 172.21.15.86:0/1034211823 wait complete. 2024-09-19T06:42:02.397 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-09-19T06:42:04.398 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:42:04.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.576+0000 7f790a9fc640 1 Processor -- start 2024-09-19T06:42:04.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.577+0000 7f790a9fc640 1 -- start start 2024-09-19T06:42:04.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.578+0000 7f790a9fc640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f79041553b0 0x7f79040c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:04.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.578+0000 7f790a9fc640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f79040ccc90 0x7f79040d0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:04.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.578+0000 7f790a9fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79040d11b0 0x7f790415b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:04.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.578+0000 7f790a9fc640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f790415e610 con 0x7f79041553b0 2024-09-19T06:42:04.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.578+0000 7f790a9fc640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f790415e870 con 0x7f79040ccc90 2024-09-19T06:42:04.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.578+0000 7f790a9fc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f790415eb50 con 0x7f79040d11b0 2024-09-19T06:42:04.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.579+0000 7f79099fa640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f79041553b0 0x7f79040c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:04.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.579+0000 7f79099fa640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f79041553b0 0x7f79040c5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35528/0 (socket says 172.21.15.86:35528) 2024-09-19T06:42:04.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.579+0000 7f79099fa640 1 -- 172.21.15.86:0/4172396211 learned_addr learned my addr 172.21.15.86:0/4172396211 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:42:04.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.580+0000 7f79091f9640 1 --2- 172.21.15.86:0/4172396211 >> v2:172.21.15.169:3300/0 conn(0x7f79040ccc90 0x7f79040d0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:04.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.581+0000 7f79091f9640 1 -- 172.21.15.86:0/4172396211 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79040d11b0 msgr2=0x7f790415b310 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:42:04.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.581+0000 7f79091f9640 1 --2- 172.21.15.86:0/4172396211 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79040d11b0 0x7f790415b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:04.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.581+0000 7f79091f9640 1 -- 172.21.15.86:0/4172396211 >> v2:172.21.15.86:3300/0 conn(0x7f79041553b0 msgr2=0x7f79040c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:04.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.581+0000 7f79091f9640 1 --2- 172.21.15.86:0/4172396211 >> v2:172.21.15.86:3300/0 conn(0x7f79041553b0 0x7f79040c5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:04.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.582+0000 7f79091f9640 1 -- 172.21.15.86:0/4172396211 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790415ee30 con 0x7f79040ccc90 2024-09-19T06:42:04.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.582+0000 7f79099fa640 1 --2- 172.21.15.86:0/4172396211 >> v2:172.21.15.86:3300/0 conn(0x7f79041553b0 0x7f79040c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:42:04.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.583+0000 7f79091f9640 1 --2- 172.21.15.86:0/4172396211 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79040ccc90 0x7f79040d0c70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f79040b47a0 tx=0x7f78f402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=605ceca567f681c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:04.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.584+0000 7f79089f8640 1 -- 172.21.15.86:0/4172396211 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4037070 con 0x7f79040ccc90 2024-09-19T06:42:04.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.584+0000 7f79089f8640 1 -- 172.21.15.86:0/4172396211 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f4032440 con 0x7f79040ccc90 2024-09-19T06:42:04.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.584+0000 7f79089f8640 1 -- 172.21.15.86:0/4172396211 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4032810 con 0x7f79040ccc90 2024-09-19T06:42:04.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.585+0000 7f790a9fc640 1 -- 172.21.15.86:0/4172396211 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79040ccc90 msgr2=0x7f79040d0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:04.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.585+0000 7f790a9fc640 1 --2- 172.21.15.86:0/4172396211 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79040ccc90 0x7f79040d0c70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f79040b47a0 tx=0x7f78f402a1c0 comp rx=0 tx=0).stop 2024-09-19T06:42:04.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.585+0000 7f790a9fc640 1 -- 172.21.15.86:0/4172396211 shutdown_connections 2024-09-19T06:42:04.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.585+0000 7f790a9fc640 1 --2- 172.21.15.86:0/4172396211 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79040d11b0 0x7f790415b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:04.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.585+0000 7f790a9fc640 1 --2- 172.21.15.86:0/4172396211 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79040ccc90 0x7f79040d0c70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:04.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.585+0000 7f790a9fc640 1 --2- 172.21.15.86:0/4172396211 >> v2:172.21.15.86:3300/0 conn(0x7f79041553b0 0x7f79040c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:04.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.585+0000 7f790a9fc640 1 -- 172.21.15.86:0/4172396211 >> 172.21.15.86:0/4172396211 conn(0x7f790406c2f0 msgr2=0x7f790406d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:04.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.585+0000 7f790a9fc640 1 -- 172.21.15.86:0/4172396211 shutdown_connections 2024-09-19T06:42:04.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.585+0000 7f790a9fc640 1 -- 172.21.15.86:0/4172396211 wait complete. 2024-09-19T06:42:04.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.588+0000 7f790a9fc640 1 Processor -- start 2024-09-19T06:42:04.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.588+0000 7f790a9fc640 1 -- start start 2024-09-19T06:42:04.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.589+0000 7f790a9fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79040ccc90 0x7f79041f1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:04.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.589+0000 7f790a9fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79040d11b0 0x7f7904159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:04.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.589+0000 7f790a9fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79041553b0 0x7f7904144630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:04.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.589+0000 7f790a9fc640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f79040c6260 con 0x7f79041553b0 2024-09-19T06:42:04.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.589+0000 7f790a9fc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7904155790 con 0x7f79040ccc90 2024-09-19T06:42:04.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.589+0000 7f790a9fc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f79040cd480 con 0x7f79040d11b0 2024-09-19T06:42:04.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.589+0000 7f79099fa640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79040ccc90 0x7f79041f1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:04.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.589+0000 7f79091f9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79040d11b0 0x7f7904159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:04.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.589+0000 7f79091f9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79040d11b0 0x7f7904159df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:60142/0 (socket says 172.21.15.86:60142) 2024-09-19T06:42:04.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.589+0000 7f79099fa640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79040ccc90 0x7f79041f1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:47734/0 (socket says 172.21.15.86:47734) 2024-09-19T06:42:04.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.589+0000 7f79091f9640 1 -- 172.21.15.86:0/3922980613 learned_addr learned my addr 172.21.15.86:0/3922980613 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:42:04.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.589+0000 7f790a1fb640 1 --2- 172.21.15.86:0/3922980613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79041553b0 0x7f7904144630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:04.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.590+0000 7f790a1fb640 1 -- 172.21.15.86:0/3922980613 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79040d11b0 msgr2=0x7f7904159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:04.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.590+0000 7f790a1fb640 1 --2- 172.21.15.86:0/3922980613 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79040d11b0 0x7f7904159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:04.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.590+0000 7f790a1fb640 1 -- 172.21.15.86:0/3922980613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79040ccc90 msgr2=0x7f79041f1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:04.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.590+0000 7f790a1fb640 1 --2- 172.21.15.86:0/3922980613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79040ccc90 0x7f79041f1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:04.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.590+0000 7f790a1fb640 1 -- 172.21.15.86:0/3922980613 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790415c250 con 0x7f79041553b0 2024-09-19T06:42:04.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.590+0000 7f79099fa640 1 --2- 172.21.15.86:0/3922980613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79040ccc90 0x7f79041f1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:42:04.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.591+0000 7f790a1fb640 1 --2- 172.21.15.86:0/3922980613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79041553b0 0x7f7904144630 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00be50 tx=0x7f78fc00bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:04.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.595+0000 7f78fa7fc640 1 -- 172.21.15.86:0/3922980613 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc019070 con 0x7f79041553b0 2024-09-19T06:42:04.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.595+0000 7f78fa7fc640 1 -- 172.21.15.86:0/3922980613 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78fc014440 con 0x7f79041553b0 2024-09-19T06:42:04.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.595+0000 7f78fa7fc640 1 -- 172.21.15.86:0/3922980613 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc014830 con 0x7f79041553b0 2024-09-19T06:42:04.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.595+0000 7f790a9fc640 1 -- 172.21.15.86:0/3922980613 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79040b6650 con 0x7f79041553b0 2024-09-19T06:42:04.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.595+0000 7f790a9fc640 1 -- 172.21.15.86:0/3922980613 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7904159030 con 0x7f79041553b0 2024-09-19T06:42:04.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.598+0000 7f790a9fc640 1 -- 172.21.15.86:0/3922980613 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79040d0c70 con 0x7f79041553b0 2024-09-19T06:42:04.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.605+0000 7f78fa7fc640 1 -- 172.21.15.86:0/3922980613 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f78fc01c070 con 0x7f79041553b0 2024-09-19T06:42:04.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.606+0000 7f78fa7fc640 1 --2- 172.21.15.86:0/3922980613 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f78e806c380 0x7f78e806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:04.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.606+0000 7f78fa7fc640 1 -- 172.21.15.86:0/3922980613 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6907+0+0 (secure 0 0 0) 0x7f78fc08b920 con 0x7f79041553b0 2024-09-19T06:42:04.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.607+0000 7f79099fa640 1 --2- 172.21.15.86:0/3922980613 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f78e806c380 0x7f78e806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:04.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.608+0000 7f79099fa640 1 --2- 172.21.15.86:0/3922980613 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f78e806c380 0x7f78e806e840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7900009b80 tx=0x7f7900008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:04.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:04.618+0000 7f78fa7fc640 1 -- 172.21.15.86:0/3922980613 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f78fc0594e0 con 0x7f79041553b0 2024-09-19T06:42:05.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:05.062+0000 7f790a9fc640 1 -- 172.21.15.86:0/3922980613 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f790414e6d0 con 0x7f79041553b0 2024-09-19T06:42:05.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:05.063+0000 7f78fa7fc640 1 -- 172.21.15.86:0/3922980613 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6880 (secure 0 0 0) 0x7f78fc05d7e0 con 0x7f79041553b0 2024-09-19T06:42:05.067 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:42:05.067 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":19,"btime":"2024-09-19T06:41:19:619629+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4998,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1006149510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1006149510},{"type":"v1","addr":"172.21.15.86:6839","nonce":1006149510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:41:14.610623+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4762},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4762":{"gid":4762,"name":"d","rank":0,"incarnation":15,"state":"up:active","state_seq":26,"addr":"172.21.15.169:6837/2213887583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2213887583},{"type":"v1","addr":"172.21.15.169:6837","nonce":2213887583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4762,"qdb_cluster":[4762]},"id":1}]} 2024-09-19T06:42:05.067 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 19 2024-09-19T06:42:05.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:05.069+0000 7f790a9fc640 1 -- 172.21.15.86:0/3922980613 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f78e806c380 msgr2=0x7f78e806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:05.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:05.069+0000 7f790a9fc640 1 --2- 172.21.15.86:0/3922980613 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f78e806c380 0x7f78e806e840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7900009b80 tx=0x7f7900008040 comp rx=0 tx=0).stop 2024-09-19T06:42:05.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:05.069+0000 7f790a9fc640 1 -- 172.21.15.86:0/3922980613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79041553b0 msgr2=0x7f7904144630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:05.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:05.069+0000 7f790a9fc640 1 --2- 172.21.15.86:0/3922980613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79041553b0 0x7f7904144630 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00be50 tx=0x7f78fc00bf40 comp rx=0 tx=0).stop 2024-09-19T06:42:05.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:05.069+0000 7f790a9fc640 1 -- 172.21.15.86:0/3922980613 shutdown_connections 2024-09-19T06:42:05.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:05.069+0000 7f790a9fc640 1 --2- 172.21.15.86:0/3922980613 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f78e806c380 0x7f78e806e840 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:05.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:05.069+0000 7f790a9fc640 1 --2- 172.21.15.86:0/3922980613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79041553b0 0x7f7904144630 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:05.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:05.069+0000 7f790a9fc640 1 --2- 172.21.15.86:0/3922980613 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79040d11b0 0x7f7904159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:05.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:05.069+0000 7f790a9fc640 1 --2- 172.21.15.86:0/3922980613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79040ccc90 0x7f79041f1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:05.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:05.069+0000 7f790a9fc640 1 -- 172.21.15.86:0/3922980613 >> 172.21.15.86:0/3922980613 conn(0x7f790406c2f0 msgr2=0x7f79040cbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:05.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:05.070+0000 7f790a9fc640 1 -- 172.21.15.86:0/3922980613 shutdown_connections 2024-09-19T06:42:05.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:05.070+0000 7f790a9fc640 1 -- 172.21.15.86:0/3922980613 wait complete. 2024-09-19T06:42:05.099 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-09-19T06:42:07.100 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:42:07.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.300+0000 7fb94e5fd640 1 Processor -- start 2024-09-19T06:42:07.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.300+0000 7fb94e5fd640 1 -- start start 2024-09-19T06:42:07.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.301+0000 7fb94e5fd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb948151270 0x7fb94815af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:07.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.301+0000 7fb94e5fd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb9480c32b0 0x7fb9480c7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:07.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.301+0000 7fb94e5fd640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9480718e0 con 0x7fb9480c7ac0 2024-09-19T06:42:07.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.301+0000 7fb94e5fd640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fb9480c8bc0 con 0x7fb9480c32b0 2024-09-19T06:42:07.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.301+0000 7fb94e5fd640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fb9480c8ea0 con 0x7fb948151270 2024-09-19T06:42:07.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.302+0000 7fb94cb9a640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fb9480c7ac0 0x7fb948072260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:38118/0 (socket says 172.21.15.86:38118) 2024-09-19T06:42:07.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.302+0000 7fb94cb9a640 1 -- 172.21.15.86:0/831700517 learned_addr learned my addr 172.21.15.86:0/831700517 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:42:07.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.302+0000 7fb9477fe640 1 --2- 172.21.15.86:0/831700517 >> v2:172.21.15.86:3300/0 conn(0x7fb9480c32b0 0x7fb9480c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:07.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.303+0000 7fb9477fe640 1 -- 172.21.15.86:0/831700517 >> v2:172.21.15.169:3300/0 conn(0x7fb948151270 msgr2=0x7fb94815af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:07.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.303+0000 7fb9477fe640 1 --2- 172.21.15.86:0/831700517 >> v2:172.21.15.169:3300/0 conn(0x7fb948151270 0x7fb94815af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:07.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.303+0000 7fb9477fe640 1 -- 172.21.15.86:0/831700517 >> v1:172.21.15.169:6789/0 conn(0x7fb9480c7ac0 legacy=0x7fb948072260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:07.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.303+0000 7fb9477fe640 1 -- 172.21.15.86:0/831700517 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb948071320 con 0x7fb9480c32b0 2024-09-19T06:42:07.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.310+0000 7fb9477fe640 1 --2- 172.21.15.86:0/831700517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9480c32b0 0x7fb9480c7580 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb9480708c0 tx=0x7fb93c02e930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea8772411ad92ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:07.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.311+0000 7fb946ffd640 1 -- 172.21.15.86:0/831700517 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c035760 con 0x7fb9480c32b0 2024-09-19T06:42:07.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.311+0000 7fb946ffd640 1 -- 172.21.15.86:0/831700517 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb93c03b070 con 0x7fb9480c32b0 2024-09-19T06:42:07.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.312+0000 7fb94e5fd640 1 -- 172.21.15.86:0/831700517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9480c32b0 msgr2=0x7fb9480c7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:07.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.312+0000 7fb94e5fd640 1 --2- 172.21.15.86:0/831700517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9480c32b0 0x7fb9480c7580 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb9480708c0 tx=0x7fb93c02e930 comp rx=0 tx=0).stop 2024-09-19T06:42:07.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.314+0000 7fb94e5fd640 1 -- 172.21.15.86:0/831700517 shutdown_connections 2024-09-19T06:42:07.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.314+0000 7fb94e5fd640 1 --2- 172.21.15.86:0/831700517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9480c32b0 0x7fb9480c7580 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:07.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.314+0000 7fb94e5fd640 1 --2- 172.21.15.86:0/831700517 >> v2:172.21.15.169:3300/0 conn(0x7fb948151270 0x7fb94815af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:07.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.314+0000 7fb94e5fd640 1 -- 172.21.15.86:0/831700517 >> 172.21.15.86:0/831700517 conn(0x7fb9480c9280 msgr2=0x7fb9480c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:07.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.317+0000 7fb94e5fd640 1 -- 172.21.15.86:0/831700517 shutdown_connections 2024-09-19T06:42:07.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.317+0000 7fb94e5fd640 1 -- 172.21.15.86:0/831700517 wait complete. 2024-09-19T06:42:07.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.319+0000 7fb94e5fd640 1 Processor -- start 2024-09-19T06:42:07.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.321+0000 7fb94e5fd640 1 -- start start 2024-09-19T06:42:07.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.322+0000 7fb94e5fd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9480c7ac0 0x7fb9481edc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:07.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.323+0000 7fb94e5fd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb948151270 0x7fb948149f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:07.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.323+0000 7fb94e5fd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb94815adb0 0x7fb9481f05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:07.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.323+0000 7fb94e5fd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb9480c3890 con 0x7fb94815adb0 2024-09-19T06:42:07.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.323+0000 7fb94e5fd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb948071d40 con 0x7fb948151270 2024-09-19T06:42:07.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.323+0000 7fb94e5fd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb948151650 con 0x7fb9480c7ac0 2024-09-19T06:42:07.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.323+0000 7fb94cb9a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb94815adb0 0x7fb9481f05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:07.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.323+0000 7fb94cb9a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb94815adb0 0x7fb9481f05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35546/0 (socket says 172.21.15.86:35546) 2024-09-19T06:42:07.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.323+0000 7fb94cb9a640 1 -- 172.21.15.86:0/3449610513 learned_addr learned my addr 172.21.15.86:0/3449610513 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:42:07.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.324+0000 7fb94cb9a640 1 -- 172.21.15.86:0/3449610513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9480c7ac0 msgr2=0x7fb9481edc10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:42:07.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.324+0000 7fb94cb9a640 1 --2- 172.21.15.86:0/3449610513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9480c7ac0 0x7fb9481edc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:07.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.324+0000 7fb94cb9a640 1 -- 172.21.15.86:0/3449610513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb948151270 msgr2=0x7fb948149f90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:42:07.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.324+0000 7fb94cb9a640 1 --2- 172.21.15.86:0/3449610513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb948151270 0x7fb948149f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:07.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.324+0000 7fb94cb9a640 1 -- 172.21.15.86:0/3449610513 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9481ed170 con 0x7fb94815adb0 2024-09-19T06:42:07.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.324+0000 7fb94cb9a640 1 --2- 172.21.15.86:0/3449610513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb94815adb0 0x7fb9481f05d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb93800b9a0 tx=0x7fb93800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:07.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.325+0000 7fb944ff9640 1 -- 172.21.15.86:0/3449610513 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb938019070 con 0x7fb94815adb0 2024-09-19T06:42:07.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.325+0000 7fb944ff9640 1 -- 172.21.15.86:0/3449610513 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb93800cbc0 con 0x7fb94815adb0 2024-09-19T06:42:07.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.325+0000 7fb944ff9640 1 -- 172.21.15.86:0/3449610513 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb938014440 con 0x7fb94815adb0 2024-09-19T06:42:07.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.327+0000 7fb94e5fd640 1 -- 172.21.15.86:0/3449610513 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9481f0e80 con 0x7fb94815adb0 2024-09-19T06:42:07.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.328+0000 7fb94e5fd640 1 -- 172.21.15.86:0/3449610513 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9481ed410 con 0x7fb94815adb0 2024-09-19T06:42:07.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.330+0000 7fb944ff9640 1 -- 172.21.15.86:0/3449610513 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb93801c070 con 0x7fb94815adb0 2024-09-19T06:42:07.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.332+0000 7fb94e5fd640 1 -- 172.21.15.86:0/3449610513 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb94814afb0 con 0x7fb94815adb0 2024-09-19T06:42:07.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.333+0000 7fb944ff9640 1 --2- 172.21.15.86:0/3449610513 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb93406c380 0x7fb93406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:07.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.333+0000 7fb944ff9640 1 -- 172.21.15.86:0/3449610513 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6993+0+0 (secure 0 0 0) 0x7fb93808b790 con 0x7fb94815adb0 2024-09-19T06:42:07.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.339+0000 7fb947fff640 1 --2- 172.21.15.86:0/3449610513 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb93406c380 0x7fb93406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:07.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.340+0000 7fb947fff640 1 --2- 172.21.15.86:0/3449610513 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb93406c380 0x7fb93406e840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb9400096b0 tx=0x7fb940006c20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:07.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.344+0000 7fb944ff9640 1 -- 172.21.15.86:0/3449610513 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb938059940 con 0x7fb94815adb0 2024-09-19T06:42:07.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.773+0000 7fb94e5fd640 1 -- 172.21.15.86:0/3449610513 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9480c9f10 con 0x7fb94815adb0 2024-09-19T06:42:07.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.775+0000 7fb944ff9640 1 -- 172.21.15.86:0/3449610513 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6044 (secure 0 0 0) 0x7fb9480c9f10 con 0x7fb94815adb0 2024-09-19T06:42:07.777 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:42:07.777 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":20,"btime":"2024-09-19T06:42:05:506115+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:42:05.506111+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"e","rank":0,"incarnation":20,"state":"up:replay","state_seq":1,"addr":"172.21.15.86:6839/1006149510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1006149510},{"type":"v1","addr":"172.21.15.86:6839","nonce":1006149510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:42:07.777 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 20 2024-09-19T06:42:07.781 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.780+0000 7fb94e5fd640 1 -- 172.21.15.86:0/3449610513 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb93406c380 msgr2=0x7fb93406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:07.781 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.780+0000 7fb94e5fd640 1 --2- 172.21.15.86:0/3449610513 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb93406c380 0x7fb93406e840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb9400096b0 tx=0x7fb940006c20 comp rx=0 tx=0).stop 2024-09-19T06:42:07.781 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.780+0000 7fb94e5fd640 1 -- 172.21.15.86:0/3449610513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb94815adb0 msgr2=0x7fb9481f05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:07.781 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.780+0000 7fb94e5fd640 1 --2- 172.21.15.86:0/3449610513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb94815adb0 0x7fb9481f05d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb93800b9a0 tx=0x7fb93800be60 comp rx=0 tx=0).stop 2024-09-19T06:42:07.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.780+0000 7fb94e5fd640 1 -- 172.21.15.86:0/3449610513 shutdown_connections 2024-09-19T06:42:07.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.780+0000 7fb94e5fd640 1 --2- 172.21.15.86:0/3449610513 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb93406c380 0x7fb93406e840 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:07.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.780+0000 7fb94e5fd640 1 --2- 172.21.15.86:0/3449610513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb94815adb0 0x7fb9481f05d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:07.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.781+0000 7fb94e5fd640 1 --2- 172.21.15.86:0/3449610513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb948151270 0x7fb948149f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:07.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.781+0000 7fb94e5fd640 1 --2- 172.21.15.86:0/3449610513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9480c7ac0 0x7fb9481edc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:07.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.781+0000 7fb94e5fd640 1 -- 172.21.15.86:0/3449610513 >> 172.21.15.86:0/3449610513 conn(0x7fb9480c9280 msgr2=0x7fb9480cb680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:07.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.781+0000 7fb94e5fd640 1 -- 172.21.15.86:0/3449610513 shutdown_connections 2024-09-19T06:42:07.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.781+0000 7fb94e5fd640 1 -- 172.21.15.86:0/3449610513 wait complete. 2024-09-19T06:42:07.803 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d down, removed from mdsmap 2024-09-19T06:42:07.804 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-09-19T06:42:07.804 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:42:07.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.992+0000 7fce69f28640 1 Processor -- start 2024-09-19T06:42:07.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.993+0000 7fce69f28640 1 -- start start 2024-09-19T06:42:07.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.994+0000 7fce69f28640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fce5c0d4bc0 0x7fce5c0db490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:07.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.994+0000 7fce69f28640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fce5c0d4fa0 0x7fce5c007830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:07.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.994+0000 7fce69f28640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fce5c04c4d0 0x7fce5c04b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:07.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.994+0000 7fce69f28640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fce5c006790 con 0x7fce5c04c4d0 2024-09-19T06:42:07.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.994+0000 7fce69f28640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fce5c006a70 con 0x7fce5c0d4bc0 2024-09-19T06:42:07.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.994+0000 7fce69f28640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fce5c006d50 con 0x7fce5c0d4fa0 2024-09-19T06:42:07.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.994+0000 7fce63fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fce5c04c4d0 0x7fce5c04b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:07.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.994+0000 7fce63fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fce5c04c4d0 0x7fce5c04b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35552/0 (socket says 172.21.15.86:35552) 2024-09-19T06:42:07.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.994+0000 7fce63fff640 1 -- 172.21.15.86:0/2399672986 learned_addr learned my addr 172.21.15.86:0/2399672986 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:42:07.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.995+0000 7fce63fff640 1 -- 172.21.15.86:0/2399672986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fce5c0d4fa0 msgr2=0x7fce5c007830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:42:07.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.995+0000 7fce63fff640 1 --2- 172.21.15.86:0/2399672986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fce5c0d4fa0 0x7fce5c007830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:07.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.995+0000 7fce63fff640 1 -- 172.21.15.86:0/2399672986 >> v2:172.21.15.169:3300/0 conn(0x7fce5c0d4bc0 msgr2=0x7fce5c0db490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:42:07.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.995+0000 7fce63fff640 1 --2- 172.21.15.86:0/2399672986 >> v2:172.21.15.169:3300/0 conn(0x7fce5c0d4bc0 0x7fce5c0db490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:07.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.995+0000 7fce63fff640 1 -- 172.21.15.86:0/2399672986 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce5c007030 con 0x7fce5c04c4d0 2024-09-19T06:42:07.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.996+0000 7fce63fff640 1 --2- 172.21.15.86:0/2399672986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce5c04c4d0 0x7fce5c04b4d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fce6402dd50 tx=0x7fce640a7400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b98ae251b3fe54d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:08.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.996+0000 7fce627fc640 1 -- 172.21.15.86:0/2399672986 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce640b3070 con 0x7fce5c04c4d0 2024-09-19T06:42:08.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.997+0000 7fce627fc640 1 -- 172.21.15.86:0/2399672986 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce640ae640 con 0x7fce5c04c4d0 2024-09-19T06:42:08.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.998+0000 7fce69f28640 1 -- 172.21.15.86:0/2399672986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce5c04c4d0 msgr2=0x7fce5c04b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:08.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.998+0000 7fce69f28640 1 --2- 172.21.15.86:0/2399672986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce5c04c4d0 0x7fce5c04b4d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fce6402dd50 tx=0x7fce640a7400 comp rx=0 tx=0).stop 2024-09-19T06:42:08.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.998+0000 7fce69f28640 1 -- 172.21.15.86:0/2399672986 shutdown_connections 2024-09-19T06:42:08.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.998+0000 7fce69f28640 1 --2- 172.21.15.86:0/2399672986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce5c04c4d0 0x7fce5c04b4d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:08.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.998+0000 7fce69f28640 1 --2- 172.21.15.86:0/2399672986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fce5c0d4fa0 0x7fce5c007830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:08.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.998+0000 7fce69f28640 1 --2- 172.21.15.86:0/2399672986 >> v2:172.21.15.169:3300/0 conn(0x7fce5c0d4bc0 0x7fce5c0db490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:08.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.998+0000 7fce69f28640 1 -- 172.21.15.86:0/2399672986 >> 172.21.15.86:0/2399672986 conn(0x7fce5c0504e0 msgr2=0x7fce5c0508f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:08.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:07.999+0000 7fce69f28640 1 -- 172.21.15.86:0/2399672986 shutdown_connections 2024-09-19T06:42:08.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.000+0000 7fce69f28640 1 -- 172.21.15.86:0/2399672986 wait complete. 2024-09-19T06:42:08.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.001+0000 7fce69f28640 1 Processor -- start 2024-09-19T06:42:08.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.002+0000 7fce69f28640 1 -- start start 2024-09-19T06:42:08.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.003+0000 7fce69f28640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce5c04c4d0 0x7fce5c04e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:08.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.003+0000 7fce69f28640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fce5c0d4bc0 0x7fce5c04f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:08.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.003+0000 7fce69f28640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce5c0d4fa0 0x7fce5c0be450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:08.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.003+0000 7fce69f28640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fce5c0453c0 con 0x7fce5c0d4fa0 2024-09-19T06:42:08.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.003+0000 7fce69f28640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fce5c007d70 con 0x7fce5c04c4d0 2024-09-19T06:42:08.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.003+0000 7fce69f28640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fce5c045540 con 0x7fce5c0d4bc0 2024-09-19T06:42:08.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.004+0000 7fce63fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce5c0d4fa0 0x7fce5c0be450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:08.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.004+0000 7fce63fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce5c0d4fa0 0x7fce5c0be450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35568/0 (socket says 172.21.15.86:35568) 2024-09-19T06:42:08.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.004+0000 7fce63fff640 1 -- 172.21.15.86:0/3039049346 learned_addr learned my addr 172.21.15.86:0/3039049346 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:42:08.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.004+0000 7fce63fff640 1 -- 172.21.15.86:0/3039049346 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fce5c0d4bc0 msgr2=0x7fce5c04f560 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:42:08.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.004+0000 7fce63fff640 1 --2- 172.21.15.86:0/3039049346 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fce5c0d4bc0 0x7fce5c04f560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:08.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.004+0000 7fce63fff640 1 -- 172.21.15.86:0/3039049346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce5c04c4d0 msgr2=0x7fce5c04e920 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:42:08.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.004+0000 7fce63fff640 1 --2- 172.21.15.86:0/3039049346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce5c04c4d0 0x7fce5c04e920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:08.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.005+0000 7fce63fff640 1 -- 172.21.15.86:0/3039049346 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce5c0e7b00 con 0x7fce5c0d4fa0 2024-09-19T06:42:08.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.005+0000 7fce63fff640 1 --2- 172.21.15.86:0/3039049346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce5c0d4fa0 0x7fce5c0be450 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fce64074f80 tx=0x7fce6406a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:08.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.007+0000 7fce4ffff640 1 -- 172.21.15.86:0/3039049346 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce640b3040 con 0x7fce5c0d4fa0 2024-09-19T06:42:08.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.007+0000 7fce69f28640 1 -- 172.21.15.86:0/3039049346 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce5c0361d0 con 0x7fce5c0d4fa0 2024-09-19T06:42:08.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.007+0000 7fce69f28640 1 -- 172.21.15.86:0/3039049346 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce5c0d32d0 con 0x7fce5c0d4fa0 2024-09-19T06:42:08.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.007+0000 7fce4ffff640 1 -- 172.21.15.86:0/3039049346 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce640ba460 con 0x7fce5c0d4fa0 2024-09-19T06:42:08.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.007+0000 7fce4ffff640 1 -- 172.21.15.86:0/3039049346 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce640ba810 con 0x7fce5c0d4fa0 2024-09-19T06:42:08.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.009+0000 7fce69f28640 1 -- 172.21.15.86:0/3039049346 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce44005290 con 0x7fce5c0d4fa0 2024-09-19T06:42:08.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.011+0000 7fce4ffff640 1 -- 172.21.15.86:0/3039049346 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fce640b6040 con 0x7fce5c0d4fa0 2024-09-19T06:42:08.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.012+0000 7fce4ffff640 1 --2- 172.21.15.86:0/3039049346 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fce4806c330 0x7fce4806e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:08.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.014+0000 7fce637fe640 1 --2- 172.21.15.86:0/3039049346 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fce4806c330 0x7fce4806e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:08.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.015+0000 7fce637fe640 1 --2- 172.21.15.86:0/3039049346 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fce4806c330 0x7fce4806e7f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fce500095d0 tx=0x7fce50006b30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:08.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.023+0000 7fce4ffff640 1 -- 172.21.15.86:0/3039049346 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6993+0+0 (secure 0 0 0) 0x7fce640f5200 con 0x7fce5c0d4fa0 2024-09-19T06:42:08.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.024+0000 7fce4ffff640 1 -- 172.21.15.86:0/3039049346 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fce5c0e7b00 con 0x7fce5c0d4fa0 2024-09-19T06:42:08.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.449+0000 7fce69f28640 1 -- 172.21.15.86:0/3039049346 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce44005850 con 0x7fce5c0d4fa0 2024-09-19T06:42:08.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.451+0000 7fce4ffff640 1 -- 172.21.15.86:0/3039049346 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6044 (secure 0 0 0) 0x7fce640be020 con 0x7fce5c0d4fa0 2024-09-19T06:42:08.453 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:42:08.453 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":20,"btime":"2024-09-19T06:42:05:506115+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:42:05.506111+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"e","rank":0,"incarnation":20,"state":"up:replay","state_seq":1,"addr":"172.21.15.86:6839/1006149510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1006149510},{"type":"v1","addr":"172.21.15.86:6839","nonce":1006149510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:42:08.453 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 20 2024-09-19T06:42:08.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.454+0000 7fce69f28640 1 -- 172.21.15.86:0/3039049346 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fce4806c330 msgr2=0x7fce4806e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:08.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.454+0000 7fce69f28640 1 --2- 172.21.15.86:0/3039049346 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fce4806c330 0x7fce4806e7f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fce500095d0 tx=0x7fce50006b30 comp rx=0 tx=0).stop 2024-09-19T06:42:08.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.454+0000 7fce69f28640 1 -- 172.21.15.86:0/3039049346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce5c0d4fa0 msgr2=0x7fce5c0be450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:08.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.454+0000 7fce69f28640 1 --2- 172.21.15.86:0/3039049346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce5c0d4fa0 0x7fce5c0be450 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fce64074f80 tx=0x7fce6406a560 comp rx=0 tx=0).stop 2024-09-19T06:42:08.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.454+0000 7fce69f28640 1 -- 172.21.15.86:0/3039049346 shutdown_connections 2024-09-19T06:42:08.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.454+0000 7fce69f28640 1 --2- 172.21.15.86:0/3039049346 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fce4806c330 0x7fce4806e7f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:08.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.454+0000 7fce69f28640 1 --2- 172.21.15.86:0/3039049346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce5c0d4fa0 0x7fce5c0be450 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:08.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.454+0000 7fce69f28640 1 --2- 172.21.15.86:0/3039049346 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fce5c0d4bc0 0x7fce5c04f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:08.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.454+0000 7fce69f28640 1 --2- 172.21.15.86:0/3039049346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce5c04c4d0 0x7fce5c04e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:08.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.454+0000 7fce69f28640 1 -- 172.21.15.86:0/3039049346 >> 172.21.15.86:0/3039049346 conn(0x7fce5c0504e0 msgr2=0x7fce5c0058a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:08.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.455+0000 7fce69f28640 1 -- 172.21.15.86:0/3039049346 shutdown_connections 2024-09-19T06:42:08.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:08.455+0000 7fce69f28640 1 -- 172.21.15.86:0/3039049346 wait complete. 2024-09-19T06:42:08.477 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "btime": "2024-09-19T06:42:05:506115+0000", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 20, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-19T06:37:08.763572+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 20, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4998": { "addr": "172.21.15.86:6839/1006149510", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6838", "nonce": 1006149510, "type": "v2" }, { "addr": "172.21.15.86:6839", "nonce": 1006149510, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4998, "incarnation": 20, "join_fscid": -1, "name": "e", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 31, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-09-19T06:42:05.506111+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4998 } } } ], "standbys": [ { "addr": "172.21.15.86:6837/728803297", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6835", "nonce": 728803297, "type": "v2" }, { "addr": "172.21.15.86:6837", "nonce": 728803297, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4247, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.169:6835/2537509253", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6833", "nonce": 2537509253, "type": "v2" }, { "addr": "172.21.15.169:6835", "nonce": 2537509253, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4262, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.169:6834/1723647527", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6832", "nonce": 1723647527, "type": "v2" }, { "addr": "172.21.15.169:6834", "nonce": 1723647527, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4265, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.86:6836/4135959816", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6834", "nonce": 4135959816, "type": "v2" }, { "addr": "172.21.15.86:6836", "nonce": 4135959816, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4270, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-09-19T06:42:09.854 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:42:09.858 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:42:10.478 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:42:10.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.667+0000 7f952483c640 1 Processor -- start 2024-09-19T06:42:10.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.667+0000 7f952483c640 1 -- start start 2024-09-19T06:42:10.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.669+0000 7f952483c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f95200d0d40 0x7f95200ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:10.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.669+0000 7f952483c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f952015e170 0x7f95200cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:10.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.669+0000 7f952483c640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f952015c9c0 con 0x7f95200d1120 2024-09-19T06:42:10.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.669+0000 7f952483c640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f952015c770 con 0x7f95200d0d40 2024-09-19T06:42:10.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.669+0000 7f952483c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f95200b3f20 con 0x7f952015e170 2024-09-19T06:42:10.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.669+0000 7f9517fff640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f95200d1120 0x7f952015da60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:46886/0 (socket says 172.21.15.86:46886) 2024-09-19T06:42:10.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.669+0000 7f9517fff640 1 -- 172.21.15.86:0/3250072759 learned_addr learned my addr 172.21.15.86:0/3250072759 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:42:10.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.669+0000 7f951e59c640 1 --2- 172.21.15.86:0/3250072759 >> v2:172.21.15.86:3300/0 conn(0x7f95200d0d40 0x7f95200ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:10.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.669+0000 7f951ed9d640 1 --2- 172.21.15.86:0/3250072759 >> v2:172.21.15.169:3300/0 conn(0x7f952015e170 0x7f95200cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:10.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.669+0000 7f951e59c640 1 -- 172.21.15.86:0/3250072759 >> v2:172.21.15.169:3300/0 conn(0x7f952015e170 msgr2=0x7f95200cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:10.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.669+0000 7f951e59c640 1 --2- 172.21.15.86:0/3250072759 >> v2:172.21.15.169:3300/0 conn(0x7f952015e170 0x7f95200cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:10.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.669+0000 7f951e59c640 1 -- 172.21.15.86:0/3250072759 >> v1:172.21.15.86:6789/0 conn(0x7f95200d1120 legacy=0x7f952015da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:10.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.670+0000 7f951e59c640 1 -- 172.21.15.86:0/3250072759 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952015cca0 con 0x7f95200d0d40 2024-09-19T06:42:10.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.671+0000 7f951e59c640 1 --2- 172.21.15.86:0/3250072759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95200d0d40 0x7f95200ca6c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f952006d820 tx=0x7f951002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3960e8ab2d5212d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:10.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.673+0000 7f951dd9b640 1 -- 172.21.15.86:0/3250072759 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9510037070 con 0x7f95200d0d40 2024-09-19T06:42:10.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.673+0000 7f951dd9b640 1 -- 172.21.15.86:0/3250072759 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9510032440 con 0x7f95200d0d40 2024-09-19T06:42:10.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.673+0000 7f951dd9b640 1 -- 172.21.15.86:0/3250072759 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9510037070 con 0x7f95200d0d40 2024-09-19T06:42:10.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.674+0000 7f952483c640 1 -- 172.21.15.86:0/3250072759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95200d0d40 msgr2=0x7f95200ca6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:10.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.674+0000 7f952483c640 1 --2- 172.21.15.86:0/3250072759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95200d0d40 0x7f95200ca6c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f952006d820 tx=0x7f951002a1e0 comp rx=0 tx=0).stop 2024-09-19T06:42:10.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.674+0000 7f952483c640 1 -- 172.21.15.86:0/3250072759 shutdown_connections 2024-09-19T06:42:10.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.674+0000 7f952483c640 1 --2- 172.21.15.86:0/3250072759 >> v2:172.21.15.169:3300/0 conn(0x7f952015e170 0x7f95200cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:10.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.674+0000 7f952483c640 1 --2- 172.21.15.86:0/3250072759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95200d0d40 0x7f95200ca6c0 secure :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f952006d820 tx=0x7f951002a1e0 comp rx=0 tx=0).stop 2024-09-19T06:42:10.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.674+0000 7f952483c640 1 -- 172.21.15.86:0/3250072759 >> 172.21.15.86:0/3250072759 conn(0x7f952006d910 msgr2=0x7f952006dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:10.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.681+0000 7f952483c640 1 -- 172.21.15.86:0/3250072759 shutdown_connections 2024-09-19T06:42:10.683 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.681+0000 7f952483c640 1 -- 172.21.15.86:0/3250072759 wait complete. 2024-09-19T06:42:10.685 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.683+0000 7f952483c640 1 Processor -- start 2024-09-19T06:42:10.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.685+0000 7f952483c640 1 -- start start 2024-09-19T06:42:10.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.686+0000 7f952483c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95200d1120 0x7f9520158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:10.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.686+0000 7f952483c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f952015e170 0x7f95200ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:10.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.687+0000 7f952483c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95201f1660 0x7f95201f1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:10.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.687+0000 7f952483c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f95200b4b60 con 0x7f95201f1660 2024-09-19T06:42:10.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.687+0000 7f952483c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f952015d260 con 0x7f952015e170 2024-09-19T06:42:10.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.687+0000 7f952483c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f95200b4ce0 con 0x7f95200d1120 2024-09-19T06:42:10.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.687+0000 7f951ed9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95201f1660 0x7f95201f1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:10.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.687+0000 7f951ed9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95201f1660 0x7f95201f1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35588/0 (socket says 172.21.15.86:35588) 2024-09-19T06:42:10.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.687+0000 7f951ed9d640 1 -- 172.21.15.86:0/3672808928 learned_addr learned my addr 172.21.15.86:0/3672808928 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:42:10.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.687+0000 7f951ed9d640 1 -- 172.21.15.86:0/3672808928 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95200d1120 msgr2=0x7f9520158710 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:42:10.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.687+0000 7f951ed9d640 1 --2- 172.21.15.86:0/3672808928 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95200d1120 0x7f9520158710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:10.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.687+0000 7f951ed9d640 1 -- 172.21.15.86:0/3672808928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f952015e170 msgr2=0x7f95200ccc30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:42:10.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.687+0000 7f951ed9d640 1 --2- 172.21.15.86:0/3672808928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f952015e170 0x7f95200ccc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:10.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.687+0000 7f951ed9d640 1 -- 172.21.15.86:0/3672808928 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95201f48e0 con 0x7f95201f1660 2024-09-19T06:42:10.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.688+0000 7f951ed9d640 1 --2- 172.21.15.86:0/3672808928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95201f1660 0x7f95201f1ae0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9518007e90 tx=0x7f951800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:10.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.689+0000 7f9516ffd640 1 -- 172.21.15.86:0/3672808928 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518014420 con 0x7f95201f1660 2024-09-19T06:42:10.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.689+0000 7f952483c640 1 -- 172.21.15.86:0/3672808928 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95201f4bc0 con 0x7f95201f1660 2024-09-19T06:42:10.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.691+0000 7f952483c640 1 -- 172.21.15.86:0/3672808928 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95201f5180 con 0x7f95201f1660 2024-09-19T06:42:10.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.691+0000 7f9516ffd640 1 -- 172.21.15.86:0/3672808928 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9518019070 con 0x7f95201f1660 2024-09-19T06:42:10.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.692+0000 7f9516ffd640 1 -- 172.21.15.86:0/3672808928 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518014820 con 0x7f95201f1660 2024-09-19T06:42:10.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.692+0000 7f9516ffd640 1 -- 172.21.15.86:0/3672808928 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f95180149c0 con 0x7f95201f1660 2024-09-19T06:42:10.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.693+0000 7f9516ffd640 1 --2- 172.21.15.86:0/3672808928 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f950006c3e0 0x7f950006e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:10.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.693+0000 7f9516ffd640 1 -- 172.21.15.86:0/3672808928 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6993+0+0 (secure 0 0 0) 0x7f9518090060 con 0x7f95201f1660 2024-09-19T06:42:10.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.693+0000 7f952483c640 1 -- 172.21.15.86:0/3672808928 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9504005290 con 0x7f95201f1660 2024-09-19T06:42:10.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.693+0000 7f951e59c640 1 --2- 172.21.15.86:0/3672808928 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f950006c3e0 0x7f950006e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:10.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.695+0000 7f951e59c640 1 --2- 172.21.15.86:0/3672808928 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f950006c3e0 0x7f950006e8a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9510034000 tx=0x7f951002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:10.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:10.701+0000 7f9516ffd640 1 -- 172.21.15.86:0/3672808928 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9518059c80 con 0x7f95201f1660 2024-09-19T06:42:11.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:11.117+0000 7f952483c640 1 -- 172.21.15.86:0/3672808928 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9504005850 con 0x7f95201f1660 2024-09-19T06:42:11.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:11.119+0000 7f9516ffd640 1 -- 172.21.15.86:0/3672808928 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6044 (secure 0 0 0) 0x7f9518059580 con 0x7f95201f1660 2024-09-19T06:42:11.121 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:42:11.121 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":20,"btime":"2024-09-19T06:42:05:506115+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:42:05.506111+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"e","rank":0,"incarnation":20,"state":"up:replay","state_seq":1,"addr":"172.21.15.86:6839/1006149510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1006149510},{"type":"v1","addr":"172.21.15.86:6839","nonce":1006149510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:42:11.121 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 20 2024-09-19T06:42:11.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:11.122+0000 7f952483c640 1 -- 172.21.15.86:0/3672808928 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f950006c3e0 msgr2=0x7f950006e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:11.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:11.122+0000 7f952483c640 1 --2- 172.21.15.86:0/3672808928 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f950006c3e0 0x7f950006e8a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9510034000 tx=0x7f951002e000 comp rx=0 tx=0).stop 2024-09-19T06:42:11.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:11.122+0000 7f952483c640 1 -- 172.21.15.86:0/3672808928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95201f1660 msgr2=0x7f95201f1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:11.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:11.122+0000 7f952483c640 1 --2- 172.21.15.86:0/3672808928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95201f1660 0x7f95201f1ae0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9518007e90 tx=0x7f951800e4b0 comp rx=0 tx=0).stop 2024-09-19T06:42:11.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:11.123+0000 7f952483c640 1 -- 172.21.15.86:0/3672808928 shutdown_connections 2024-09-19T06:42:11.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:11.123+0000 7f952483c640 1 --2- 172.21.15.86:0/3672808928 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f950006c3e0 0x7f950006e8a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:11.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:11.123+0000 7f952483c640 1 --2- 172.21.15.86:0/3672808928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95201f1660 0x7f95201f1ae0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:11.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:11.123+0000 7f952483c640 1 --2- 172.21.15.86:0/3672808928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f952015e170 0x7f95200ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:11.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:11.123+0000 7f952483c640 1 --2- 172.21.15.86:0/3672808928 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95200d1120 0x7f9520158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:11.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:11.123+0000 7f952483c640 1 -- 172.21.15.86:0/3672808928 >> 172.21.15.86:0/3672808928 conn(0x7f952006d910 msgr2=0x7f95200c9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:11.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:11.123+0000 7f952483c640 1 -- 172.21.15.86:0/3672808928 shutdown_connections 2024-09-19T06:42:11.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:11.123+0000 7f952483c640 1 -- 172.21.15.86:0/3672808928 wait complete. 2024-09-19T06:42:11.150 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:42:13.151 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:42:13.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.323+0000 7f58f7fff640 1 Processor -- start 2024-09-19T06:42:13.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.324+0000 7f58f7fff640 1 -- start start 2024-09-19T06:42:13.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.325+0000 7f58f7fff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f58f00dee40 0x7f58f00e9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:13.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.325+0000 7f58f7fff640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58f0050850 con 0x7f58f00502d0 2024-09-19T06:42:13.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.325+0000 7f58f7fff640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58f00e1c60 con 0x7f58f00d8870 2024-09-19T06:42:13.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.325+0000 7f58f7fff640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f58f00e1f40 con 0x7f58f00dee40 2024-09-19T06:42:13.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.327+0000 7f58f77fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f58f00dee40 0x7f58f00e9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:13.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.327+0000 7f58f77fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f58f00dee40 0x7f58f00e9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:38666/0 (socket says 172.21.15.86:38666) 2024-09-19T06:42:13.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.327+0000 7f58f77fe640 1 -- 172.21.15.86:0/2474539540 learned_addr learned my addr 172.21.15.86:0/2474539540 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:42:13.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.327+0000 7f58f77fe640 1 -- 172.21.15.86:0/2474539540 >> v1:172.21.15.169:6789/0 conn(0x7f58f00d8870 legacy=0x7f58f0049950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:42:13.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.327+0000 7f58f77fe640 1 -- 172.21.15.86:0/2474539540 >> v1:172.21.15.86:6789/0 conn(0x7f58f00502d0 legacy=0x7f58f00de730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:13.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.327+0000 7f58f77fe640 1 -- 172.21.15.86:0/2474539540 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f00e2220 con 0x7f58f00dee40 2024-09-19T06:42:13.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.328+0000 7f58f77fe640 1 --2- 172.21.15.86:0/2474539540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58f00dee40 0x7f58f00e9f60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009870 tx=0x7f58e802a2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=946cf636a97f730b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:13.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.329+0000 7f58f5ffb640 1 -- 172.21.15.86:0/2474539540 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e8037070 con 0x7f58f00dee40 2024-09-19T06:42:13.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.329+0000 7f58f5ffb640 1 -- 172.21.15.86:0/2474539540 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e8032440 con 0x7f58f00dee40 2024-09-19T06:42:13.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.329+0000 7f58f5ffb640 1 -- 172.21.15.86:0/2474539540 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e8032810 con 0x7f58f00dee40 2024-09-19T06:42:13.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.330+0000 7f58f7fff640 1 -- 172.21.15.86:0/2474539540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58f00dee40 msgr2=0x7f58f00e9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:13.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.330+0000 7f58f7fff640 1 --2- 172.21.15.86:0/2474539540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58f00dee40 0x7f58f00e9f60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009870 tx=0x7f58e802a2a0 comp rx=0 tx=0).stop 2024-09-19T06:42:13.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.330+0000 7f58f7fff640 1 -- 172.21.15.86:0/2474539540 shutdown_connections 2024-09-19T06:42:13.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.330+0000 7f58f7fff640 1 --2- 172.21.15.86:0/2474539540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58f00dee40 0x7f58f00e9f60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:13.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.330+0000 7f58f7fff640 1 -- 172.21.15.86:0/2474539540 >> 172.21.15.86:0/2474539540 conn(0x7f58f0054450 msgr2=0x7f58f0054860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:13.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.334+0000 7f58f7fff640 1 -- 172.21.15.86:0/2474539540 shutdown_connections 2024-09-19T06:42:13.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.334+0000 7f58f7fff640 1 -- 172.21.15.86:0/2474539540 wait complete. 2024-09-19T06:42:13.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.336+0000 7f58f7fff640 1 Processor -- start 2024-09-19T06:42:13.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.336+0000 7f58f7fff640 1 -- start start 2024-09-19T06:42:13.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.337+0000 7f58f7fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58f00502d0 0x7f58f00d0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:13.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.337+0000 7f58f7fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58f00d8870 0x7f58f0051f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:13.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.337+0000 7f58f7fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58f00dee40 0x7f58f0181270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:13.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.337+0000 7f58f7fff640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f58f00d8c50 con 0x7f58f00dee40 2024-09-19T06:42:13.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.337+0000 7f58f7fff640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f58f000f720 con 0x7f58f00502d0 2024-09-19T06:42:13.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.337+0000 7f58f7fff640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f58f00d8dd0 con 0x7f58f00d8870 2024-09-19T06:42:13.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.337+0000 7f58f77fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58f00dee40 0x7f58f0181270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:13.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.337+0000 7f58f77fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58f00dee40 0x7f58f0181270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35714/0 (socket says 172.21.15.86:35714) 2024-09-19T06:42:13.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.337+0000 7f58f77fe640 1 -- 172.21.15.86:0/250851992 learned_addr learned my addr 172.21.15.86:0/250851992 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:42:13.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.337+0000 7f58f67fc640 1 --2- 172.21.15.86:0/250851992 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58f00d8870 0x7f58f0051f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:13.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.337+0000 7f58f6ffd640 1 --2- 172.21.15.86:0/250851992 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58f00502d0 0x7f58f00d0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:13.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.338+0000 7f58f77fe640 1 -- 172.21.15.86:0/250851992 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58f00d8870 msgr2=0x7f58f0051f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:13.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.338+0000 7f58f77fe640 1 --2- 172.21.15.86:0/250851992 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58f00d8870 0x7f58f0051f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:13.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.338+0000 7f58f77fe640 1 -- 172.21.15.86:0/250851992 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58f00502d0 msgr2=0x7f58f00d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:13.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.338+0000 7f58f77fe640 1 --2- 172.21.15.86:0/250851992 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58f00502d0 0x7f58f00d0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:13.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.338+0000 7f58f77fe640 1 -- 172.21.15.86:0/250851992 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f00ddc60 con 0x7f58f00dee40 2024-09-19T06:42:13.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.339+0000 7f58f77fe640 1 --2- 172.21.15.86:0/250851992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58f00dee40 0x7f58f0181270 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f58e802a2e0 tx=0x7f58e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:13.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.340+0000 7f58df7fe640 1 -- 172.21.15.86:0/250851992 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e8041070 con 0x7f58f00dee40 2024-09-19T06:42:13.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.340+0000 7f58df7fe640 1 -- 172.21.15.86:0/250851992 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e803c890 con 0x7f58f00dee40 2024-09-19T06:42:13.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.340+0000 7f58df7fe640 1 -- 172.21.15.86:0/250851992 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e8037040 con 0x7f58f00dee40 2024-09-19T06:42:13.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.341+0000 7f58f7fff640 1 -- 172.21.15.86:0/250851992 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58f01844e0 con 0x7f58f00dee40 2024-09-19T06:42:13.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.344+0000 7f58df7fe640 1 -- 172.21.15.86:0/250851992 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f58e8044070 con 0x7f58f00dee40 2024-09-19T06:42:13.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.345+0000 7f58df7fe640 1 --2- 172.21.15.86:0/250851992 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f58e406c330 0x7f58e406e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:13.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.346+0000 7f58f6ffd640 1 --2- 172.21.15.86:0/250851992 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f58e406c330 0x7f58e406e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:13.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.346+0000 7f58f7fff640 1 -- 172.21.15.86:0/250851992 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58f0184aa0 con 0x7f58f00dee40 2024-09-19T06:42:13.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.347+0000 7f58f6ffd640 1 --2- 172.21.15.86:0/250851992 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f58e406c330 0x7f58e406e7f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f58ec006fd0 tx=0x7f58ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:13.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.348+0000 7f58df7fe640 1 -- 172.21.15.86:0/250851992 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6993+0+0 (secure 0 0 0) 0x7f58e8077860 con 0x7f58f00dee40 2024-09-19T06:42:13.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.352+0000 7f58f7fff640 1 -- 172.21.15.86:0/250851992 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58f0036e20 con 0x7f58f00dee40 2024-09-19T06:42:13.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.361+0000 7f58df7fe640 1 -- 172.21.15.86:0/250851992 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f58e80a9e20 con 0x7f58f00dee40 2024-09-19T06:42:13.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.774+0000 7f58f7fff640 1 -- 172.21.15.86:0/250851992 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58f004e490 con 0x7f58f00dee40 2024-09-19T06:42:13.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.775+0000 7f58df7fe640 1 -- 172.21.15.86:0/250851992 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6044 (secure 0 0 0) 0x7f58e8079ec0 con 0x7f58f00dee40 2024-09-19T06:42:13.779 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:42:13.779 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":20,"btime":"2024-09-19T06:42:05:506115+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:42:05.506111+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"e","rank":0,"incarnation":20,"state":"up:replay","state_seq":1,"addr":"172.21.15.86:6839/1006149510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1006149510},{"type":"v1","addr":"172.21.15.86:6839","nonce":1006149510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:42:13.779 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 20 2024-09-19T06:42:13.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.781+0000 7f58f7fff640 1 -- 172.21.15.86:0/250851992 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f58e406c330 msgr2=0x7f58e406e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:13.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.781+0000 7f58f7fff640 1 --2- 172.21.15.86:0/250851992 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f58e406c330 0x7f58e406e7f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f58ec006fd0 tx=0x7f58ec008040 comp rx=0 tx=0).stop 2024-09-19T06:42:13.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.782+0000 7f58f7fff640 1 -- 172.21.15.86:0/250851992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58f00dee40 msgr2=0x7f58f0181270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:13.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.782+0000 7f58f7fff640 1 --2- 172.21.15.86:0/250851992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58f00dee40 0x7f58f0181270 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f58e802a2e0 tx=0x7f58e80046c0 comp rx=0 tx=0).stop 2024-09-19T06:42:13.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.782+0000 7f58f7fff640 1 -- 172.21.15.86:0/250851992 shutdown_connections 2024-09-19T06:42:13.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.782+0000 7f58f7fff640 1 --2- 172.21.15.86:0/250851992 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f58e406c330 0x7f58e406e7f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:13.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.782+0000 7f58f7fff640 1 --2- 172.21.15.86:0/250851992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58f00dee40 0x7f58f0181270 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:13.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.782+0000 7f58f7fff640 1 --2- 172.21.15.86:0/250851992 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58f00d8870 0x7f58f0051f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:13.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.782+0000 7f58f7fff640 1 --2- 172.21.15.86:0/250851992 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58f00502d0 0x7f58f00d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:13.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.782+0000 7f58f7fff640 1 -- 172.21.15.86:0/250851992 >> 172.21.15.86:0/250851992 conn(0x7f58f0054450 msgr2=0x7f58f00d52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:13.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.782+0000 7f58f7fff640 1 -- 172.21.15.86:0/250851992 shutdown_connections 2024-09-19T06:42:13.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:13.782+0000 7f58f7fff640 1 -- 172.21.15.86:0/250851992 wait complete. 2024-09-19T06:42:13.804 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:42:15.806 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:42:16.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:15.995+0000 7fe7f1eb6640 1 Processor -- start 2024-09-19T06:42:16.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:15.995+0000 7fe7f1eb6640 1 -- start start 2024-09-19T06:42:16.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:15.997+0000 7fe7f1eb6640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe7ec06c180 0x7fe7ec150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:16.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:15.997+0000 7fe7f1eb6640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7ec0732d0 con 0x7fe7ec068f20 2024-09-19T06:42:16.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:15.997+0000 7fe7f1eb6640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7ec071f50 con 0x7fe7ec06bda0 2024-09-19T06:42:16.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:15.997+0000 7fe7f1eb6640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fe7ec072230 con 0x7fe7ec06c180 2024-09-19T06:42:16.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:15.997+0000 7fe7ebfff640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe7ec068f20 0x7fe7ec0c75d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58964/0 (socket says 172.21.15.86:58964) 2024-09-19T06:42:16.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:15.997+0000 7fe7ebfff640 1 -- 172.21.15.86:0/2040603173 learned_addr learned my addr 172.21.15.86:0/2040603173 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:42:16.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:15.998+0000 7fe7f16b5640 1 --2- 172.21.15.86:0/2040603173 >> v2:172.21.15.86:3300/0 conn(0x7fe7ec06c180 0x7fe7ec150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:16.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:15.998+0000 7fe7eb7fe640 1 -- 172.21.15.86:0/2040603173 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1118568836 0 0) 0x7fe7ec0732d0 con 0x7fe7ec068f20 2024-09-19T06:42:16.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:15.998+0000 7fe7eb7fe640 1 -- 172.21.15.86:0/2040603173 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7d4003520 con 0x7fe7ec068f20 2024-09-19T06:42:16.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:15.998+0000 7fe7eb7fe640 1 -- 172.21.15.86:0/2040603173 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3637985119 0 0) 0x7fe7ec071f50 con 0x7fe7ec06bda0 2024-09-19T06:42:16.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:15.998+0000 7fe7eb7fe640 1 -- 172.21.15.86:0/2040603173 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7ec0732d0 con 0x7fe7ec06bda0 2024-09-19T06:42:16.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:15.998+0000 7fe7f16b5640 1 -- 172.21.15.86:0/2040603173 >> v1:172.21.15.169:6789/0 conn(0x7fe7ec06bda0 legacy=0x7fe7ec157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:16.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:15.998+0000 7fe7f16b5640 1 -- 172.21.15.86:0/2040603173 >> v1:172.21.15.86:6789/0 conn(0x7fe7ec068f20 legacy=0x7fe7ec0c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:16.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:15.998+0000 7fe7f16b5640 1 -- 172.21.15.86:0/2040603173 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ec072510 con 0x7fe7ec06c180 2024-09-19T06:42:16.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.000+0000 7fe7f16b5640 1 --2- 172.21.15.86:0/2040603173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7ec06c180 0x7fe7ec150ba0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4014480 tx=0x7fe7e4032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=724c21e77f5d00e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:16.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.001+0000 7fe7eb7fe640 1 -- 172.21.15.86:0/2040603173 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4040070 con 0x7fe7ec06c180 2024-09-19T06:42:16.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.001+0000 7fe7eb7fe640 1 -- 172.21.15.86:0/2040603173 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7e4033860 con 0x7fe7ec06c180 2024-09-19T06:42:16.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.001+0000 7fe7eb7fe640 1 -- 172.21.15.86:0/2040603173 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e0001670 con 0x7fe7ec06c180 2024-09-19T06:42:16.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.002+0000 7fe7f1eb6640 1 -- 172.21.15.86:0/2040603173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7ec06c180 msgr2=0x7fe7ec150ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:16.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.002+0000 7fe7f1eb6640 1 --2- 172.21.15.86:0/2040603173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7ec06c180 0x7fe7ec150ba0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4014480 tx=0x7fe7e4032dd0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.003+0000 7fe7f1eb6640 1 -- 172.21.15.86:0/2040603173 shutdown_connections 2024-09-19T06:42:16.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.003+0000 7fe7f1eb6640 1 --2- 172.21.15.86:0/2040603173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7ec06c180 0x7fe7ec150ba0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.003+0000 7fe7f1eb6640 1 -- 172.21.15.86:0/2040603173 >> 172.21.15.86:0/2040603173 conn(0x7fe7ec0ccbd0 msgr2=0x7fe7ec0ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:16.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.008+0000 7fe7f1eb6640 1 -- 172.21.15.86:0/2040603173 shutdown_connections 2024-09-19T06:42:16.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.010+0000 7fe7f1eb6640 1 -- 172.21.15.86:0/2040603173 wait complete. 2024-09-19T06:42:16.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.012+0000 7fe7f1eb6640 1 Processor -- start 2024-09-19T06:42:16.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.016+0000 7fe7f1eb6640 1 -- start start 2024-09-19T06:42:16.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.017+0000 7fe7f1eb6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7ec068f20 0x7fe7ec1ecec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:16.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.017+0000 7fe7f1eb6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7ec06bda0 0x7fe7ec0c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:16.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.017+0000 7fe7f1eb6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7ec06c180 0x7fe7ec159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:16.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.017+0000 7fe7f1eb6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec072db0 con 0x7fe7ec06c180 2024-09-19T06:42:16.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.017+0000 7fe7f1eb6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec072ad0 con 0x7fe7ec06bda0 2024-09-19T06:42:16.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.017+0000 7fe7f1eb6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe7ec0c7ce0 con 0x7fe7ec068f20 2024-09-19T06:42:16.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.017+0000 7fe7ebfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7ec06bda0 0x7fe7ec0c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:16.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.018+0000 7fe7ebfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7ec06bda0 0x7fe7ec0c9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:38694/0 (socket says 172.21.15.86:38694) 2024-09-19T06:42:16.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.018+0000 7fe7ebfff640 1 -- 172.21.15.86:0/3688592808 learned_addr learned my addr 172.21.15.86:0/3688592808 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:42:16.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.018+0000 7fe7f16b5640 1 --2- 172.21.15.86:0/3688592808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7ec06c180 0x7fe7ec159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:16.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.018+0000 7fe7ebfff640 1 -- 172.21.15.86:0/3688592808 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7ec068f20 msgr2=0x7fe7ec1ecec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:16.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.018+0000 7fe7ebfff640 1 --2- 172.21.15.86:0/3688592808 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7ec068f20 0x7fe7ec1ecec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.018+0000 7fe7ebfff640 1 -- 172.21.15.86:0/3688592808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7ec06c180 msgr2=0x7fe7ec159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:16.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.018+0000 7fe7ebfff640 1 --2- 172.21.15.86:0/3688592808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7ec06c180 0x7fe7ec159e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.018+0000 7fe7ebfff640 1 -- 172.21.15.86:0/3688592808 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ec15a9b0 con 0x7fe7ec06bda0 2024-09-19T06:42:16.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.018+0000 7fe7f16b5640 1 --2- 172.21.15.86:0/3688592808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7ec06c180 0x7fe7ec159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:42:16.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.020+0000 7fe7ebfff640 1 --2- 172.21.15.86:0/3688592808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7ec06bda0 0x7fe7ec0c9210 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe7e00011e0 tx=0x7fe7e000cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:16.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.021+0000 7fe7e97fa640 1 -- 172.21.15.86:0/3688592808 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e0018070 con 0x7fe7ec06bda0 2024-09-19T06:42:16.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.021+0000 7fe7f1eb6640 1 -- 172.21.15.86:0/3688592808 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7ec15ac50 con 0x7fe7ec06bda0 2024-09-19T06:42:16.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.021+0000 7fe7f1eb6640 1 -- 172.21.15.86:0/3688592808 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7ec15b210 con 0x7fe7ec06bda0 2024-09-19T06:42:16.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.023+0000 7fe7f1eb6640 1 -- 172.21.15.86:0/3688592808 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7ec068920 con 0x7fe7ec06bda0 2024-09-19T06:42:16.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.024+0000 7fe7e97fa640 1 -- 172.21.15.86:0/3688592808 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7e0007500 con 0x7fe7ec06bda0 2024-09-19T06:42:16.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.024+0000 7fe7e97fa640 1 -- 172.21.15.86:0/3688592808 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e0004a20 con 0x7fe7ec06bda0 2024-09-19T06:42:16.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.027+0000 7fe7e97fa640 1 -- 172.21.15.86:0/3688592808 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe7e001b070 con 0x7fe7ec06bda0 2024-09-19T06:42:16.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.028+0000 7fe7e97fa640 1 --2- 172.21.15.86:0/3688592808 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe7d806c2e0 0x7fe7d806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:16.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.028+0000 7fe7f0eb4640 1 --2- 172.21.15.86:0/3688592808 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe7d806c2e0 0x7fe7d806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:16.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.029+0000 7fe7f0eb4640 1 --2- 172.21.15.86:0/3688592808 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe7d806c2e0 0x7fe7d806e7a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc001640 tx=0x7fe7dc007860 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:16.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.029+0000 7fe7e97fa640 1 -- 172.21.15.86:0/3688592808 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6993+0+0 (secure 0 0 0) 0x7fe7e008b3a0 con 0x7fe7ec06bda0 2024-09-19T06:42:16.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.031+0000 7fe7e97fa640 1 -- 172.21.15.86:0/3688592808 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe7e0022020 con 0x7fe7ec06bda0 2024-09-19T06:42:16.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.457+0000 7fe7f1eb6640 1 -- 172.21.15.86:0/3688592808 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7ec14e880 con 0x7fe7ec06bda0 2024-09-19T06:42:16.459 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.457+0000 7fe7e97fa640 1 -- 172.21.15.86:0/3688592808 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+6048 (secure 0 0 0) 0x7fe7e0059670 con 0x7fe7ec06bda0 2024-09-19T06:42:16.459 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:42:16.459 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":21,"btime":"2024-09-19T06:42:14:549543+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:42:14.282453+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"e","rank":0,"incarnation":20,"state":"up:reconnect","state_seq":15,"addr":"172.21.15.86:6839/1006149510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1006149510},{"type":"v1","addr":"172.21.15.86:6839","nonce":1006149510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:42:16.460 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 21 2024-09-19T06:42:16.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.461+0000 7fe7f1eb6640 1 -- 172.21.15.86:0/3688592808 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe7d806c2e0 msgr2=0x7fe7d806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:16.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.461+0000 7fe7f1eb6640 1 --2- 172.21.15.86:0/3688592808 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe7d806c2e0 0x7fe7d806e7a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc001640 tx=0x7fe7dc007860 comp rx=0 tx=0).stop 2024-09-19T06:42:16.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.461+0000 7fe7f1eb6640 1 -- 172.21.15.86:0/3688592808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7ec06bda0 msgr2=0x7fe7ec0c9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:16.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.461+0000 7fe7f1eb6640 1 --2- 172.21.15.86:0/3688592808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7ec06bda0 0x7fe7ec0c9210 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe7e00011e0 tx=0x7fe7e000cc50 comp rx=0 tx=0).stop 2024-09-19T06:42:16.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.461+0000 7fe7f1eb6640 1 -- 172.21.15.86:0/3688592808 shutdown_connections 2024-09-19T06:42:16.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.461+0000 7fe7f1eb6640 1 --2- 172.21.15.86:0/3688592808 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe7d806c2e0 0x7fe7d806e7a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.461+0000 7fe7f1eb6640 1 --2- 172.21.15.86:0/3688592808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7ec06c180 0x7fe7ec159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.461+0000 7fe7f1eb6640 1 --2- 172.21.15.86:0/3688592808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7ec06bda0 0x7fe7ec0c9210 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.461+0000 7fe7f1eb6640 1 --2- 172.21.15.86:0/3688592808 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7ec068f20 0x7fe7ec1ecec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.461+0000 7fe7f1eb6640 1 -- 172.21.15.86:0/3688592808 >> 172.21.15.86:0/3688592808 conn(0x7fe7ec0ccbd0 msgr2=0x7fe7ec075200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:16.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.464+0000 7fe7f1eb6640 1 -- 172.21.15.86:0/3688592808 shutdown_connections 2024-09-19T06:42:16.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:16.464+0000 7fe7f1eb6640 1 -- 172.21.15.86:0/3688592808 wait complete. 2024-09-19T06:42:16.483 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:42:18.484 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:42:18.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.667+0000 7f673ffff640 1 Processor -- start 2024-09-19T06:42:18.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.667+0000 7f673ffff640 1 -- start start 2024-09-19T06:42:18.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.668+0000 7f673ffff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6740150c30 0x7f6740151040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:18.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.668+0000 7f673ffff640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6740151580 con 0x7f67400c7e20 2024-09-19T06:42:18.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.668+0000 7f673ffff640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67400c7060 con 0x7f67400c8fc0 2024-09-19T06:42:18.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.668+0000 7f673ffff640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f67400c7340 con 0x7f6740150c30 2024-09-19T06:42:18.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.669+0000 7f673f7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6740150c30 0x7f6740151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:18.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.669+0000 7f673f7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6740150c30 0x7f6740151040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35748/0 (socket says 172.21.15.86:35748) 2024-09-19T06:42:18.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.669+0000 7f673f7fe640 1 -- 172.21.15.86:0/2284082790 learned_addr learned my addr 172.21.15.86:0/2284082790 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:42:18.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.669+0000 7f673f7fe640 1 -- 172.21.15.86:0/2284082790 >> v1:172.21.15.169:6789/0 conn(0x7f67400c8fc0 legacy=0x7f67400c8280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:42:18.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.669+0000 7f673f7fe640 1 -- 172.21.15.86:0/2284082790 >> v1:172.21.15.86:6789/0 conn(0x7f67400c7e20 legacy=0x7f67401582b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:42:18.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.669+0000 7f673f7fe640 1 -- 172.21.15.86:0/2284082790 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67400c7620 con 0x7f6740150c30 2024-09-19T06:42:18.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.670+0000 7f673f7fe640 1 --2- 172.21.15.86:0/2284082790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6740150c30 0x7f6740151040 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f67380133b0 tx=0x7f6738032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44cfc3feb55b303f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:18.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.672+0000 7f673dffb640 1 -- 172.21.15.86:0/2284082790 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67380112d0 con 0x7f6740150c30 2024-09-19T06:42:18.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.673+0000 7f673dffb640 1 -- 172.21.15.86:0/2284082790 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6738011470 con 0x7f6740150c30 2024-09-19T06:42:18.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.673+0000 7f673dffb640 1 -- 172.21.15.86:0/2284082790 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673800f850 con 0x7f6740150c30 2024-09-19T06:42:18.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.674+0000 7f673ffff640 1 -- 172.21.15.86:0/2284082790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6740150c30 msgr2=0x7f6740151040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:18.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.674+0000 7f673ffff640 1 --2- 172.21.15.86:0/2284082790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6740150c30 0x7f6740151040 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f67380133b0 tx=0x7f6738032c60 comp rx=0 tx=0).stop 2024-09-19T06:42:18.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.674+0000 7f673ffff640 1 -- 172.21.15.86:0/2284082790 shutdown_connections 2024-09-19T06:42:18.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.674+0000 7f673ffff640 1 --2- 172.21.15.86:0/2284082790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6740150c30 0x7f6740151040 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.674+0000 7f673ffff640 1 -- 172.21.15.86:0/2284082790 >> 172.21.15.86:0/2284082790 conn(0x7f674006bda0 msgr2=0x7f674006c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:18.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.674+0000 7f673ffff640 1 -- 172.21.15.86:0/2284082790 shutdown_connections 2024-09-19T06:42:18.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.674+0000 7f673ffff640 1 -- 172.21.15.86:0/2284082790 wait complete. 2024-09-19T06:42:18.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.676+0000 7f673ffff640 1 Processor -- start 2024-09-19T06:42:18.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.676+0000 7f673ffff640 1 -- start start 2024-09-19T06:42:18.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.678+0000 7f673ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67400c7e20 0x7f67401efe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:18.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.678+0000 7f673ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67400c8fc0 0x7f6740149170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:18.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.678+0000 7f673ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6740150c30 0x7f6740072630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:18.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.678+0000 7f673effd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67400c7e20 0x7f67401efe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:18.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.678+0000 7f673effd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67400c7e20 0x7f67401efe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:38704/0 (socket says 172.21.15.86:38704) 2024-09-19T06:42:18.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.678+0000 7f673effd640 1 -- 172.21.15.86:0/362587939 learned_addr learned my addr 172.21.15.86:0/362587939 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:42:18.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.678+0000 7f673f7fe640 1 --2- 172.21.15.86:0/362587939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6740150c30 0x7f6740072630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:18.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.678+0000 7f673ffff640 1 -- 172.21.15.86:0/362587939 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f67401571b0 con 0x7f67400c8fc0 2024-09-19T06:42:18.681 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.678+0000 7f673ffff640 1 -- 172.21.15.86:0/362587939 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6740157030 con 0x7f67400c7e20 2024-09-19T06:42:18.681 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.678+0000 7f673ffff640 1 -- 172.21.15.86:0/362587939 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f67400c8990 con 0x7f6740150c30 2024-09-19T06:42:18.681 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.679+0000 7f673e7fc640 1 --2- 172.21.15.86:0/362587939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67400c8fc0 0x7f6740149170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:18.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.679+0000 7f673e7fc640 1 -- 172.21.15.86:0/362587939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6740150c30 msgr2=0x7f6740072630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:18.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.680+0000 7f673e7fc640 1 --2- 172.21.15.86:0/362587939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6740150c30 0x7f6740072630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.680+0000 7f673e7fc640 1 -- 172.21.15.86:0/362587939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67400c7e20 msgr2=0x7f67401efe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:18.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.680+0000 7f673e7fc640 1 --2- 172.21.15.86:0/362587939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67400c7e20 0x7f67401efe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.680+0000 7f673e7fc640 1 -- 172.21.15.86:0/362587939 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67400cba00 con 0x7f67400c8fc0 2024-09-19T06:42:18.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.680+0000 7f673effd640 1 --2- 172.21.15.86:0/362587939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67400c7e20 0x7f67401efe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:42:18.683 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.680+0000 7f673e7fc640 1 --2- 172.21.15.86:0/362587939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67400c8fc0 0x7f6740149170 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f673000bfc0 tx=0x7f6730009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:18.683 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.680+0000 7f673f7fe640 1 --2- 172.21.15.86:0/362587939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6740150c30 0x7f6740072630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:42:18.683 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.681+0000 7f67377fe640 1 -- 172.21.15.86:0/362587939 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6730013600 con 0x7f67400c8fc0 2024-09-19T06:42:18.683 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.681+0000 7f67377fe640 1 -- 172.21.15.86:0/362587939 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67300137c0 con 0x7f67400c8fc0 2024-09-19T06:42:18.683 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.681+0000 7f673ffff640 1 -- 172.21.15.86:0/362587939 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67400c55a0 con 0x7f67400c8fc0 2024-09-19T06:42:18.683 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.682+0000 7f67377fe640 1 -- 172.21.15.86:0/362587939 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6730013bb0 con 0x7f67400c8fc0 2024-09-19T06:42:18.684 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.682+0000 7f673ffff640 1 -- 172.21.15.86:0/362587939 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67401f0340 con 0x7f67400c8fc0 2024-09-19T06:42:18.685 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.684+0000 7f67377fe640 1 -- 172.21.15.86:0/362587939 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f673001c400 con 0x7f67400c8fc0 2024-09-19T06:42:18.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.685+0000 7f67377fe640 1 --2- 172.21.15.86:0/362587939 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f672006c2b0 0x7f672006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:18.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.685+0000 7f673effd640 1 --2- 172.21.15.86:0/362587939 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f672006c2b0 0x7f672006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:18.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.686+0000 7f673effd640 1 --2- 172.21.15.86:0/362587939 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f672006c2b0 0x7f672006e770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f672800a920 tx=0x7f6728008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:18.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.686+0000 7f67377fe640 1 -- 172.21.15.86:0/362587939 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6993+0+0 (secure 0 0 0) 0x7f673008c640 con 0x7f67400c8fc0 2024-09-19T06:42:18.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.687+0000 7f67357fa640 1 -- 172.21.15.86:0/362587939 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6740156ba0 con 0x7f67400c8fc0 2024-09-19T06:42:18.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:18.696+0000 7f67377fe640 1 -- 172.21.15.86:0/362587939 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6740156ba0 con 0x7f67400c8fc0 2024-09-19T06:42:19.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:19.155+0000 7f67357fa640 1 -- 172.21.15.86:0/362587939 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6740151040 con 0x7f67400c8fc0 2024-09-19T06:42:19.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:19.156+0000 7f67377fe640 1 -- 172.21.15.86:0/362587939 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+6048 (secure 0 0 0) 0x7f673005a130 con 0x7f67400c8fc0 2024-09-19T06:42:19.159 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:42:19.159 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":21,"btime":"2024-09-19T06:42:14:549543+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:42:14.282453+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"e","rank":0,"incarnation":20,"state":"up:reconnect","state_seq":15,"addr":"172.21.15.86:6839/1006149510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1006149510},{"type":"v1","addr":"172.21.15.86:6839","nonce":1006149510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:42:19.159 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 21 2024-09-19T06:42:19.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:19.161+0000 7f67357fa640 1 -- 172.21.15.86:0/362587939 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f672006c2b0 msgr2=0x7f672006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:19.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:19.162+0000 7f67357fa640 1 --2- 172.21.15.86:0/362587939 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f672006c2b0 0x7f672006e770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f672800a920 tx=0x7f6728008040 comp rx=0 tx=0).stop 2024-09-19T06:42:19.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:19.162+0000 7f67357fa640 1 -- 172.21.15.86:0/362587939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67400c8fc0 msgr2=0x7f6740149170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:19.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:19.162+0000 7f67357fa640 1 --2- 172.21.15.86:0/362587939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67400c8fc0 0x7f6740149170 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f673000bfc0 tx=0x7f6730009f10 comp rx=0 tx=0).stop 2024-09-19T06:42:19.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:19.163+0000 7f67357fa640 1 -- 172.21.15.86:0/362587939 shutdown_connections 2024-09-19T06:42:19.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:19.163+0000 7f67357fa640 1 --2- 172.21.15.86:0/362587939 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f672006c2b0 0x7f672006e770 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:19.163+0000 7f67357fa640 1 --2- 172.21.15.86:0/362587939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6740150c30 0x7f6740072630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:19.163+0000 7f67357fa640 1 --2- 172.21.15.86:0/362587939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67400c8fc0 0x7f6740149170 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:19.163+0000 7f67357fa640 1 --2- 172.21.15.86:0/362587939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67400c7e20 0x7f67401efe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:19.163+0000 7f67357fa640 1 -- 172.21.15.86:0/362587939 >> 172.21.15.86:0/362587939 conn(0x7f674006bda0 msgr2=0x7f674014f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:19.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:19.164+0000 7f67357fa640 1 -- 172.21.15.86:0/362587939 shutdown_connections 2024-09-19T06:42:19.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:19.165+0000 7f67357fa640 1 -- 172.21.15.86:0/362587939 wait complete. 2024-09-19T06:42:19.188 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:42:21.189 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:42:21.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.357+0000 7f8cac9f6640 1 Processor -- start 2024-09-19T06:42:21.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.357+0000 7f8cac9f6640 1 -- start start 2024-09-19T06:42:21.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.359+0000 7f8cac9f6640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8ca00d8be0 0x7f8ca004ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:21.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.359+0000 7f8cac9f6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ca0007370 0x7f8ca0005d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:21.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.359+0000 7f8cac9f6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8ca004f8a0 0x7f8ca000e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:21.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.359+0000 7f8cac9f6640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f8ca0050550 con 0x7f8ca00d8be0 2024-09-19T06:42:21.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.359+0000 7f8cac9f6640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f8ca0050830 con 0x7f8ca004f8a0 2024-09-19T06:42:21.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.359+0000 7f8ca6d9d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8ca004f8a0 0x7f8ca000e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:21.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.359+0000 7f8ca5d9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ca0007370 0x7f8ca0005d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:21.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.359+0000 7f8ca5d9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ca0007370 0x7f8ca0005d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:33630/0 (socket says 172.21.15.86:33630) 2024-09-19T06:42:21.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.359+0000 7f8ca5d9b640 1 -- 172.21.15.86:0/78430991 learned_addr learned my addr 172.21.15.86:0/78430991 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:42:21.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.359+0000 7f8cac9f6640 1 -- 172.21.15.86:0/78430991 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8ca004f0a0 con 0x7f8ca0007370 2024-09-19T06:42:21.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.359+0000 7f8ca659c640 1 --2- 172.21.15.86:0/78430991 >> v2:172.21.15.86:3300/0 conn(0x7f8ca00d8be0 0x7f8ca004ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:21.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.360+0000 7f8ca659c640 1 -- 172.21.15.86:0/78430991 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ca0007370 msgr2=0x7f8ca0005d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:21.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.360+0000 7f8ca659c640 1 --2- 172.21.15.86:0/78430991 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ca0007370 0x7f8ca0005d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:21.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.360+0000 7f8ca659c640 1 -- 172.21.15.86:0/78430991 >> v2:172.21.15.169:3300/0 conn(0x7f8ca004f8a0 msgr2=0x7f8ca000e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:21.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.360+0000 7f8ca659c640 1 --2- 172.21.15.86:0/78430991 >> v2:172.21.15.169:3300/0 conn(0x7f8ca004f8a0 0x7f8ca000e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:21.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.360+0000 7f8ca659c640 1 -- 172.21.15.86:0/78430991 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca004f380 con 0x7f8ca00d8be0 2024-09-19T06:42:21.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.361+0000 7f8ca659c640 1 --2- 172.21.15.86:0/78430991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ca00d8be0 0x7f8ca004ea30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8ca004b2a0 tx=0x7f8c9802a120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13128c44015cdc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:21.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.362+0000 7f8ca559a640 1 -- 172.21.15.86:0/78430991 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c98037070 con 0x7f8ca00d8be0 2024-09-19T06:42:21.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.362+0000 7f8ca559a640 1 -- 172.21.15.86:0/78430991 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c98032440 con 0x7f8ca00d8be0 2024-09-19T06:42:21.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.362+0000 7f8ca559a640 1 -- 172.21.15.86:0/78430991 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c98032810 con 0x7f8ca00d8be0 2024-09-19T06:42:21.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.363+0000 7f8cac9f6640 1 -- 172.21.15.86:0/78430991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ca00d8be0 msgr2=0x7f8ca004ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:21.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.363+0000 7f8cac9f6640 1 --2- 172.21.15.86:0/78430991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ca00d8be0 0x7f8ca004ea30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8ca004b2a0 tx=0x7f8c9802a120 comp rx=0 tx=0).stop 2024-09-19T06:42:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.365+0000 7f8cac9f6640 1 -- 172.21.15.86:0/78430991 shutdown_connections 2024-09-19T06:42:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.365+0000 7f8cac9f6640 1 --2- 172.21.15.86:0/78430991 >> v2:172.21.15.169:3300/0 conn(0x7f8ca004f8a0 0x7f8ca000e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:21.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.365+0000 7f8cac9f6640 1 --2- 172.21.15.86:0/78430991 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ca0007370 0x7f8ca0005d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:21.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.365+0000 7f8cac9f6640 1 --2- 172.21.15.86:0/78430991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ca00d8be0 0x7f8ca004ea30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:21.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.365+0000 7f8cac9f6640 1 -- 172.21.15.86:0/78430991 >> 172.21.15.86:0/78430991 conn(0x7f8ca00544a0 msgr2=0x7f8ca00548b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:21.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.365+0000 7f8cac9f6640 1 -- 172.21.15.86:0/78430991 shutdown_connections 2024-09-19T06:42:21.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.365+0000 7f8cac9f6640 1 -- 172.21.15.86:0/78430991 wait complete. 2024-09-19T06:42:21.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.367+0000 7f8cac9f6640 1 Processor -- start 2024-09-19T06:42:21.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.367+0000 7f8cac9f6640 1 -- start start 2024-09-19T06:42:21.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.369+0000 7f8cac9f6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ca0007370 0x7f8ca01783f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:21.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.369+0000 7f8cac9f6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ca004f8a0 0x7f8ca0174e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:21.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.369+0000 7f8ca659c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ca0007370 0x7f8ca01783f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:21.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.369+0000 7f8ca659c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ca0007370 0x7f8ca01783f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:38724/0 (socket says 172.21.15.86:38724) 2024-09-19T06:42:21.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.370+0000 7f8ca5d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ca004f8a0 0x7f8ca0174e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:21.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.370+0000 7f8ca5d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ca004f8a0 0x7f8ca0174e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35772/0 (socket says 172.21.15.86:35772) 2024-09-19T06:42:21.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.370+0000 7f8ca659c640 1 -- 172.21.15.86:0/4174337530 learned_addr learned my addr 172.21.15.86:0/4174337530 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:42:21.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.370+0000 7f8cac9f6640 1 --2- 172.21.15.86:0/4174337530 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ca00d8be0 0x7f8ca00d4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:21.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.370+0000 7f8cac9f6640 1 -- 172.21.15.86:0/4174337530 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca0049370 con 0x7f8ca004f8a0 2024-09-19T06:42:21.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.370+0000 7f8ca6d9d640 1 --2- 172.21.15.86:0/4174337530 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ca00d8be0 0x7f8ca00d4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:21.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.371+0000 7f8cac9f6640 1 -- 172.21.15.86:0/4174337530 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca00491f0 con 0x7f8ca0007370 2024-09-19T06:42:21.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.371+0000 7f8cac9f6640 1 -- 172.21.15.86:0/4174337530 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8ca004fee0 con 0x7f8ca00d8be0 2024-09-19T06:42:21.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.371+0000 7f8ca6d9d640 1 -- 172.21.15.86:0/4174337530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ca0007370 msgr2=0x7f8ca01783f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:21.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.371+0000 7f8ca6d9d640 1 --2- 172.21.15.86:0/4174337530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ca0007370 0x7f8ca01783f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:21.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.371+0000 7f8ca6d9d640 1 -- 172.21.15.86:0/4174337530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ca004f8a0 msgr2=0x7f8ca0174e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:21.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.371+0000 7f8ca6d9d640 1 --2- 172.21.15.86:0/4174337530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ca004f8a0 0x7f8ca0174e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:21.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.371+0000 7f8ca6d9d640 1 -- 172.21.15.86:0/4174337530 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca00d4ad0 con 0x7f8ca00d8be0 2024-09-19T06:42:21.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.372+0000 7f8ca6d9d640 1 --2- 172.21.15.86:0/4174337530 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ca00d8be0 0x7f8ca00d4220 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8065710 tx=0x7f8ca80692f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:21.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.372+0000 7f8c96ffd640 1 -- 172.21.15.86:0/4174337530 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca809a070 con 0x7f8ca00d8be0 2024-09-19T06:42:21.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.372+0000 7f8c96ffd640 1 -- 172.21.15.86:0/4174337530 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca8074960 con 0x7f8ca00d8be0 2024-09-19T06:42:21.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.372+0000 7f8cac9f6640 1 -- 172.21.15.86:0/4174337530 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ca00d7790 con 0x7f8ca00d8be0 2024-09-19T06:42:21.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.373+0000 7f8cac9f6640 1 -- 172.21.15.86:0/4174337530 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ca00d7d50 con 0x7f8ca00d8be0 2024-09-19T06:42:21.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.373+0000 7f8c96ffd640 1 -- 172.21.15.86:0/4174337530 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8095630 con 0x7f8ca00d8be0 2024-09-19T06:42:21.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.376+0000 7f8cac9f6640 1 -- 172.21.15.86:0/4174337530 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c8c005290 con 0x7f8ca00d8be0 2024-09-19T06:42:21.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.377+0000 7f8c96ffd640 1 -- 172.21.15.86:0/4174337530 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8ca809d070 con 0x7f8ca00d8be0 2024-09-19T06:42:21.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.377+0000 7f8c96ffd640 1 --2- 172.21.15.86:0/4174337530 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8c8806c380 0x7f8c8806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:21.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.378+0000 7f8c96ffd640 1 -- 172.21.15.86:0/4174337530 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) ==== 6993+0+0 (secure 0 0 0) 0x7f8ca8107cf0 con 0x7f8ca00d8be0 2024-09-19T06:42:21.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.379+0000 7f8ca659c640 1 --2- 172.21.15.86:0/4174337530 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8c8806c380 0x7f8c8806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:21.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.385+0000 7f8ca659c640 1 --2- 172.21.15.86:0/4174337530 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8c8806c380 0x7f8c8806e840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009560 tx=0x7f8c9802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:21.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.388+0000 7f8c96ffd640 1 -- 172.21.15.86:0/4174337530 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8ca8092070 con 0x7f8ca00d8be0 2024-09-19T06:42:21.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.793+0000 7f8cac9f6640 1 -- 172.21.15.86:0/4174337530 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c8c005580 con 0x7f8ca00d8be0 2024-09-19T06:42:21.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.795+0000 7f8c96ffd640 1 -- 172.21.15.86:0/4174337530 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+6045 (secure 0 0 0) 0x7f8ca80d58e0 con 0x7f8ca00d8be0 2024-09-19T06:42:21.797 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:42:21.797 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":22,"btime":"2024-09-19T06:42:19:580114+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:42:19.573971+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"e","rank":0,"incarnation":20,"state":"up:rejoin","state_seq":17,"addr":"172.21.15.86:6839/1006149510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1006149510},{"type":"v1","addr":"172.21.15.86:6839","nonce":1006149510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:42:21.797 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 22 2024-09-19T06:42:21.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.801+0000 7f8cac9f6640 1 -- 172.21.15.86:0/4174337530 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8c8806c380 msgr2=0x7f8c8806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:21.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.801+0000 7f8cac9f6640 1 --2- 172.21.15.86:0/4174337530 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8c8806c380 0x7f8c8806e840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009560 tx=0x7f8c9802e000 comp rx=0 tx=0).stop 2024-09-19T06:42:21.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.801+0000 7f8cac9f6640 1 -- 172.21.15.86:0/4174337530 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ca00d8be0 msgr2=0x7f8ca00d4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:21.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.801+0000 7f8cac9f6640 1 --2- 172.21.15.86:0/4174337530 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ca00d8be0 0x7f8ca00d4220 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8065710 tx=0x7f8ca80692f0 comp rx=0 tx=0).stop 2024-09-19T06:42:21.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.801+0000 7f8cac9f6640 1 -- 172.21.15.86:0/4174337530 shutdown_connections 2024-09-19T06:42:21.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.801+0000 7f8cac9f6640 1 --2- 172.21.15.86:0/4174337530 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8c8806c380 0x7f8c8806e840 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:21.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.801+0000 7f8cac9f6640 1 --2- 172.21.15.86:0/4174337530 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ca00d8be0 0x7f8ca00d4220 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:21.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.801+0000 7f8cac9f6640 1 --2- 172.21.15.86:0/4174337530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ca004f8a0 0x7f8ca0174e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:21.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.801+0000 7f8cac9f6640 1 --2- 172.21.15.86:0/4174337530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ca0007370 0x7f8ca01783f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:21.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.801+0000 7f8cac9f6640 1 -- 172.21.15.86:0/4174337530 >> 172.21.15.86:0/4174337530 conn(0x7f8ca00544a0 msgr2=0x7f8ca00de6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:21.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.802+0000 7f8cac9f6640 1 -- 172.21.15.86:0/4174337530 shutdown_connections 2024-09-19T06:42:21.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:21.802+0000 7f8cac9f6640 1 -- 172.21.15.86:0/4174337530 wait complete. 2024-09-19T06:42:21.822 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "btime": "2024-09-19T06:42:19:580114+0000", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 22, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-19T06:37:08.763572+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 22, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4998": { "addr": "172.21.15.86:6839/1006149510", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6838", "nonce": 1006149510, "type": "v2" }, { "addr": "172.21.15.86:6839", "nonce": 1006149510, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4998, "incarnation": 20, "join_fscid": -1, "name": "e", "rank": 0, "state": "up:rejoin", "state_seq": 17 } }, "last_failure": 0, "last_failure_osd_epoch": 31, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-09-19T06:42:19.573971+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4998 } } } ], "standbys": [ { "addr": "172.21.15.86:6837/728803297", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6835", "nonce": 728803297, "type": "v2" }, { "addr": "172.21.15.86:6837", "nonce": 728803297, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4247, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.169:6835/2537509253", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6833", "nonce": 2537509253, "type": "v2" }, { "addr": "172.21.15.169:6835", "nonce": 2537509253, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4262, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.169:6834/1723647527", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6832", "nonce": 1723647527, "type": "v2" }, { "addr": "172.21.15.169:6834", "nonce": 1723647527, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4265, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.86:6836/4135959816", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6834", "nonce": 4135959816, "type": "v2" }, { "addr": "172.21.15.86:6836", "nonce": 4135959816, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4270, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-09-19T06:42:23.823 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:42:24.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.007+0000 7f2ddc4a6640 1 Processor -- start 2024-09-19T06:42:24.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.007+0000 7f2ddc4a6640 1 -- start start 2024-09-19T06:42:24.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.009+0000 7f2ddc4a6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dd4159490 0x7f2dd406cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:24.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.009+0000 7f2ddc4a6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2dd40c8300 0x7f2dd40c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:24.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.009+0000 7f2dda242640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dd4159490 0x7f2dd406cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:24.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.009+0000 7f2dda242640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dd4159490 0x7f2dd406cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:48804/0 (socket says 172.21.15.86:48804) 2024-09-19T06:42:24.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.009+0000 7f2dda242640 1 -- 172.21.15.86:0/1975558178 learned_addr learned my addr 172.21.15.86:0/1975558178 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:42:24.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.009+0000 7f2ddaa43640 1 --2- 172.21.15.86:0/1975558178 >> v2:172.21.15.169:3300/0 conn(0x7f2dd40c8300 0x7f2dd40c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:24.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.009+0000 7f2ddc4a6640 1 -- 172.21.15.86:0/1975558178 --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dd406bcf0 con 0x7f2dd4163090 2024-09-19T06:42:24.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.009+0000 7f2ddc4a6640 1 -- 172.21.15.86:0/1975558178 --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f2dd4159870 con 0x7f2dd40c8300 2024-09-19T06:42:24.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.009+0000 7f2ddc4a6640 1 -- 172.21.15.86:0/1975558178 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd4163560 con 0x7f2dd4159490 2024-09-19T06:42:24.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.012+0000 7f2dd9240640 1 -- 172.21.15.86:0/1975558178 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 506676700 0 0) 0x7f2dd406bcf0 con 0x7f2dd4163090 2024-09-19T06:42:24.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.012+0000 7f2dd9240640 1 -- 172.21.15.86:0/1975558178 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dc0003520 con 0x7f2dd4163090 2024-09-19T06:42:24.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.012+0000 7f2ddaa43640 1 -- 172.21.15.86:0/1975558178 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dd4159490 msgr2=0x7f2dd406cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:24.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.012+0000 7f2ddaa43640 1 --2- 172.21.15.86:0/1975558178 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dd4159490 0x7f2dd406cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:24.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.013+0000 7f2ddaa43640 1 -- 172.21.15.86:0/1975558178 >> v1:172.21.15.169:6789/0 conn(0x7f2dd4163090 legacy=0x7f2dd40c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:24.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.013+0000 7f2ddaa43640 1 -- 172.21.15.86:0/1975558178 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd406bfd0 con 0x7f2dd40c8300 2024-09-19T06:42:24.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.014+0000 7f2ddaa43640 1 --2- 172.21.15.86:0/1975558178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dd40c8300 0x7f2dd40c78f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc009d90 tx=0x7f2dcc02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e06d05f4a9938e84 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:24.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.014+0000 7f2dd9240640 1 -- 172.21.15.86:0/1975558178 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc007740 con 0x7f2dd40c8300 2024-09-19T06:42:24.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.014+0000 7f2dd9240640 1 -- 172.21.15.86:0/1975558178 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dcc0078e0 con 0x7f2dd40c8300 2024-09-19T06:42:24.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.014+0000 7f2dd9240640 1 -- 172.21.15.86:0/1975558178 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc007c90 con 0x7f2dd40c8300 2024-09-19T06:42:24.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.015+0000 7f2ddc4a6640 1 -- 172.21.15.86:0/1975558178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dd40c8300 msgr2=0x7f2dd40c78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:24.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.015+0000 7f2ddc4a6640 1 --2- 172.21.15.86:0/1975558178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dd40c8300 0x7f2dd40c78f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc009d90 tx=0x7f2dcc02a660 comp rx=0 tx=0).stop 2024-09-19T06:42:24.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.016+0000 7f2ddc4a6640 1 -- 172.21.15.86:0/1975558178 shutdown_connections 2024-09-19T06:42:24.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.016+0000 7f2ddc4a6640 1 --2- 172.21.15.86:0/1975558178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dd40c8300 0x7f2dd40c78f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:24.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.016+0000 7f2ddc4a6640 1 --2- 172.21.15.86:0/1975558178 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dd4159490 0x7f2dd406cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:24.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.016+0000 7f2ddc4a6640 1 -- 172.21.15.86:0/1975558178 >> 172.21.15.86:0/1975558178 conn(0x7f2dd40cc3e0 msgr2=0x7f2dd40cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:24.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.016+0000 7f2ddc4a6640 1 -- 172.21.15.86:0/1975558178 shutdown_connections 2024-09-19T06:42:24.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.016+0000 7f2ddc4a6640 1 -- 172.21.15.86:0/1975558178 wait complete. 2024-09-19T06:42:24.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.018+0000 7f2ddc4a6640 1 Processor -- start 2024-09-19T06:42:24.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.018+0000 7f2ddc4a6640 1 -- start start 2024-09-19T06:42:24.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.020+0000 7f2ddc4a6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dd40c8300 0x7f2dd414a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:24.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.020+0000 7f2dda242640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dd40c8300 0x7f2dd414a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:24.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.020+0000 7f2dda242640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dd40c8300 0x7f2dd414a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45204/0 (socket says 172.21.15.86:45204) 2024-09-19T06:42:24.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.020+0000 7f2dda242640 1 -- 172.21.15.86:0/2868838091 learned_addr learned my addr 172.21.15.86:0/2868838091 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:42:24.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.020+0000 7f2ddc4a6640 1 --2- 172.21.15.86:0/2868838091 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dd4159490 0x7f2dd414dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:24.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.021+0000 7f2ddc4a6640 1 --2- 172.21.15.86:0/2868838091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dd4163090 0x7f2dd414e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:24.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.021+0000 7f2ddc4a6640 1 -- 172.21.15.86:0/2868838091 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd406c590 con 0x7f2dd40c8300 2024-09-19T06:42:24.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.021+0000 7f2dd9a41640 1 --2- 172.21.15.86:0/2868838091 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dd4159490 0x7f2dd414dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:24.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.021+0000 7f2ddaa43640 1 --2- 172.21.15.86:0/2868838091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dd4163090 0x7f2dd414e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:24.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.021+0000 7f2ddc4a6640 1 -- 172.21.15.86:0/2868838091 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd406c900 con 0x7f2dd4163090 2024-09-19T06:42:24.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.021+0000 7f2ddc4a6640 1 -- 172.21.15.86:0/2868838091 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd40c7e30 con 0x7f2dd4159490 2024-09-19T06:42:24.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.022+0000 7f2dd9a41640 1 -- 172.21.15.86:0/2868838091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dd4163090 msgr2=0x7f2dd414e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:24.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.022+0000 7f2dd9a41640 1 --2- 172.21.15.86:0/2868838091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dd4163090 0x7f2dd414e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:24.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.022+0000 7f2dd9a41640 1 -- 172.21.15.86:0/2868838091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dd40c8300 msgr2=0x7f2dd414a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:24.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.022+0000 7f2dd9a41640 1 --2- 172.21.15.86:0/2868838091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dd40c8300 0x7f2dd414a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:24.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.022+0000 7f2dd9a41640 1 -- 172.21.15.86:0/2868838091 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd4158740 con 0x7f2dd4159490 2024-09-19T06:42:24.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.022+0000 7f2dda242640 1 --2- 172.21.15.86:0/2868838091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dd40c8300 0x7f2dd414a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:42:24.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.022+0000 7f2dd9a41640 1 --2- 172.21.15.86:0/2868838091 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dd4159490 0x7f2dd414dcd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40c6570 tx=0x7f2dc4001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:24.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.023+0000 7f2dcaffd640 1 -- 172.21.15.86:0/2868838091 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc4017070 con 0x7f2dd4159490 2024-09-19T06:42:24.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.023+0000 7f2dcaffd640 1 -- 172.21.15.86:0/2868838091 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc40052d0 con 0x7f2dd4159490 2024-09-19T06:42:24.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.023+0000 7f2dcaffd640 1 -- 172.21.15.86:0/2868838091 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc4003830 con 0x7f2dd4159490 2024-09-19T06:42:24.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.023+0000 7f2ddc4a6640 1 -- 172.21.15.86:0/2868838091 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dd41fe9f0 con 0x7f2dd4159490 2024-09-19T06:42:24.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.023+0000 7f2ddc4a6640 1 -- 172.21.15.86:0/2868838091 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd41fdf10 con 0x7f2dd4159490 2024-09-19T06:42:24.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.026+0000 7f2dcaffd640 1 -- 172.21.15.86:0/2868838091 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2dc401a070 con 0x7f2dd4159490 2024-09-19T06:42:24.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.027+0000 7f2dcaffd640 1 --2- 172.21.15.86:0/2868838091 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2db806c2b0 0x7f2db806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:24.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.026+0000 7f2ddc4a6640 1 -- 172.21.15.86:0/2868838091 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dbc005290 con 0x7f2dd4159490 2024-09-19T06:42:24.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.028+0000 7f2dcaffd640 1 -- 172.21.15.86:0/2868838091 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) ==== 6993+0+0 (secure 0 0 0) 0x7f2dc408abf0 con 0x7f2dd4159490 2024-09-19T06:42:24.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.028+0000 7f2dda242640 1 --2- 172.21.15.86:0/2868838091 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2db806c2b0 0x7f2db806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:24.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.029+0000 7f2dda242640 1 --2- 172.21.15.86:0/2868838091 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2db806c2b0 0x7f2db806e770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2dd00094a0 tx=0x7f2dd0009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:24.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.040+0000 7f2dcaffd640 1 -- 172.21.15.86:0/2868838091 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2dc4058760 con 0x7f2dd4159490 2024-09-19T06:42:24.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.501+0000 7f2ddc4a6640 1 -- 172.21.15.86:0/2868838091 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2dbc005580 con 0x7f2dd4159490 2024-09-19T06:42:24.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.502+0000 7f2dcaffd640 1 -- 172.21.15.86:0/2868838091 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+6045 (secure 0 0 0) 0x7f2dc405ca60 con 0x7f2dd4159490 2024-09-19T06:42:24.503 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:42:24.504 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":22,"btime":"2024-09-19T06:42:19:580114+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:42:19.573971+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"e","rank":0,"incarnation":20,"state":"up:rejoin","state_seq":17,"addr":"172.21.15.86:6839/1006149510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1006149510},{"type":"v1","addr":"172.21.15.86:6839","nonce":1006149510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:42:24.504 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 22 2024-09-19T06:42:24.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.509+0000 7f2ddc4a6640 1 -- 172.21.15.86:0/2868838091 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2db806c2b0 msgr2=0x7f2db806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:24.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.509+0000 7f2ddc4a6640 1 --2- 172.21.15.86:0/2868838091 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2db806c2b0 0x7f2db806e770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2dd00094a0 tx=0x7f2dd0009240 comp rx=0 tx=0).stop 2024-09-19T06:42:24.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.509+0000 7f2ddc4a6640 1 -- 172.21.15.86:0/2868838091 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dd4159490 msgr2=0x7f2dd414dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:24.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.509+0000 7f2ddc4a6640 1 --2- 172.21.15.86:0/2868838091 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dd4159490 0x7f2dd414dcd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40c6570 tx=0x7f2dc4001e70 comp rx=0 tx=0).stop 2024-09-19T06:42:24.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.509+0000 7f2ddc4a6640 1 -- 172.21.15.86:0/2868838091 shutdown_connections 2024-09-19T06:42:24.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.509+0000 7f2ddc4a6640 1 --2- 172.21.15.86:0/2868838091 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2db806c2b0 0x7f2db806e770 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:24.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.509+0000 7f2ddc4a6640 1 --2- 172.21.15.86:0/2868838091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dd4163090 0x7f2dd414e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:24.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.509+0000 7f2ddc4a6640 1 --2- 172.21.15.86:0/2868838091 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dd4159490 0x7f2dd414dcd0 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40c6570 tx=0x7f2dc4001e70 comp rx=0 tx=0).stop 2024-09-19T06:42:24.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.509+0000 7f2ddc4a6640 1 --2- 172.21.15.86:0/2868838091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dd40c8300 0x7f2dd414a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:24.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.509+0000 7f2ddc4a6640 1 -- 172.21.15.86:0/2868838091 >> 172.21.15.86:0/2868838091 conn(0x7f2dd40cc3e0 msgr2=0x7f2dd4154a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:24.513 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.512+0000 7f2ddc4a6640 1 -- 172.21.15.86:0/2868838091 shutdown_connections 2024-09-19T06:42:24.513 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:24.512+0000 7f2ddc4a6640 1 -- 172.21.15.86:0/2868838091 wait complete. 2024-09-19T06:42:24.537 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:42:26.538 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:42:26.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.693+0000 7fdf7ade8640 1 Processor -- start 2024-09-19T06:42:26.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.693+0000 7fdf7ade8640 1 -- start start 2024-09-19T06:42:26.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.694+0000 7fdf7ade8640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdf740d1120 0x7fdf7415da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:26.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.695+0000 7fdf73fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdf740d1120 0x7fdf7415da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:26.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.695+0000 7fdf73fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdf740d1120 0x7fdf7415da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45220/0 (socket says 172.21.15.86:45220) 2024-09-19T06:42:26.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.695+0000 7fdf73fff640 1 -- 172.21.15.86:0/4161774388 learned_addr learned my addr 172.21.15.86:0/4161774388 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:42:26.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.695+0000 7fdf7ade8640 1 --2- 172.21.15.86:0/4161774388 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf7415dfa0 0x7fdf740b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:26.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.695+0000 7fdf7ade8640 1 -- 172.21.15.86:0/4161774388 --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf7415c9c0 con 0x7fdf740d0d40 2024-09-19T06:42:26.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.695+0000 7fdf7ade8640 1 -- 172.21.15.86:0/4161774388 --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fdf7415c770 con 0x7fdf740d1120 2024-09-19T06:42:26.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.695+0000 7fdf7ade8640 1 -- 172.21.15.86:0/4161774388 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fdf7415e450 con 0x7fdf7415dfa0 2024-09-19T06:42:26.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.695+0000 7fdf79385640 1 --2- 172.21.15.86:0/4161774388 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf7415dfa0 0x7fdf740b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:26.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.695+0000 7fdf73fff640 1 -- 172.21.15.86:0/4161774388 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf7415dfa0 msgr2=0x7fdf740b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:26.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.695+0000 7fdf73fff640 1 --2- 172.21.15.86:0/4161774388 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf7415dfa0 0x7fdf740b4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:26.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.695+0000 7fdf73fff640 1 -- 172.21.15.86:0/4161774388 >> v1:172.21.15.169:6789/0 conn(0x7fdf740d0d40 legacy=0x7fdf740ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:26.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.695+0000 7fdf73fff640 1 -- 172.21.15.86:0/4161774388 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf7415cca0 con 0x7fdf740d1120 2024-09-19T06:42:26.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.695+0000 7fdf79385640 1 --2- 172.21.15.86:0/4161774388 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf7415dfa0 0x7fdf740b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:42:26.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.696+0000 7fdf73fff640 1 --2- 172.21.15.86:0/4161774388 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf740d1120 0x7fdf7415da60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdf7415c8f0 tx=0x7fdf6002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1239f381ec5c3ded server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:26.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.697+0000 7fdf737fe640 1 -- 172.21.15.86:0/4161774388 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf60037070 con 0x7fdf740d1120 2024-09-19T06:42:26.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.697+0000 7fdf737fe640 1 -- 172.21.15.86:0/4161774388 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf60032440 con 0x7fdf740d1120 2024-09-19T06:42:26.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.697+0000 7fdf737fe640 1 -- 172.21.15.86:0/4161774388 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf60032810 con 0x7fdf740d1120 2024-09-19T06:42:26.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.698+0000 7fdf7ade8640 1 -- 172.21.15.86:0/4161774388 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf740d1120 msgr2=0x7fdf7415da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:26.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.698+0000 7fdf7ade8640 1 --2- 172.21.15.86:0/4161774388 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf740d1120 0x7fdf7415da60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdf7415c8f0 tx=0x7fdf6002a250 comp rx=0 tx=0).stop 2024-09-19T06:42:26.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.698+0000 7fdf7ade8640 1 -- 172.21.15.86:0/4161774388 shutdown_connections 2024-09-19T06:42:26.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.698+0000 7fdf7ade8640 1 --2- 172.21.15.86:0/4161774388 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf7415dfa0 0x7fdf740b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:26.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.698+0000 7fdf7ade8640 1 --2- 172.21.15.86:0/4161774388 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf740d1120 0x7fdf7415da60 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:26.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.698+0000 7fdf7ade8640 1 -- 172.21.15.86:0/4161774388 >> 172.21.15.86:0/4161774388 conn(0x7fdf7406d910 msgr2=0x7fdf7406dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:26.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.698+0000 7fdf7ade8640 1 -- 172.21.15.86:0/4161774388 shutdown_connections 2024-09-19T06:42:26.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.698+0000 7fdf7ade8640 1 -- 172.21.15.86:0/4161774388 wait complete. 2024-09-19T06:42:26.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.700+0000 7fdf7ade8640 1 Processor -- start 2024-09-19T06:42:26.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.700+0000 7fdf7ade8640 1 -- start start 2024-09-19T06:42:26.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.701+0000 7fdf7ade8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf740d0d40 0x7fdf741f46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:26.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.701+0000 7fdf7ade8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf740d1120 0x7fdf741f0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:26.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.701+0000 7fdf7ade8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf7415dfa0 0x7fdf74155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:26.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.701+0000 7fdf7ade8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7415d260 con 0x7fdf7415dfa0 2024-09-19T06:42:26.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.701+0000 7fdf7ade8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdf740b3f20 con 0x7fdf740d1120 2024-09-19T06:42:26.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.701+0000 7fdf7ade8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fdf740cadd0 con 0x7fdf740d0d40 2024-09-19T06:42:26.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.701+0000 7fdf73fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf740d1120 0x7fdf741f0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:26.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.701+0000 7fdf73fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf740d1120 0x7fdf741f0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:46958/0 (socket says 172.21.15.86:46958) 2024-09-19T06:42:26.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.701+0000 7fdf73fff640 1 -- 172.21.15.86:0/173862982 learned_addr learned my addr 172.21.15.86:0/173862982 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:42:26.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.701+0000 7fdf79385640 1 --2- 172.21.15.86:0/173862982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf7415dfa0 0x7fdf74155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:26.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.702+0000 7fdf78b84640 1 --2- 172.21.15.86:0/173862982 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf740d0d40 0x7fdf741f46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:26.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.702+0000 7fdf79385640 1 -- 172.21.15.86:0/173862982 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf740d0d40 msgr2=0x7fdf741f46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:26.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.702+0000 7fdf79385640 1 --2- 172.21.15.86:0/173862982 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf740d0d40 0x7fdf741f46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:26.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.702+0000 7fdf79385640 1 -- 172.21.15.86:0/173862982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf740d1120 msgr2=0x7fdf741f0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:26.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.702+0000 7fdf79385640 1 --2- 172.21.15.86:0/173862982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf740d1120 0x7fdf741f0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:26.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.702+0000 7fdf79385640 1 -- 172.21.15.86:0/173862982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf740d0090 con 0x7fdf7415dfa0 2024-09-19T06:42:26.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.702+0000 7fdf79385640 1 --2- 172.21.15.86:0/173862982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf7415dfa0 0x7fdf74155c70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c007d70 tx=0x7fdf6c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:26.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.703+0000 7fdf717fa640 1 -- 172.21.15.86:0/173862982 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c01a070 con 0x7fdf7415dfa0 2024-09-19T06:42:26.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.703+0000 7fdf717fa640 1 -- 172.21.15.86:0/173862982 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf6c003990 con 0x7fdf7415dfa0 2024-09-19T06:42:26.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.703+0000 7fdf717fa640 1 -- 172.21.15.86:0/173862982 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c003d80 con 0x7fdf7415dfa0 2024-09-19T06:42:26.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.703+0000 7fdf7ade8640 1 -- 172.21.15.86:0/173862982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf740c54c0 con 0x7fdf7415dfa0 2024-09-19T06:42:26.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.703+0000 7fdf7ade8640 1 -- 172.21.15.86:0/173862982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf740c5a80 con 0x7fdf7415dfa0 2024-09-19T06:42:26.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.704+0000 7fdf5effd640 1 -- 172.21.15.86:0/173862982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf7415da60 con 0x7fdf7415dfa0 2024-09-19T06:42:26.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.707+0000 7fdf717fa640 1 -- 172.21.15.86:0/173862982 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdf6c01d070 con 0x7fdf7415dfa0 2024-09-19T06:42:26.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.707+0000 7fdf717fa640 1 --2- 172.21.15.86:0/173862982 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fdf5806c2e0 0x7fdf5806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:26.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.707+0000 7fdf717fa640 1 -- 172.21.15.86:0/173862982 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6993+0+0 (secure 0 0 0) 0x7fdf6c08bb30 con 0x7fdf7415dfa0 2024-09-19T06:42:26.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.708+0000 7fdf78b84640 1 --2- 172.21.15.86:0/173862982 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fdf5806c2e0 0x7fdf5806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:26.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.708+0000 7fdf78b84640 1 --2- 172.21.15.86:0/173862982 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fdf5806c2e0 0x7fdf5806e7a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdf68000f60 tx=0x7fdf68009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:26.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:26.712+0000 7fdf717fa640 1 -- 172.21.15.86:0/173862982 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fdf6c010070 con 0x7fdf7415dfa0 2024-09-19T06:42:27.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:27.025+0000 7fdf5effd640 1 -- 172.21.15.86:0/173862982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf74154d50 con 0x7fdf7415dfa0 2024-09-19T06:42:27.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:27.026+0000 7fdf717fa640 1 -- 172.21.15.86:0/173862982 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+6052 (secure 0 0 0) 0x7fdf6c059610 con 0x7fdf7415dfa0 2024-09-19T06:42:27.027 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:42:27.028 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":23,"btime":"2024-09-19T06:42:24:620685+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:42:24.620680+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"e","rank":0,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.86:6839/1006149510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1006149510},{"type":"v1","addr":"172.21.15.86:6839","nonce":1006149510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4998,"qdb_cluster":[4998]},"id":1}]} 2024-09-19T06:42:27.028 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 23 2024-09-19T06:42:27.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:27.029+0000 7fdf5effd640 1 -- 172.21.15.86:0/173862982 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fdf5806c2e0 msgr2=0x7fdf5806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:27.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:27.029+0000 7fdf5effd640 1 --2- 172.21.15.86:0/173862982 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fdf5806c2e0 0x7fdf5806e7a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdf68000f60 tx=0x7fdf68009040 comp rx=0 tx=0).stop 2024-09-19T06:42:27.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:27.029+0000 7fdf5effd640 1 -- 172.21.15.86:0/173862982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf7415dfa0 msgr2=0x7fdf74155c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:27.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:27.029+0000 7fdf5effd640 1 --2- 172.21.15.86:0/173862982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf7415dfa0 0x7fdf74155c70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c007d70 tx=0x7fdf6c00d4a0 comp rx=0 tx=0).stop 2024-09-19T06:42:27.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:27.029+0000 7fdf5effd640 1 -- 172.21.15.86:0/173862982 shutdown_connections 2024-09-19T06:42:27.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:27.029+0000 7fdf5effd640 1 --2- 172.21.15.86:0/173862982 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fdf5806c2e0 0x7fdf5806e7a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:27.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:27.029+0000 7fdf5effd640 1 --2- 172.21.15.86:0/173862982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf7415dfa0 0x7fdf74155c70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:27.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:27.029+0000 7fdf5effd640 1 --2- 172.21.15.86:0/173862982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf740d1120 0x7fdf741f0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:27.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:27.029+0000 7fdf5effd640 1 --2- 172.21.15.86:0/173862982 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf740d0d40 0x7fdf741f46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:27.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:27.029+0000 7fdf5effd640 1 -- 172.21.15.86:0/173862982 >> 172.21.15.86:0/173862982 conn(0x7fdf7406d910 msgr2=0x7fdf740ca490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:27.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:27.029+0000 7fdf5effd640 1 -- 172.21.15.86:0/173862982 shutdown_connections 2024-09-19T06:42:27.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:27.029+0000 7fdf5effd640 1 -- 172.21.15.86:0/173862982 wait complete. 2024-09-19T06:42:27.044 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e has gained rank=0, replacing gid=4762 2024-09-19T06:42:27.044 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 1 secs before reviving mds.d 2024-09-19T06:42:28.046 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.d 2024-09-19T06:42:28.046 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T06:42:28.046 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T06:42:28.049 INFO:tasks.ceph.mds.d:Started 2024-09-19T06:42:28.049 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:42:28.134 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2024-09-19T06:42:28.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.159+0000 7f983d7d8640 1 Processor -- start 2024-09-19T06:42:28.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.159+0000 7f983d7d8640 1 -- start start 2024-09-19T06:42:28.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.159+0000 7f983d7d8640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f98380d1120 0x7f983815da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:28.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.159+0000 7f983d7d8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f983815dfa0 0x7f98380b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:28.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.159+0000 7f983d7d8640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f983815c9c0 con 0x7f98380d0d40 2024-09-19T06:42:28.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.159+0000 7f983d7d8640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f983815c770 con 0x7f98380d1120 2024-09-19T06:42:28.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.159+0000 7f983d7d8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f983815e450 con 0x7f983815dfa0 2024-09-19T06:42:28.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.160+0000 7f9836ffd640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f98380d0d40 0x7f98380ca6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49374/0 (socket says 172.21.15.86:49374) 2024-09-19T06:42:28.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.160+0000 7f9836ffd640 1 -- 172.21.15.86:0/3193302735 learned_addr learned my addr 172.21.15.86:0/3193302735 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:42:28.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.160+0000 7f98367fc640 1 --2- 172.21.15.86:0/3193302735 >> v2:172.21.15.169:3300/0 conn(0x7f98380d1120 0x7f983815da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:28.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.160+0000 7f98377fe640 1 --2- 172.21.15.86:0/3193302735 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f983815dfa0 0x7f98380b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:28.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.160+0000 7f9835ffb640 1 -- 172.21.15.86:0/3193302735 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3210910181 0 0) 0x7f983815c9c0 con 0x7f98380d0d40 2024-09-19T06:42:28.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.160+0000 7f9835ffb640 1 -- 172.21.15.86:0/3193302735 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9820003520 con 0x7f98380d0d40 2024-09-19T06:42:28.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.160+0000 7f98377fe640 1 -- 172.21.15.86:0/3193302735 >> v2:172.21.15.169:3300/0 conn(0x7f98380d1120 msgr2=0x7f983815da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:28.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.160+0000 7f98377fe640 1 --2- 172.21.15.86:0/3193302735 >> v2:172.21.15.169:3300/0 conn(0x7f98380d1120 0x7f983815da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:28.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.160+0000 7f9835ffb640 1 -- 172.21.15.86:0/3193302735 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3892624420 0 0) 0x7f9820003520 con 0x7f98380d0d40 2024-09-19T06:42:28.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.160+0000 7f98377fe640 1 -- 172.21.15.86:0/3193302735 >> v1:172.21.15.86:6789/0 conn(0x7f98380d0d40 legacy=0x7f98380ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:28.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.160+0000 7f98377fe640 1 -- 172.21.15.86:0/3193302735 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f983815cca0 con 0x7f983815dfa0 2024-09-19T06:42:28.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.160+0000 7f98367fc640 1 --2- 172.21.15.86:0/3193302735 >> v2:172.21.15.169:3300/0 conn(0x7f98380d1120 0x7f983815da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:42:28.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.161+0000 7f98377fe640 1 --2- 172.21.15.86:0/3193302735 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f983815dfa0 0x7f98380b4b60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f983815c8f0 tx=0x7f983002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f371e0aea4e809ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:28.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.161+0000 7f9835ffb640 1 -- 172.21.15.86:0/3193302735 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9828001670 con 0x7f983815dfa0 2024-09-19T06:42:28.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.161+0000 7f9835ffb640 1 -- 172.21.15.86:0/3193302735 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9830007540 con 0x7f983815dfa0 2024-09-19T06:42:28.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.161+0000 7f9835ffb640 1 -- 172.21.15.86:0/3193302735 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98300078f0 con 0x7f983815dfa0 2024-09-19T06:42:28.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.161+0000 7f983d7d8640 1 -- 172.21.15.86:0/3193302735 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f983815dfa0 msgr2=0x7f98380b4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:28.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.161+0000 7f983d7d8640 1 --2- 172.21.15.86:0/3193302735 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f983815dfa0 0x7f98380b4b60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f983815c8f0 tx=0x7f983002a5d0 comp rx=0 tx=0).stop 2024-09-19T06:42:28.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.162+0000 7f983d7d8640 1 -- 172.21.15.86:0/3193302735 shutdown_connections 2024-09-19T06:42:28.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.162+0000 7f983d7d8640 1 --2- 172.21.15.86:0/3193302735 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f983815dfa0 0x7f98380b4b60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:28.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.162+0000 7f983d7d8640 1 --2- 172.21.15.86:0/3193302735 >> v2:172.21.15.169:3300/0 conn(0x7f98380d1120 0x7f983815da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:28.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.162+0000 7f983d7d8640 1 -- 172.21.15.86:0/3193302735 >> 172.21.15.86:0/3193302735 conn(0x7f983806d910 msgr2=0x7f983806dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:28.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.162+0000 7f983d7d8640 1 -- 172.21.15.86:0/3193302735 shutdown_connections 2024-09-19T06:42:28.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.162+0000 7f983d7d8640 1 -- 172.21.15.86:0/3193302735 wait complete. 2024-09-19T06:42:28.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.163+0000 7f983d7d8640 1 Processor -- start 2024-09-19T06:42:28.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.163+0000 7f983d7d8640 1 -- start start 2024-09-19T06:42:28.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.164+0000 7f983d7d8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98380d0d40 0x7f98380c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:28.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.164+0000 7f983d7d8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98380d1120 0x7f98381500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:28.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.164+0000 7f983d7d8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f983815dfa0 0x7f98381f3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:28.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.164+0000 7f983d7d8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f983815d260 con 0x7f98380d0d40 2024-09-19T06:42:28.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.164+0000 7f983d7d8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f98380b3f20 con 0x7f98380d1120 2024-09-19T06:42:28.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.164+0000 7f983d7d8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f98380cadd0 con 0x7f983815dfa0 2024-09-19T06:42:28.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.164+0000 7f9836ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98380d0d40 0x7f98380c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:28.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.164+0000 7f9836ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98380d0d40 0x7f98380c5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45242/0 (socket says 172.21.15.86:45242) 2024-09-19T06:42:28.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.164+0000 7f9836ffd640 1 -- 172.21.15.86:0/3557776014 learned_addr learned my addr 172.21.15.86:0/3557776014 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:42:28.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.164+0000 7f98377fe640 1 --2- 172.21.15.86:0/3557776014 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f983815dfa0 0x7f98381f3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:28.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.164+0000 7f98367fc640 1 --2- 172.21.15.86:0/3557776014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98380d1120 0x7f98381500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:28.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.164+0000 7f9836ffd640 1 -- 172.21.15.86:0/3557776014 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f983815dfa0 msgr2=0x7f98381f3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:28.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.164+0000 7f9836ffd640 1 --2- 172.21.15.86:0/3557776014 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f983815dfa0 0x7f98381f3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:28.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.164+0000 7f9836ffd640 1 -- 172.21.15.86:0/3557776014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98380d1120 msgr2=0x7f98381500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:28.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.164+0000 7f9836ffd640 1 --2- 172.21.15.86:0/3557776014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98380d1120 0x7f98381500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:28.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.164+0000 7f9836ffd640 1 -- 172.21.15.86:0/3557776014 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98381f23c0 con 0x7f98380d0d40 2024-09-19T06:42:28.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.164+0000 7f9836ffd640 1 --2- 172.21.15.86:0/3557776014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98380d0d40 0x7f98380c5af0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f982800c780 tx=0x7f982800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:28.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.164+0000 7f981f7fe640 1 -- 172.21.15.86:0/3557776014 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9828017070 con 0x7f98380d0d40 2024-09-19T06:42:28.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.164+0000 7f981f7fe640 1 -- 172.21.15.86:0/3557776014 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9828005ad0 con 0x7f98380d0d40 2024-09-19T06:42:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.164+0000 7f983d7d8640 1 -- 172.21.15.86:0/3557776014 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98381f26a0 con 0x7f98380d0d40 2024-09-19T06:42:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.165+0000 7f981f7fe640 1 -- 172.21.15.86:0/3557776014 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9828007070 con 0x7f98380d0d40 2024-09-19T06:42:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.165+0000 7f983d7d8640 1 -- 172.21.15.86:0/3557776014 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98381f2c60 con 0x7f98380d0d40 2024-09-19T06:42:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.166+0000 7f983d7d8640 1 -- 172.21.15.86:0/3557776014 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f983815c460 con 0x7f98380d0d40 2024-09-19T06:42:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.166+0000 7f981f7fe640 1 -- 172.21.15.86:0/3557776014 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f982801a070 con 0x7f98380d0d40 2024-09-19T06:42:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.166+0000 7f981f7fe640 1 --2- 172.21.15.86:0/3557776014 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f982406c2b0 0x7f982406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.167+0000 7f981f7fe640 1 -- 172.21.15.86:0/3557776014 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6993+0+0 (secure 0 0 0) 0x7f982808ae20 con 0x7f98380d0d40 2024-09-19T06:42:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.167+0000 7f98367fc640 1 --2- 172.21.15.86:0/3557776014 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f982406c2b0 0x7f982406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.167+0000 7f98367fc640 1 --2- 172.21.15.86:0/3557776014 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f982406c2b0 0x7f982406e770 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f982c009560 tx=0x7f982c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:28.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.171+0000 7f981f7fe640 1 -- 172.21.15.86:0/3557776014 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f983815c460 con 0x7f98380d0d40 2024-09-19T06:42:28.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.609+0000 7f983d7d8640 1 -- 172.21.15.86:0/3557776014 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98380cda00 con 0x7f98380d0d40 2024-09-19T06:42:28.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.610+0000 7f981f7fe640 1 -- 172.21.15.86:0/3557776014 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+6052 (secure 0 0 0) 0x7f9828058a30 con 0x7f98380d0d40 2024-09-19T06:42:28.612 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:42:28.612 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":23,"btime":"2024-09-19T06:42:24:620685+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:42:24.620680+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"e","rank":0,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.86:6839/1006149510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1006149510},{"type":"v1","addr":"172.21.15.86:6839","nonce":1006149510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4998,"qdb_cluster":[4998]},"id":1}]} 2024-09-19T06:42:28.612 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 23 2024-09-19T06:42:28.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.616+0000 7f981d7fa640 1 -- 172.21.15.86:0/3557776014 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f982406c2b0 msgr2=0x7f982406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:28.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.616+0000 7f981d7fa640 1 --2- 172.21.15.86:0/3557776014 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f982406c2b0 0x7f982406e770 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f982c009560 tx=0x7f982c009190 comp rx=0 tx=0).stop 2024-09-19T06:42:28.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.616+0000 7f981d7fa640 1 -- 172.21.15.86:0/3557776014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98380d0d40 msgr2=0x7f98380c5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:28.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.616+0000 7f981d7fa640 1 --2- 172.21.15.86:0/3557776014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98380d0d40 0x7f98380c5af0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f982800c780 tx=0x7f982800cc40 comp rx=0 tx=0).stop 2024-09-19T06:42:28.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.619+0000 7f981d7fa640 1 -- 172.21.15.86:0/3557776014 shutdown_connections 2024-09-19T06:42:28.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.619+0000 7f981d7fa640 1 --2- 172.21.15.86:0/3557776014 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f982406c2b0 0x7f982406e770 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:28.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.619+0000 7f981d7fa640 1 --2- 172.21.15.86:0/3557776014 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f983815dfa0 0x7f98381f3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:28.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.619+0000 7f981d7fa640 1 --2- 172.21.15.86:0/3557776014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98380d1120 0x7f98381500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:28.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.619+0000 7f981d7fa640 1 --2- 172.21.15.86:0/3557776014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98380d0d40 0x7f98380c5af0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:28.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.619+0000 7f981d7fa640 1 -- 172.21.15.86:0/3557776014 >> 172.21.15.86:0/3557776014 conn(0x7f983806d910 msgr2=0x7f983815eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:28.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.620+0000 7f981d7fa640 1 -- 172.21.15.86:0/3557776014 shutdown_connections 2024-09-19T06:42:28.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:28.620+0000 7f981d7fa640 1 -- 172.21.15.86:0/3557776014 wait complete. 2024-09-19T06:42:28.643 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is in active, standby or standby-replay 2024-09-19T06:42:30.644 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:42:30.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.843+0000 7ff14fa8d640 1 Processor -- start 2024-09-19T06:42:30.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.844+0000 7ff14fa8d640 1 -- start start 2024-09-19T06:42:30.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.845+0000 7ff14fa8d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff1400d4940 0x7ff140005a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.845+0000 7ff14d829640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff1400d4940 0x7ff140005a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:30.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.846+0000 7ff14d829640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff1400d4940 0x7ff140005a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45246/0 (socket says 172.21.15.86:45246) 2024-09-19T06:42:30.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.846+0000 7ff14d829640 1 -- 172.21.15.86:0/1168142796 learned_addr learned my addr 172.21.15.86:0/1168142796 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:42:30.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.846+0000 7ff14fa8d640 1 --2- 172.21.15.86:0/1168142796 >> v2:172.21.15.169:3300/0 conn(0x7ff1400450f0 0x7ff1400ddc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.846+0000 7ff14fa8d640 1 -- 172.21.15.86:0/1168142796 --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff14004aa40 con 0x7ff14004c090 2024-09-19T06:42:30.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.846+0000 7ff14fa8d640 1 -- 172.21.15.86:0/1168142796 --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7ff140044c60 con 0x7ff1400d4940 2024-09-19T06:42:30.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.846+0000 7ff14fa8d640 1 -- 172.21.15.86:0/1168142796 --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7ff14004ace0 con 0x7ff1400450f0 2024-09-19T06:42:30.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.847+0000 7ff14d829640 1 -- 172.21.15.86:0/1168142796 >> v2:172.21.15.169:3300/0 conn(0x7ff1400450f0 msgr2=0x7ff1400ddc50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:42:30.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.847+0000 7ff14d829640 1 --2- 172.21.15.86:0/1168142796 >> v2:172.21.15.169:3300/0 conn(0x7ff1400450f0 0x7ff1400ddc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.847+0000 7ff14d829640 1 -- 172.21.15.86:0/1168142796 >> v1:172.21.15.86:6789/0 conn(0x7ff14004c090 legacy=0x7ff1400de190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:30.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.847+0000 7ff14d829640 1 -- 172.21.15.86:0/1168142796 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff14004afa0 con 0x7ff1400d4940 2024-09-19T06:42:30.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.848+0000 7ff14d829640 1 --2- 172.21.15.86:0/1168142796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1400d4940 0x7ff140005a00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff14802dd50 tx=0x7ff1480a87b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2075db29b3cd97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:30.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.849+0000 7ff14c827640 1 -- 172.21.15.86:0/1168142796 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1480b4070 con 0x7ff1400d4940 2024-09-19T06:42:30.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.849+0000 7ff14c827640 1 -- 172.21.15.86:0/1168142796 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1480af600 con 0x7ff1400d4940 2024-09-19T06:42:30.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.850+0000 7ff14c827640 1 -- 172.21.15.86:0/1168142796 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff148072040 con 0x7ff1400d4940 2024-09-19T06:42:30.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.850+0000 7ff14fa8d640 1 -- 172.21.15.86:0/1168142796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1400d4940 msgr2=0x7ff140005a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:30.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.850+0000 7ff14fa8d640 1 --2- 172.21.15.86:0/1168142796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1400d4940 0x7ff140005a00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff14802dd50 tx=0x7ff1480a87b0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.850+0000 7ff14fa8d640 1 -- 172.21.15.86:0/1168142796 shutdown_connections 2024-09-19T06:42:30.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.850+0000 7ff14fa8d640 1 --2- 172.21.15.86:0/1168142796 >> v2:172.21.15.169:3300/0 conn(0x7ff1400450f0 0x7ff1400ddc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.850+0000 7ff14fa8d640 1 --2- 172.21.15.86:0/1168142796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1400d4940 0x7ff140005a00 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.850+0000 7ff14fa8d640 1 -- 172.21.15.86:0/1168142796 >> 172.21.15.86:0/1168142796 conn(0x7ff14004fc50 msgr2=0x7ff140050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:30.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.857+0000 7ff14fa8d640 1 -- 172.21.15.86:0/1168142796 shutdown_connections 2024-09-19T06:42:30.861 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.859+0000 7ff14fa8d640 1 -- 172.21.15.86:0/1168142796 wait complete. 2024-09-19T06:42:30.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.861+0000 7ff14fa8d640 1 Processor -- start 2024-09-19T06:42:30.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.861+0000 7ff14fa8d640 1 -- start start 2024-09-19T06:42:30.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.862+0000 7ff14fa8d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1400450f0 0x7ff140049140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.862+0000 7ff14fa8d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff14004c090 0x7ff140049680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.862+0000 7ff14fa8d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1400d4940 0x7ff140047db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.862+0000 7ff14fa8d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff140046770 con 0x7ff1400450f0 2024-09-19T06:42:30.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.862+0000 7ff14fa8d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff140046490 con 0x7ff1400d4940 2024-09-19T06:42:30.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.862+0000 7ff14fa8d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff140005f40 con 0x7ff14004c090 2024-09-19T06:42:30.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.863+0000 7ff14e02a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1400d4940 0x7ff140047db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:30.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.863+0000 7ff14d028640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff14004c090 0x7ff140049680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:30.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.864+0000 7ff14e02a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1400d4940 0x7ff140047db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:46984/0 (socket says 172.21.15.86:46984) 2024-09-19T06:42:30.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.864+0000 7ff14e02a640 1 -- 172.21.15.86:0/2593634198 learned_addr learned my addr 172.21.15.86:0/2593634198 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:42:30.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.864+0000 7ff14d829640 1 --2- 172.21.15.86:0/2593634198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1400450f0 0x7ff140049140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:30.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.865+0000 7ff14d028640 1 -- 172.21.15.86:0/2593634198 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1400d4940 msgr2=0x7ff140047db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:30.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.865+0000 7ff14d028640 1 --2- 172.21.15.86:0/2593634198 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1400d4940 0x7ff140047db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.865+0000 7ff14d028640 1 -- 172.21.15.86:0/2593634198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1400450f0 msgr2=0x7ff140049140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:30.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.865+0000 7ff14d028640 1 --2- 172.21.15.86:0/2593634198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1400450f0 0x7ff140049140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.865+0000 7ff14d028640 1 -- 172.21.15.86:0/2593634198 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1400d8060 con 0x7ff14004c090 2024-09-19T06:42:30.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.865+0000 7ff14d829640 1 --2- 172.21.15.86:0/2593634198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1400450f0 0x7ff140049140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:42:30.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.865+0000 7ff14d028640 1 --2- 172.21.15.86:0/2593634198 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff14004c090 0x7ff140049680 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff14400b410 tx=0x7ff14400b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:30.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.865+0000 7ff13e7fc640 1 -- 172.21.15.86:0/2593634198 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff144015020 con 0x7ff14004c090 2024-09-19T06:42:30.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.865+0000 7ff14fa8d640 1 -- 172.21.15.86:0/2593634198 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff140170d90 con 0x7ff14004c090 2024-09-19T06:42:30.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.865+0000 7ff14fa8d640 1 -- 172.21.15.86:0/2593634198 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff140046ff0 con 0x7ff14004c090 2024-09-19T06:42:30.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.867+0000 7ff13e7fc640 1 -- 172.21.15.86:0/2593634198 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff144011830 con 0x7ff14004c090 2024-09-19T06:42:30.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.867+0000 7ff13e7fc640 1 -- 172.21.15.86:0/2593634198 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff144011c00 con 0x7ff14004c090 2024-09-19T06:42:30.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.869+0000 7ff14fa8d640 1 -- 172.21.15.86:0/2593634198 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff130005290 con 0x7ff14004c090 2024-09-19T06:42:30.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.870+0000 7ff13e7fc640 1 -- 172.21.15.86:0/2593634198 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff144018020 con 0x7ff14004c090 2024-09-19T06:42:30.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.871+0000 7ff13e7fc640 1 --2- 172.21.15.86:0/2593634198 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff12c06c2b0 0x7ff12c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.871+0000 7ff13e7fc640 1 -- 172.21.15.86:0/2593634198 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) ==== 6993+0+0 (secure 0 0 0) 0x7ff14408b830 con 0x7ff14004c090 2024-09-19T06:42:30.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.871+0000 7ff14d829640 1 --2- 172.21.15.86:0/2593634198 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff12c06c2b0 0x7ff12c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:30.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.872+0000 7ff14d829640 1 --2- 172.21.15.86:0/2593634198 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff12c06c2b0 0x7ff12c06e770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff140046cd0 tx=0x7ff1480ac000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:30.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:30.879+0000 7ff13e7fc640 1 -- 172.21.15.86:0/2593634198 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff14401f020 con 0x7ff14004c090 2024-09-19T06:42:31.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:31.315+0000 7ff14fa8d640 1 -- 172.21.15.86:0/2593634198 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff130005580 con 0x7ff14004c090 2024-09-19T06:42:31.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:31.318+0000 7ff13e7fc640 1 -- 172.21.15.86:0/2593634198 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6880 (secure 0 0 0) 0x7ff144059960 con 0x7ff14004c090 2024-09-19T06:42:31.321 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:42:31.321 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":24,"btime":"2024-09-19T06:42:28:634666+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/3116130916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":3116130916},{"type":"v1","addr":"172.21.15.169:6837","nonce":3116130916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:42:24.620680+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"e","rank":0,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.86:6839/1006149510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1006149510},{"type":"v1","addr":"172.21.15.86:6839","nonce":1006149510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4998,"qdb_cluster":[4998]},"id":1}]} 2024-09-19T06:42:31.321 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 24 2024-09-19T06:42:31.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:31.323+0000 7ff14fa8d640 1 -- 172.21.15.86:0/2593634198 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff12c06c2b0 msgr2=0x7ff12c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:31.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:31.323+0000 7ff14fa8d640 1 --2- 172.21.15.86:0/2593634198 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff12c06c2b0 0x7ff12c06e770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff140046cd0 tx=0x7ff1480ac000 comp rx=0 tx=0).stop 2024-09-19T06:42:31.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:31.323+0000 7ff14fa8d640 1 -- 172.21.15.86:0/2593634198 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff14004c090 msgr2=0x7ff140049680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:31.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:31.323+0000 7ff14fa8d640 1 --2- 172.21.15.86:0/2593634198 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff14004c090 0x7ff140049680 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff14400b410 tx=0x7ff14400b8d0 comp rx=0 tx=0).stop 2024-09-19T06:42:31.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:31.323+0000 7ff14fa8d640 1 -- 172.21.15.86:0/2593634198 shutdown_connections 2024-09-19T06:42:31.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:31.323+0000 7ff14fa8d640 1 --2- 172.21.15.86:0/2593634198 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff12c06c2b0 0x7ff12c06e770 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:31.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:31.323+0000 7ff14fa8d640 1 --2- 172.21.15.86:0/2593634198 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1400d4940 0x7ff140047db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:31.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:31.323+0000 7ff14fa8d640 1 --2- 172.21.15.86:0/2593634198 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff14004c090 0x7ff140049680 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:31.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:31.323+0000 7ff14fa8d640 1 --2- 172.21.15.86:0/2593634198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1400450f0 0x7ff140049140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:31.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:31.323+0000 7ff14fa8d640 1 -- 172.21.15.86:0/2593634198 >> 172.21.15.86:0/2593634198 conn(0x7ff14004fc50 msgr2=0x7ff1400d3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:31.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:31.324+0000 7ff14fa8d640 1 -- 172.21.15.86:0/2593634198 shutdown_connections 2024-09-19T06:42:31.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:42:31.324+0000 7ff14fa8d640 1 -- 172.21.15.86:0/2593634198 wait complete. 2024-09-19T06:42:31.345 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d reported in up:standby state 2024-09-19T06:42:31.345 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 67 secs before thrashing 2024-09-19T06:42:34.637 INFO:tasks.ceph.mds.e.smithi086.stderr:2024-09-19T06:42:34.635+0000 7f0293bff640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T06:42:40.169 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:42:40.176 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:43:13.109 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:43:13.114 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T06:43:13.271 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-09-19T06:43:13.269+0000 7fce9935f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50392) UID: 0 2024-09-19T06:43:13.271 INFO:tasks.ceph.osd.2.smithi086.stderr:2024-09-19T06:43:13.269+0000 7fe81494c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50392) UID: 0 2024-09-19T06:43:13.271 INFO:tasks.ceph.osd.1.smithi086.stderr:2024-09-19T06:43:13.270+0000 7fad0fc78640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50392) UID: 0 2024-09-19T06:43:13.275 INFO:tasks.ceph.osd.3.smithi086.stderr:2024-09-19T06:43:13.270+0000 7fef9f552640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50392) UID: 0 2024-09-19T06:43:38.346 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:43:38.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.554+0000 7fc32ed2c640 1 Processor -- start 2024-09-19T06:43:38.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.555+0000 7fc32ed2c640 1 -- start start 2024-09-19T06:43:38.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.556+0000 7fc32ed2c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc328159490 0x7fc328162900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:38.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.556+0000 7fc32ed2c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc328071eb0 0x7fc32815fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:38.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.556+0000 7fc32ed2c640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc32815f420 con 0x7fc3280c42d0 2024-09-19T06:43:38.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.556+0000 7fc32ed2c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fc328072680 con 0x7fc328071eb0 2024-09-19T06:43:38.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.556+0000 7fc32ed2c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc328072960 con 0x7fc328159490 2024-09-19T06:43:38.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.557+0000 7fc32d2c9640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc3280c42d0 0x7fc3280ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33264/0 (socket says 172.21.15.86:33264) 2024-09-19T06:43:38.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.557+0000 7fc32d2c9640 1 -- 172.21.15.86:0/1959819822 learned_addr learned my addr 172.21.15.86:0/1959819822 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:43:38.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.557+0000 7fc327fff640 1 --2- 172.21.15.86:0/1959819822 >> v2:172.21.15.169:3300/0 conn(0x7fc328071eb0 0x7fc32815fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:38.560 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.557+0000 7fc3277fe640 1 -- 172.21.15.86:0/1959819822 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1919980226 0 0) 0x7fc32815f420 con 0x7fc3280c42d0 2024-09-19T06:43:38.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.557+0000 7fc3277fe640 1 -- 172.21.15.86:0/1959819822 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc310003520 con 0x7fc3280c42d0 2024-09-19T06:43:38.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.558+0000 7fc32cac8640 1 --2- 172.21.15.86:0/1959819822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc328159490 0x7fc328162900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:38.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.558+0000 7fc327fff640 1 -- 172.21.15.86:0/1959819822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc328159490 msgr2=0x7fc328162900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:38.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.558+0000 7fc327fff640 1 --2- 172.21.15.86:0/1959819822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc328159490 0x7fc328162900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:38.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.558+0000 7fc327fff640 1 -- 172.21.15.86:0/1959819822 >> v1:172.21.15.86:6789/0 conn(0x7fc3280c42d0 legacy=0x7fc3280ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:38.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.558+0000 7fc3277fe640 1 -- 172.21.15.86:0/1959819822 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4196569578 0 0) 0x7fc310003520 con 0x7fc3280c42d0 2024-09-19T06:43:38.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.558+0000 7fc327fff640 1 -- 172.21.15.86:0/1959819822 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc32815f6c0 con 0x7fc328071eb0 2024-09-19T06:43:38.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.558+0000 7fc32cac8640 1 --2- 172.21.15.86:0/1959819822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc328159490 0x7fc328162900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:43:38.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.559+0000 7fc327fff640 1 --2- 172.21.15.86:0/1959819822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc328071eb0 0x7fc32815fec0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc3180097a0 tx=0x7fc31802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20b18a49cd163a94 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:38.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.561+0000 7fc3277fe640 1 -- 172.21.15.86:0/1959819822 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc318037070 con 0x7fc328071eb0 2024-09-19T06:43:38.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.561+0000 7fc3277fe640 1 -- 172.21.15.86:0/1959819822 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc31802ac30 con 0x7fc328071eb0 2024-09-19T06:43:38.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.562+0000 7fc32ed2c640 1 -- 172.21.15.86:0/1959819822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc328071eb0 msgr2=0x7fc32815fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:38.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.562+0000 7fc32ed2c640 1 --2- 172.21.15.86:0/1959819822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc328071eb0 0x7fc32815fec0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc3180097a0 tx=0x7fc31802a1a0 comp rx=0 tx=0).stop 2024-09-19T06:43:38.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.563+0000 7fc32ed2c640 1 -- 172.21.15.86:0/1959819822 shutdown_connections 2024-09-19T06:43:38.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.563+0000 7fc32ed2c640 1 --2- 172.21.15.86:0/1959819822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc328071eb0 0x7fc32815fec0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:38.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.563+0000 7fc32ed2c640 1 --2- 172.21.15.86:0/1959819822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc328159490 0x7fc328162900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:38.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.563+0000 7fc32ed2c640 1 -- 172.21.15.86:0/1959819822 >> 172.21.15.86:0/1959819822 conn(0x7fc32806fd60 msgr2=0x7fc328070140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:38.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.564+0000 7fc32ed2c640 1 -- 172.21.15.86:0/1959819822 shutdown_connections 2024-09-19T06:43:38.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.565+0000 7fc32ed2c640 1 -- 172.21.15.86:0/1959819822 wait complete. 2024-09-19T06:43:38.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.567+0000 7fc32ed2c640 1 Processor -- start 2024-09-19T06:43:38.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.567+0000 7fc32ed2c640 1 -- start start 2024-09-19T06:43:38.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.568+0000 7fc32ed2c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc328071eb0 0x7fc32815d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:38.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.568+0000 7fc32ed2c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3280c42d0 0x7fc32815d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:38.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.568+0000 7fc32ed2c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc328159490 0x7fc3281351c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:38.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.568+0000 7fc32ed2c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc328074080 con 0x7fc3280c42d0 2024-09-19T06:43:38.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.568+0000 7fc32ed2c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc328072c40 con 0x7fc328159490 2024-09-19T06:43:38.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.568+0000 7fc32ed2c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc3280cab70 con 0x7fc328071eb0 2024-09-19T06:43:38.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.569+0000 7fc32d2c9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc328159490 0x7fc3281351c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:38.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.569+0000 7fc32d2c9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc328159490 0x7fc3281351c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:58900/0 (socket says 172.21.15.86:58900) 2024-09-19T06:43:38.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.569+0000 7fc32d2c9640 1 -- 172.21.15.86:0/3677443002 learned_addr learned my addr 172.21.15.86:0/3677443002 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:43:38.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.569+0000 7fc327fff640 1 --2- 172.21.15.86:0/3677443002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3280c42d0 0x7fc32815d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:38.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.569+0000 7fc32d2c9640 1 -- 172.21.15.86:0/3677443002 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc328071eb0 msgr2=0x7fc32815d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:38.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.569+0000 7fc32d2c9640 1 --2- 172.21.15.86:0/3677443002 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc328071eb0 0x7fc32815d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:38.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.569+0000 7fc32d2c9640 1 -- 172.21.15.86:0/3677443002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3280c42d0 msgr2=0x7fc32815d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:38.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.569+0000 7fc32d2c9640 1 --2- 172.21.15.86:0/3677443002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3280c42d0 0x7fc32815d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:38.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.569+0000 7fc32d2c9640 1 -- 172.21.15.86:0/3677443002 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3281369b0 con 0x7fc328159490 2024-09-19T06:43:38.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.569+0000 7fc327fff640 1 --2- 172.21.15.86:0/3677443002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3280c42d0 0x7fc32815d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:43:38.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.570+0000 7fc32d2c9640 1 --2- 172.21.15.86:0/3677443002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc328159490 0x7fc3281351c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc3200020d0 tx=0x7fc32000a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:38.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.571+0000 7fc3257fa640 1 -- 172.21.15.86:0/3677443002 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc320017070 con 0x7fc328159490 2024-09-19T06:43:38.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.571+0000 7fc3257fa640 1 -- 172.21.15.86:0/3677443002 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc320012400 con 0x7fc328159490 2024-09-19T06:43:38.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.571+0000 7fc3257fa640 1 -- 172.21.15.86:0/3677443002 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3200127f0 con 0x7fc328159490 2024-09-19T06:43:38.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.571+0000 7fc32ed2c640 1 -- 172.21.15.86:0/3677443002 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc32808c500 con 0x7fc328159490 2024-09-19T06:43:38.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.571+0000 7fc32ed2c640 1 -- 172.21.15.86:0/3677443002 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3280ce150 con 0x7fc328159490 2024-09-19T06:43:38.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.576+0000 7fc3257fa640 1 -- 172.21.15.86:0/3677443002 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc32001a070 con 0x7fc328159490 2024-09-19T06:43:38.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.575+0000 7fc32ed2c640 1 -- 172.21.15.86:0/3677443002 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc308005290 con 0x7fc328159490 2024-09-19T06:43:38.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.577+0000 7fc3257fa640 1 --2- 172.21.15.86:0/3677443002 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc31406c300 0x7fc31406e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:38.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.577+0000 7fc32cac8640 1 --2- 172.21.15.86:0/3677443002 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc31406c300 0x7fc31406e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:38.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.577+0000 7fc3257fa640 1 -- 172.21.15.86:0/3677443002 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6993+0+0 (secure 0 0 0) 0x7fc32008b6b0 con 0x7fc328159490 2024-09-19T06:43:38.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.578+0000 7fc32cac8640 1 --2- 172.21.15.86:0/3677443002 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc31406c300 0x7fc31406e7c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc31c006b10 tx=0x7fc31c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:38.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:38.582+0000 7fc3257fa640 1 -- 172.21.15.86:0/3677443002 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc320059430 con 0x7fc328159490 2024-09-19T06:43:39.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.004+0000 7fc32ed2c640 1 -- 172.21.15.86:0/3677443002 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc308005850 con 0x7fc328159490 2024-09-19T06:43:39.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.011+0000 7fc3257fa640 1 -- 172.21.15.86:0/3677443002 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6880 (secure 0 0 0) 0x7fc32005d730 con 0x7fc328159490 2024-09-19T06:43:39.015 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:43:39.015 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":24,"btime":"2024-09-19T06:42:28:634666+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/3116130916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":3116130916},{"type":"v1","addr":"172.21.15.169:6837","nonce":3116130916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:42:24.620680+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"e","rank":0,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.86:6839/1006149510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1006149510},{"type":"v1","addr":"172.21.15.86:6839","nonce":1006149510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4998,"qdb_cluster":[4998]},"id":1}]} 2024-09-19T06:43:39.016 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 24 2024-09-19T06:43:39.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.014+0000 7fc30effd640 1 -- 172.21.15.86:0/3677443002 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc31406c300 msgr2=0x7fc31406e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:39.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.014+0000 7fc30effd640 1 --2- 172.21.15.86:0/3677443002 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc31406c300 0x7fc31406e7c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc31c006b10 tx=0x7fc31c008040 comp rx=0 tx=0).stop 2024-09-19T06:43:39.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.014+0000 7fc30effd640 1 -- 172.21.15.86:0/3677443002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc328159490 msgr2=0x7fc3281351c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:39.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.014+0000 7fc30effd640 1 --2- 172.21.15.86:0/3677443002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc328159490 0x7fc3281351c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc3200020d0 tx=0x7fc32000a430 comp rx=0 tx=0).stop 2024-09-19T06:43:39.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.015+0000 7fc30effd640 1 -- 172.21.15.86:0/3677443002 shutdown_connections 2024-09-19T06:43:39.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.015+0000 7fc30effd640 1 --2- 172.21.15.86:0/3677443002 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc31406c300 0x7fc31406e7c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:39.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.015+0000 7fc30effd640 1 --2- 172.21.15.86:0/3677443002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc328159490 0x7fc3281351c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:39.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.015+0000 7fc30effd640 1 --2- 172.21.15.86:0/3677443002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3280c42d0 0x7fc32815d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:39.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.015+0000 7fc30effd640 1 --2- 172.21.15.86:0/3677443002 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc328071eb0 0x7fc32815d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:39.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.015+0000 7fc30effd640 1 -- 172.21.15.86:0/3677443002 >> 172.21.15.86:0/3677443002 conn(0x7fc32806fd60 msgr2=0x7fc328070140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:39.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.015+0000 7fc30effd640 1 -- 172.21.15.86:0/3677443002 shutdown_connections 2024-09-19T06:43:39.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.015+0000 7fc30effd640 1 -- 172.21.15.86:0/3677443002 wait complete. 2024-09-19T06:43:39.036 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.e (rank=0) 2024-09-19T06:43:39.037 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-09-19T06:43:39.037 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:43:39.056 INFO:tasks.ceph.mds.e:Stopped 2024-09-19T06:43:39.056 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:43:39.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.292+0000 7fa4a1e15640 1 Processor -- start 2024-09-19T06:43:39.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.292+0000 7fa4a1e15640 1 -- start start 2024-09-19T06:43:39.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.293+0000 7fa4a1e15640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa49c0c8b20 0x7fa49c15ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:39.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.293+0000 7fa4a1e15640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa49c15cf60 0x7fa49c073120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:39.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.293+0000 7fa4a1e15640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa49c0cc040 con 0x7fa49c153050 2024-09-19T06:43:39.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.293+0000 7fa4a1e15640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fa49c0c5da0 con 0x7fa49c15cf60 2024-09-19T06:43:39.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.293+0000 7fa4a1e15640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa49c153430 con 0x7fa49c0c8b20 2024-09-19T06:43:39.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.296+0000 7fa49bfff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa49c15cf60 0x7fa49c073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:39.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.296+0000 7fa49bfff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa49c15cf60 0x7fa49c073120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:58904/0 (socket says 172.21.15.86:58904) 2024-09-19T06:43:39.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.296+0000 7fa49bfff640 1 -- 172.21.15.86:0/3775580778 learned_addr learned my addr 172.21.15.86:0/3775580778 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:43:39.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.297+0000 7fa49affd640 1 --2- 172.21.15.86:0/3775580778 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa49c0c8b20 0x7fa49c15ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:39.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.298+0000 7fa49bfff640 1 -- 172.21.15.86:0/3775580778 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa49c0c8b20 msgr2=0x7fa49c15ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:39.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.298+0000 7fa49bfff640 1 --2- 172.21.15.86:0/3775580778 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa49c0c8b20 0x7fa49c15ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:39.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.298+0000 7fa49bfff640 1 -- 172.21.15.86:0/3775580778 >> v1:172.21.15.169:6789/0 conn(0x7fa49c153050 legacy=0x7fa49c0cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:39.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.298+0000 7fa49bfff640 1 -- 172.21.15.86:0/3775580778 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49c0c6040 con 0x7fa49c15cf60 2024-09-19T06:43:39.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.298+0000 7fa49bfff640 1 --2- 172.21.15.86:0/3775580778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa49c15cf60 0x7fa49c073120 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa490009870 tx=0x7fa49002a290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fd7c70aff3b82ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:39.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.298+0000 7fa49a7fc640 1 -- 172.21.15.86:0/3775580778 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490037070 con 0x7fa49c15cf60 2024-09-19T06:43:39.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.298+0000 7fa49a7fc640 1 -- 172.21.15.86:0/3775580778 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa490032440 con 0x7fa49c15cf60 2024-09-19T06:43:39.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.298+0000 7fa49a7fc640 1 -- 172.21.15.86:0/3775580778 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490037070 con 0x7fa49c15cf60 2024-09-19T06:43:39.306 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.304+0000 7fa4a1e15640 1 -- 172.21.15.86:0/3775580778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa49c15cf60 msgr2=0x7fa49c073120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:39.306 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.304+0000 7fa4a1e15640 1 --2- 172.21.15.86:0/3775580778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa49c15cf60 0x7fa49c073120 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa490009870 tx=0x7fa49002a290 comp rx=0 tx=0).stop 2024-09-19T06:43:39.306 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.304+0000 7fa4a1e15640 1 -- 172.21.15.86:0/3775580778 shutdown_connections 2024-09-19T06:43:39.306 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.304+0000 7fa4a1e15640 1 --2- 172.21.15.86:0/3775580778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa49c15cf60 0x7fa49c073120 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:39.306 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.304+0000 7fa4a1e15640 1 --2- 172.21.15.86:0/3775580778 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa49c0c8b20 0x7fa49c15ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:39.306 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.304+0000 7fa4a1e15640 1 -- 172.21.15.86:0/3775580778 >> 172.21.15.86:0/3775580778 conn(0x7fa49c070d10 msgr2=0x7fa49c0710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:39.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.304+0000 7fa4a1e15640 1 -- 172.21.15.86:0/3775580778 shutdown_connections 2024-09-19T06:43:39.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.304+0000 7fa4a1e15640 1 -- 172.21.15.86:0/3775580778 wait complete. 2024-09-19T06:43:39.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.304+0000 7fa4a1e15640 1 Processor -- start 2024-09-19T06:43:39.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.304+0000 7fa4a1e15640 1 -- start start 2024-09-19T06:43:39.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.309+0000 7fa4a1e15640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa49c0c8b20 0x7fa49c154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:39.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.309+0000 7fa4a1e15640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa49c153050 0x7fa49c1f8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:39.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.309+0000 7fa4a1e15640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa49c15cf60 0x7fa49c1f8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:39.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.309+0000 7fa4a1e15640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c0c68e0 con 0x7fa49c153050 2024-09-19T06:43:39.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.309+0000 7fa4a1e15640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c0c6600 con 0x7fa49c15cf60 2024-09-19T06:43:39.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.309+0000 7fa4a1e15640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa49c15c500 con 0x7fa49c0c8b20 2024-09-19T06:43:39.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.309+0000 7fa49affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa49c153050 0x7fa49c1f8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:39.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.309+0000 7fa49affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa49c153050 0x7fa49c1f8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46498/0 (socket says 172.21.15.86:46498) 2024-09-19T06:43:39.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.309+0000 7fa49affd640 1 -- 172.21.15.86:0/3415528992 learned_addr learned my addr 172.21.15.86:0/3415528992 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:43:39.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.311+0000 7fa49affd640 1 -- 172.21.15.86:0/3415528992 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa49c0c8b20 msgr2=0x7fa49c154ec0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:43:39.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.311+0000 7fa49affd640 1 --2- 172.21.15.86:0/3415528992 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa49c0c8b20 0x7fa49c154ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:39.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.311+0000 7fa49affd640 1 -- 172.21.15.86:0/3415528992 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa49c15cf60 msgr2=0x7fa49c1f8c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:43:39.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.311+0000 7fa49affd640 1 --2- 172.21.15.86:0/3415528992 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa49c15cf60 0x7fa49c1f8c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:39.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.311+0000 7fa49affd640 1 -- 172.21.15.86:0/3415528992 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49c156670 con 0x7fa49c153050 2024-09-19T06:43:39.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.311+0000 7fa49affd640 1 --2- 172.21.15.86:0/3415528992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa49c153050 0x7fa49c1f8700 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00eb70 tx=0x7fa48c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:39.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.312+0000 7fa483fff640 1 -- 172.21.15.86:0/3415528992 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48c017070 con 0x7fa49c153050 2024-09-19T06:43:39.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.312+0000 7fa483fff640 1 -- 172.21.15.86:0/3415528992 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa48c00ed80 con 0x7fa49c153050 2024-09-19T06:43:39.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.312+0000 7fa483fff640 1 -- 172.21.15.86:0/3415528992 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48c013470 con 0x7fa49c153050 2024-09-19T06:43:39.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.312+0000 7fa4a1e15640 1 -- 172.21.15.86:0/3415528992 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa49c156390 con 0x7fa49c153050 2024-09-19T06:43:39.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.312+0000 7fa4a1e15640 1 -- 172.21.15.86:0/3415528992 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa49c0ce830 con 0x7fa49c153050 2024-09-19T06:43:39.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.314+0000 7fa4a1e15640 1 -- 172.21.15.86:0/3415528992 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa49c15ca20 con 0x7fa49c153050 2024-09-19T06:43:39.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.333+0000 7fa483fff640 1 -- 172.21.15.86:0/3415528992 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa48c01a070 con 0x7fa49c153050 2024-09-19T06:43:39.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.333+0000 7fa483fff640 1 --2- 172.21.15.86:0/3415528992 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa48806c380 0x7fa48806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:39.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.334+0000 7fa483fff640 1 -- 172.21.15.86:0/3415528992 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6993+0+0 (secure 0 0 0) 0x7fa48c08c230 con 0x7fa49c153050 2024-09-19T06:43:39.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.334+0000 7fa483fff640 1 -- 172.21.15.86:0/3415528992 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa48c08c6f0 con 0x7fa49c153050 2024-09-19T06:43:39.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.335+0000 7fa49b7fe640 1 --2- 172.21.15.86:0/3415528992 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa48806c380 0x7fa48806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:39.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.336+0000 7fa49b7fe640 1 --2- 172.21.15.86:0/3415528992 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa48806c380 0x7fa48806e840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa4940012e0 tx=0x7fa494007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:39.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.814+0000 7fa4a1e15640 1 -- 172.21.15.86:0/3415528992 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa49c071280 con 0x7fa49c153050 2024-09-19T06:43:39.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.816+0000 7fa483fff640 1 -- 172.21.15.86:0/3415528992 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6880 (secure 0 0 0) 0x7fa48c05a470 con 0x7fa49c153050 2024-09-19T06:43:39.819 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:43:39.819 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":24,"btime":"2024-09-19T06:42:28:634666+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/3116130916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":3116130916},{"type":"v1","addr":"172.21.15.169:6837","nonce":3116130916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:42:24.620680+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"e","rank":0,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.86:6839/1006149510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1006149510},{"type":"v1","addr":"172.21.15.86:6839","nonce":1006149510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4998,"qdb_cluster":[4998]},"id":1}]} 2024-09-19T06:43:39.819 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 24 2024-09-19T06:43:39.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.820+0000 7fa4a1e15640 1 -- 172.21.15.86:0/3415528992 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa48806c380 msgr2=0x7fa48806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:39.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.820+0000 7fa4a1e15640 1 --2- 172.21.15.86:0/3415528992 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa48806c380 0x7fa48806e840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa4940012e0 tx=0x7fa494007d30 comp rx=0 tx=0).stop 2024-09-19T06:43:39.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.820+0000 7fa4a1e15640 1 -- 172.21.15.86:0/3415528992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa49c153050 msgr2=0x7fa49c1f8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:39.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.820+0000 7fa4a1e15640 1 --2- 172.21.15.86:0/3415528992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa49c153050 0x7fa49c1f8700 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00eb70 tx=0x7fa48c00c520 comp rx=0 tx=0).stop 2024-09-19T06:43:39.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.821+0000 7fa4a1e15640 1 -- 172.21.15.86:0/3415528992 shutdown_connections 2024-09-19T06:43:39.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.821+0000 7fa4a1e15640 1 --2- 172.21.15.86:0/3415528992 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa48806c380 0x7fa48806e840 secure :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa4940012e0 tx=0x7fa494007d30 comp rx=0 tx=0).stop 2024-09-19T06:43:39.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.821+0000 7fa4a1e15640 1 --2- 172.21.15.86:0/3415528992 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa49c15cf60 0x7fa49c1f8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:39.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.821+0000 7fa4a1e15640 1 --2- 172.21.15.86:0/3415528992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa49c153050 0x7fa49c1f8700 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:39.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.821+0000 7fa4a1e15640 1 --2- 172.21.15.86:0/3415528992 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa49c0c8b20 0x7fa49c154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:39.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.821+0000 7fa4a1e15640 1 -- 172.21.15.86:0/3415528992 >> 172.21.15.86:0/3415528992 conn(0x7fa49c070d10 msgr2=0x7fa49c06df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:39.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.821+0000 7fa4a1e15640 1 -- 172.21.15.86:0/3415528992 shutdown_connections 2024-09-19T06:43:39.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:39.821+0000 7fa4a1e15640 1 -- 172.21.15.86:0/3415528992 wait complete. 2024-09-19T06:43:39.842 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-09-19T06:43:41.842 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:43:42.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.032+0000 7fe2709a6640 1 Processor -- start 2024-09-19T06:43:42.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.032+0000 7fe2709a6640 1 -- start start 2024-09-19T06:43:42.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.034+0000 7fe2709a6640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe26c0c8450 0x7fe26c157b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:42.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.034+0000 7fe2709a6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe26c0c8c30 0x7fe26c150f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:42.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.034+0000 7fe2709a6640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe26c0c7e30 con 0x7fe26c0c8830 2024-09-19T06:43:42.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.034+0000 7fe2709a6640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fe26c071200 con 0x7fe26c0c8450 2024-09-19T06:43:42.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.034+0000 7fe2709a6640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe26c1580a0 con 0x7fe26c0c8c30 2024-09-19T06:43:42.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.035+0000 7fe26a59c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe26c0c8450 0x7fe26c157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:42.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.035+0000 7fe26a59c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe26c0c8450 0x7fe26c157b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46510/0 (socket says 172.21.15.86:46510) 2024-09-19T06:43:42.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.035+0000 7fe26a59c640 1 -- 172.21.15.86:0/1185454191 learned_addr learned my addr 172.21.15.86:0/1185454191 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:43:42.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.035+0000 7fe26ad9d640 1 --2- 172.21.15.86:0/1185454191 >> v2:172.21.15.169:3300/0 conn(0x7fe26c0c8c30 0x7fe26c150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:42.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.035+0000 7fe26a59c640 1 -- 172.21.15.86:0/1185454191 >> v2:172.21.15.169:3300/0 conn(0x7fe26c0c8c30 msgr2=0x7fe26c150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:42.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.035+0000 7fe26a59c640 1 --2- 172.21.15.86:0/1185454191 >> v2:172.21.15.169:3300/0 conn(0x7fe26c0c8c30 0x7fe26c150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:42.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.035+0000 7fe26a59c640 1 -- 172.21.15.86:0/1185454191 >> v1:172.21.15.169:6789/0 conn(0x7fe26c0c8830 legacy=0x7fe26c06cc60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:43:42.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.035+0000 7fe26a59c640 1 -- 172.21.15.86:0/1185454191 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe26c06bbc0 con 0x7fe26c0c8450 2024-09-19T06:43:42.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.037+0000 7fe26a59c640 1 --2- 172.21.15.86:0/1185454191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe26c0c8450 0x7fe26c157b60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe26c15b6f0 tx=0x7fe25c02efa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9348fd01ec938b33 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:42.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.037+0000 7fe26ad9d640 1 --2- 172.21.15.86:0/1185454191 >> v2:172.21.15.169:3300/0 conn(0x7fe26c0c8c30 0x7fe26c150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:43:42.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.038+0000 7fe26959a640 1 -- 172.21.15.86:0/1185454191 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c035070 con 0x7fe26c0c8450 2024-09-19T06:43:42.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.038+0000 7fe26959a640 1 -- 172.21.15.86:0/1185454191 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe25c02faa0 con 0x7fe26c0c8450 2024-09-19T06:43:42.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.039+0000 7fe2709a6640 1 -- 172.21.15.86:0/1185454191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe26c0c8450 msgr2=0x7fe26c157b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:42.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.039+0000 7fe2709a6640 1 --2- 172.21.15.86:0/1185454191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe26c0c8450 0x7fe26c157b60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe26c15b6f0 tx=0x7fe25c02efa0 comp rx=0 tx=0).stop 2024-09-19T06:43:42.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.043+0000 7fe2709a6640 1 -- 172.21.15.86:0/1185454191 shutdown_connections 2024-09-19T06:43:42.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.043+0000 7fe2709a6640 1 --2- 172.21.15.86:0/1185454191 >> v2:172.21.15.169:3300/0 conn(0x7fe26c0c8c30 0x7fe26c150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:42.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.043+0000 7fe2709a6640 1 --2- 172.21.15.86:0/1185454191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe26c0c8450 0x7fe26c157b60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:42.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.043+0000 7fe2709a6640 1 -- 172.21.15.86:0/1185454191 >> 172.21.15.86:0/1185454191 conn(0x7fe26c0c9280 msgr2=0x7fe26c0c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:42.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.050+0000 7fe2709a6640 1 -- 172.21.15.86:0/1185454191 shutdown_connections 2024-09-19T06:43:42.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.052+0000 7fe2709a6640 1 -- 172.21.15.86:0/1185454191 wait complete. 2024-09-19T06:43:42.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.054+0000 7fe2709a6640 1 Processor -- start 2024-09-19T06:43:42.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.056+0000 7fe2709a6640 1 -- start start 2024-09-19T06:43:42.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.057+0000 7fe2709a6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe26c0c8450 0x7fe26c1532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:42.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.057+0000 7fe2709a6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe26c0c8830 0x7fe26c155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:42.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.057+0000 7fe2709a6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe26c0c8c30 0x7fe26c155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:42.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.057+0000 7fe2709a6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe26c06c460 con 0x7fe26c0c8450 2024-09-19T06:43:42.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.057+0000 7fe2709a6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe26c06c180 con 0x7fe26c0c8c30 2024-09-19T06:43:42.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.057+0000 7fe2709a6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe26c06d370 con 0x7fe26c0c8830 2024-09-19T06:43:42.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.058+0000 7fe26a59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe26c0c8450 0x7fe26c1532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:42.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.058+0000 7fe26a59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe26c0c8450 0x7fe26c1532b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46514/0 (socket says 172.21.15.86:46514) 2024-09-19T06:43:42.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.058+0000 7fe26a59c640 1 -- 172.21.15.86:0/756372785 learned_addr learned my addr 172.21.15.86:0/756372785 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:43:42.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.058+0000 7fe26a59c640 1 -- 172.21.15.86:0/756372785 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe26c0c8830 msgr2=0x7fe26c155120 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:43:42.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.058+0000 7fe26a59c640 1 --2- 172.21.15.86:0/756372785 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe26c0c8830 0x7fe26c155120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:42.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.059+0000 7fe26a59c640 1 -- 172.21.15.86:0/756372785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe26c0c8c30 msgr2=0x7fe26c155660 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:43:42.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.059+0000 7fe26a59c640 1 --2- 172.21.15.86:0/756372785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe26c0c8c30 0x7fe26c155660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:42.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.059+0000 7fe26a59c640 1 -- 172.21.15.86:0/756372785 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe26c0c4ee0 con 0x7fe26c0c8450 2024-09-19T06:43:42.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.059+0000 7fe26a59c640 1 --2- 172.21.15.86:0/756372785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe26c0c8450 0x7fe26c1532b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe25c03b040 tx=0x7fe25c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:42.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.060+0000 7fe25affd640 1 -- 172.21.15.86:0/756372785 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c047070 con 0x7fe26c0c8450 2024-09-19T06:43:42.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.060+0000 7fe2709a6640 1 -- 172.21.15.86:0/756372785 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe26c156620 con 0x7fe26c0c8450 2024-09-19T06:43:42.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.060+0000 7fe2709a6640 1 -- 172.21.15.86:0/756372785 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe26c156be0 con 0x7fe26c0c8450 2024-09-19T06:43:42.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.061+0000 7fe25affd640 1 -- 172.21.15.86:0/756372785 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe25c004250 con 0x7fe26c0c8450 2024-09-19T06:43:42.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.061+0000 7fe25affd640 1 -- 172.21.15.86:0/756372785 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c004660 con 0x7fe26c0c8450 2024-09-19T06:43:42.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.067+0000 7fe25affd640 1 -- 172.21.15.86:0/756372785 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe25c02f9e0 con 0x7fe26c0c8450 2024-09-19T06:43:42.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.068+0000 7fe2709a6640 1 -- 172.21.15.86:0/756372785 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe250005290 con 0x7fe26c0c8450 2024-09-19T06:43:42.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.071+0000 7fe25affd640 1 --2- 172.21.15.86:0/756372785 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe24c06c380 0x7fe24c06e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:42.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.071+0000 7fe25affd640 1 -- 172.21.15.86:0/756372785 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6993+0+0 (secure 0 0 0) 0x7fe25c0ac160 con 0x7fe26c0c8450 2024-09-19T06:43:42.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.071+0000 7fe269d9b640 1 --2- 172.21.15.86:0/756372785 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe24c06c380 0x7fe24c06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:42.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.073+0000 7fe269d9b640 1 --2- 172.21.15.86:0/756372785 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe24c06c380 0x7fe24c06e840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe26c1fb2c0 tx=0x7fe264006bd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:42.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.084+0000 7fe25affd640 1 -- 172.21.15.86:0/756372785 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe25c010070 con 0x7fe26c0c8450 2024-09-19T06:43:42.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.505+0000 7fe2709a6640 1 -- 172.21.15.86:0/756372785 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe250005580 con 0x7fe26c0c8450 2024-09-19T06:43:42.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.507+0000 7fe25affd640 1 -- 172.21.15.86:0/756372785 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6880 (secure 0 0 0) 0x7fe25c07a3a0 con 0x7fe26c0c8450 2024-09-19T06:43:42.509 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:43:42.509 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":24,"btime":"2024-09-19T06:42:28:634666+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/3116130916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":3116130916},{"type":"v1","addr":"172.21.15.169:6837","nonce":3116130916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:42:24.620680+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"e","rank":0,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.86:6839/1006149510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1006149510},{"type":"v1","addr":"172.21.15.86:6839","nonce":1006149510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4998,"qdb_cluster":[4998]},"id":1}]} 2024-09-19T06:43:42.509 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 24 2024-09-19T06:43:42.517 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.516+0000 7fe258ff9640 1 -- 172.21.15.86:0/756372785 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe24c06c380 msgr2=0x7fe24c06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:42.517 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.516+0000 7fe258ff9640 1 --2- 172.21.15.86:0/756372785 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe24c06c380 0x7fe24c06e840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe26c1fb2c0 tx=0x7fe264006bd0 comp rx=0 tx=0).stop 2024-09-19T06:43:42.517 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.516+0000 7fe258ff9640 1 -- 172.21.15.86:0/756372785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe26c0c8450 msgr2=0x7fe26c1532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:42.517 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.516+0000 7fe258ff9640 1 --2- 172.21.15.86:0/756372785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe26c0c8450 0x7fe26c1532b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe25c03b040 tx=0x7fe25c004a40 comp rx=0 tx=0).stop 2024-09-19T06:43:42.517 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.516+0000 7fe258ff9640 1 -- 172.21.15.86:0/756372785 shutdown_connections 2024-09-19T06:43:42.517 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.516+0000 7fe258ff9640 1 --2- 172.21.15.86:0/756372785 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe24c06c380 0x7fe24c06e840 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:42.517 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.516+0000 7fe258ff9640 1 --2- 172.21.15.86:0/756372785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe26c0c8c30 0x7fe26c155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:42.518 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.516+0000 7fe258ff9640 1 --2- 172.21.15.86:0/756372785 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe26c0c8830 0x7fe26c155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:42.518 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.516+0000 7fe258ff9640 1 --2- 172.21.15.86:0/756372785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe26c0c8450 0x7fe26c1532b0 secure :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe25c03b040 tx=0x7fe25c004a40 comp rx=0 tx=0).stop 2024-09-19T06:43:42.518 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.516+0000 7fe258ff9640 1 -- 172.21.15.86:0/756372785 >> 172.21.15.86:0/756372785 conn(0x7fe26c0c9280 msgr2=0x7fe26c0c9660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:42.518 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.517+0000 7fe258ff9640 1 -- 172.21.15.86:0/756372785 shutdown_connections 2024-09-19T06:43:42.518 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:42.517+0000 7fe258ff9640 1 -- 172.21.15.86:0/756372785 wait complete. 2024-09-19T06:43:42.538 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-09-19T06:43:44.539 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:43:44.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.732+0000 7f1f7715f640 1 Processor -- start 2024-09-19T06:43:44.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.732+0000 7f1f7715f640 1 -- start start 2024-09-19T06:43:44.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.738+0000 7f1f7715f640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1f70165340 0x7f1f70168700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:44.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.738+0000 7f1f7715f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f700c84d0 0x7f1f700723d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:44.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.738+0000 7f1f7715f640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f700c8a80 con 0x7f1f70072910 2024-09-19T06:43:44.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.738+0000 7f1f7715f640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f1f70168c40 con 0x7f1f70165340 2024-09-19T06:43:44.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.738+0000 7f1f7715f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1f700c8110 con 0x7f1f700c84d0 2024-09-19T06:43:44.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.738+0000 7f1f6ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f700c84d0 0x7f1f700723d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:44.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.738+0000 7f1f6ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f700c84d0 0x7f1f700723d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:39902/0 (socket says 172.21.15.86:39902) 2024-09-19T06:43:44.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.738+0000 7f1f6ffff640 1 -- 172.21.15.86:0/3651030608 learned_addr learned my addr 172.21.15.86:0/3651030608 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:43:44.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.738+0000 7f1f74efb640 1 --2- 172.21.15.86:0/3651030608 >> v2:172.21.15.86:3300/0 conn(0x7f1f70165340 0x7f1f70168700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:44.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.739+0000 7f1f6ffff640 1 -- 172.21.15.86:0/3651030608 >> v2:172.21.15.86:3300/0 conn(0x7f1f70165340 msgr2=0x7f1f70168700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:44.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.739+0000 7f1f6ffff640 1 --2- 172.21.15.86:0/3651030608 >> v2:172.21.15.86:3300/0 conn(0x7f1f70165340 0x7f1f70168700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:44.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.739+0000 7f1f6ffff640 1 -- 172.21.15.86:0/3651030608 >> v1:172.21.15.169:6789/0 conn(0x7f1f70072910 legacy=0x7f1f700c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:44.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.739+0000 7f1f6ffff640 1 -- 172.21.15.86:0/3651030608 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f700c8d40 con 0x7f1f700c84d0 2024-09-19T06:43:44.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.739+0000 7f1f74efb640 1 --2- 172.21.15.86:0/3651030608 >> v2:172.21.15.86:3300/0 conn(0x7f1f70165340 0x7f1f70168700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:43:44.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.740+0000 7f1f6ffff640 1 --2- 172.21.15.86:0/3651030608 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f700c84d0 0x7f1f700723d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1f68008ec0 tx=0x7f1f6802aa80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9c2c4f23d177f46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:44.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.742+0000 7f1f6f7fe640 1 -- 172.21.15.86:0/3651030608 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6802e800 con 0x7f1f700c84d0 2024-09-19T06:43:44.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.742+0000 7f1f6f7fe640 1 -- 172.21.15.86:0/3651030608 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f6802e9a0 con 0x7f1f700c84d0 2024-09-19T06:43:44.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.742+0000 7f1f6f7fe640 1 -- 172.21.15.86:0/3651030608 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6802ed70 con 0x7f1f700c84d0 2024-09-19T06:43:44.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.743+0000 7f1f7715f640 1 -- 172.21.15.86:0/3651030608 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f700c84d0 msgr2=0x7f1f700723d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:44.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.743+0000 7f1f7715f640 1 --2- 172.21.15.86:0/3651030608 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f700c84d0 0x7f1f700723d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1f68008ec0 tx=0x7f1f6802aa80 comp rx=0 tx=0).stop 2024-09-19T06:43:44.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.747+0000 7f1f7715f640 1 -- 172.21.15.86:0/3651030608 shutdown_connections 2024-09-19T06:43:44.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.747+0000 7f1f7715f640 1 --2- 172.21.15.86:0/3651030608 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f700c84d0 0x7f1f700723d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:44.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.747+0000 7f1f7715f640 1 --2- 172.21.15.86:0/3651030608 >> v2:172.21.15.86:3300/0 conn(0x7f1f70165340 0x7f1f70168700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:44.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.747+0000 7f1f7715f640 1 -- 172.21.15.86:0/3651030608 >> 172.21.15.86:0/3651030608 conn(0x7f1f700c9280 msgr2=0x7f1f700c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:44.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.751+0000 7f1f7715f640 1 -- 172.21.15.86:0/3651030608 shutdown_connections 2024-09-19T06:43:44.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.751+0000 7f1f7715f640 1 -- 172.21.15.86:0/3651030608 wait complete. 2024-09-19T06:43:44.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.753+0000 7f1f7715f640 1 Processor -- start 2024-09-19T06:43:44.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.753+0000 7f1f7715f640 1 -- start start 2024-09-19T06:43:44.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.754+0000 7f1f7715f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f70072910 0x7f1f701f3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:44.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.754+0000 7f1f7715f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f700c84d0 0x7f1f701f36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:44.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.754+0000 7f1f7715f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f70165340 0x7f1f70158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:44.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.754+0000 7f1f7715f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1f70071bd0 con 0x7f1f700c84d0 2024-09-19T06:43:44.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.755+0000 7f1f7715f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1f70071f40 con 0x7f1f70072910 2024-09-19T06:43:44.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.755+0000 7f1f7715f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1f70070ed0 con 0x7f1f70165340 2024-09-19T06:43:44.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.755+0000 7f1f6ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f700c84d0 0x7f1f701f36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:44.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.755+0000 7f1f6ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f700c84d0 0x7f1f701f36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33352/0 (socket says 172.21.15.86:33352) 2024-09-19T06:43:44.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.755+0000 7f1f6ffff640 1 -- 172.21.15.86:0/3366584843 learned_addr learned my addr 172.21.15.86:0/3366584843 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:43:44.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.755+0000 7f1f756fc640 1 --2- 172.21.15.86:0/3366584843 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f70165340 0x7f1f70158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:44.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.755+0000 7f1f74efb640 1 --2- 172.21.15.86:0/3366584843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f70072910 0x7f1f701f3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:44.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.756+0000 7f1f6ffff640 1 -- 172.21.15.86:0/3366584843 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f70165340 msgr2=0x7f1f70158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:44.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.756+0000 7f1f6ffff640 1 --2- 172.21.15.86:0/3366584843 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f70165340 0x7f1f70158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:44.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.756+0000 7f1f6ffff640 1 -- 172.21.15.86:0/3366584843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f70072910 msgr2=0x7f1f701f3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:44.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.756+0000 7f1f6ffff640 1 --2- 172.21.15.86:0/3366584843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f70072910 0x7f1f701f3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:44.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.756+0000 7f1f6ffff640 1 -- 172.21.15.86:0/3366584843 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f700c55d0 con 0x7f1f700c84d0 2024-09-19T06:43:44.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.757+0000 7f1f6ffff640 1 --2- 172.21.15.86:0/3366584843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f700c84d0 0x7f1f701f36b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1f6802aac0 tx=0x7f1f68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:44.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.757+0000 7f1f6d7fa640 1 -- 172.21.15.86:0/3366584843 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f68036c00 con 0x7f1f700c84d0 2024-09-19T06:43:44.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.757+0000 7f1f6d7fa640 1 -- 172.21.15.86:0/3366584843 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f68046070 con 0x7f1f700c84d0 2024-09-19T06:43:44.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.757+0000 7f1f6d7fa640 1 -- 172.21.15.86:0/3366584843 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f68041410 con 0x7f1f700c84d0 2024-09-19T06:43:44.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.757+0000 7f1f7715f640 1 -- 172.21.15.86:0/3366584843 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f701f23b0 con 0x7f1f700c84d0 2024-09-19T06:43:44.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.757+0000 7f1f7715f640 1 -- 172.21.15.86:0/3366584843 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f701f2970 con 0x7f1f700c84d0 2024-09-19T06:43:44.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.758+0000 7f1f6d7fa640 1 -- 172.21.15.86:0/3366584843 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1f6803e030 con 0x7f1f700c84d0 2024-09-19T06:43:44.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.758+0000 7f1f6d7fa640 1 --2- 172.21.15.86:0/3366584843 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1f5c06c380 0x7f1f5c06e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:44.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.758+0000 7f1f6d7fa640 1 -- 172.21.15.86:0/3366584843 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6993+0+0 (secure 0 0 0) 0x7f1f680ad120 con 0x7f1f700c84d0 2024-09-19T06:43:44.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.758+0000 7f1f74efb640 1 --2- 172.21.15.86:0/3366584843 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1f5c06c380 0x7f1f5c06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:44.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.763+0000 7f1f7715f640 1 -- 172.21.15.86:0/3366584843 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f7006bbc0 con 0x7f1f700c84d0 2024-09-19T06:43:44.779 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.778+0000 7f1f74efb640 1 --2- 172.21.15.86:0/3366584843 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1f5c06c380 0x7f1f5c06e840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1f6000b800 tx=0x7f1f6000b3a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:44.779 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:44.778+0000 7f1f6d7fa640 1 -- 172.21.15.86:0/3366584843 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1f6803c040 con 0x7f1f700c84d0 2024-09-19T06:43:45.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:45.206+0000 7f1f7715f640 1 -- 172.21.15.86:0/3366584843 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f701658d0 con 0x7f1f700c84d0 2024-09-19T06:43:45.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:45.207+0000 7f1f6d7fa640 1 -- 172.21.15.86:0/3366584843 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6880 (secure 0 0 0) 0x7f1f68032030 con 0x7f1f700c84d0 2024-09-19T06:43:45.210 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:43:45.211 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":24,"btime":"2024-09-19T06:42:28:634666+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/3116130916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":3116130916},{"type":"v1","addr":"172.21.15.169:6837","nonce":3116130916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:42:24.620680+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"e","rank":0,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.86:6839/1006149510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1006149510},{"type":"v1","addr":"172.21.15.86:6839","nonce":1006149510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4998,"qdb_cluster":[4998]},"id":1}]} 2024-09-19T06:43:45.211 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 24 2024-09-19T06:43:45.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:45.214+0000 7f1f7715f640 1 -- 172.21.15.86:0/3366584843 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1f5c06c380 msgr2=0x7f1f5c06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:45.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:45.214+0000 7f1f7715f640 1 --2- 172.21.15.86:0/3366584843 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1f5c06c380 0x7f1f5c06e840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1f6000b800 tx=0x7f1f6000b3a0 comp rx=0 tx=0).stop 2024-09-19T06:43:45.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:45.214+0000 7f1f7715f640 1 -- 172.21.15.86:0/3366584843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f700c84d0 msgr2=0x7f1f701f36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:45.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:45.214+0000 7f1f7715f640 1 --2- 172.21.15.86:0/3366584843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f700c84d0 0x7f1f701f36b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1f6802aac0 tx=0x7f1f68004a40 comp rx=0 tx=0).stop 2024-09-19T06:43:45.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:45.214+0000 7f1f7715f640 1 -- 172.21.15.86:0/3366584843 shutdown_connections 2024-09-19T06:43:45.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:45.214+0000 7f1f7715f640 1 --2- 172.21.15.86:0/3366584843 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1f5c06c380 0x7f1f5c06e840 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:45.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:45.214+0000 7f1f7715f640 1 --2- 172.21.15.86:0/3366584843 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f70165340 0x7f1f70158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:45.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:45.214+0000 7f1f7715f640 1 --2- 172.21.15.86:0/3366584843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f700c84d0 0x7f1f701f36b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:45.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:45.214+0000 7f1f7715f640 1 --2- 172.21.15.86:0/3366584843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f70072910 0x7f1f701f3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:45.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:45.214+0000 7f1f7715f640 1 -- 172.21.15.86:0/3366584843 >> 172.21.15.86:0/3366584843 conn(0x7f1f700c9280 msgr2=0x7f1f700cb170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:45.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:45.214+0000 7f1f7715f640 1 -- 172.21.15.86:0/3366584843 shutdown_connections 2024-09-19T06:43:45.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:45.214+0000 7f1f7715f640 1 -- 172.21.15.86:0/3366584843 wait complete. 2024-09-19T06:43:45.235 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-09-19T06:43:47.237 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:43:47.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.435+0000 7fab1e35f640 1 Processor -- start 2024-09-19T06:43:47.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.435+0000 7fab1e35f640 1 -- start start 2024-09-19T06:43:47.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.436+0000 7fab1e35f640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fab18072730 0x7fab1806bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:47.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.436+0000 7fab1e35f640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab180713a0 con 0x7fab180c7a40 2024-09-19T06:43:47.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.436+0000 7fab1e35f640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab18071680 con 0x7fab180c7e20 2024-09-19T06:43:47.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.436+0000 7fab1e35f640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fab18072b60 con 0x7fab18072730 2024-09-19T06:43:47.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.437+0000 7fab17fff640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fab180c7a40 0x7fab181632d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:34100/0 (socket says 172.21.15.86:34100) 2024-09-19T06:43:47.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.437+0000 7fab17fff640 1 -- 172.21.15.86:0/3797040679 learned_addr learned my addr 172.21.15.86:0/3797040679 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:43:47.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.438+0000 7fab16ffd640 1 -- 172.21.15.86:0/3797040679 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 710481702 0 0) 0x7fab180713a0 con 0x7fab180c7a40 2024-09-19T06:43:47.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.438+0000 7fab16ffd640 1 -- 172.21.15.86:0/3797040679 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab00003520 con 0x7fab180c7a40 2024-09-19T06:43:47.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.440+0000 7fab16ffd640 1 -- 172.21.15.86:0/3797040679 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3791337227 0 0) 0x7fab18071680 con 0x7fab180c7e20 2024-09-19T06:43:47.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.440+0000 7fab16ffd640 1 -- 172.21.15.86:0/3797040679 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab180713a0 con 0x7fab180c7e20 2024-09-19T06:43:47.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.440+0000 7fab16ffd640 1 -- 172.21.15.86:0/3797040679 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 253008831 0 0) 0x7fab00003520 con 0x7fab180c7a40 2024-09-19T06:43:47.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.440+0000 7fab16ffd640 1 -- 172.21.15.86:0/3797040679 >> v2:172.21.15.86:3300/0 conn(0x7fab18072730 msgr2=0x7fab1806bbc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:43:47.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.440+0000 7fab16ffd640 1 --2- 172.21.15.86:0/3797040679 >> v2:172.21.15.86:3300/0 conn(0x7fab18072730 0x7fab1806bbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:47.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.440+0000 7fab16ffd640 1 -- 172.21.15.86:0/3797040679 >> v1:172.21.15.169:6789/0 conn(0x7fab180c7e20 legacy=0x7fab18159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:47.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.440+0000 7fab16ffd640 1 -- 172.21.15.86:0/3797040679 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab18071c50 con 0x7fab180c7a40 2024-09-19T06:43:47.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.441+0000 7fab16ffd640 1 -- 172.21.15.86:0/3797040679 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7fab0c001670 con 0x7fab180c7a40 2024-09-19T06:43:47.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.441+0000 7fab16ffd640 1 -- 172.21.15.86:0/3797040679 >> v1:172.21.15.86:6789/0 conn(0x7fab180c7a40 legacy=0x7fab181632d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:47.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.441+0000 7fab16ffd640 1 --2- 172.21.15.86:0/3797040679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab00003b40 0x7fab00003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:47.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.441+0000 7fab16ffd640 1 --2- 172.21.15.86:0/3797040679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab00004800 0x7fab00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:47.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.441+0000 7fab16ffd640 1 --2- 172.21.15.86:0/3797040679 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab000052e0 0x7fab0000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:47.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.441+0000 7fab16ffd640 1 -- 172.21.15.86:0/3797040679 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fab18072b60 con 0x7fab00004800 2024-09-19T06:43:47.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.441+0000 7fab16ffd640 1 -- 172.21.15.86:0/3797040679 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fab0000c110 con 0x7fab00003b40 2024-09-19T06:43:47.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.441+0000 7fab16ffd640 1 -- 172.21.15.86:0/3797040679 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fab0000c310 con 0x7fab000052e0 2024-09-19T06:43:47.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.441+0000 7fab177fe640 1 --2- 172.21.15.86:0/3797040679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab00004800 0x7fab00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:47.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.442+0000 7fab17fff640 1 --2- 172.21.15.86:0/3797040679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab00003b40 0x7fab00003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:47.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.442+0000 7fab177fe640 1 -- 172.21.15.86:0/3797040679 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab000052e0 msgr2=0x7fab0000b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:43:47.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.442+0000 7fab177fe640 1 --2- 172.21.15.86:0/3797040679 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab000052e0 0x7fab0000b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:47.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.442+0000 7fab177fe640 1 -- 172.21.15.86:0/3797040679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab00003b40 msgr2=0x7fab00003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:47.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.442+0000 7fab177fe640 1 --2- 172.21.15.86:0/3797040679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab00003b40 0x7fab00003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:47.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.442+0000 7fab177fe640 1 -- 172.21.15.86:0/3797040679 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab00003520 con 0x7fab00004800 2024-09-19T06:43:47.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.443+0000 7fab1c8fc640 1 -- 172.21.15.86:0/3797040679 reap_dead start 2024-09-19T06:43:47.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.443+0000 7fab177fe640 1 --2- 172.21.15.86:0/3797040679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab00004800 0x7fab00004c80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fab080097d0 tx=0x7fab00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2235fa9785273f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:47.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.444+0000 7fab16ffd640 1 -- 172.21.15.86:0/3797040679 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab08037070 con 0x7fab00004800 2024-09-19T06:43:47.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.444+0000 7fab16ffd640 1 -- 172.21.15.86:0/3797040679 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab0802a9f0 con 0x7fab00004800 2024-09-19T06:43:47.447 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.445+0000 7fab1e35f640 1 -- 172.21.15.86:0/3797040679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab00004800 msgr2=0x7fab00004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:47.447 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.445+0000 7fab1e35f640 1 --2- 172.21.15.86:0/3797040679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab00004800 0x7fab00004c80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fab080097d0 tx=0x7fab00005830 comp rx=0 tx=0).stop 2024-09-19T06:43:47.447 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.446+0000 7fab1e35f640 1 -- 172.21.15.86:0/3797040679 shutdown_connections 2024-09-19T06:43:47.447 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.446+0000 7fab1e35f640 1 --2- 172.21.15.86:0/3797040679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab00004800 0x7fab00004c80 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:47.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.446+0000 7fab1e35f640 1 -- 172.21.15.86:0/3797040679 >> 172.21.15.86:0/3797040679 conn(0x7fab180c9280 msgr2=0x7fab180c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:47.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.446+0000 7fab1e35f640 1 -- 172.21.15.86:0/3797040679 shutdown_connections 2024-09-19T06:43:47.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.446+0000 7fab1e35f640 1 -- 172.21.15.86:0/3797040679 wait complete. 2024-09-19T06:43:47.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.448+0000 7fab1e35f640 1 Processor -- start 2024-09-19T06:43:47.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.449+0000 7fab1e35f640 1 -- start start 2024-09-19T06:43:47.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.450+0000 7fab1e35f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab181fd640 0x7fab181fda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:47.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.450+0000 7fab1e35f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab181fe7f0 0x7fab18152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:47.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.450+0000 7fab1e35f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab181fec30 0x7fab18152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:47.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.450+0000 7fab1e35f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fab18071a00 con 0x7fab181fe7f0 2024-09-19T06:43:47.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.450+0000 7fab1e35f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fab180c8e70 con 0x7fab181fd640 2024-09-19T06:43:47.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.450+0000 7fab1e35f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fab180c8ff0 con 0x7fab181fec30 2024-09-19T06:43:47.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.451+0000 7fab17fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab181fd640 0x7fab181fda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:47.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.451+0000 7fab177fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab181fe7f0 0x7fab18152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:47.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.451+0000 7fab1c8fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab181fec30 0x7fab18152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:47.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.451+0000 7fab17fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab181fd640 0x7fab181fda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:38870/0 (socket says 172.21.15.86:38870) 2024-09-19T06:43:47.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.451+0000 7fab17fff640 1 -- 172.21.15.86:0/3481117055 learned_addr learned my addr 172.21.15.86:0/3481117055 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:43:47.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.452+0000 7fab177fe640 1 -- 172.21.15.86:0/3481117055 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab181fec30 msgr2=0x7fab18152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:47.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.452+0000 7fab177fe640 1 --2- 172.21.15.86:0/3481117055 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab181fec30 0x7fab18152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:47.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.452+0000 7fab177fe640 1 -- 172.21.15.86:0/3481117055 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab181fd640 msgr2=0x7fab181fda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:47.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.452+0000 7fab177fe640 1 --2- 172.21.15.86:0/3481117055 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab181fd640 0x7fab181fda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:47.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.452+0000 7fab177fe640 1 -- 172.21.15.86:0/3481117055 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab181fe1a0 con 0x7fab181fe7f0 2024-09-19T06:43:47.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.452+0000 7fab177fe640 1 --2- 172.21.15.86:0/3481117055 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab181fe7f0 0x7fab18152960 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fab08006fd0 tx=0x7fab08004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:47.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.453+0000 7fab14ff9640 1 -- 172.21.15.86:0/3481117055 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab08037070 con 0x7fab181fe7f0 2024-09-19T06:43:47.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.453+0000 7fab1e35f640 1 -- 172.21.15.86:0/3481117055 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab18160f90 con 0x7fab181fe7f0 2024-09-19T06:43:47.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.453+0000 7fab1e35f640 1 -- 172.21.15.86:0/3481117055 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab18161530 con 0x7fab181fe7f0 2024-09-19T06:43:47.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.455+0000 7fab14ff9640 1 -- 172.21.15.86:0/3481117055 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab08041070 con 0x7fab181fe7f0 2024-09-19T06:43:47.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.455+0000 7fab14ff9640 1 -- 172.21.15.86:0/3481117055 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab08030900 con 0x7fab181fe7f0 2024-09-19T06:43:47.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.458+0000 7fab14ff9640 1 -- 172.21.15.86:0/3481117055 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fab08030aa0 con 0x7fab181fe7f0 2024-09-19T06:43:47.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.458+0000 7fab1e35f640 1 -- 172.21.15.86:0/3481117055 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaf8005290 con 0x7fab181fe7f0 2024-09-19T06:43:47.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.458+0000 7fab14ff9640 1 --2- 172.21.15.86:0/3481117055 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fab0406c3b0 0x7fab0406e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:47.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.459+0000 7fab17fff640 1 --2- 172.21.15.86:0/3481117055 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fab0406c3b0 0x7fab0406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:47.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.460+0000 7fab14ff9640 1 -- 172.21.15.86:0/3481117055 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6993+0+0 (secure 0 0 0) 0x7fab080ab630 con 0x7fab181fe7f0 2024-09-19T06:43:47.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.460+0000 7fab17fff640 1 --2- 172.21.15.86:0/3481117055 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fab0406c3b0 0x7fab0406e870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fab0c001050 tx=0x7fab0c007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:47.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.468+0000 7fab14ff9640 1 -- 172.21.15.86:0/3481117055 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fab080792e0 con 0x7fab181fe7f0 2024-09-19T06:43:47.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.894+0000 7fab1e35f640 1 -- 172.21.15.86:0/3481117055 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faaf8005580 con 0x7fab181fe7f0 2024-09-19T06:43:47.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.899+0000 7fab14ff9640 1 -- 172.21.15.86:0/3481117055 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6880 (secure 0 0 0) 0x7fab0807d5e0 con 0x7fab181fe7f0 2024-09-19T06:43:47.901 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:43:47.901 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":24,"btime":"2024-09-19T06:42:28:634666+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/3116130916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":3116130916},{"type":"v1","addr":"172.21.15.169:6837","nonce":3116130916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:42:24.620680+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"e","rank":0,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.86:6839/1006149510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1006149510},{"type":"v1","addr":"172.21.15.86:6839","nonce":1006149510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4998,"qdb_cluster":[4998]},"id":1}]} 2024-09-19T06:43:47.901 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 24 2024-09-19T06:43:47.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.903+0000 7fab1e35f640 1 -- 172.21.15.86:0/3481117055 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fab0406c3b0 msgr2=0x7fab0406e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:47.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.903+0000 7fab1e35f640 1 --2- 172.21.15.86:0/3481117055 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fab0406c3b0 0x7fab0406e870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fab0c001050 tx=0x7fab0c007040 comp rx=0 tx=0).stop 2024-09-19T06:43:47.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.903+0000 7fab1e35f640 1 -- 172.21.15.86:0/3481117055 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab181fe7f0 msgr2=0x7fab18152960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:47.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.903+0000 7fab1e35f640 1 --2- 172.21.15.86:0/3481117055 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab181fe7f0 0x7fab18152960 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fab08006fd0 tx=0x7fab08004700 comp rx=0 tx=0).stop 2024-09-19T06:43:47.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.903+0000 7fab1e35f640 1 -- 172.21.15.86:0/3481117055 shutdown_connections 2024-09-19T06:43:47.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.903+0000 7fab1e35f640 1 --2- 172.21.15.86:0/3481117055 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fab0406c3b0 0x7fab0406e870 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:47.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.903+0000 7fab1e35f640 1 --2- 172.21.15.86:0/3481117055 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab181fec30 0x7fab18152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:47.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.903+0000 7fab1e35f640 1 --2- 172.21.15.86:0/3481117055 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab181fe7f0 0x7fab18152960 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:47.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.903+0000 7fab1e35f640 1 --2- 172.21.15.86:0/3481117055 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab181fd640 0x7fab181fda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:47.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.903+0000 7fab1e35f640 1 -- 172.21.15.86:0/3481117055 >> 172.21.15.86:0/3481117055 conn(0x7fab180c9280 msgr2=0x7fab18156cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:47.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.905+0000 7fab1e35f640 1 -- 172.21.15.86:0/3481117055 shutdown_connections 2024-09-19T06:43:47.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:47.905+0000 7fab1e35f640 1 -- 172.21.15.86:0/3481117055 wait complete. 2024-09-19T06:43:47.925 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-09-19T06:43:49.925 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:43:50.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.123+0000 7f3ab0ad9640 1 Processor -- start 2024-09-19T06:43:50.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.123+0000 7f3ab0ad9640 1 -- start start 2024-09-19T06:43:50.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.124+0000 7f3ab0ad9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3aac0c9b30 0x7f3aac151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:50.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.124+0000 7f3ab0ad9640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3aac0722d0 0x7f3aac15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:50.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.124+0000 7f3ab0ad9640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3aac157c60 con 0x7f3aac071eb0 2024-09-19T06:43:50.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.124+0000 7f3ab0ad9640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f3aac157f00 con 0x7f3aac0722d0 2024-09-19T06:43:50.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.124+0000 7f3ab0ad9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3aac1581e0 con 0x7f3aac0c9b30 2024-09-19T06:43:50.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.125+0000 7f3aaaffd640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f3aac071eb0 0x7f3aac0ca040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:43312/0 (socket says 172.21.15.86:43312) 2024-09-19T06:43:50.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.125+0000 7f3aaaffd640 1 -- 172.21.15.86:0/380230359 learned_addr learned my addr 172.21.15.86:0/380230359 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:43:50.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.125+0000 7f3aabfff640 1 --2- 172.21.15.86:0/380230359 >> v2:172.21.15.86:3300/0 conn(0x7f3aac0722d0 0x7f3aac15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:50.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.125+0000 7f3aab7fe640 1 --2- 172.21.15.86:0/380230359 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3aac0c9b30 0x7f3aac151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:50.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.126+0000 7f3aabfff640 1 -- 172.21.15.86:0/380230359 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3aac0c9b30 msgr2=0x7f3aac151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:50.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.126+0000 7f3aabfff640 1 --2- 172.21.15.86:0/380230359 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3aac0c9b30 0x7f3aac151cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:50.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.126+0000 7f3aabfff640 1 -- 172.21.15.86:0/380230359 >> v1:172.21.15.169:6789/0 conn(0x7f3aac071eb0 legacy=0x7f3aac0ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:50.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.126+0000 7f3aabfff640 1 -- 172.21.15.86:0/380230359 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aac1584c0 con 0x7f3aac0722d0 2024-09-19T06:43:50.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.127+0000 7f3aabfff640 1 --2- 172.21.15.86:0/380230359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aac0722d0 0x7f3aac15b0e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c009a00 tx=0x7f3a9c02a390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=642363870e2a88fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:50.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.128+0000 7f3aaa7fc640 1 -- 172.21.15.86:0/380230359 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c037070 con 0x7f3aac0722d0 2024-09-19T06:43:50.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.128+0000 7f3aaa7fc640 1 -- 172.21.15.86:0/380230359 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a9c02ae10 con 0x7f3aac0722d0 2024-09-19T06:43:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.129+0000 7f3ab0ad9640 1 -- 172.21.15.86:0/380230359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aac0722d0 msgr2=0x7f3aac15b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.129+0000 7f3ab0ad9640 1 --2- 172.21.15.86:0/380230359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aac0722d0 0x7f3aac15b0e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c009a00 tx=0x7f3a9c02a390 comp rx=0 tx=0).stop 2024-09-19T06:43:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.130+0000 7f3ab0ad9640 1 -- 172.21.15.86:0/380230359 shutdown_connections 2024-09-19T06:43:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.130+0000 7f3ab0ad9640 1 --2- 172.21.15.86:0/380230359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aac0722d0 0x7f3aac15b0e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.130+0000 7f3ab0ad9640 1 --2- 172.21.15.86:0/380230359 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3aac0c9b30 0x7f3aac151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.130+0000 7f3ab0ad9640 1 -- 172.21.15.86:0/380230359 >> 172.21.15.86:0/380230359 conn(0x7f3aac06ccd0 msgr2=0x7f3aac06d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:50.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.130+0000 7f3ab0ad9640 1 -- 172.21.15.86:0/380230359 shutdown_connections 2024-09-19T06:43:50.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.130+0000 7f3ab0ad9640 1 -- 172.21.15.86:0/380230359 wait complete. 2024-09-19T06:43:50.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.132+0000 7f3ab0ad9640 1 Processor -- start 2024-09-19T06:43:50.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.132+0000 7f3ab0ad9640 1 -- start start 2024-09-19T06:43:50.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.133+0000 7f3ab0ad9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aac071eb0 0x7f3aac0cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:50.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.133+0000 7f3ab0ad9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3aac0722d0 0x7f3aac15ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:50.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.133+0000 7f3ab0ad9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3aac0c9b30 0x7f3aac15b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:50.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.133+0000 7f3ab0ad9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3aac0ca750 con 0x7f3aac071eb0 2024-09-19T06:43:50.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.133+0000 7f3ab0ad9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3aac152210 con 0x7f3aac0722d0 2024-09-19T06:43:50.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.133+0000 7f3ab0ad9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3aac0ca8d0 con 0x7f3aac0c9b30 2024-09-19T06:43:50.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.134+0000 7f3aaaffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3aac0722d0 0x7f3aac15ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:50.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.134+0000 7f3aaaffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3aac0722d0 0x7f3aac15ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:38880/0 (socket says 172.21.15.86:38880) 2024-09-19T06:43:50.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.134+0000 7f3aaaffd640 1 -- 172.21.15.86:0/2357204689 learned_addr learned my addr 172.21.15.86:0/2357204689 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:43:50.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.134+0000 7f3aaaffd640 1 -- 172.21.15.86:0/2357204689 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3aac0c9b30 msgr2=0x7f3aac15b0c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:43:50.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.134+0000 7f3aaaffd640 1 --2- 172.21.15.86:0/2357204689 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3aac0c9b30 0x7f3aac15b0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:50.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.134+0000 7f3aaaffd640 1 -- 172.21.15.86:0/2357204689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aac071eb0 msgr2=0x7f3aac0cc390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:43:50.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.135+0000 7f3aab7fe640 1 --2- 172.21.15.86:0/2357204689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aac071eb0 0x7f3aac0cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:50.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.135+0000 7f3aaaffd640 1 --2- 172.21.15.86:0/2357204689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aac071eb0 0x7f3aac0cc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:50.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.135+0000 7f3aaaffd640 1 -- 172.21.15.86:0/2357204689 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aac1454f0 con 0x7f3aac0722d0 2024-09-19T06:43:50.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.135+0000 7f3aab7fe640 1 --2- 172.21.15.86:0/2357204689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aac071eb0 0x7f3aac0cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:43:50.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.135+0000 7f3aaaffd640 1 --2- 172.21.15.86:0/2357204689 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3aac0722d0 0x7f3aac15ab80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400caa0 tx=0x7f3aa400cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:50.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.135+0000 7f3a93fff640 1 -- 172.21.15.86:0/2357204689 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4018070 con 0x7f3aac0722d0 2024-09-19T06:43:50.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.136+0000 7f3ab0ad9640 1 -- 172.21.15.86:0/2357204689 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aac15bdd0 con 0x7f3aac0722d0 2024-09-19T06:43:50.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.136+0000 7f3ab0ad9640 1 -- 172.21.15.86:0/2357204689 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aac15a380 con 0x7f3aac0722d0 2024-09-19T06:43:50.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.136+0000 7f3a93fff640 1 -- 172.21.15.86:0/2357204689 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa400a6d0 con 0x7f3aac0722d0 2024-09-19T06:43:50.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.137+0000 7f3a93fff640 1 -- 172.21.15.86:0/2357204689 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa400aaa0 con 0x7f3aac0722d0 2024-09-19T06:43:50.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.138+0000 7f3a93fff640 1 -- 172.21.15.86:0/2357204689 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3aa401b070 con 0x7f3aac0722d0 2024-09-19T06:43:50.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.139+0000 7f3a93fff640 1 --2- 172.21.15.86:0/2357204689 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f3a9806c2b0 0x7f3a9806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:50.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.139+0000 7f3a93fff640 1 -- 172.21.15.86:0/2357204689 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6993+0+0 (secure 0 0 0) 0x7f3aa408b060 con 0x7f3aac0722d0 2024-09-19T06:43:50.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.140+0000 7f3ab0ad9640 1 -- 172.21.15.86:0/2357204689 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a8c005290 con 0x7f3aac0722d0 2024-09-19T06:43:50.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.140+0000 7f3aab7fe640 1 --2- 172.21.15.86:0/2357204689 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f3a9806c2b0 0x7f3a9806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:50.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.141+0000 7f3aab7fe640 1 --2- 172.21.15.86:0/2357204689 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f3a9806c2b0 0x7f3a9806e770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0006fd0 tx=0x7f3aa0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:50.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.152+0000 7f3a93fff640 1 -- 172.21.15.86:0/2357204689 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3aa4058c60 con 0x7f3aac0722d0 2024-09-19T06:43:50.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.609+0000 7f3ab0ad9640 1 -- 172.21.15.86:0/2357204689 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a8c005580 con 0x7f3aac0722d0 2024-09-19T06:43:50.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.611+0000 7f3a93fff640 1 -- 172.21.15.86:0/2357204689 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6880 (secure 0 0 0) 0x7f3aa405cf60 con 0x7f3aac0722d0 2024-09-19T06:43:50.615 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:43:50.615 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":24,"btime":"2024-09-19T06:42:28:634666+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/3116130916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":3116130916},{"type":"v1","addr":"172.21.15.169:6837","nonce":3116130916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:42:24.620680+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"e","rank":0,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.86:6839/1006149510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1006149510},{"type":"v1","addr":"172.21.15.86:6839","nonce":1006149510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4998,"qdb_cluster":[4998]},"id":1}]} 2024-09-19T06:43:50.616 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 24 2024-09-19T06:43:50.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.615+0000 7f3ab0ad9640 1 -- 172.21.15.86:0/2357204689 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f3a9806c2b0 msgr2=0x7f3a9806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:50.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.615+0000 7f3ab0ad9640 1 --2- 172.21.15.86:0/2357204689 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f3a9806c2b0 0x7f3a9806e770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0006fd0 tx=0x7f3aa0008040 comp rx=0 tx=0).stop 2024-09-19T06:43:50.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.615+0000 7f3ab0ad9640 1 -- 172.21.15.86:0/2357204689 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3aac0722d0 msgr2=0x7f3aac15ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:50.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.615+0000 7f3ab0ad9640 1 --2- 172.21.15.86:0/2357204689 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3aac0722d0 0x7f3aac15ab80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400caa0 tx=0x7f3aa400cf60 comp rx=0 tx=0).stop 2024-09-19T06:43:50.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.618+0000 7f3ab0ad9640 1 -- 172.21.15.86:0/2357204689 shutdown_connections 2024-09-19T06:43:50.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.618+0000 7f3ab0ad9640 1 --2- 172.21.15.86:0/2357204689 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f3a9806c2b0 0x7f3a9806e770 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:50.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.618+0000 7f3ab0ad9640 1 --2- 172.21.15.86:0/2357204689 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3aac0c9b30 0x7f3aac15b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:50.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.618+0000 7f3ab0ad9640 1 --2- 172.21.15.86:0/2357204689 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3aac0722d0 0x7f3aac15ab80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:50.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.618+0000 7f3ab0ad9640 1 --2- 172.21.15.86:0/2357204689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aac071eb0 0x7f3aac0cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:50.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.618+0000 7f3ab0ad9640 1 -- 172.21.15.86:0/2357204689 >> 172.21.15.86:0/2357204689 conn(0x7f3aac06ccd0 msgr2=0x7f3aac150f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:50.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.622+0000 7f3ab0ad9640 1 -- 172.21.15.86:0/2357204689 shutdown_connections 2024-09-19T06:43:50.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:50.622+0000 7f3ab0ad9640 1 -- 172.21.15.86:0/2357204689 wait complete. 2024-09-19T06:43:50.643 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-09-19T06:43:52.644 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:43:52.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.827+0000 7f1c51aac640 1 Processor -- start 2024-09-19T06:43:52.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.828+0000 7f1c51aac640 1 -- start start 2024-09-19T06:43:52.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.829+0000 7f1c51aac640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1c4c0b2060 0x7f1c4c06d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:52.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.829+0000 7f1c51aac640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c4c0c7a30 0x7f1c4c165a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:52.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.829+0000 7f1c51aac640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c4c0ca9f0 con 0x7f1c4c0c4040 2024-09-19T06:43:52.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.829+0000 7f1c51aac640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f1c4c06d280 con 0x7f1c4c0b2060 2024-09-19T06:43:52.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.829+0000 7f1c51aac640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1c4c067a30 con 0x7f1c4c0c7a30 2024-09-19T06:43:52.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.829+0000 7f1c4b7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1c4c0b2060 0x7f1c4c06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:52.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.829+0000 7f1c4b7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1c4c0b2060 0x7f1c4c06d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54046/0 (socket says 172.21.15.86:54046) 2024-09-19T06:43:52.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.829+0000 7f1c4b7fe640 1 -- 172.21.15.86:0/2297742034 learned_addr learned my addr 172.21.15.86:0/2297742034 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:43:52.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.829+0000 7f1c4bfff640 1 --2- 172.21.15.86:0/2297742034 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c4c0c7a30 0x7f1c4c165a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:52.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.830+0000 7f1c4bfff640 1 -- 172.21.15.86:0/2297742034 >> v2:172.21.15.86:3300/0 conn(0x7f1c4c0b2060 msgr2=0x7f1c4c06d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:52.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.830+0000 7f1c4bfff640 1 --2- 172.21.15.86:0/2297742034 >> v2:172.21.15.86:3300/0 conn(0x7f1c4c0b2060 0x7f1c4c06d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:52.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.830+0000 7f1c4bfff640 1 -- 172.21.15.86:0/2297742034 >> v1:172.21.15.86:6789/0 conn(0x7f1c4c0c4040 legacy=0x7f1c4c0c2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:52.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.830+0000 7f1c4bfff640 1 -- 172.21.15.86:0/2297742034 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c4c067d10 con 0x7f1c4c0c7a30 2024-09-19T06:43:52.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.831+0000 7f1c4bfff640 1 --2- 172.21.15.86:0/2297742034 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c4c0c7a30 0x7f1c4c165a40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c06d400 tx=0x7f1c4002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=749ae6dff8ed1c9a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:52.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.835+0000 7f1c4a7fc640 1 -- 172.21.15.86:0/2297742034 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c40037070 con 0x7f1c4c0c7a30 2024-09-19T06:43:52.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.835+0000 7f1c4a7fc640 1 -- 172.21.15.86:0/2297742034 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c40032440 con 0x7f1c4c0c7a30 2024-09-19T06:43:52.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.835+0000 7f1c4a7fc640 1 -- 172.21.15.86:0/2297742034 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c40032810 con 0x7f1c4c0c7a30 2024-09-19T06:43:52.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.836+0000 7f1c51aac640 1 -- 172.21.15.86:0/2297742034 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c4c0c7a30 msgr2=0x7f1c4c165a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:52.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.836+0000 7f1c51aac640 1 --2- 172.21.15.86:0/2297742034 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c4c0c7a30 0x7f1c4c165a40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c06d400 tx=0x7f1c4002a1c0 comp rx=0 tx=0).stop 2024-09-19T06:43:52.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.836+0000 7f1c51aac640 1 -- 172.21.15.86:0/2297742034 shutdown_connections 2024-09-19T06:43:52.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.836+0000 7f1c51aac640 1 --2- 172.21.15.86:0/2297742034 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c4c0c7a30 0x7f1c4c165a40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:52.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.836+0000 7f1c51aac640 1 --2- 172.21.15.86:0/2297742034 >> v2:172.21.15.86:3300/0 conn(0x7f1c4c0b2060 0x7f1c4c06d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:52.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.836+0000 7f1c51aac640 1 -- 172.21.15.86:0/2297742034 >> 172.21.15.86:0/2297742034 conn(0x7f1c4c0cd030 msgr2=0x7f1c4c0cd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:52.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.836+0000 7f1c51aac640 1 -- 172.21.15.86:0/2297742034 shutdown_connections 2024-09-19T06:43:52.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.836+0000 7f1c51aac640 1 -- 172.21.15.86:0/2297742034 wait complete. 2024-09-19T06:43:52.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.838+0000 7f1c51aac640 1 Processor -- start 2024-09-19T06:43:52.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.838+0000 7f1c51aac640 1 -- start start 2024-09-19T06:43:52.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.839+0000 7f1c51aac640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c4c0b2060 0x7f1c4c159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:52.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.839+0000 7f1c51aac640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c4c0c7a30 0x7f1c4c153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:52.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.839+0000 7f1c51aac640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c4c158990 0x7f1c4c157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:52.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.839+0000 7f1c51aac640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4c0b2440 con 0x7f1c4c158990 2024-09-19T06:43:52.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.839+0000 7f1c51aac640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4c06dc50 con 0x7f1c4c0c7a30 2024-09-19T06:43:52.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.839+0000 7f1c51aac640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1c4c0c2760 con 0x7f1c4c0b2060 2024-09-19T06:43:52.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.839+0000 7f1c4b7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c4c0b2060 0x7f1c4c159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:52.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.840+0000 7f1c4b7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c4c0b2060 0x7f1c4c159b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:42598/0 (socket says 172.21.15.86:42598) 2024-09-19T06:43:52.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.840+0000 7f1c4b7fe640 1 -- 172.21.15.86:0/833243111 learned_addr learned my addr 172.21.15.86:0/833243111 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:43:52.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.840+0000 7f1c4affd640 1 --2- 172.21.15.86:0/833243111 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c4c0c7a30 0x7f1c4c153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:52.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.840+0000 7f1c4bfff640 1 --2- 172.21.15.86:0/833243111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c4c158990 0x7f1c4c157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:52.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.840+0000 7f1c4b7fe640 1 -- 172.21.15.86:0/833243111 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c4c0c7a30 msgr2=0x7f1c4c153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:52.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.840+0000 7f1c4b7fe640 1 --2- 172.21.15.86:0/833243111 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c4c0c7a30 0x7f1c4c153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:52.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.840+0000 7f1c4b7fe640 1 -- 172.21.15.86:0/833243111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c4c158990 msgr2=0x7f1c4c157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:52.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.841+0000 7f1c4b7fe640 1 --2- 172.21.15.86:0/833243111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c4c158990 0x7f1c4c157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:52.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.841+0000 7f1c4b7fe640 1 -- 172.21.15.86:0/833243111 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c4c1544a0 con 0x7f1c4c0b2060 2024-09-19T06:43:52.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.841+0000 7f1c4bfff640 1 --2- 172.21.15.86:0/833243111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c4c158990 0x7f1c4c157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:43:52.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.842+0000 7f1c4b7fe640 1 --2- 172.21.15.86:0/833243111 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c4c0b2060 0x7f1c4c159b20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1c44009fd0 tx=0x7f1c4400d4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:52.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.842+0000 7f1c33fff640 1 -- 172.21.15.86:0/833243111 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4401a070 con 0x7f1c4c0b2060 2024-09-19T06:43:52.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.843+0000 7f1c33fff640 1 -- 172.21.15.86:0/833243111 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c4400ddb0 con 0x7f1c4c0b2060 2024-09-19T06:43:52.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.843+0000 7f1c33fff640 1 -- 172.21.15.86:0/833243111 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c44015600 con 0x7f1c4c0b2060 2024-09-19T06:43:52.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.843+0000 7f1c51aac640 1 -- 172.21.15.86:0/833243111 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c4c0c4640 con 0x7f1c4c0b2060 2024-09-19T06:43:52.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.843+0000 7f1c51aac640 1 -- 172.21.15.86:0/833243111 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c4c071f20 con 0x7f1c4c0b2060 2024-09-19T06:43:52.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.845+0000 7f1c51aac640 1 -- 172.21.15.86:0/833243111 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c2c005290 con 0x7f1c4c0b2060 2024-09-19T06:43:52.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.846+0000 7f1c33fff640 1 -- 172.21.15.86:0/833243111 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1c4401d070 con 0x7f1c4c0b2060 2024-09-19T06:43:52.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.848+0000 7f1c33fff640 1 --2- 172.21.15.86:0/833243111 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1c3806c380 0x7f1c3806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:52.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.848+0000 7f1c4affd640 1 --2- 172.21.15.86:0/833243111 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1c3806c380 0x7f1c3806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:52.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.849+0000 7f1c33fff640 1 -- 172.21.15.86:0/833243111 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) ==== 6993+0+0 (secure 0 0 0) 0x7f1c4408b750 con 0x7f1c4c0b2060 2024-09-19T06:43:52.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.851+0000 7f1c4affd640 1 --2- 172.21.15.86:0/833243111 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1c3806c380 0x7f1c3806e840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c0c23a0 tx=0x7f1c3c007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:52.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:52.857+0000 7f1c33fff640 1 -- 172.21.15.86:0/833243111 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1c44010070 con 0x7f1c4c0b2060 2024-09-19T06:43:53.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:53.238+0000 7f1c51aac640 1 -- 172.21.15.86:0/833243111 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c2c005580 con 0x7f1c4c0b2060 2024-09-19T06:43:53.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:53.242+0000 7f1c33fff640 1 -- 172.21.15.86:0/833243111 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6880 (secure 0 0 0) 0x7f1c440593d0 con 0x7f1c4c0b2060 2024-09-19T06:43:53.244 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:43:53.244 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":24,"btime":"2024-09-19T06:42:28:634666+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/3116130916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":3116130916},{"type":"v1","addr":"172.21.15.169:6837","nonce":3116130916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:42:24.620680+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"e","rank":0,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.86:6839/1006149510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1006149510},{"type":"v1","addr":"172.21.15.86:6839","nonce":1006149510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4998,"qdb_cluster":[4998]},"id":1}]} 2024-09-19T06:43:53.245 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 24 2024-09-19T06:43:53.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:53.246+0000 7f1c51aac640 1 -- 172.21.15.86:0/833243111 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1c3806c380 msgr2=0x7f1c3806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:53.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:53.246+0000 7f1c51aac640 1 --2- 172.21.15.86:0/833243111 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1c3806c380 0x7f1c3806e840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c0c23a0 tx=0x7f1c3c007e30 comp rx=0 tx=0).stop 2024-09-19T06:43:53.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:53.246+0000 7f1c51aac640 1 -- 172.21.15.86:0/833243111 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c4c0b2060 msgr2=0x7f1c4c159b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:53.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:53.246+0000 7f1c51aac640 1 --2- 172.21.15.86:0/833243111 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c4c0b2060 0x7f1c4c159b20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1c44009fd0 tx=0x7f1c4400d4a0 comp rx=0 tx=0).stop 2024-09-19T06:43:53.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:53.246+0000 7f1c51aac640 1 -- 172.21.15.86:0/833243111 shutdown_connections 2024-09-19T06:43:53.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:53.246+0000 7f1c51aac640 1 --2- 172.21.15.86:0/833243111 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f1c3806c380 0x7f1c3806e840 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:53.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:53.246+0000 7f1c51aac640 1 --2- 172.21.15.86:0/833243111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c4c158990 0x7f1c4c157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:53.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:53.246+0000 7f1c51aac640 1 --2- 172.21.15.86:0/833243111 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c4c0c7a30 0x7f1c4c153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:53.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:53.246+0000 7f1c51aac640 1 --2- 172.21.15.86:0/833243111 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c4c0b2060 0x7f1c4c159b20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:53.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:53.246+0000 7f1c51aac640 1 -- 172.21.15.86:0/833243111 >> 172.21.15.86:0/833243111 conn(0x7f1c4c0cd030 msgr2=0x7f1c4c0cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:53.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:53.246+0000 7f1c51aac640 1 -- 172.21.15.86:0/833243111 shutdown_connections 2024-09-19T06:43:53.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:53.246+0000 7f1c51aac640 1 -- 172.21.15.86:0/833243111 wait complete. 2024-09-19T06:43:53.268 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-09-19T06:43:55.269 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:43:55.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.445+0000 7f2933b52640 1 Processor -- start 2024-09-19T06:43:55.447 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.445+0000 7f2933b52640 1 -- start start 2024-09-19T06:43:55.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.447+0000 7f2933b52640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f292c159480 0x7f292c06bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:55.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.447+0000 7f2933b52640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f292c0c7d30 0x7f292c15fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:55.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.447+0000 7f2933b52640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f292c0c7700 con 0x7f292c159860 2024-09-19T06:43:55.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.447+0000 7f2933b52640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f292c073d20 con 0x7f292c0c7d30 2024-09-19T06:43:55.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.447+0000 7f2933b52640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f292c071990 con 0x7f292c159480 2024-09-19T06:43:55.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.447+0000 7f29310ed640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f292c159860 0x7f292c0c84d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:33756/0 (socket says 172.21.15.86:33756) 2024-09-19T06:43:55.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.447+0000 7f29310ed640 1 -- 172.21.15.86:0/2699902063 learned_addr learned my addr 172.21.15.86:0/2699902063 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:43:55.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.447+0000 7f29320ef640 1 --2- 172.21.15.86:0/2699902063 >> v2:172.21.15.86:3300/0 conn(0x7f292c0c7d30 0x7f292c15fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:55.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.447+0000 7f29318ee640 1 --2- 172.21.15.86:0/2699902063 >> v2:172.21.15.169:3300/0 conn(0x7f292c159480 0x7f292c06bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:55.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.448+0000 7f29320ef640 1 -- 172.21.15.86:0/2699902063 >> v2:172.21.15.169:3300/0 conn(0x7f292c159480 msgr2=0x7f292c06bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:55.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.448+0000 7f29320ef640 1 --2- 172.21.15.86:0/2699902063 >> v2:172.21.15.169:3300/0 conn(0x7f292c159480 0x7f292c06bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:55.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.448+0000 7f29320ef640 1 -- 172.21.15.86:0/2699902063 >> v1:172.21.15.169:6789/0 conn(0x7f292c159860 legacy=0x7f292c0c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:55.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.448+0000 7f29320ef640 1 -- 172.21.15.86:0/2699902063 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292c0c79c0 con 0x7f292c0c7d30 2024-09-19T06:43:55.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.448+0000 7f29318ee640 1 --2- 172.21.15.86:0/2699902063 >> v2:172.21.15.169:3300/0 conn(0x7f292c159480 0x7f292c06bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:43:55.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.449+0000 7f29320ef640 1 --2- 172.21.15.86:0/2699902063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f292c0c7d30 0x7f292c15fd70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f292c0708c0 tx=0x7f292402a810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e605866351613fb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:55.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.450+0000 7f29308ec640 1 -- 172.21.15.86:0/2699902063 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2924038070 con 0x7f292c0c7d30 2024-09-19T06:43:55.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.450+0000 7f29308ec640 1 -- 172.21.15.86:0/2699902063 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f292402f070 con 0x7f292c0c7d30 2024-09-19T06:43:55.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.451+0000 7f29308ec640 1 -- 172.21.15.86:0/2699902063 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2924033880 con 0x7f292c0c7d30 2024-09-19T06:43:55.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.451+0000 7f2933b52640 1 -- 172.21.15.86:0/2699902063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f292c0c7d30 msgr2=0x7f292c15fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:55.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.451+0000 7f2933b52640 1 --2- 172.21.15.86:0/2699902063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f292c0c7d30 0x7f292c15fd70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f292c0708c0 tx=0x7f292402a810 comp rx=0 tx=0).stop 2024-09-19T06:43:55.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.451+0000 7f2933b52640 1 -- 172.21.15.86:0/2699902063 shutdown_connections 2024-09-19T06:43:55.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.451+0000 7f2933b52640 1 --2- 172.21.15.86:0/2699902063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f292c0c7d30 0x7f292c15fd70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:55.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.451+0000 7f2933b52640 1 --2- 172.21.15.86:0/2699902063 >> v2:172.21.15.169:3300/0 conn(0x7f292c159480 0x7f292c06bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:55.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.451+0000 7f2933b52640 1 -- 172.21.15.86:0/2699902063 >> 172.21.15.86:0/2699902063 conn(0x7f292c0c9280 msgr2=0x7f292c0c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:55.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.452+0000 7f2933b52640 1 -- 172.21.15.86:0/2699902063 shutdown_connections 2024-09-19T06:43:55.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.452+0000 7f2933b52640 1 -- 172.21.15.86:0/2699902063 wait complete. 2024-09-19T06:43:55.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.454+0000 7f2933b52640 1 Processor -- start 2024-09-19T06:43:55.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.454+0000 7f2933b52640 1 -- start start 2024-09-19T06:43:55.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.455+0000 7f2933b52640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f292c0c7d30 0x7f292c1f86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:55.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.455+0000 7f2933b52640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f292c159480 0x7f292c15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:55.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.455+0000 7f2933b52640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f292c159860 0x7f292c15c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:55.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.455+0000 7f2933b52640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f292c0721a0 con 0x7f292c159480 2024-09-19T06:43:55.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.455+0000 7f2933b52640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f292c071ec0 con 0x7f292c0c7d30 2024-09-19T06:43:55.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.455+0000 7f2933b52640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f292c070ed0 con 0x7f292c159860 2024-09-19T06:43:55.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.456+0000 7f29318ee640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f292c0c7d30 0x7f292c1f86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:55.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.456+0000 7f29318ee640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f292c0c7d30 0x7f292c1f86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:54852/0 (socket says 172.21.15.86:54852) 2024-09-19T06:43:55.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.456+0000 7f29318ee640 1 -- 172.21.15.86:0/1448516303 learned_addr learned my addr 172.21.15.86:0/1448516303 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:43:55.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.456+0000 7f29320ef640 1 --2- 172.21.15.86:0/1448516303 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f292c159860 0x7f292c15c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:55.459 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.458+0000 7f29318ee640 1 -- 172.21.15.86:0/1448516303 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f292c159860 msgr2=0x7f292c15c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:55.459 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.458+0000 7f29318ee640 1 --2- 172.21.15.86:0/1448516303 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f292c159860 0x7f292c15c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:55.459 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.458+0000 7f29318ee640 1 -- 172.21.15.86:0/1448516303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f292c159480 msgr2=0x7f292c15bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:55.459 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.458+0000 7f29318ee640 1 --2- 172.21.15.86:0/1448516303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f292c159480 0x7f292c15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:55.459 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.458+0000 7f29318ee640 1 -- 172.21.15.86:0/1448516303 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292c1eaa40 con 0x7f292c0c7d30 2024-09-19T06:43:55.460 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.458+0000 7f29318ee640 1 --2- 172.21.15.86:0/1448516303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f292c0c7d30 0x7f292c1f86b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f292800c820 tx=0x7f292800cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:55.460 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.459+0000 7f29227fc640 1 -- 172.21.15.86:0/1448516303 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2928015070 con 0x7f292c0c7d30 2024-09-19T06:43:55.460 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.459+0000 7f29227fc640 1 -- 172.21.15.86:0/1448516303 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2928007a30 con 0x7f292c0c7d30 2024-09-19T06:43:55.460 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.459+0000 7f29227fc640 1 -- 172.21.15.86:0/1448516303 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2928007de0 con 0x7f292c0c7d30 2024-09-19T06:43:55.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.464+0000 7f2933b52640 1 -- 172.21.15.86:0/1448516303 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f292c1f9170 con 0x7f292c0c7d30 2024-09-19T06:43:55.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.464+0000 7f2933b52640 1 -- 172.21.15.86:0/1448516303 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f292c1ea760 con 0x7f292c0c7d30 2024-09-19T06:43:55.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.466+0000 7f2933b52640 1 -- 172.21.15.86:0/1448516303 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f292c06bbc0 con 0x7f292c0c7d30 2024-09-19T06:43:55.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.469+0000 7f29227fc640 1 -- 172.21.15.86:0/1448516303 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2928018070 con 0x7f292c0c7d30 2024-09-19T06:43:55.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.470+0000 7f29227fc640 1 --2- 172.21.15.86:0/1448516303 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f291006c380 0x7f291006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:55.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.470+0000 7f29227fc640 1 -- 172.21.15.86:0/1448516303 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6993+0+0 (secure 0 0 0) 0x7f292808bd20 con 0x7f292c0c7d30 2024-09-19T06:43:55.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.470+0000 7f29310ed640 1 --2- 172.21.15.86:0/1448516303 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f291006c380 0x7f291006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:55.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.471+0000 7f29310ed640 1 --2- 172.21.15.86:0/1448516303 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f291006c380 0x7f291006e840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f292c1f2a40 tx=0x7f291c006bd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:55.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.476+0000 7f29227fc640 1 -- 172.21.15.86:0/1448516303 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2928059910 con 0x7f292c0c7d30 2024-09-19T06:43:55.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.914+0000 7f2933b52640 1 -- 172.21.15.86:0/1448516303 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f292c071750 con 0x7f292c0c7d30 2024-09-19T06:43:55.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.916+0000 7f29227fc640 1 -- 172.21.15.86:0/1448516303 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6047 (secure 0 0 0) 0x7f292805dc10 con 0x7f292c0c7d30 2024-09-19T06:43:55.918 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:43:55.918 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":25,"btime":"2024-09-19T06:43:55:529244+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:43:55.529240+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"d","rank":0,"incarnation":25,"state":"up:replay","state_seq":1,"addr":"172.21.15.169:6837/3116130916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":3116130916},{"type":"v1","addr":"172.21.15.169:6837","nonce":3116130916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:43:55.918 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 25 2024-09-19T06:43:55.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.920+0000 7f2933b52640 1 -- 172.21.15.86:0/1448516303 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f291006c380 msgr2=0x7f291006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:55.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.920+0000 7f2933b52640 1 --2- 172.21.15.86:0/1448516303 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f291006c380 0x7f291006e840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f292c1f2a40 tx=0x7f291c006bd0 comp rx=0 tx=0).stop 2024-09-19T06:43:55.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.920+0000 7f2933b52640 1 -- 172.21.15.86:0/1448516303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f292c0c7d30 msgr2=0x7f292c1f86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:55.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.920+0000 7f2933b52640 1 --2- 172.21.15.86:0/1448516303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f292c0c7d30 0x7f292c1f86b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f292800c820 tx=0x7f292800cc20 comp rx=0 tx=0).stop 2024-09-19T06:43:55.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.920+0000 7f2933b52640 1 -- 172.21.15.86:0/1448516303 shutdown_connections 2024-09-19T06:43:55.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.920+0000 7f2933b52640 1 --2- 172.21.15.86:0/1448516303 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f291006c380 0x7f291006e840 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:55.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.920+0000 7f2933b52640 1 --2- 172.21.15.86:0/1448516303 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f292c159860 0x7f292c15c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:55.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.920+0000 7f2933b52640 1 --2- 172.21.15.86:0/1448516303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f292c159480 0x7f292c15bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:55.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.920+0000 7f2933b52640 1 --2- 172.21.15.86:0/1448516303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f292c0c7d30 0x7f292c1f86b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:55.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.920+0000 7f2933b52640 1 -- 172.21.15.86:0/1448516303 >> 172.21.15.86:0/1448516303 conn(0x7f292c0c9280 msgr2=0x7f292c0c82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:55.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.922+0000 7f2933b52640 1 -- 172.21.15.86:0/1448516303 shutdown_connections 2024-09-19T06:43:55.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:55.922+0000 7f2933b52640 1 -- 172.21.15.86:0/1448516303 wait complete. 2024-09-19T06:43:55.943 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e down, removed from mdsmap 2024-09-19T06:43:55.943 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-09-19T06:43:55.943 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:43:56.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.117+0000 7ff7d000a640 1 Processor -- start 2024-09-19T06:43:56.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.119+0000 7ff7d000a640 1 -- start start 2024-09-19T06:43:56.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.120+0000 7ff7d000a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7c8159860 0x7ff7c806bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:56.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.120+0000 7ff7d000a640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7c80c7700 con 0x7ff7c8159480 2024-09-19T06:43:56.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.120+0000 7ff7d000a640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7c80c79c0 con 0x7ff7c80c7d30 2024-09-19T06:43:56.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.120+0000 7ff7d000a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff7c8073d20 con 0x7ff7c8159860 2024-09-19T06:43:56.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.121+0000 7ff7cd5a5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7c8159860 0x7ff7c806bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:56.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.121+0000 7ff7cd5a5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7c8159860 0x7ff7c806bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:42610/0 (socket says 172.21.15.86:42610) 2024-09-19T06:43:56.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.121+0000 7ff7ce5a7640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7ff7c80c7d30 0x7ff7c8169c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:33764/0 (socket says 172.21.15.86:33764) 2024-09-19T06:43:56.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.121+0000 7ff7cdda6640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ff7c8159480 0x7ff7c80c84d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49460/0 (socket says 172.21.15.86:49460) 2024-09-19T06:43:56.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.121+0000 7ff7cd5a5640 1 -- 172.21.15.86:0/3321849783 learned_addr learned my addr 172.21.15.86:0/3321849783 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:43:56.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.121+0000 7ff7ccda4640 1 -- 172.21.15.86:0/3321849783 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2453531983 0 0) 0x7ff7c80c7700 con 0x7ff7c8159480 2024-09-19T06:43:56.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.121+0000 7ff7ccda4640 1 -- 172.21.15.86:0/3321849783 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7b4003520 con 0x7ff7c8159480 2024-09-19T06:43:56.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.122+0000 7ff7cd5a5640 1 -- 172.21.15.86:0/3321849783 >> v1:172.21.15.169:6789/0 conn(0x7ff7c80c7d30 legacy=0x7ff7c8169c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:56.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.122+0000 7ff7cd5a5640 1 -- 172.21.15.86:0/3321849783 >> v1:172.21.15.86:6789/0 conn(0x7ff7c8159480 legacy=0x7ff7c80c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:56.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.122+0000 7ff7cd5a5640 1 -- 172.21.15.86:0/3321849783 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c8071be0 con 0x7ff7c8159860 2024-09-19T06:43:56.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.123+0000 7ff7cd5a5640 1 --2- 172.21.15.86:0/3321849783 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7c8159860 0x7ff7c806bbc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0009e80 tx=0x7ff7c002a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d6a812780e0ebbe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:56.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.123+0000 7ff7ccda4640 1 -- 172.21.15.86:0/3321849783 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c4001520 con 0x7ff7c8159860 2024-09-19T06:43:56.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.123+0000 7ff7ccda4640 1 -- 172.21.15.86:0/3321849783 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7c0031400 con 0x7ff7c8159860 2024-09-19T06:43:56.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.123+0000 7ff7ccda4640 1 -- 172.21.15.86:0/3321849783 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c00317d0 con 0x7ff7c8159860 2024-09-19T06:43:56.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.125+0000 7ff7d000a640 1 -- 172.21.15.86:0/3321849783 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7c8159860 msgr2=0x7ff7c806bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:56.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.125+0000 7ff7d000a640 1 --2- 172.21.15.86:0/3321849783 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7c8159860 0x7ff7c806bbc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0009e80 tx=0x7ff7c002a640 comp rx=0 tx=0).stop 2024-09-19T06:43:56.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.126+0000 7ff7d000a640 1 -- 172.21.15.86:0/3321849783 shutdown_connections 2024-09-19T06:43:56.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.126+0000 7ff7d000a640 1 --2- 172.21.15.86:0/3321849783 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7c8159860 0x7ff7c806bbc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:56.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.126+0000 7ff7d000a640 1 -- 172.21.15.86:0/3321849783 >> 172.21.15.86:0/3321849783 conn(0x7ff7c80c9280 msgr2=0x7ff7c80c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:56.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.126+0000 7ff7d000a640 1 -- 172.21.15.86:0/3321849783 shutdown_connections 2024-09-19T06:43:56.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.126+0000 7ff7d000a640 1 -- 172.21.15.86:0/3321849783 wait complete. 2024-09-19T06:43:56.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.128+0000 7ff7d000a640 1 Processor -- start 2024-09-19T06:43:56.132 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.131+0000 7ff7d000a640 1 -- start start 2024-09-19T06:43:56.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.132+0000 7ff7d000a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7c80c7d30 0x7ff7c80cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:56.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.132+0000 7ff7d000a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7c8159480 0x7ff7c81f93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:56.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.132+0000 7ff7d000a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7c8159860 0x7ff7c814f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:56.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.132+0000 7ff7d000a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c80721a0 con 0x7ff7c8159860 2024-09-19T06:43:56.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.132+0000 7ff7d000a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c8071990 con 0x7ff7c8159480 2024-09-19T06:43:56.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.132+0000 7ff7d000a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff7c8070ed0 con 0x7ff7c80c7d30 2024-09-19T06:43:56.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.133+0000 7ff7ce5a7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7c8159860 0x7ff7c814f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:56.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.133+0000 7ff7ce5a7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7c8159860 0x7ff7c814f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54088/0 (socket says 172.21.15.86:54088) 2024-09-19T06:43:56.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.133+0000 7ff7ce5a7640 1 -- 172.21.15.86:0/2696289560 learned_addr learned my addr 172.21.15.86:0/2696289560 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:43:56.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.133+0000 7ff7cdda6640 1 --2- 172.21.15.86:0/2696289560 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7c80c7d30 0x7ff7c80cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:56.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.133+0000 7ff7cd5a5640 1 --2- 172.21.15.86:0/2696289560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7c8159480 0x7ff7c81f93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:56.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.133+0000 7ff7ce5a7640 1 -- 172.21.15.86:0/2696289560 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7c80c7d30 msgr2=0x7ff7c80cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:56.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.133+0000 7ff7ce5a7640 1 --2- 172.21.15.86:0/2696289560 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7c80c7d30 0x7ff7c80cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:56.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.133+0000 7ff7ce5a7640 1 -- 172.21.15.86:0/2696289560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7c8159480 msgr2=0x7ff7c81f93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:56.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.133+0000 7ff7ce5a7640 1 --2- 172.21.15.86:0/2696289560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7c8159480 0x7ff7c81f93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:56.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.133+0000 7ff7ce5a7640 1 -- 172.21.15.86:0/2696289560 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c81f5640 con 0x7ff7c8159860 2024-09-19T06:43:56.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.134+0000 7ff7ce5a7640 1 --2- 172.21.15.86:0/2696289560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7c8159860 0x7ff7c814f2e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff7b800c550 tx=0x7ff7b800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:56.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.134+0000 7ff7be7fc640 1 -- 172.21.15.86:0/2696289560 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8018070 con 0x7ff7c8159860 2024-09-19T06:43:56.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.134+0000 7ff7be7fc640 1 -- 172.21.15.86:0/2696289560 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b8007500 con 0x7ff7c8159860 2024-09-19T06:43:56.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.134+0000 7ff7be7fc640 1 -- 172.21.15.86:0/2696289560 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8004a20 con 0x7ff7c8159860 2024-09-19T06:43:56.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.135+0000 7ff7d000a640 1 -- 172.21.15.86:0/2696289560 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c81f5920 con 0x7ff7c8159860 2024-09-19T06:43:56.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.135+0000 7ff7d000a640 1 -- 172.21.15.86:0/2696289560 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c81f5ee0 con 0x7ff7c8159860 2024-09-19T06:43:56.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.137+0000 7ff7d000a640 1 -- 172.21.15.86:0/2696289560 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7c806bbc0 con 0x7ff7c8159860 2024-09-19T06:43:56.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.147+0000 7ff7be7fc640 1 -- 172.21.15.86:0/2696289560 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff7b801b070 con 0x7ff7c8159860 2024-09-19T06:43:56.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.148+0000 7ff7be7fc640 1 --2- 172.21.15.86:0/2696289560 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff7ac06c380 0x7ff7ac06e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:56.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.149+0000 7ff7cdda6640 1 --2- 172.21.15.86:0/2696289560 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff7ac06c380 0x7ff7ac06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:56.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.149+0000 7ff7cdda6640 1 --2- 172.21.15.86:0/2696289560 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff7ac06c380 0x7ff7ac06e840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4005a50 tx=0x7ff7c40016b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:56.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.150+0000 7ff7be7fc640 1 -- 172.21.15.86:0/2696289560 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7079+0+0 (secure 0 0 0) 0x7ff7b808af40 con 0x7ff7c8159860 2024-09-19T06:43:56.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.150+0000 7ff7be7fc640 1 -- 172.21.15.86:0/2696289560 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff7b808f590 con 0x7ff7c8159860 2024-09-19T06:43:56.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.560+0000 7ff7d000a640 1 -- 172.21.15.86:0/2696289560 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7c8071750 con 0x7ff7c8159860 2024-09-19T06:43:56.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.561+0000 7ff7be7fc640 1 -- 172.21.15.86:0/2696289560 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6047 (secure 0 0 0) 0x7ff7b8059130 con 0x7ff7c8159860 2024-09-19T06:43:56.563 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:43:56.564 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":25,"btime":"2024-09-19T06:43:55:529244+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:43:55.529240+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"d","rank":0,"incarnation":25,"state":"up:replay","state_seq":1,"addr":"172.21.15.169:6837/3116130916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":3116130916},{"type":"v1","addr":"172.21.15.169:6837","nonce":3116130916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:43:56.564 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 25 2024-09-19T06:43:56.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.565+0000 7ff7d000a640 1 -- 172.21.15.86:0/2696289560 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff7ac06c380 msgr2=0x7ff7ac06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:56.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.565+0000 7ff7d000a640 1 --2- 172.21.15.86:0/2696289560 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff7ac06c380 0x7ff7ac06e840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4005a50 tx=0x7ff7c40016b0 comp rx=0 tx=0).stop 2024-09-19T06:43:56.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.565+0000 7ff7d000a640 1 -- 172.21.15.86:0/2696289560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7c8159860 msgr2=0x7ff7c814f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:56.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.566+0000 7ff7d000a640 1 --2- 172.21.15.86:0/2696289560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7c8159860 0x7ff7c814f2e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff7b800c550 tx=0x7ff7b800ca10 comp rx=0 tx=0).stop 2024-09-19T06:43:56.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.566+0000 7ff7d000a640 1 -- 172.21.15.86:0/2696289560 shutdown_connections 2024-09-19T06:43:56.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.566+0000 7ff7d000a640 1 --2- 172.21.15.86:0/2696289560 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff7ac06c380 0x7ff7ac06e840 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:56.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.566+0000 7ff7d000a640 1 --2- 172.21.15.86:0/2696289560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7c8159860 0x7ff7c814f2e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:56.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.566+0000 7ff7d000a640 1 --2- 172.21.15.86:0/2696289560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7c8159480 0x7ff7c81f93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:56.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.566+0000 7ff7d000a640 1 --2- 172.21.15.86:0/2696289560 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7c80c7d30 0x7ff7c80cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:56.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.566+0000 7ff7d000a640 1 -- 172.21.15.86:0/2696289560 >> 172.21.15.86:0/2696289560 conn(0x7ff7c80c9280 msgr2=0x7ff7c80c82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:56.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.567+0000 7ff7d000a640 1 -- 172.21.15.86:0/2696289560 shutdown_connections 2024-09-19T06:43:56.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:56.567+0000 7ff7d000a640 1 -- 172.21.15.86:0/2696289560 wait complete. 2024-09-19T06:43:56.589 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "btime": "2024-09-19T06:43:55:529244+0000", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 25, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-19T06:37:08.763572+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 25, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4718": { "addr": "172.21.15.169:6837/3116130916", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6836", "nonce": 3116130916, "type": "v2" }, { "addr": "172.21.15.169:6837", "nonce": 3116130916, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4718, "incarnation": 25, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 32, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-09-19T06:43:55.529240+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4718 } } } ], "standbys": [ { "addr": "172.21.15.86:6837/728803297", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6835", "nonce": 728803297, "type": "v2" }, { "addr": "172.21.15.86:6837", "nonce": 728803297, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4247, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.169:6835/2537509253", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6833", "nonce": 2537509253, "type": "v2" }, { "addr": "172.21.15.169:6835", "nonce": 2537509253, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4262, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.169:6834/1723647527", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6832", "nonce": 1723647527, "type": "v2" }, { "addr": "172.21.15.169:6834", "nonce": 1723647527, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4265, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.86:6836/4135959816", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6834", "nonce": 4135959816, "type": "v2" }, { "addr": "172.21.15.86:6836", "nonce": 4135959816, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4270, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-09-19T06:43:58.590 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:43:58.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.762+0000 7fa989675640 1 Processor -- start 2024-09-19T06:43:58.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.762+0000 7fa989675640 1 -- start start 2024-09-19T06:43:58.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.764+0000 7fa989675640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa97c050770 0x7fa97c0da540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:58.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.764+0000 7fa989675640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa97c005fd0 con 0x7fa97c005a00 2024-09-19T06:43:58.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.764+0000 7fa989675640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa97c0062b0 con 0x7fa97c034250 2024-09-19T06:43:58.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.764+0000 7fa989675640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa97c032c10 con 0x7fa97c050770 2024-09-19T06:43:58.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.764+0000 7fa9837fe640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa97c005a00 0x7fa97c0d4380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49464/0 (socket says 172.21.15.86:49464) 2024-09-19T06:43:58.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.764+0000 7fa9837fe640 1 -- 172.21.15.86:0/3812857520 learned_addr learned my addr 172.21.15.86:0/3812857520 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:43:58.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.765+0000 7fa983fff640 1 --2- 172.21.15.86:0/3812857520 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa97c050770 0x7fa97c0da540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:58.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.766+0000 7fa983fff640 1 -- 172.21.15.86:0/3812857520 >> v1:172.21.15.169:6789/0 conn(0x7fa97c034250 legacy=0x7fa97c04ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:58.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.766+0000 7fa983fff640 1 -- 172.21.15.86:0/3812857520 >> v1:172.21.15.86:6789/0 conn(0x7fa97c005a00 legacy=0x7fa97c0d4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:58.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.766+0000 7fa983fff640 1 -- 172.21.15.86:0/3812857520 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa97c006590 con 0x7fa97c050770 2024-09-19T06:43:58.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.770+0000 7fa983fff640 1 --2- 172.21.15.86:0/3812857520 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa97c050770 0x7fa97c0da540 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa9780097d0 tx=0x7fa97802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ceb0536b79ab8413 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:58.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.772+0000 7fa982ffd640 1 -- 172.21.15.86:0/3812857520 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa978037070 con 0x7fa97c050770 2024-09-19T06:43:58.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.772+0000 7fa982ffd640 1 -- 172.21.15.86:0/3812857520 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa978032440 con 0x7fa97c050770 2024-09-19T06:43:58.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.773+0000 7fa989675640 1 -- 172.21.15.86:0/3812857520 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa97c050770 msgr2=0x7fa97c0da540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:58.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.773+0000 7fa982ffd640 1 -- 172.21.15.86:0/3812857520 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa978037070 con 0x7fa97c050770 2024-09-19T06:43:58.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.773+0000 7fa989675640 1 --2- 172.21.15.86:0/3812857520 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa97c050770 0x7fa97c0da540 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa9780097d0 tx=0x7fa97802a210 comp rx=0 tx=0).stop 2024-09-19T06:43:58.779 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.778+0000 7fa989675640 1 -- 172.21.15.86:0/3812857520 shutdown_connections 2024-09-19T06:43:58.779 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.778+0000 7fa989675640 1 --2- 172.21.15.86:0/3812857520 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa97c050770 0x7fa97c0da540 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:58.779 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.778+0000 7fa989675640 1 -- 172.21.15.86:0/3812857520 >> 172.21.15.86:0/3812857520 conn(0x7fa97c04fc50 msgr2=0x7fa97c050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:58.785 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.780+0000 7fa989675640 1 -- 172.21.15.86:0/3812857520 shutdown_connections 2024-09-19T06:43:58.785 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.780+0000 7fa989675640 1 -- 172.21.15.86:0/3812857520 wait complete. 2024-09-19T06:43:58.785 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.782+0000 7fa989675640 1 Processor -- start 2024-09-19T06:43:58.786 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.782+0000 7fa989675640 1 -- start start 2024-09-19T06:43:58.786 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.784+0000 7fa989675640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa97c005a00 0x7fa97c0d9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:58.786 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.784+0000 7fa989675640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa97c034250 0x7fa97c0ce290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:58.786 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.784+0000 7fa989675640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa97c050770 0x7fa97c0ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:58.786 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.784+0000 7fa989675640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa97c006e30 con 0x7fa97c050770 2024-09-19T06:43:58.786 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.784+0000 7fa989675640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa97c006b50 con 0x7fa97c034250 2024-09-19T06:43:58.786 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.784+0000 7fa989675640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa97c04a5d0 con 0x7fa97c005a00 2024-09-19T06:43:58.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.785+0000 7fa9837fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa97c034250 0x7fa97c0ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:58.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.785+0000 7fa9837fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa97c034250 0x7fa97c0ce290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:54866/0 (socket says 172.21.15.86:54866) 2024-09-19T06:43:58.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.785+0000 7fa9837fe640 1 -- 172.21.15.86:0/2962679287 learned_addr learned my addr 172.21.15.86:0/2962679287 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:43:58.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.785+0000 7fa983fff640 1 --2- 172.21.15.86:0/2962679287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa97c005a00 0x7fa97c0d9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:58.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.786+0000 7fa988e74640 1 --2- 172.21.15.86:0/2962679287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa97c050770 0x7fa97c0ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:58.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.786+0000 7fa9837fe640 1 -- 172.21.15.86:0/2962679287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa97c005a00 msgr2=0x7fa97c0d9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:58.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.786+0000 7fa9837fe640 1 --2- 172.21.15.86:0/2962679287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa97c005a00 0x7fa97c0d9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:58.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.786+0000 7fa9837fe640 1 -- 172.21.15.86:0/2962679287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa97c050770 msgr2=0x7fa97c0ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:58.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.786+0000 7fa9837fe640 1 --2- 172.21.15.86:0/2962679287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa97c050770 0x7fa97c0ce7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:58.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.786+0000 7fa9837fe640 1 -- 172.21.15.86:0/2962679287 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa97c0492a0 con 0x7fa97c034250 2024-09-19T06:43:58.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.786+0000 7fa988e74640 1 --2- 172.21.15.86:0/2962679287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa97c050770 0x7fa97c0ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:43:58.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.786+0000 7fa9837fe640 1 --2- 172.21.15.86:0/2962679287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa97c034250 0x7fa97c0ce290 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa97000c4b0 tx=0x7fa97000c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:58.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.787+0000 7fa980ff9640 1 -- 172.21.15.86:0/2962679287 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa970017070 con 0x7fa97c034250 2024-09-19T06:43:58.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.787+0000 7fa989675640 1 -- 172.21.15.86:0/2962679287 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa97c047bc0 con 0x7fa97c034250 2024-09-19T06:43:58.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.787+0000 7fa989675640 1 -- 172.21.15.86:0/2962679287 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa97c049800 con 0x7fa97c034250 2024-09-19T06:43:58.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.788+0000 7fa980ff9640 1 -- 172.21.15.86:0/2962679287 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa970005ce0 con 0x7fa97c034250 2024-09-19T06:43:58.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.788+0000 7fa980ff9640 1 -- 172.21.15.86:0/2962679287 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa970007270 con 0x7fa97c034250 2024-09-19T06:43:58.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.789+0000 7fa96e7fc640 1 -- 172.21.15.86:0/2962679287 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa97c047940 con 0x7fa97c034250 2024-09-19T06:43:58.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.791+0000 7fa980ff9640 1 -- 172.21.15.86:0/2962679287 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa97001a070 con 0x7fa97c034250 2024-09-19T06:43:58.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.792+0000 7fa980ff9640 1 --2- 172.21.15.86:0/2962679287 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa96806c380 0x7fa96806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:58.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.792+0000 7fa980ff9640 1 -- 172.21.15.86:0/2962679287 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7079+0+0 (secure 0 0 0) 0x7fa97008b530 con 0x7fa97c034250 2024-09-19T06:43:58.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.793+0000 7fa983fff640 1 --2- 172.21.15.86:0/2962679287 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa96806c380 0x7fa96806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:58.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.794+0000 7fa983fff640 1 --2- 172.21.15.86:0/2962679287 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa96806c380 0x7fa96806e840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa978034000 tx=0x7fa97802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:58.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:58.798+0000 7fa980ff9640 1 -- 172.21.15.86:0/2962679287 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa97c047940 con 0x7fa97c034250 2024-09-19T06:43:59.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:59.225+0000 7fa96e7fc640 1 -- 172.21.15.86:0/2962679287 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa97c0cedd0 con 0x7fa97c034250 2024-09-19T06:43:59.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:59.232+0000 7fa980ff9640 1 -- 172.21.15.86:0/2962679287 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6047 (secure 0 0 0) 0x7fa97c0492a0 con 0x7fa97c034250 2024-09-19T06:43:59.236 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:43:59.236 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":25,"btime":"2024-09-19T06:43:55:529244+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:43:55.529240+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"d","rank":0,"incarnation":25,"state":"up:replay","state_seq":1,"addr":"172.21.15.169:6837/3116130916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":3116130916},{"type":"v1","addr":"172.21.15.169:6837","nonce":3116130916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:43:59.236 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 25 2024-09-19T06:43:59.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:59.238+0000 7fa96e7fc640 1 -- 172.21.15.86:0/2962679287 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa96806c380 msgr2=0x7fa96806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:59.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:59.238+0000 7fa96e7fc640 1 --2- 172.21.15.86:0/2962679287 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa96806c380 0x7fa96806e840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa978034000 tx=0x7fa97802e000 comp rx=0 tx=0).stop 2024-09-19T06:43:59.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:59.238+0000 7fa96e7fc640 1 -- 172.21.15.86:0/2962679287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa97c034250 msgr2=0x7fa97c0ce290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:59.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:59.238+0000 7fa96e7fc640 1 --2- 172.21.15.86:0/2962679287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa97c034250 0x7fa97c0ce290 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa97000c4b0 tx=0x7fa97000c970 comp rx=0 tx=0).stop 2024-09-19T06:43:59.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:59.240+0000 7fa96e7fc640 1 -- 172.21.15.86:0/2962679287 shutdown_connections 2024-09-19T06:43:59.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:59.240+0000 7fa96e7fc640 1 --2- 172.21.15.86:0/2962679287 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa96806c380 0x7fa96806e840 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:59.242 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:59.240+0000 7fa96e7fc640 1 --2- 172.21.15.86:0/2962679287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa97c050770 0x7fa97c0ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:59.242 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:59.240+0000 7fa96e7fc640 1 --2- 172.21.15.86:0/2962679287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa97c034250 0x7fa97c0ce290 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:59.242 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:59.240+0000 7fa96e7fc640 1 --2- 172.21.15.86:0/2962679287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa97c005a00 0x7fa97c0d9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:59.242 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:59.240+0000 7fa96e7fc640 1 -- 172.21.15.86:0/2962679287 >> 172.21.15.86:0/2962679287 conn(0x7fa97c04fc50 msgr2=0x7fa97c0cfad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:59.242 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:59.240+0000 7fa96e7fc640 1 -- 172.21.15.86:0/2962679287 shutdown_connections 2024-09-19T06:43:59.242 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:43:59.240+0000 7fa96e7fc640 1 -- 172.21.15.86:0/2962679287 wait complete. 2024-09-19T06:43:59.262 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:44:01.262 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:44:01.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.453+0000 7f8a12467640 1 Processor -- start 2024-09-19T06:44:01.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.453+0000 7f8a12467640 1 -- start start 2024-09-19T06:44:01.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.455+0000 7f8a12467640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8a040dcd90 0x7f8a04045d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:01.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.455+0000 7f8a12467640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a0404a680 0x7f8a0404aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:01.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.455+0000 7f8a12467640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a040e6d30 con 0x7f8a040e5f30 2024-09-19T06:44:01.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.455+0000 7f8a12467640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f8a04044d40 con 0x7f8a040dcd90 2024-09-19T06:44:01.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.455+0000 7f8a12467640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8a040dd170 con 0x7f8a0404a680 2024-09-19T06:44:01.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.455+0000 7f8a10c64640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a0404a680 0x7f8a0404aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:01.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.455+0000 7f8a10c64640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a0404a680 0x7f8a0404aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:42656/0 (socket says 172.21.15.86:42656) 2024-09-19T06:44:01.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.455+0000 7f8a10c64640 1 -- 172.21.15.86:0/4059127485 learned_addr learned my addr 172.21.15.86:0/4059127485 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:01.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.456+0000 7f8a10c64640 1 -- 172.21.15.86:0/4059127485 >> v2:172.21.15.169:3300/0 conn(0x7f8a040dcd90 msgr2=0x7f8a04045d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:44:01.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.456+0000 7f8a10c64640 1 --2- 172.21.15.86:0/4059127485 >> v2:172.21.15.169:3300/0 conn(0x7f8a040dcd90 0x7f8a04045d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:01.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.456+0000 7f8a10c64640 1 -- 172.21.15.86:0/4059127485 >> v1:172.21.15.169:6789/0 conn(0x7f8a040e5f30 legacy=0x7f8a040e63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:01.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.456+0000 7f8a10c64640 1 -- 172.21.15.86:0/4059127485 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a04044f90 con 0x7f8a0404a680 2024-09-19T06:44:01.460 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.458+0000 7f8a10c64640 1 --2- 172.21.15.86:0/4059127485 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a0404a680 0x7f8a0404aa80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8a08009870 tx=0x7f8a0802a2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a068828bd9167bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:01.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.459+0000 7f8a03fff640 1 -- 172.21.15.86:0/4059127485 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a08037070 con 0x7f8a0404a680 2024-09-19T06:44:01.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.459+0000 7f8a03fff640 1 -- 172.21.15.86:0/4059127485 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a08032440 con 0x7f8a0404a680 2024-09-19T06:44:01.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.459+0000 7f8a03fff640 1 -- 172.21.15.86:0/4059127485 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a080327f0 con 0x7f8a0404a680 2024-09-19T06:44:01.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.460+0000 7f8a12467640 1 -- 172.21.15.86:0/4059127485 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a0404a680 msgr2=0x7f8a0404aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:01.462 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.460+0000 7f8a12467640 1 --2- 172.21.15.86:0/4059127485 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a0404a680 0x7f8a0404aa80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8a08009870 tx=0x7f8a0802a2c0 comp rx=0 tx=0).stop 2024-09-19T06:44:01.462 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.460+0000 7f8a12467640 1 -- 172.21.15.86:0/4059127485 shutdown_connections 2024-09-19T06:44:01.462 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.460+0000 7f8a12467640 1 --2- 172.21.15.86:0/4059127485 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a0404a680 0x7f8a0404aa80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:01.462 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.460+0000 7f8a12467640 1 --2- 172.21.15.86:0/4059127485 >> v2:172.21.15.169:3300/0 conn(0x7f8a040dcd90 0x7f8a04045d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:01.462 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.460+0000 7f8a12467640 1 -- 172.21.15.86:0/4059127485 >> 172.21.15.86:0/4059127485 conn(0x7f8a0404fc50 msgr2=0x7f8a04050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:01.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.463+0000 7f8a12467640 1 -- 172.21.15.86:0/4059127485 shutdown_connections 2024-09-19T06:44:01.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.463+0000 7f8a12467640 1 -- 172.21.15.86:0/4059127485 wait complete. 2024-09-19T06:44:01.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.465+0000 7f8a12467640 1 Processor -- start 2024-09-19T06:44:01.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.465+0000 7f8a12467640 1 -- start start 2024-09-19T06:44:01.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.466+0000 7f8a12467640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a0404a680 0x7f8a040e58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:01.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.466+0000 7f8a12467640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a040dcd90 0x7f8a0404c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:01.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.466+0000 7f8a12467640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a040e5f30 0x7f8a040d4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:01.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.466+0000 7f8a12467640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8a04045550 con 0x7f8a040e5f30 2024-09-19T06:44:01.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.466+0000 7f8a12467640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8a040e6ad0 con 0x7f8a0404a680 2024-09-19T06:44:01.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.466+0000 7f8a12467640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8a04045830 con 0x7f8a040dcd90 2024-09-19T06:44:01.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.467+0000 7f8a10c64640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a040dcd90 0x7f8a0404c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:01.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.467+0000 7f8a10c64640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a040dcd90 0x7f8a0404c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:42668/0 (socket says 172.21.15.86:42668) 2024-09-19T06:44:01.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.467+0000 7f8a10c64640 1 -- 172.21.15.86:0/2291098856 learned_addr learned my addr 172.21.15.86:0/2291098856 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:01.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.467+0000 7f8a11465640 1 --2- 172.21.15.86:0/2291098856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a0404a680 0x7f8a040e58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:01.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.468+0000 7f8a10c64640 1 -- 172.21.15.86:0/2291098856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a0404a680 msgr2=0x7f8a040e58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:01.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.468+0000 7f8a10c64640 1 --2- 172.21.15.86:0/2291098856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a0404a680 0x7f8a040e58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:01.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.468+0000 7f8a10c64640 1 -- 172.21.15.86:0/2291098856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a040e5f30 msgr2=0x7f8a040d4e80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:44:01.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.468+0000 7f8a10c64640 1 --2- 172.21.15.86:0/2291098856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a040e5f30 0x7f8a040d4e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:01.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.468+0000 7f8a10c64640 1 -- 172.21.15.86:0/2291098856 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a0416c160 con 0x7f8a040dcd90 2024-09-19T06:44:01.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.468+0000 7f8a10c64640 1 --2- 172.21.15.86:0/2291098856 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a040dcd90 0x7f8a0404c6e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a080090b0 tx=0x7f8a080046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:01.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.469+0000 7f8a01ffb640 1 -- 172.21.15.86:0/2291098856 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a08041020 con 0x7f8a040dcd90 2024-09-19T06:44:01.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.469+0000 7f8a12467640 1 -- 172.21.15.86:0/2291098856 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a04006a20 con 0x7f8a040dcd90 2024-09-19T06:44:01.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.469+0000 7f8a12467640 1 -- 172.21.15.86:0/2291098856 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a0416dad0 con 0x7f8a040dcd90 2024-09-19T06:44:01.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.469+0000 7f8a01ffb640 1 -- 172.21.15.86:0/2291098856 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a080325f0 con 0x7f8a040dcd90 2024-09-19T06:44:01.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.469+0000 7f8a01ffb640 1 -- 172.21.15.86:0/2291098856 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a08037040 con 0x7f8a040dcd90 2024-09-19T06:44:01.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.472+0000 7f8a01ffb640 1 -- 172.21.15.86:0/2291098856 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8a08044020 con 0x7f8a040dcd90 2024-09-19T06:44:01.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.473+0000 7f8a01ffb640 1 --2- 172.21.15.86:0/2291098856 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f89f006c2b0 0x7f89f006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:01.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.473+0000 7f8a01ffb640 1 -- 172.21.15.86:0/2291098856 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 7079+0+0 (secure 0 0 0) 0x7f8a080ac670 con 0x7f8a040dcd90 2024-09-19T06:44:01.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.474+0000 7f8a11465640 1 --2- 172.21.15.86:0/2291098856 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f89f006c2b0 0x7f89f006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:01.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.474+0000 7f8a11465640 1 --2- 172.21.15.86:0/2291098856 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f89f006c2b0 0x7f89f006e770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c065710 tx=0x7f8a0c06f040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:01.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.475+0000 7f8a12467640 1 -- 172.21.15.86:0/2291098856 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89ec005290 con 0x7f8a040dcd90 2024-09-19T06:44:01.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.484+0000 7f8a01ffb640 1 -- 172.21.15.86:0/2291098856 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8a0804b030 con 0x7f8a040dcd90 2024-09-19T06:44:01.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.907+0000 7f8a12467640 1 -- 172.21.15.86:0/2291098856 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89ec005580 con 0x7f8a040dcd90 2024-09-19T06:44:01.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.909+0000 7f8a01ffb640 1 -- 172.21.15.86:0/2291098856 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6047 (secure 0 0 0) 0x7f8a08030e20 con 0x7f8a040dcd90 2024-09-19T06:44:01.915 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:44:01.915 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":25,"btime":"2024-09-19T06:43:55:529244+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:43:55.529240+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"d","rank":0,"incarnation":25,"state":"up:replay","state_seq":1,"addr":"172.21.15.169:6837/3116130916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":3116130916},{"type":"v1","addr":"172.21.15.169:6837","nonce":3116130916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:44:01.915 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 25 2024-09-19T06:44:01.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.915+0000 7f8a12467640 1 -- 172.21.15.86:0/2291098856 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f89f006c2b0 msgr2=0x7f89f006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:01.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.915+0000 7f8a12467640 1 --2- 172.21.15.86:0/2291098856 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f89f006c2b0 0x7f89f006e770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c065710 tx=0x7f8a0c06f040 comp rx=0 tx=0).stop 2024-09-19T06:44:01.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.916+0000 7f8a12467640 1 -- 172.21.15.86:0/2291098856 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a040dcd90 msgr2=0x7f8a0404c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:01.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.916+0000 7f8a12467640 1 --2- 172.21.15.86:0/2291098856 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a040dcd90 0x7f8a0404c6e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a080090b0 tx=0x7f8a080046c0 comp rx=0 tx=0).stop 2024-09-19T06:44:01.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.920+0000 7f8a12467640 1 -- 172.21.15.86:0/2291098856 shutdown_connections 2024-09-19T06:44:01.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.920+0000 7f8a12467640 1 --2- 172.21.15.86:0/2291098856 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f89f006c2b0 0x7f89f006e770 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:01.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.920+0000 7f8a12467640 1 --2- 172.21.15.86:0/2291098856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a040e5f30 0x7f8a040d4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:01.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.920+0000 7f8a12467640 1 --2- 172.21.15.86:0/2291098856 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a040dcd90 0x7f8a0404c6e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:01.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.920+0000 7f8a12467640 1 --2- 172.21.15.86:0/2291098856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a0404a680 0x7f8a040e58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:01.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.920+0000 7f8a12467640 1 -- 172.21.15.86:0/2291098856 >> 172.21.15.86:0/2291098856 conn(0x7f8a0404fc50 msgr2=0x7f8a0404b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:01.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.920+0000 7f8a12467640 1 -- 172.21.15.86:0/2291098856 shutdown_connections 2024-09-19T06:44:01.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:01.920+0000 7f8a12467640 1 -- 172.21.15.86:0/2291098856 wait complete. 2024-09-19T06:44:01.949 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:44:03.950 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:44:04.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.067+0000 7f13eecc9640 1 Processor -- start 2024-09-19T06:44:04.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.068+0000 7f13eecc9640 1 -- start start 2024-09-19T06:44:04.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.069+0000 7f13eecc9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f13e80c9da0 0x7f13e8157b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:04.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.069+0000 7f13eecc9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13e806cc60 0x7f13e806d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:04.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.069+0000 7f13eecc9640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f13e8150f70 0x7f13e8151400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:04.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.069+0000 7f13eecc9640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f13e8071200 con 0x7f13e8150f70 2024-09-19T06:44:04.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.069+0000 7f13eecc9640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f13e81580a0 con 0x7f13e80c9da0 2024-09-19T06:44:04.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.069+0000 7f13eecc9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f13e80c7e30 con 0x7f13e806cc60 2024-09-19T06:44:04.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.069+0000 7f13e7fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13e806cc60 0x7f13e806d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:04.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.069+0000 7f13e7fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13e806cc60 0x7f13e806d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:51794/0 (socket says 172.21.15.86:51794) 2024-09-19T06:44:04.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.069+0000 7f13e7fff640 1 -- 172.21.15.86:0/2505688588 learned_addr learned my addr 172.21.15.86:0/2505688588 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:04.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.070+0000 7f13eca65640 1 --2- 172.21.15.86:0/2505688588 >> v2:172.21.15.169:3300/0 conn(0x7f13e80c9da0 0x7f13e8157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:04.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.070+0000 7f13ed266640 1 --2- 172.21.15.86:0/2505688588 >> v2:172.21.15.86:3300/0 conn(0x7f13e8150f70 0x7f13e8151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:04.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.070+0000 7f13ed266640 1 -- 172.21.15.86:0/2505688588 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13e806cc60 msgr2=0x7f13e806d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:04.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.070+0000 7f13ed266640 1 --2- 172.21.15.86:0/2505688588 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13e806cc60 0x7f13e806d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:04.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.071+0000 7f13ed266640 1 -- 172.21.15.86:0/2505688588 >> v2:172.21.15.169:3300/0 conn(0x7f13e80c9da0 msgr2=0x7f13e8157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:04.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.071+0000 7f13ed266640 1 --2- 172.21.15.86:0/2505688588 >> v2:172.21.15.169:3300/0 conn(0x7f13e80c9da0 0x7f13e8157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:04.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.071+0000 7f13ed266640 1 -- 172.21.15.86:0/2505688588 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e806bbc0 con 0x7f13e8150f70 2024-09-19T06:44:04.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.072+0000 7f13ed266640 1 --2- 172.21.15.86:0/2505688588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13e8150f70 0x7f13e8151400 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f13e80ca310 tx=0x7f13dc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2155383d3e6a1e1f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:04.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.073+0000 7f13e77fe640 1 -- 172.21.15.86:0/2505688588 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc037070 con 0x7f13e8150f70 2024-09-19T06:44:04.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.073+0000 7f13e77fe640 1 -- 172.21.15.86:0/2505688588 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13dc032440 con 0x7f13e8150f70 2024-09-19T06:44:04.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.073+0000 7f13e77fe640 1 -- 172.21.15.86:0/2505688588 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc032810 con 0x7f13e8150f70 2024-09-19T06:44:04.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.074+0000 7f13eecc9640 1 -- 172.21.15.86:0/2505688588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13e8150f70 msgr2=0x7f13e8151400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:04.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.074+0000 7f13eecc9640 1 --2- 172.21.15.86:0/2505688588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13e8150f70 0x7f13e8151400 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f13e80ca310 tx=0x7f13dc02a1a0 comp rx=0 tx=0).stop 2024-09-19T06:44:04.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.075+0000 7f13eecc9640 1 -- 172.21.15.86:0/2505688588 shutdown_connections 2024-09-19T06:44:04.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.075+0000 7f13eecc9640 1 --2- 172.21.15.86:0/2505688588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13e8150f70 0x7f13e8151400 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:04.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.075+0000 7f13eecc9640 1 --2- 172.21.15.86:0/2505688588 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13e806cc60 0x7f13e806d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:04.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.075+0000 7f13eecc9640 1 --2- 172.21.15.86:0/2505688588 >> v2:172.21.15.169:3300/0 conn(0x7f13e80c9da0 0x7f13e8157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:04.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.075+0000 7f13eecc9640 1 -- 172.21.15.86:0/2505688588 >> 172.21.15.86:0/2505688588 conn(0x7f13e80c9280 msgr2=0x7f13e80c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:04.078 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.076+0000 7f13eecc9640 1 -- 172.21.15.86:0/2505688588 shutdown_connections 2024-09-19T06:44:04.078 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.076+0000 7f13eecc9640 1 -- 172.21.15.86:0/2505688588 wait complete. 2024-09-19T06:44:04.078 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.077+0000 7f13eecc9640 1 Processor -- start 2024-09-19T06:44:04.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.078+0000 7f13eecc9640 1 -- start start 2024-09-19T06:44:04.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.079+0000 7f13eecc9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13e806cc60 0x7f13e8154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:04.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.079+0000 7f13eecc9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13e80c9da0 0x7f13e80bbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:04.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.079+0000 7f13eecc9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13e8150f70 0x7f13e8157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:04.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.079+0000 7f13eecc9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f13e806c460 con 0x7f13e806cc60 2024-09-19T06:44:04.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.079+0000 7f13eecc9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f13e806c180 con 0x7f13e8150f70 2024-09-19T06:44:04.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.079+0000 7f13eecc9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f13e80c79f0 con 0x7f13e80c9da0 2024-09-19T06:44:04.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.079+0000 7f13eca65640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13e806cc60 0x7f13e8154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:04.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.079+0000 7f13eca65640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13e806cc60 0x7f13e8154450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41588/0 (socket says 172.21.15.86:41588) 2024-09-19T06:44:04.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.079+0000 7f13eca65640 1 -- 172.21.15.86:0/1121154052 learned_addr learned my addr 172.21.15.86:0/1121154052 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:04.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.079+0000 7f13ed266640 1 --2- 172.21.15.86:0/1121154052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13e8150f70 0x7f13e8157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:04.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.079+0000 7f13e7fff640 1 --2- 172.21.15.86:0/1121154052 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13e80c9da0 0x7f13e80bbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:04.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.080+0000 7f13ed266640 1 -- 172.21.15.86:0/1121154052 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13e80c9da0 msgr2=0x7f13e80bbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:04.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.080+0000 7f13ed266640 1 --2- 172.21.15.86:0/1121154052 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13e80c9da0 0x7f13e80bbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:04.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.080+0000 7f13ed266640 1 -- 172.21.15.86:0/1121154052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13e806cc60 msgr2=0x7f13e8154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:04.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.080+0000 7f13ed266640 1 --2- 172.21.15.86:0/1121154052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13e806cc60 0x7f13e8154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:04.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.080+0000 7f13ed266640 1 -- 172.21.15.86:0/1121154052 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e80ba600 con 0x7f13e8150f70 2024-09-19T06:44:04.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.080+0000 7f13ed266640 1 --2- 172.21.15.86:0/1121154052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13e8150f70 0x7f13e8157660 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f13e80c7420 tx=0x7f13dc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:04.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.081+0000 7f13e57fa640 1 -- 172.21.15.86:0/1121154052 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc042020 con 0x7f13e8150f70 2024-09-19T06:44:04.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.081+0000 7f13e57fa640 1 -- 172.21.15.86:0/1121154052 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13dc03d730 con 0x7f13e8150f70 2024-09-19T06:44:04.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.081+0000 7f13e57fa640 1 -- 172.21.15.86:0/1121154052 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc037040 con 0x7f13e8150f70 2024-09-19T06:44:04.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.082+0000 7f13eecc9640 1 -- 172.21.15.86:0/1121154052 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e80ba8e0 con 0x7f13e8150f70 2024-09-19T06:44:04.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.082+0000 7f13eecc9640 1 -- 172.21.15.86:0/1121154052 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e80baea0 con 0x7f13e8150f70 2024-09-19T06:44:04.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.084+0000 7f13eecc9640 1 -- 172.21.15.86:0/1121154052 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e806d060 con 0x7f13e8150f70 2024-09-19T06:44:04.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.087+0000 7f13e57fa640 1 -- 172.21.15.86:0/1121154052 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f13dc045020 con 0x7f13e8150f70 2024-09-19T06:44:04.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.087+0000 7f13e57fa640 1 --2- 172.21.15.86:0/1121154052 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f13d406c380 0x7f13d406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:04.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.087+0000 7f13e57fa640 1 -- 172.21.15.86:0/1121154052 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7079+0+0 (secure 0 0 0) 0x7f13dc0ac490 con 0x7f13e8150f70 2024-09-19T06:44:04.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.089+0000 7f13eca65640 1 --2- 172.21.15.86:0/1121154052 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f13d406c380 0x7f13d406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:04.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.089+0000 7f13eca65640 1 --2- 172.21.15.86:0/1121154052 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f13d406c380 0x7f13d406e840 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f13e0007520 tx=0x7f13e0009950 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:04.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.094+0000 7f13e57fa640 1 -- 172.21.15.86:0/1121154052 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f13dc04c030 con 0x7f13e8150f70 2024-09-19T06:44:04.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.531+0000 7f13eecc9640 1 -- 172.21.15.86:0/1121154052 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13e80c9660 con 0x7f13e8150f70 2024-09-19T06:44:04.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.536+0000 7f13e57fa640 1 -- 172.21.15.86:0/1121154052 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6047 (secure 0 0 0) 0x7f13dc07a0c0 con 0x7f13e8150f70 2024-09-19T06:44:04.539 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:44:04.539 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":25,"btime":"2024-09-19T06:43:55:529244+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:43:55.529240+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"d","rank":0,"incarnation":25,"state":"up:replay","state_seq":1,"addr":"172.21.15.169:6837/3116130916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":3116130916},{"type":"v1","addr":"172.21.15.169:6837","nonce":3116130916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:44:04.539 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 25 2024-09-19T06:44:04.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.544+0000 7f13eecc9640 1 -- 172.21.15.86:0/1121154052 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f13d406c380 msgr2=0x7f13d406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:04.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.544+0000 7f13eecc9640 1 --2- 172.21.15.86:0/1121154052 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f13d406c380 0x7f13d406e840 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f13e0007520 tx=0x7f13e0009950 comp rx=0 tx=0).stop 2024-09-19T06:44:04.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.544+0000 7f13eecc9640 1 -- 172.21.15.86:0/1121154052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13e8150f70 msgr2=0x7f13e8157660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:04.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.544+0000 7f13eecc9640 1 --2- 172.21.15.86:0/1121154052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13e8150f70 0x7f13e8157660 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f13e80c7420 tx=0x7f13dc0046c0 comp rx=0 tx=0).stop 2024-09-19T06:44:04.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.545+0000 7f13eecc9640 1 -- 172.21.15.86:0/1121154052 shutdown_connections 2024-09-19T06:44:04.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.545+0000 7f13eecc9640 1 --2- 172.21.15.86:0/1121154052 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f13d406c380 0x7f13d406e840 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:04.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.545+0000 7f13eecc9640 1 --2- 172.21.15.86:0/1121154052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13e8150f70 0x7f13e8157660 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:04.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.545+0000 7f13eecc9640 1 --2- 172.21.15.86:0/1121154052 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13e80c9da0 0x7f13e80bbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:04.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.545+0000 7f13eecc9640 1 --2- 172.21.15.86:0/1121154052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13e806cc60 0x7f13e8154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:04.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.545+0000 7f13eecc9640 1 -- 172.21.15.86:0/1121154052 >> 172.21.15.86:0/1121154052 conn(0x7f13e80c9280 msgr2=0x7f13e8071390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:04.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.545+0000 7f13eecc9640 1 -- 172.21.15.86:0/1121154052 shutdown_connections 2024-09-19T06:44:04.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:04.546+0000 7f13eecc9640 1 -- 172.21.15.86:0/1121154052 wait complete. 2024-09-19T06:44:04.566 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:44:06.568 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:44:06.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.747+0000 7f27dca2b640 1 Processor -- start 2024-09-19T06:44:06.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.747+0000 7f27dca2b640 1 -- start start 2024-09-19T06:44:06.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.748+0000 7f27dca2b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f27d00d88f0 0x7f27d0005eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:06.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.748+0000 7f27dca2b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27d004aee0 0x7f27d00de630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:06.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.748+0000 7f27dca2b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27d00e2980 con 0x7f27d004b310 2024-09-19T06:44:06.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.748+0000 7f27dca2b640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f27d0006d70 con 0x7f27d00d88f0 2024-09-19T06:44:06.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.748+0000 7f27dca2b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f27d0006fc0 con 0x7f27d004aee0 2024-09-19T06:44:06.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.750+0000 7f27d759e640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f27d004b310 0x7f27d00deb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:53352/0 (socket says 172.21.15.86:53352) 2024-09-19T06:44:06.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.750+0000 7f27d759e640 1 -- 172.21.15.86:0/1635196532 learned_addr learned my addr 172.21.15.86:0/1635196532 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:44:06.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.750+0000 7f27d5d9b640 1 -- 172.21.15.86:0/1635196532 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1278321035 0 0) 0x7f27d00e2980 con 0x7f27d004b310 2024-09-19T06:44:06.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.750+0000 7f27d5d9b640 1 -- 172.21.15.86:0/1635196532 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27c0003520 con 0x7f27d004b310 2024-09-19T06:44:06.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.751+0000 7f27d5d9b640 1 -- 172.21.15.86:0/1635196532 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1552634853 0 0) 0x7f27c0003520 con 0x7f27d004b310 2024-09-19T06:44:06.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.751+0000 7f27d5d9b640 1 -- 172.21.15.86:0/1635196532 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27d004aee0 msgr2=0x7f27d00de630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:06.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.751+0000 7f27d5d9b640 1 --2- 172.21.15.86:0/1635196532 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27d004aee0 0x7f27d00de630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:06.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.751+0000 7f27d5d9b640 1 -- 172.21.15.86:0/1635196532 >> v2:172.21.15.169:3300/0 conn(0x7f27d00d88f0 msgr2=0x7f27d0005eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:06.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.751+0000 7f27d5d9b640 1 --2- 172.21.15.86:0/1635196532 >> v2:172.21.15.169:3300/0 conn(0x7f27d00d88f0 0x7f27d0005eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:06.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.751+0000 7f27d5d9b640 1 -- 172.21.15.86:0/1635196532 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d00072a0 con 0x7f27d004b310 2024-09-19T06:44:06.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.751+0000 7f27d5d9b640 1 -- 172.21.15.86:0/1635196532 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f27cc001670 con 0x7f27d004b310 2024-09-19T06:44:06.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.751+0000 7f27d5d9b640 1 -- 172.21.15.86:0/1635196532 >> v1:172.21.15.169:6789/0 conn(0x7f27d004b310 legacy=0x7f27d00deb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:06.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.751+0000 7f27d5d9b640 1 --2- 172.21.15.86:0/1635196532 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27c00039b0 0x7f27c0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:06.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.751+0000 7f27d5d9b640 1 --2- 172.21.15.86:0/1635196532 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27d004aee0 0x7f27c0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:06.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.751+0000 7f27d5d9b640 1 --2- 172.21.15.86:0/1635196532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27c0004d90 0x7f27c0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:06.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.751+0000 7f27d5d9b640 1 -- 172.21.15.86:0/1635196532 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f27d0006d70 con 0x7f27c0004d90 2024-09-19T06:44:06.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.751+0000 7f27d5d9b640 1 -- 172.21.15.86:0/1635196532 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f27d0006fc0 con 0x7f27c00039b0 2024-09-19T06:44:06.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.751+0000 7f27d5d9b640 1 -- 172.21.15.86:0/1635196532 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f27c000bc50 con 0x7f27d004aee0 2024-09-19T06:44:06.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.751+0000 7f27d759e640 1 --2- 172.21.15.86:0/1635196532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27c0004d90 0x7f27c0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:06.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.752+0000 7f27d659c640 1 --2- 172.21.15.86:0/1635196532 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27d004aee0 0x7f27c0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:06.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.752+0000 7f27d759e640 1 -- 172.21.15.86:0/1635196532 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27d004aee0 msgr2=0x7f27c0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:06.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.752+0000 7f27d759e640 1 --2- 172.21.15.86:0/1635196532 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27d004aee0 0x7f27c0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:06.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.752+0000 7f27d759e640 1 -- 172.21.15.86:0/1635196532 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27c00039b0 msgr2=0x7f27c0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:06.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.752+0000 7f27d759e640 1 --2- 172.21.15.86:0/1635196532 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27c00039b0 0x7f27c0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:06.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.752+0000 7f27d759e640 1 -- 172.21.15.86:0/1635196532 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c0003520 con 0x7f27c0004d90 2024-09-19T06:44:06.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.752+0000 7f27d659c640 1 --2- 172.21.15.86:0/1635196532 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27d004aee0 0x7f27c0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:44:06.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.753+0000 7f27d759e640 1 --2- 172.21.15.86:0/1635196532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27c0004d90 0x7f27c0005210 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f27d000c1a0 tx=0x7f27c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9192f5d5c849f2ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:06.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.753+0000 7f27d5d9b640 1 -- 172.21.15.86:0/1635196532 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc007d50 con 0x7f27c0004d90 2024-09-19T06:44:06.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.753+0000 7f27d5d9b640 1 -- 172.21.15.86:0/1635196532 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27cc005ad0 con 0x7f27c0004d90 2024-09-19T06:44:06.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.753+0000 7f27d5d9b640 1 -- 172.21.15.86:0/1635196532 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc007070 con 0x7f27c0004d90 2024-09-19T06:44:06.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.755+0000 7f27dca2b640 1 -- 172.21.15.86:0/1635196532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27c0004d90 msgr2=0x7f27c0005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:06.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.755+0000 7f27dca2b640 1 --2- 172.21.15.86:0/1635196532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27c0004d90 0x7f27c0005210 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f27d000c1a0 tx=0x7f27c0005830 comp rx=0 tx=0).stop 2024-09-19T06:44:06.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.755+0000 7f27d759e640 1 -- 172.21.15.86:0/1635196532 reap_dead start 2024-09-19T06:44:06.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.756+0000 7f27dca2b640 1 -- 172.21.15.86:0/1635196532 shutdown_connections 2024-09-19T06:44:06.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.756+0000 7f27dca2b640 1 -- 172.21.15.86:0/1635196532 >> 172.21.15.86:0/1635196532 conn(0x7f27d0050560 msgr2=0x7f27d0050940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:06.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.756+0000 7f27dca2b640 1 -- 172.21.15.86:0/1635196532 shutdown_connections 2024-09-19T06:44:06.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.757+0000 7f27dca2b640 1 -- 172.21.15.86:0/1635196532 wait complete. 2024-09-19T06:44:06.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.759+0000 7f27dca2b640 1 Processor -- start 2024-09-19T06:44:06.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.759+0000 7f27dca2b640 1 -- start start 2024-09-19T06:44:06.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.760+0000 7f27dca2b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27d004ba40 0x7f27d0033420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:06.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.760+0000 7f27dca2b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27d004be20 0x7f27d00dc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:06.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.760+0000 7f27dca2b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27d00dbbc0 0x7f27d00dcd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:06.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.760+0000 7f27d659c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27d004be20 0x7f27d00dc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:06.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.760+0000 7f27d659c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27d004be20 0x7f27d00dc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:51820/0 (socket says 172.21.15.86:51820) 2024-09-19T06:44:06.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.761+0000 7f27d6d9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27d004ba40 0x7f27d0033420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:06.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.761+0000 7f27d759e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27d00dbbc0 0x7f27d00dcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:06.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.761+0000 7f27d6d9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27d004ba40 0x7f27d0033420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:33468/0 (socket says 172.21.15.86:33468) 2024-09-19T06:44:06.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.761+0000 7f27d759e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27d00dbbc0 0x7f27d00dcd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41598/0 (socket says 172.21.15.86:41598) 2024-09-19T06:44:06.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.761+0000 7f27d659c640 1 -- 172.21.15.86:0/1938856301 learned_addr learned my addr 172.21.15.86:0/1938856301 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:06.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.761+0000 7f27dca2b640 1 -- 172.21.15.86:0/1938856301 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f27d00d8cd0 con 0x7f27d00dbbc0 2024-09-19T06:44:06.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.761+0000 7f27dca2b640 1 -- 172.21.15.86:0/1938856301 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f27d0007860 con 0x7f27d004ba40 2024-09-19T06:44:06.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.761+0000 7f27dca2b640 1 -- 172.21.15.86:0/1938856301 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f27d0007d80 con 0x7f27d004be20 2024-09-19T06:44:06.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.762+0000 7f27d759e640 1 -- 172.21.15.86:0/1938856301 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27d004be20 msgr2=0x7f27d00dc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:06.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.762+0000 7f27d759e640 1 --2- 172.21.15.86:0/1938856301 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27d004be20 0x7f27d00dc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:06.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.762+0000 7f27d759e640 1 -- 172.21.15.86:0/1938856301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27d004ba40 msgr2=0x7f27d0033420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:06.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.762+0000 7f27d759e640 1 --2- 172.21.15.86:0/1938856301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27d004ba40 0x7f27d0033420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:06.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.762+0000 7f27d759e640 1 -- 172.21.15.86:0/1938856301 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d00dd4c0 con 0x7f27d00dbbc0 2024-09-19T06:44:06.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.762+0000 7f27d759e640 1 --2- 172.21.15.86:0/1938856301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27d00dbbc0 0x7f27d00dcd50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f27c000bba0 tx=0x7f27d00e2b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:06.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.763+0000 7f27bf7fe640 1 -- 172.21.15.86:0/1938856301 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc007d50 con 0x7f27d00dbbc0 2024-09-19T06:44:06.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.763+0000 7f27dca2b640 1 -- 172.21.15.86:0/1938856301 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27d00358a0 con 0x7f27d00dbbc0 2024-09-19T06:44:06.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.763+0000 7f27dca2b640 1 -- 172.21.15.86:0/1938856301 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27d00da2b0 con 0x7f27d00dbbc0 2024-09-19T06:44:06.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.768+0000 7f27bf7fe640 1 -- 172.21.15.86:0/1938856301 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27cc042070 con 0x7f27d00dbbc0 2024-09-19T06:44:06.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.768+0000 7f27bf7fe640 1 -- 172.21.15.86:0/1938856301 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc007270 con 0x7f27d00dbbc0 2024-09-19T06:44:06.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.768+0000 7f27bf7fe640 1 -- 172.21.15.86:0/1938856301 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f27cc03b070 con 0x7f27d00dbbc0 2024-09-19T06:44:06.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.769+0000 7f27bf7fe640 1 --2- 172.21.15.86:0/1938856301 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f27c406c3b0 0x7f27c406e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:06.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.769+0000 7f27bf7fe640 1 -- 172.21.15.86:0/1938856301 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7079+0+0 (secure 0 0 0) 0x7f27cc0aaaf0 con 0x7f27d00dbbc0 2024-09-19T06:44:06.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.769+0000 7f27d6d9d640 1 --2- 172.21.15.86:0/1938856301 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f27c406c3b0 0x7f27c406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:06.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.769+0000 7f27dca2b640 1 -- 172.21.15.86:0/1938856301 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27b8005290 con 0x7f27d00dbbc0 2024-09-19T06:44:06.779 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.777+0000 7f27d6d9d640 1 --2- 172.21.15.86:0/1938856301 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f27c406c3b0 0x7f27c406e870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f27c800b850 tx=0x7f27c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:06.779 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:06.779+0000 7f27bf7fe640 1 -- 172.21.15.86:0/1938856301 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f27cc04b060 con 0x7f27d00dbbc0 2024-09-19T06:44:07.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:07.216+0000 7f27dca2b640 1 -- 172.21.15.86:0/1938856301 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27b8005580 con 0x7f27d00dbbc0 2024-09-19T06:44:07.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:07.217+0000 7f27bf7fe640 1 -- 172.21.15.86:0/1938856301 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6051 (secure 0 0 0) 0x7f27cc078720 con 0x7f27d00dbbc0 2024-09-19T06:44:07.218 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:44:07.218 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":26,"btime":"2024-09-19T06:44:05:578959+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:05.377142+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"d","rank":0,"incarnation":25,"state":"up:reconnect","state_seq":26,"addr":"172.21.15.169:6837/3116130916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":3116130916},{"type":"v1","addr":"172.21.15.169:6837","nonce":3116130916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:44:07.218 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 26 2024-09-19T06:44:07.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:07.222+0000 7f27dca2b640 1 -- 172.21.15.86:0/1938856301 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f27c406c3b0 msgr2=0x7f27c406e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:07.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:07.222+0000 7f27dca2b640 1 --2- 172.21.15.86:0/1938856301 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f27c406c3b0 0x7f27c406e870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f27c800b850 tx=0x7f27c8008040 comp rx=0 tx=0).stop 2024-09-19T06:44:07.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:07.222+0000 7f27dca2b640 1 -- 172.21.15.86:0/1938856301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27d00dbbc0 msgr2=0x7f27d00dcd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:07.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:07.222+0000 7f27dca2b640 1 --2- 172.21.15.86:0/1938856301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27d00dbbc0 0x7f27d00dcd50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f27c000bba0 tx=0x7f27d00e2b50 comp rx=0 tx=0).stop 2024-09-19T06:44:07.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:07.222+0000 7f27dca2b640 1 -- 172.21.15.86:0/1938856301 shutdown_connections 2024-09-19T06:44:07.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:07.222+0000 7f27dca2b640 1 --2- 172.21.15.86:0/1938856301 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f27c406c3b0 0x7f27c406e870 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:07.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:07.222+0000 7f27dca2b640 1 --2- 172.21.15.86:0/1938856301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27d00dbbc0 0x7f27d00dcd50 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:07.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:07.222+0000 7f27dca2b640 1 --2- 172.21.15.86:0/1938856301 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27d004be20 0x7f27d00dc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:07.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:07.222+0000 7f27dca2b640 1 --2- 172.21.15.86:0/1938856301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27d004ba40 0x7f27d0033420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:07.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:07.222+0000 7f27dca2b640 1 -- 172.21.15.86:0/1938856301 >> 172.21.15.86:0/1938856301 conn(0x7f27d0050560 msgr2=0x7f27d00d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:07.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:07.222+0000 7f27dca2b640 1 -- 172.21.15.86:0/1938856301 shutdown_connections 2024-09-19T06:44:07.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:07.224+0000 7f27dca2b640 1 -- 172.21.15.86:0/1938856301 wait complete. 2024-09-19T06:44:07.241 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:44:09.242 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:44:09.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.412+0000 7f76e028d640 1 Processor -- start 2024-09-19T06:44:09.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.412+0000 7f76e028d640 1 -- start start 2024-09-19T06:44:09.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.414+0000 7f76e028d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f76d80c9da0 0x7f76d8157b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:09.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.414+0000 7f76e028d640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76d806bbc0 con 0x7f76d806cc60 2024-09-19T06:44:09.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.414+0000 7f76e028d640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76d806bea0 con 0x7f76d806d090 2024-09-19T06:44:09.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.414+0000 7f76e028d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f76d8071200 con 0x7f76d80c9da0 2024-09-19T06:44:09.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.414+0000 7f76dd828640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f76d806cc60 0x7f76d8150f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:43108/0 (socket says 172.21.15.86:43108) 2024-09-19T06:44:09.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.414+0000 7f76dd828640 1 -- 172.21.15.86:0/3305086960 learned_addr learned my addr 172.21.15.86:0/3305086960 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:44:09.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.414+0000 7f76de029640 1 --2- 172.21.15.86:0/3305086960 >> v2:172.21.15.169:3300/0 conn(0x7f76d80c9da0 0x7f76d8157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:09.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.414+0000 7f76dd027640 1 -- 172.21.15.86:0/3305086960 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3306415089 0 0) 0x7f76d806bea0 con 0x7f76d806d090 2024-09-19T06:44:09.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.414+0000 7f76dd027640 1 -- 172.21.15.86:0/3305086960 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76c4003520 con 0x7f76d806d090 2024-09-19T06:44:09.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.415+0000 7f76dd027640 1 -- 172.21.15.86:0/3305086960 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3795370248 0 0) 0x7f76d806bbc0 con 0x7f76d806cc60 2024-09-19T06:44:09.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.415+0000 7f76dd027640 1 -- 172.21.15.86:0/3305086960 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76d806bea0 con 0x7f76d806cc60 2024-09-19T06:44:09.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.416+0000 7f76dd027640 1 -- 172.21.15.86:0/3305086960 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 707664260 0 0) 0x7f76d806bea0 con 0x7f76d806cc60 2024-09-19T06:44:09.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.416+0000 7f76dd027640 1 -- 172.21.15.86:0/3305086960 >> v2:172.21.15.169:3300/0 conn(0x7f76d80c9da0 msgr2=0x7f76d8157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:09.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.416+0000 7f76dd027640 1 --2- 172.21.15.86:0/3305086960 >> v2:172.21.15.169:3300/0 conn(0x7f76d80c9da0 0x7f76d8157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:09.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.416+0000 7f76dd027640 1 -- 172.21.15.86:0/3305086960 >> v1:172.21.15.169:6789/0 conn(0x7f76d806d090 legacy=0x7f76d80c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:09.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.416+0000 7f76dd027640 1 -- 172.21.15.86:0/3305086960 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d806c180 con 0x7f76d806cc60 2024-09-19T06:44:09.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.416+0000 7f76dd027640 1 -- 172.21.15.86:0/3305086960 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f76d4001670 con 0x7f76d806cc60 2024-09-19T06:44:09.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.416+0000 7f76dd027640 1 -- 172.21.15.86:0/3305086960 >> v1:172.21.15.86:6789/0 conn(0x7f76d806cc60 legacy=0x7f76d8150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:09.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.416+0000 7f76dd027640 1 --2- 172.21.15.86:0/3305086960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76c4003b90 0x7f76c4003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:09.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.416+0000 7f76dd027640 1 --2- 172.21.15.86:0/3305086960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76c4004800 0x7f76c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:09.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.416+0000 7f76dd027640 1 --2- 172.21.15.86:0/3305086960 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76c40051c0 0x7f76c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:09.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.416+0000 7f76dd027640 1 -- 172.21.15.86:0/3305086960 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f76c400bfb0 con 0x7f76c4004800 2024-09-19T06:44:09.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.416+0000 7f76dd027640 1 -- 172.21.15.86:0/3305086960 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f76c400c160 con 0x7f76c4003b90 2024-09-19T06:44:09.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.416+0000 7f76dd027640 1 -- 172.21.15.86:0/3305086960 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f76c400c360 con 0x7f76c40051c0 2024-09-19T06:44:09.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.416+0000 7f76de029640 1 --2- 172.21.15.86:0/3305086960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76c4003b90 0x7f76c4003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:09.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.417+0000 7f76de82a640 1 --2- 172.21.15.86:0/3305086960 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76c40051c0 0x7f76c400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:09.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.417+0000 7f76dd828640 1 --2- 172.21.15.86:0/3305086960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76c4004800 0x7f76c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:09.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.417+0000 7f76de82a640 1 -- 172.21.15.86:0/3305086960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76c4003b90 msgr2=0x7f76c4003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:09.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.417+0000 7f76de82a640 1 --2- 172.21.15.86:0/3305086960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76c4003b90 0x7f76c4003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:09.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.417+0000 7f76de82a640 1 -- 172.21.15.86:0/3305086960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76c4004800 msgr2=0x7f76c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:09.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.417+0000 7f76de82a640 1 --2- 172.21.15.86:0/3305086960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76c4004800 0x7f76c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:09.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.417+0000 7f76de82a640 1 -- 172.21.15.86:0/3305086960 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d806bea0 con 0x7f76c40051c0 2024-09-19T06:44:09.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.418+0000 7f76de82a640 1 -- 172.21.15.86:0/3305086960 reap_dead start 2024-09-19T06:44:09.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.418+0000 7f76de82a640 1 --2- 172.21.15.86:0/3305086960 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76c40051c0 0x7f76c400b9c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f76d0002000 tx=0x7f76c4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bda116b73f33473f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:09.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.419+0000 7f76dd027640 1 -- 172.21.15.86:0/3305086960 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d0001c20 con 0x7f76c40051c0 2024-09-19T06:44:09.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.419+0000 7f76dd027640 1 -- 172.21.15.86:0/3305086960 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76d0003b70 con 0x7f76c40051c0 2024-09-19T06:44:09.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.419+0000 7f76dd027640 1 -- 172.21.15.86:0/3305086960 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d00050d0 con 0x7f76c40051c0 2024-09-19T06:44:09.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.420+0000 7f76e028d640 1 -- 172.21.15.86:0/3305086960 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76c40051c0 msgr2=0x7f76c400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:09.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.420+0000 7f76e028d640 1 --2- 172.21.15.86:0/3305086960 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76c40051c0 0x7f76c400b9c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f76d0002000 tx=0x7f76c4005830 comp rx=0 tx=0).stop 2024-09-19T06:44:09.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.420+0000 7f76e028d640 1 -- 172.21.15.86:0/3305086960 shutdown_connections 2024-09-19T06:44:09.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.420+0000 7f76e028d640 1 --2- 172.21.15.86:0/3305086960 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76c40051c0 0x7f76c400b9c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:09.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.420+0000 7f76e028d640 1 -- 172.21.15.86:0/3305086960 >> 172.21.15.86:0/3305086960 conn(0x7f76d80c9280 msgr2=0x7f76d80c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:09.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.421+0000 7f76e028d640 1 -- 172.21.15.86:0/3305086960 shutdown_connections 2024-09-19T06:44:09.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.421+0000 7f76e028d640 1 -- 172.21.15.86:0/3305086960 wait complete. 2024-09-19T06:44:09.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.423+0000 7f76e028d640 1 Processor -- start 2024-09-19T06:44:09.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.423+0000 7f76e028d640 1 -- start start 2024-09-19T06:44:09.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.424+0000 7f76e028d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76c40051c0 0x7f76d8148b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:09.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.424+0000 7f76e028d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76d8145fb0 0x7f76d8140c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:09.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.424+0000 7f76dd828640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76d8145fb0 0x7f76d8140c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:09.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.424+0000 7f76dd828640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76d8145fb0 0x7f76d8140c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41624/0 (socket says 172.21.15.86:41624) 2024-09-19T06:44:09.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.424+0000 7f76dd828640 1 -- 172.21.15.86:0/8945647 learned_addr learned my addr 172.21.15.86:0/8945647 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:09.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.424+0000 7f76e028d640 1 --2- 172.21.15.86:0/8945647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76d8140220 0x7f76d813efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:09.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.424+0000 7f76e028d640 1 -- 172.21.15.86:0/8945647 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f76d80c79f0 con 0x7f76d8145fb0 2024-09-19T06:44:09.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.424+0000 7f76e028d640 1 -- 172.21.15.86:0/8945647 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f76d806d4c0 con 0x7f76d8140220 2024-09-19T06:44:09.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.424+0000 7f76e028d640 1 -- 172.21.15.86:0/8945647 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f76d80c7b70 con 0x7f76c40051c0 2024-09-19T06:44:09.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.425+0000 7f76dd828640 1 -- 172.21.15.86:0/8945647 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76c40051c0 msgr2=0x7f76d8148b70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:44:09.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.425+0000 7f76dd828640 1 --2- 172.21.15.86:0/8945647 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76c40051c0 0x7f76d8148b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:09.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.425+0000 7f76dd828640 1 -- 172.21.15.86:0/8945647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76d8140220 msgr2=0x7f76d813efe0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:44:09.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.425+0000 7f76dd828640 1 --2- 172.21.15.86:0/8945647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76d8140220 0x7f76d813efe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:09.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.425+0000 7f76dd828640 1 -- 172.21.15.86:0/8945647 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d81f9160 con 0x7f76d8145fb0 2024-09-19T06:44:09.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.425+0000 7f76dd828640 1 --2- 172.21.15.86:0/8945647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76d8145fb0 0x7f76d8140c20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f76d40076b0 tx=0x7f76d400f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:09.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.426+0000 7f76ceffd640 1 -- 172.21.15.86:0/8945647 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d401a070 con 0x7f76d8145fb0 2024-09-19T06:44:09.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.426+0000 7f76ceffd640 1 -- 172.21.15.86:0/8945647 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76d4001520 con 0x7f76d8145fb0 2024-09-19T06:44:09.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.426+0000 7f76ceffd640 1 -- 172.21.15.86:0/8945647 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d4012350 con 0x7f76d8145fb0 2024-09-19T06:44:09.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.426+0000 7f76e028d640 1 -- 172.21.15.86:0/8945647 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d81f51c0 con 0x7f76d8145fb0 2024-09-19T06:44:09.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.428+0000 7f76ceffd640 1 -- 172.21.15.86:0/8945647 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f76d401d070 con 0x7f76d8145fb0 2024-09-19T06:44:09.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.429+0000 7f76ceffd640 1 --2- 172.21.15.86:0/8945647 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f76bc06c330 0x7f76bc06e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:09.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.429+0000 7f76e028d640 1 -- 172.21.15.86:0/8945647 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d81f5780 con 0x7f76d8145fb0 2024-09-19T06:44:09.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.430+0000 7f76ceffd640 1 -- 172.21.15.86:0/8945647 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7079+0+0 (secure 0 0 0) 0x7f76d4056e70 con 0x7f76d8145fb0 2024-09-19T06:44:09.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.430+0000 7f76de029640 1 --2- 172.21.15.86:0/8945647 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f76bc06c330 0x7f76bc06e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:09.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.431+0000 7f76de029640 1 --2- 172.21.15.86:0/8945647 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f76bc06c330 0x7f76bc06e7f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f76d8051790 tx=0x7f76c8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:09.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.431+0000 7f76ccff9640 1 -- 172.21.15.86:0/8945647 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76d8149730 con 0x7f76d8145fb0 2024-09-19T06:44:09.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.465+0000 7f76ceffd640 1 -- 172.21.15.86:0/8945647 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f76d40594d0 con 0x7f76d8145fb0 2024-09-19T06:44:09.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.973+0000 7f76ccff9640 1 -- 172.21.15.86:0/8945647 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76d80cb5f0 con 0x7f76d8145fb0 2024-09-19T06:44:09.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.974+0000 7f76ceffd640 1 -- 172.21.15.86:0/8945647 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6051 (secure 0 0 0) 0x7f76d4058dd0 con 0x7f76d8145fb0 2024-09-19T06:44:09.978 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:44:09.978 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":26,"btime":"2024-09-19T06:44:05:578959+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:05.377142+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"d","rank":0,"incarnation":25,"state":"up:reconnect","state_seq":26,"addr":"172.21.15.169:6837/3116130916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":3116130916},{"type":"v1","addr":"172.21.15.169:6837","nonce":3116130916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:44:09.978 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 26 2024-09-19T06:44:09.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.980+0000 7f76e028d640 1 -- 172.21.15.86:0/8945647 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f76bc06c330 msgr2=0x7f76bc06e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:09.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.981+0000 7f76e028d640 1 --2- 172.21.15.86:0/8945647 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f76bc06c330 0x7f76bc06e7f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f76d8051790 tx=0x7f76c8009190 comp rx=0 tx=0).stop 2024-09-19T06:44:09.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.981+0000 7f76e028d640 1 -- 172.21.15.86:0/8945647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76d8145fb0 msgr2=0x7f76d8140c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:09.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.981+0000 7f76e028d640 1 --2- 172.21.15.86:0/8945647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76d8145fb0 0x7f76d8140c20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f76d40076b0 tx=0x7f76d400f5a0 comp rx=0 tx=0).stop 2024-09-19T06:44:09.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.981+0000 7f76e028d640 1 -- 172.21.15.86:0/8945647 shutdown_connections 2024-09-19T06:44:09.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.981+0000 7f76e028d640 1 --2- 172.21.15.86:0/8945647 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f76bc06c330 0x7f76bc06e7f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:09.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.981+0000 7f76e028d640 1 --2- 172.21.15.86:0/8945647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76d8140220 0x7f76d813efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:09.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.981+0000 7f76e028d640 1 --2- 172.21.15.86:0/8945647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76d8145fb0 0x7f76d8140c20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:09.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.981+0000 7f76e028d640 1 --2- 172.21.15.86:0/8945647 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76c40051c0 0x7f76d8148b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:09.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.981+0000 7f76e028d640 1 -- 172.21.15.86:0/8945647 >> 172.21.15.86:0/8945647 conn(0x7f76d80c9280 msgr2=0x7f76d806ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:09.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.981+0000 7f76e028d640 1 -- 172.21.15.86:0/8945647 shutdown_connections 2024-09-19T06:44:09.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:09.981+0000 7f76e028d640 1 -- 172.21.15.86:0/8945647 wait complete. 2024-09-19T06:44:10.002 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "btime": "2024-09-19T06:44:05:578959+0000", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 26, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-19T06:37:08.763572+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 26, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4718": { "addr": "172.21.15.169:6837/3116130916", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6836", "nonce": 3116130916, "type": "v2" }, { "addr": "172.21.15.169:6837", "nonce": 3116130916, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4718, "incarnation": 25, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:reconnect", "state_seq": 26 } }, "last_failure": 0, "last_failure_osd_epoch": 32, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-09-19T06:44:05.377142+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4718 } } } ], "standbys": [ { "addr": "172.21.15.86:6837/728803297", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6835", "nonce": 728803297, "type": "v2" }, { "addr": "172.21.15.86:6837", "nonce": 728803297, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4247, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.169:6835/2537509253", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6833", "nonce": 2537509253, "type": "v2" }, { "addr": "172.21.15.169:6835", "nonce": 2537509253, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4262, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.169:6834/1723647527", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6832", "nonce": 1723647527, "type": "v2" }, { "addr": "172.21.15.169:6834", "nonce": 1723647527, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4265, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.86:6836/4135959816", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6834", "nonce": 4135959816, "type": "v2" }, { "addr": "172.21.15.86:6836", "nonce": 4135959816, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4270, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-09-19T06:44:12.003 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:44:12.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.181+0000 7f5a24aa5640 1 Processor -- start 2024-09-19T06:44:12.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.181+0000 7f5a24aa5640 1 -- start start 2024-09-19T06:44:12.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.183+0000 7f5a24aa5640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5a200c8950 0x7f5a200708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:12.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.183+0000 7f5a24aa5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a200c5810 0x7f5a2015f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:12.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.183+0000 7f5a24aa5640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a20163900 con 0x7f5a20070df0 2024-09-19T06:44:12.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.183+0000 7f5a24aa5640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f5a201603b0 con 0x7f5a200c8950 2024-09-19T06:44:12.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.183+0000 7f5a24aa5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5a201600d0 con 0x7f5a200c5810 2024-09-19T06:44:12.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.183+0000 7f5a1dd9b640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f5a20070df0 0x7f5a20073840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:47392/0 (socket says 172.21.15.86:47392) 2024-09-19T06:44:12.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.183+0000 7f5a1dd9b640 1 -- 172.21.15.86:0/1462268677 learned_addr learned my addr 172.21.15.86:0/1462268677 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:44:12.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.183+0000 7f5a1ed9d640 1 --2- 172.21.15.86:0/1462268677 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a200c5810 0x7f5a2015f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:12.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.184+0000 7f5a1ed9d640 1 -- 172.21.15.86:0/1462268677 >> v2:172.21.15.86:3300/0 conn(0x7f5a200c8950 msgr2=0x7f5a200708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:12.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.184+0000 7f5a1ed9d640 1 --2- 172.21.15.86:0/1462268677 >> v2:172.21.15.86:3300/0 conn(0x7f5a200c8950 0x7f5a200708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:12.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.184+0000 7f5a1ed9d640 1 -- 172.21.15.86:0/1462268677 >> v1:172.21.15.86:6789/0 conn(0x7f5a20070df0 legacy=0x7f5a20073840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:12.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.184+0000 7f5a1ed9d640 1 -- 172.21.15.86:0/1462268677 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a20162b40 con 0x7f5a200c5810 2024-09-19T06:44:12.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.185+0000 7f5a1ed9d640 1 --2- 172.21.15.86:0/1462268677 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a200c5810 0x7f5a2015f420 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5a100097a0 tx=0x7f5a1002a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c2d51abf5e55055 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:12.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.186+0000 7f5a1d59a640 1 -- 172.21.15.86:0/1462268677 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a10037070 con 0x7f5a200c5810 2024-09-19T06:44:12.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.186+0000 7f5a1d59a640 1 -- 172.21.15.86:0/1462268677 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a1002ad10 con 0x7f5a200c5810 2024-09-19T06:44:12.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.186+0000 7f5a1d59a640 1 -- 172.21.15.86:0/1462268677 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a10032660 con 0x7f5a200c5810 2024-09-19T06:44:12.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.187+0000 7f5a24aa5640 1 -- 172.21.15.86:0/1462268677 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a200c5810 msgr2=0x7f5a2015f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:12.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.187+0000 7f5a24aa5640 1 --2- 172.21.15.86:0/1462268677 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a200c5810 0x7f5a2015f420 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5a100097a0 tx=0x7f5a1002a080 comp rx=0 tx=0).stop 2024-09-19T06:44:12.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.193+0000 7f5a24aa5640 1 -- 172.21.15.86:0/1462268677 shutdown_connections 2024-09-19T06:44:12.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.193+0000 7f5a24aa5640 1 --2- 172.21.15.86:0/1462268677 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a200c5810 0x7f5a2015f420 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:12.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.193+0000 7f5a24aa5640 1 --2- 172.21.15.86:0/1462268677 >> v2:172.21.15.86:3300/0 conn(0x7f5a200c8950 0x7f5a200708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:12.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.193+0000 7f5a24aa5640 1 -- 172.21.15.86:0/1462268677 >> 172.21.15.86:0/1462268677 conn(0x7f5a20067890 msgr2=0x7f5a20067c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:12.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.197+0000 7f5a24aa5640 1 -- 172.21.15.86:0/1462268677 shutdown_connections 2024-09-19T06:44:12.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.198+0000 7f5a24aa5640 1 -- 172.21.15.86:0/1462268677 wait complete. 2024-09-19T06:44:12.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.200+0000 7f5a24aa5640 1 Processor -- start 2024-09-19T06:44:12.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.200+0000 7f5a24aa5640 1 -- start start 2024-09-19T06:44:12.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.201+0000 7f5a24aa5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a20070df0 0x7f5a20153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:12.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.201+0000 7f5a24aa5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a200c5810 0x7f5a2014ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:12.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.201+0000 7f5a24aa5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a200c8950 0x7f5a201f4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:12.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.201+0000 7f5a24aa5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5a200c8d30 con 0x7f5a200c5810 2024-09-19T06:44:12.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.201+0000 7f5a24aa5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5a20163100 con 0x7f5a200c8950 2024-09-19T06:44:12.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.201+0000 7f5a24aa5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5a200c8eb0 con 0x7f5a20070df0 2024-09-19T06:44:12.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.201+0000 7f5a1ed9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a200c8950 0x7f5a201f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:12.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.201+0000 7f5a1ed9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a200c8950 0x7f5a201f4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:37322/0 (socket says 172.21.15.86:37322) 2024-09-19T06:44:12.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.201+0000 7f5a1ed9d640 1 -- 172.21.15.86:0/2666778412 learned_addr learned my addr 172.21.15.86:0/2666778412 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:12.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.201+0000 7f5a1dd9b640 1 --2- 172.21.15.86:0/2666778412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a200c5810 0x7f5a2014ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:12.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.202+0000 7f5a1e59c640 1 --2- 172.21.15.86:0/2666778412 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a20070df0 0x7f5a20153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:12.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.202+0000 7f5a1ed9d640 1 -- 172.21.15.86:0/2666778412 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a20070df0 msgr2=0x7f5a20153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:12.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.202+0000 7f5a1ed9d640 1 --2- 172.21.15.86:0/2666778412 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a20070df0 0x7f5a20153b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:12.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.202+0000 7f5a1ed9d640 1 -- 172.21.15.86:0/2666778412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a200c5810 msgr2=0x7f5a2014ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:12.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.202+0000 7f5a1ed9d640 1 --2- 172.21.15.86:0/2666778412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a200c5810 0x7f5a2014ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:12.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.202+0000 7f5a1ed9d640 1 -- 172.21.15.86:0/2666778412 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a2014b2a0 con 0x7f5a200c8950 2024-09-19T06:44:12.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.202+0000 7f5a1dd9b640 1 --2- 172.21.15.86:0/2666778412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a200c5810 0x7f5a2014ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:44:12.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.204+0000 7f5a1ed9d640 1 --2- 172.21.15.86:0/2666778412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a200c8950 0x7f5a201f4750 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5a100098c0 tx=0x7f5a100046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:12.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.207+0000 7f5a0effd640 1 -- 172.21.15.86:0/2666778412 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a10037040 con 0x7f5a200c8950 2024-09-19T06:44:12.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.207+0000 7f5a0effd640 1 -- 172.21.15.86:0/2666778412 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a10004230 con 0x7f5a200c8950 2024-09-19T06:44:12.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.208+0000 7f5a0effd640 1 -- 172.21.15.86:0/2666778412 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a10003610 con 0x7f5a200c8950 2024-09-19T06:44:12.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.209+0000 7f5a24aa5640 1 -- 172.21.15.86:0/2666778412 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a201545b0 con 0x7f5a200c8950 2024-09-19T06:44:12.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.209+0000 7f5a24aa5640 1 -- 172.21.15.86:0/2666778412 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a20154b70 con 0x7f5a200c8950 2024-09-19T06:44:12.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.211+0000 7f5a24aa5640 1 -- 172.21.15.86:0/2666778412 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a200708b0 con 0x7f5a200c8950 2024-09-19T06:44:12.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.212+0000 7f5a0effd640 1 -- 172.21.15.86:0/2666778412 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5a100037b0 con 0x7f5a200c8950 2024-09-19T06:44:12.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.213+0000 7f5a0effd640 1 --2- 172.21.15.86:0/2666778412 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5a0006c380 0x7f5a0006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:12.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.213+0000 7f5a0effd640 1 -- 172.21.15.86:0/2666778412 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7079+0+0 (secure 0 0 0) 0x7f5a100ac680 con 0x7f5a200c8950 2024-09-19T06:44:12.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.214+0000 7f5a1e59c640 1 --2- 172.21.15.86:0/2666778412 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5a0006c380 0x7f5a0006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:12.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.218+0000 7f5a1e59c640 1 --2- 172.21.15.86:0/2666778412 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5a0006c380 0x7f5a0006e840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5a18007e10 tx=0x7f5a180072f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:12.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.224+0000 7f5a0effd640 1 -- 172.21.15.86:0/2666778412 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5a1007aa20 con 0x7f5a200c8950 2024-09-19T06:44:12.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.638+0000 7f5a24aa5640 1 -- 172.21.15.86:0/2666778412 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a201625e0 con 0x7f5a200c8950 2024-09-19T06:44:12.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.644+0000 7f5a0effd640 1 -- 172.21.15.86:0/2666778412 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+6048 (secure 0 0 0) 0x7f5a1007a320 con 0x7f5a200c8950 2024-09-19T06:44:12.647 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:44:12.647 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":27,"btime":"2024-09-19T06:44:10:624628+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:10.590466+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"d","rank":0,"incarnation":25,"state":"up:rejoin","state_seq":28,"addr":"172.21.15.169:6837/3116130916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":3116130916},{"type":"v1","addr":"172.21.15.169:6837","nonce":3116130916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:44:12.648 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 27 2024-09-19T06:44:12.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.650+0000 7f5a24aa5640 1 -- 172.21.15.86:0/2666778412 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5a0006c380 msgr2=0x7f5a0006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:12.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.650+0000 7f5a24aa5640 1 --2- 172.21.15.86:0/2666778412 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5a0006c380 0x7f5a0006e840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5a18007e10 tx=0x7f5a180072f0 comp rx=0 tx=0).stop 2024-09-19T06:44:12.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.650+0000 7f5a24aa5640 1 -- 172.21.15.86:0/2666778412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a200c8950 msgr2=0x7f5a201f4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:12.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.650+0000 7f5a24aa5640 1 --2- 172.21.15.86:0/2666778412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a200c8950 0x7f5a201f4750 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5a100098c0 tx=0x7f5a100046c0 comp rx=0 tx=0).stop 2024-09-19T06:44:12.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.654+0000 7f5a24aa5640 1 -- 172.21.15.86:0/2666778412 shutdown_connections 2024-09-19T06:44:12.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.654+0000 7f5a24aa5640 1 --2- 172.21.15.86:0/2666778412 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5a0006c380 0x7f5a0006e840 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:12.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.654+0000 7f5a24aa5640 1 --2- 172.21.15.86:0/2666778412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a200c8950 0x7f5a201f4750 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:12.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.654+0000 7f5a24aa5640 1 --2- 172.21.15.86:0/2666778412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a200c5810 0x7f5a2014ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:12.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.654+0000 7f5a24aa5640 1 --2- 172.21.15.86:0/2666778412 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a20070df0 0x7f5a20153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:12.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.654+0000 7f5a24aa5640 1 -- 172.21.15.86:0/2666778412 >> 172.21.15.86:0/2666778412 conn(0x7f5a20067890 msgr2=0x7f5a200cab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:12.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.655+0000 7f5a24aa5640 1 -- 172.21.15.86:0/2666778412 shutdown_connections 2024-09-19T06:44:12.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:12.656+0000 7f5a24aa5640 1 -- 172.21.15.86:0/2666778412 wait complete. 2024-09-19T06:44:12.677 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:44:14.678 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:44:14.865 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.864+0000 7f2c893e4640 1 Processor -- start 2024-09-19T06:44:14.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.864+0000 7f2c893e4640 1 -- start start 2024-09-19T06:44:14.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.865+0000 7f2c893e4640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2c840c8450 0x7f2c84157b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:14.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.865+0000 7f2c893e4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c840c8830 0x7f2c840c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:14.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.865+0000 7f2c893e4640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2c8406cc60 0x7f2c8406d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:14.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.865+0000 7f2c893e4640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f2c84071200 con 0x7f2c840c8450 2024-09-19T06:44:14.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.865+0000 7f2c893e4640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f2c841580a0 con 0x7f2c8406cc60 2024-09-19T06:44:14.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.865+0000 7f2c893e4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2c840c7e30 con 0x7f2c840c8830 2024-09-19T06:44:14.868 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.866+0000 7f2c837fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2c8406cc60 0x7f2c8406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:14.868 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.866+0000 7f2c837fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2c8406cc60 0x7f2c8406d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:37328/0 (socket says 172.21.15.86:37328) 2024-09-19T06:44:14.868 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.866+0000 7f2c837fe640 1 -- 172.21.15.86:0/660454063 learned_addr learned my addr 172.21.15.86:0/660454063 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:14.868 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.866+0000 7f2c827fc640 1 --2- 172.21.15.86:0/660454063 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c840c8830 0x7f2c840c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:14.868 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.866+0000 7f2c82ffd640 1 --2- 172.21.15.86:0/660454063 >> v2:172.21.15.86:3300/0 conn(0x7f2c840c8450 0x7f2c84157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:14.868 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.866+0000 7f2c82ffd640 1 -- 172.21.15.86:0/660454063 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c840c8830 msgr2=0x7f2c840c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:14.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.866+0000 7f2c82ffd640 1 --2- 172.21.15.86:0/660454063 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c840c8830 0x7f2c840c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:14.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.866+0000 7f2c82ffd640 1 -- 172.21.15.86:0/660454063 >> v2:172.21.15.169:3300/0 conn(0x7f2c8406cc60 msgr2=0x7f2c8406d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:14.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.866+0000 7f2c82ffd640 1 --2- 172.21.15.86:0/660454063 >> v2:172.21.15.169:3300/0 conn(0x7f2c8406cc60 0x7f2c8406d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:14.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.866+0000 7f2c82ffd640 1 -- 172.21.15.86:0/660454063 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c8406bbc0 con 0x7f2c840c8450 2024-09-19T06:44:14.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.867+0000 7f2c82ffd640 1 --2- 172.21.15.86:0/660454063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c840c8450 0x7f2c84157b60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2c840c3b30 tx=0x7f2c7c03b0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c0eaa263d5b1d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:14.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.869+0000 7f2c81ffb640 1 -- 172.21.15.86:0/660454063 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c03be40 con 0x7f2c840c8450 2024-09-19T06:44:14.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.869+0000 7f2c81ffb640 1 -- 172.21.15.86:0/660454063 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c7c0110d0 con 0x7f2c840c8450 2024-09-19T06:44:14.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.869+0000 7f2c81ffb640 1 -- 172.21.15.86:0/660454063 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c011480 con 0x7f2c840c8450 2024-09-19T06:44:14.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.870+0000 7f2c893e4640 1 -- 172.21.15.86:0/660454063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c840c8450 msgr2=0x7f2c84157b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:14.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.870+0000 7f2c893e4640 1 --2- 172.21.15.86:0/660454063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c840c8450 0x7f2c84157b60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2c840c3b30 tx=0x7f2c7c03b0f0 comp rx=0 tx=0).stop 2024-09-19T06:44:14.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.870+0000 7f2c893e4640 1 -- 172.21.15.86:0/660454063 shutdown_connections 2024-09-19T06:44:14.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.870+0000 7f2c893e4640 1 --2- 172.21.15.86:0/660454063 >> v2:172.21.15.169:3300/0 conn(0x7f2c8406cc60 0x7f2c8406d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:14.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.870+0000 7f2c893e4640 1 --2- 172.21.15.86:0/660454063 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c840c8830 0x7f2c840c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:14.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.870+0000 7f2c893e4640 1 --2- 172.21.15.86:0/660454063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c840c8450 0x7f2c84157b60 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:14.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.870+0000 7f2c893e4640 1 -- 172.21.15.86:0/660454063 >> 172.21.15.86:0/660454063 conn(0x7f2c840c9280 msgr2=0x7f2c840c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:14.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.870+0000 7f2c893e4640 1 -- 172.21.15.86:0/660454063 shutdown_connections 2024-09-19T06:44:14.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.870+0000 7f2c893e4640 1 -- 172.21.15.86:0/660454063 wait complete. 2024-09-19T06:44:14.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.872+0000 7f2c893e4640 1 Processor -- start 2024-09-19T06:44:14.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.872+0000 7f2c893e4640 1 -- start start 2024-09-19T06:44:14.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.874+0000 7f2c893e4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c8406cc60 0x7f2c8414e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:14.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.874+0000 7f2c893e4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c840c8450 0x7f2c8414aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:14.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.874+0000 7f2c893e4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c840c8830 0x7f2c8414b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:14.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.874+0000 7f2c893e4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8406c460 con 0x7f2c840c8450 2024-09-19T06:44:14.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.874+0000 7f2c893e4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8406c180 con 0x7f2c8406cc60 2024-09-19T06:44:14.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.874+0000 7f2c893e4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2c840c79f0 con 0x7f2c840c8830 2024-09-19T06:44:14.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.874+0000 7f2c82ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c8406cc60 0x7f2c8414e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:14.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.874+0000 7f2c82ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c8406cc60 0x7f2c8414e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:37340/0 (socket says 172.21.15.86:37340) 2024-09-19T06:44:14.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.874+0000 7f2c82ffd640 1 -- 172.21.15.86:0/574851043 learned_addr learned my addr 172.21.15.86:0/574851043 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:14.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.874+0000 7f2c837fe640 1 --2- 172.21.15.86:0/574851043 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c840c8830 0x7f2c8414b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:14.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.874+0000 7f2c827fc640 1 --2- 172.21.15.86:0/574851043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c840c8450 0x7f2c8414aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:14.878 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.875+0000 7f2c82ffd640 1 -- 172.21.15.86:0/574851043 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c840c8830 msgr2=0x7f2c8414b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:14.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.875+0000 7f2c82ffd640 1 --2- 172.21.15.86:0/574851043 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c840c8830 0x7f2c8414b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:14.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.875+0000 7f2c82ffd640 1 -- 172.21.15.86:0/574851043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c840c8450 msgr2=0x7f2c8414aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:14.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.875+0000 7f2c82ffd640 1 --2- 172.21.15.86:0/574851043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c840c8450 0x7f2c8414aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:14.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.875+0000 7f2c82ffd640 1 -- 172.21.15.86:0/574851043 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c840734e0 con 0x7f2c8406cc60 2024-09-19T06:44:14.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.875+0000 7f2c837fe640 1 --2- 172.21.15.86:0/574851043 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c840c8830 0x7f2c8414b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:44:14.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.875+0000 7f2c82ffd640 1 --2- 172.21.15.86:0/574851043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c8406cc60 0x7f2c8414e5b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c013140 tx=0x7f2c7c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:14.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.875+0000 7f2c7b7fe640 1 -- 172.21.15.86:0/574851043 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c052020 con 0x7f2c8406cc60 2024-09-19T06:44:14.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.876+0000 7f2c893e4640 1 -- 172.21.15.86:0/574851043 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c8414c4f0 con 0x7f2c8406cc60 2024-09-19T06:44:14.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.876+0000 7f2c893e4640 1 -- 172.21.15.86:0/574851043 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c840723a0 con 0x7f2c8406cc60 2024-09-19T06:44:14.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.877+0000 7f2c893e4640 1 -- 172.21.15.86:0/574851043 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c840c9da0 con 0x7f2c8406cc60 2024-09-19T06:44:14.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.877+0000 7f2c7b7fe640 1 -- 172.21.15.86:0/574851043 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c7c04d660 con 0x7f2c8406cc60 2024-09-19T06:44:14.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.877+0000 7f2c7b7fe640 1 -- 172.21.15.86:0/574851043 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c04da30 con 0x7f2c8406cc60 2024-09-19T06:44:14.884 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.882+0000 7f2c7b7fe640 1 -- 172.21.15.86:0/574851043 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2c7c055020 con 0x7f2c8406cc60 2024-09-19T06:44:14.884 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.882+0000 7f2c7b7fe640 1 --2- 172.21.15.86:0/574851043 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2c6406c2b0 0x7f2c6406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:14.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.883+0000 7f2c7b7fe640 1 -- 172.21.15.86:0/574851043 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7079+0+0 (secure 0 0 0) 0x7f2c7c0bd6a0 con 0x7f2c8406cc60 2024-09-19T06:44:14.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.883+0000 7f2c827fc640 1 --2- 172.21.15.86:0/574851043 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2c6406c2b0 0x7f2c6406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:14.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.883+0000 7f2c827fc640 1 --2- 172.21.15.86:0/574851043 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2c6406c2b0 0x7f2c6406e770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c00d440 tx=0x7f2c6c00f040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:14.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:14.886+0000 7f2c7b7fe640 1 -- 172.21.15.86:0/574851043 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2c7c05c030 con 0x7f2c8406cc60 2024-09-19T06:44:15.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:15.306+0000 7f2c893e4640 1 -- 172.21.15.86:0/574851043 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c840c8d30 con 0x7f2c8406cc60 2024-09-19T06:44:15.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:15.307+0000 7f2c7b7fe640 1 -- 172.21.15.86:0/574851043 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+6048 (secure 0 0 0) 0x7f2c7c08b4b0 con 0x7f2c8406cc60 2024-09-19T06:44:15.310 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:44:15.310 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":27,"btime":"2024-09-19T06:44:10:624628+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:10.590466+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"d","rank":0,"incarnation":25,"state":"up:rejoin","state_seq":28,"addr":"172.21.15.169:6837/3116130916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":3116130916},{"type":"v1","addr":"172.21.15.169:6837","nonce":3116130916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:44:15.310 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 27 2024-09-19T06:44:15.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:15.312+0000 7f2c893e4640 1 -- 172.21.15.86:0/574851043 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2c6406c2b0 msgr2=0x7f2c6406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:15.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:15.312+0000 7f2c893e4640 1 --2- 172.21.15.86:0/574851043 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2c6406c2b0 0x7f2c6406e770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c00d440 tx=0x7f2c6c00f040 comp rx=0 tx=0).stop 2024-09-19T06:44:15.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:15.312+0000 7f2c893e4640 1 -- 172.21.15.86:0/574851043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c8406cc60 msgr2=0x7f2c8414e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:15.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:15.312+0000 7f2c893e4640 1 --2- 172.21.15.86:0/574851043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c8406cc60 0x7f2c8414e5b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c013140 tx=0x7f2c7c0046c0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:15.313+0000 7f2c893e4640 1 -- 172.21.15.86:0/574851043 shutdown_connections 2024-09-19T06:44:15.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:15.313+0000 7f2c893e4640 1 --2- 172.21.15.86:0/574851043 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2c6406c2b0 0x7f2c6406e770 secure :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c00d440 tx=0x7f2c6c00f040 comp rx=0 tx=0).stop 2024-09-19T06:44:15.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:15.313+0000 7f2c893e4640 1 --2- 172.21.15.86:0/574851043 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c840c8830 0x7f2c8414b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:15.313+0000 7f2c893e4640 1 --2- 172.21.15.86:0/574851043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c840c8450 0x7f2c8414aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:15.313+0000 7f2c893e4640 1 --2- 172.21.15.86:0/574851043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c8406cc60 0x7f2c8414e5b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:15.313+0000 7f2c893e4640 1 -- 172.21.15.86:0/574851043 >> 172.21.15.86:0/574851043 conn(0x7f2c840c9280 msgr2=0x7f2c8414f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:15.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:15.318+0000 7f2c893e4640 1 -- 172.21.15.86:0/574851043 shutdown_connections 2024-09-19T06:44:15.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:15.322+0000 7f2c893e4640 1 -- 172.21.15.86:0/574851043 wait complete. 2024-09-19T06:44:15.344 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:44:17.344 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:44:17.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.524+0000 7fa5fec20640 1 Processor -- start 2024-09-19T06:44:17.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.524+0000 7fa5fec20640 1 -- start start 2024-09-19T06:44:17.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.525+0000 7fa5fec20640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa5f00dce90 0x7fa5f0005a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:17.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.525+0000 7fa5fec20640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5f00e6030 0x7fa5f00e6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:17.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.526+0000 7fa5fe41f640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5f00e6030 0x7fa5f00e6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:17.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.526+0000 7fa5fe41f640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5f00e6030 0x7fa5f00e6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57312/0 (socket says 172.21.15.86:57312) 2024-09-19T06:44:17.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.526+0000 7fa5fd41d640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa5f004aa40 0x7fa5f0046390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:47396/0 (socket says 172.21.15.86:47396) 2024-09-19T06:44:17.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.526+0000 7fa5fe41f640 1 -- 172.21.15.86:0/1532533018 learned_addr learned my addr 172.21.15.86:0/1532533018 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:17.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.526+0000 7fa5fec20640 1 -- 172.21.15.86:0/1532533018 --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5f00e6ae0 con 0x7fa5f004aa40 2024-09-19T06:44:17.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.526+0000 7fa5fec20640 1 -- 172.21.15.86:0/1532533018 --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fa5f0045660 con 0x7fa5f00e6030 2024-09-19T06:44:17.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.526+0000 7fa5fec20640 1 -- 172.21.15.86:0/1532533018 --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fa5f0045f00 con 0x7fa5f00dce90 2024-09-19T06:44:17.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.527+0000 7fa5fe41f640 1 -- 172.21.15.86:0/1532533018 >> v2:172.21.15.169:3300/0 conn(0x7fa5f00dce90 msgr2=0x7fa5f0005a00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:44:17.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.527+0000 7fa5fe41f640 1 --2- 172.21.15.86:0/1532533018 >> v2:172.21.15.169:3300/0 conn(0x7fa5f00dce90 0x7fa5f0005a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.527+0000 7fa5fe41f640 1 -- 172.21.15.86:0/1532533018 >> v1:172.21.15.86:6789/0 conn(0x7fa5f004aa40 legacy=0x7fa5f0046390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:17.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.527+0000 7fa5fe41f640 1 -- 172.21.15.86:0/1532533018 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f00e6dc0 con 0x7fa5f00e6030 2024-09-19T06:44:17.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.528+0000 7fa5fe41f640 1 --2- 172.21.15.86:0/1532533018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f00e6030 0x7fa5f00e6480 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8050d60 tx=0x7fa5f80a7160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a796912afdd1b086 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:17.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.528+0000 7fa5fcc1c640 1 -- 172.21.15.86:0/1532533018 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80b4070 con 0x7fa5f00e6030 2024-09-19T06:44:17.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.529+0000 7fa5fcc1c640 1 -- 172.21.15.86:0/1532533018 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f80af440 con 0x7fa5f00e6030 2024-09-19T06:44:17.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.529+0000 7fa5fcc1c640 1 -- 172.21.15.86:0/1532533018 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80af8b0 con 0x7fa5f00e6030 2024-09-19T06:44:17.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.530+0000 7fa5fec20640 1 -- 172.21.15.86:0/1532533018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f00e6030 msgr2=0x7fa5f00e6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:17.532 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.530+0000 7fa5fec20640 1 --2- 172.21.15.86:0/1532533018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f00e6030 0x7fa5f00e6480 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8050d60 tx=0x7fa5f80a7160 comp rx=0 tx=0).stop 2024-09-19T06:44:17.532 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.531+0000 7fa5fec20640 1 -- 172.21.15.86:0/1532533018 shutdown_connections 2024-09-19T06:44:17.532 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.531+0000 7fa5fec20640 1 --2- 172.21.15.86:0/1532533018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f00e6030 0x7fa5f00e6480 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.532 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.531+0000 7fa5fec20640 1 --2- 172.21.15.86:0/1532533018 >> v2:172.21.15.169:3300/0 conn(0x7fa5f00dce90 0x7fa5f0005a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.532 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.531+0000 7fa5fec20640 1 -- 172.21.15.86:0/1532533018 >> 172.21.15.86:0/1532533018 conn(0x7fa5f004fc50 msgr2=0x7fa5f0050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:17.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.532+0000 7fa5fec20640 1 -- 172.21.15.86:0/1532533018 shutdown_connections 2024-09-19T06:44:17.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.533+0000 7fa5fec20640 1 -- 172.21.15.86:0/1532533018 wait complete. 2024-09-19T06:44:17.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.535+0000 7fa5fec20640 1 Processor -- start 2024-09-19T06:44:17.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.536+0000 7fa5fec20640 1 -- start start 2024-09-19T06:44:17.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.538+0000 7fa5fec20640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5f004aa40 0x7fa5f00dfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:17.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.538+0000 7fa5fec20640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5f00dce90 0x7fa5f0048cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:17.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.538+0000 7fa5fec20640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f00e6030 0x7fa5f0047ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:17.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.538+0000 7fa5fe41f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f00e6030 0x7fa5f0047ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:17.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.538+0000 7fa5fe41f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f00e6030 0x7fa5f0047ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57326/0 (socket says 172.21.15.86:57326) 2024-09-19T06:44:17.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.538+0000 7fa5fe41f640 1 -- 172.21.15.86:0/85832265 learned_addr learned my addr 172.21.15.86:0/85832265 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:17.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.538+0000 7fa5fdc1e640 1 --2- 172.21.15.86:0/85832265 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5f004aa40 0x7fa5f00dfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:17.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.538+0000 7fa5fec20640 1 -- 172.21.15.86:0/85832265 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f0045b90 con 0x7fa5f00e6030 2024-09-19T06:44:17.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.538+0000 7fa5fec20640 1 -- 172.21.15.86:0/85832265 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f00dd270 con 0x7fa5f00dce90 2024-09-19T06:44:17.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.539+0000 7fa5fec20640 1 -- 172.21.15.86:0/85832265 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa5f0044b30 con 0x7fa5f004aa40 2024-09-19T06:44:17.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.539+0000 7fa5fd41d640 1 --2- 172.21.15.86:0/85832265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5f00dce90 0x7fa5f0048cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:17.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.539+0000 7fa5fe41f640 1 -- 172.21.15.86:0/85832265 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5f004aa40 msgr2=0x7fa5f00dfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:17.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.539+0000 7fa5fe41f640 1 --2- 172.21.15.86:0/85832265 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5f004aa40 0x7fa5f00dfdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.539+0000 7fa5fe41f640 1 -- 172.21.15.86:0/85832265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5f00dce90 msgr2=0x7fa5f0048cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:17.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.539+0000 7fa5fe41f640 1 --2- 172.21.15.86:0/85832265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5f00dce90 0x7fa5f0048cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.539+0000 7fa5fe41f640 1 -- 172.21.15.86:0/85832265 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f00e0310 con 0x7fa5f00e6030 2024-09-19T06:44:17.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.540+0000 7fa5fdc1e640 1 --2- 172.21.15.86:0/85832265 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5f004aa40 0x7fa5f00dfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:44:17.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.540+0000 7fa5fe41f640 1 --2- 172.21.15.86:0/85832265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f00e6030 0x7fa5f0047ff0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa5f802dd50 tx=0x7fa5f806a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:17.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.540+0000 7fa5ee7fc640 1 -- 172.21.15.86:0/85832265 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80bc070 con 0x7fa5f00e6030 2024-09-19T06:44:17.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.541+0000 7fa5ee7fc640 1 -- 172.21.15.86:0/85832265 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f80aedc0 con 0x7fa5f00e6030 2024-09-19T06:44:17.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.541+0000 7fa5fec20640 1 -- 172.21.15.86:0/85832265 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f00d8f90 con 0x7fa5f00e6030 2024-09-19T06:44:17.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.543+0000 7fa5ee7fc640 1 -- 172.21.15.86:0/85832265 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80b4040 con 0x7fa5f00e6030 2024-09-19T06:44:17.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.543+0000 7fa5fec20640 1 -- 172.21.15.86:0/85832265 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f00498b0 con 0x7fa5f00e6030 2024-09-19T06:44:17.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.544+0000 7fa5ee7fc640 1 -- 172.21.15.86:0/85832265 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa5f80bf070 con 0x7fa5f00e6030 2024-09-19T06:44:17.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.551+0000 7fa5ee7fc640 1 --2- 172.21.15.86:0/85832265 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa5dc06c330 0x7fa5dc06e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:17.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.551+0000 7fa5ee7fc640 1 -- 172.21.15.86:0/85832265 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7079+0+0 (secure 0 0 0) 0x7fa5f8128060 con 0x7fa5f00e6030 2024-09-19T06:44:17.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.549+0000 7fa5fec20640 1 -- 172.21.15.86:0/85832265 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5f0044f50 con 0x7fa5f00e6030 2024-09-19T06:44:17.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.552+0000 7fa5fdc1e640 1 --2- 172.21.15.86:0/85832265 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa5dc06c330 0x7fa5dc06e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:17.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.552+0000 7fa5fdc1e640 1 --2- 172.21.15.86:0/85832265 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa5dc06c330 0x7fa5dc06e7f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400a8b0 tx=0x7fa5f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:17.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.561+0000 7fa5ee7fc640 1 -- 172.21.15.86:0/85832265 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa5f80f6260 con 0x7fa5f00e6030 2024-09-19T06:44:17.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.982+0000 7fa5fec20640 1 -- 172.21.15.86:0/85832265 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5f0046ab0 con 0x7fa5f00e6030 2024-09-19T06:44:17.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.983+0000 7fa5ee7fc640 1 -- 172.21.15.86:0/85832265 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+6055 (secure 0 0 0) 0x7fa5f80f5b60 con 0x7fa5f00e6030 2024-09-19T06:44:17.984 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:44:17.984 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":28,"btime":"2024-09-19T06:44:16:648721+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:16.648712+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"d","rank":0,"incarnation":25,"state":"up:active","state_seq":30,"addr":"172.21.15.169:6837/3116130916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":3116130916},{"type":"v1","addr":"172.21.15.169:6837","nonce":3116130916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4718,"qdb_cluster":[4718]},"id":1}]} 2024-09-19T06:44:17.985 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 28 2024-09-19T06:44:17.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.986+0000 7fa5fec20640 1 -- 172.21.15.86:0/85832265 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa5dc06c330 msgr2=0x7fa5dc06e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:17.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.986+0000 7fa5fec20640 1 --2- 172.21.15.86:0/85832265 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa5dc06c330 0x7fa5dc06e7f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400a8b0 tx=0x7fa5f4008040 comp rx=0 tx=0).stop 2024-09-19T06:44:17.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.986+0000 7fa5fec20640 1 -- 172.21.15.86:0/85832265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f00e6030 msgr2=0x7fa5f0047ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:17.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.986+0000 7fa5fec20640 1 --2- 172.21.15.86:0/85832265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f00e6030 0x7fa5f0047ff0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa5f802dd50 tx=0x7fa5f806a560 comp rx=0 tx=0).stop 2024-09-19T06:44:17.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.986+0000 7fa5fec20640 1 -- 172.21.15.86:0/85832265 shutdown_connections 2024-09-19T06:44:17.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.986+0000 7fa5fec20640 1 --2- 172.21.15.86:0/85832265 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa5dc06c330 0x7fa5dc06e7f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.986+0000 7fa5fec20640 1 --2- 172.21.15.86:0/85832265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f00e6030 0x7fa5f0047ff0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.986+0000 7fa5fec20640 1 --2- 172.21.15.86:0/85832265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5f00dce90 0x7fa5f0048cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.986+0000 7fa5fec20640 1 --2- 172.21.15.86:0/85832265 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5f004aa40 0x7fa5f00dfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.986+0000 7fa5fec20640 1 -- 172.21.15.86:0/85832265 >> 172.21.15.86:0/85832265 conn(0x7fa5f004fc50 msgr2=0x7fa5f0050030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:17.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.989+0000 7fa5fec20640 1 -- 172.21.15.86:0/85832265 shutdown_connections 2024-09-19T06:44:17.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:17.989+0000 7fa5fec20640 1 -- 172.21.15.86:0/85832265 wait complete. 2024-09-19T06:44:18.010 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d has gained rank=0, replacing gid=4998 2024-09-19T06:44:18.010 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 1 secs before reviving mds.e 2024-09-19T06:44:19.011 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.e 2024-09-19T06:44:19.011 INFO:tasks.ceph.mds.e:Restarting daemon 2024-09-19T06:44:19.011 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-09-19T06:44:19.016 INFO:tasks.ceph.mds.e:Started 2024-09-19T06:44:19.016 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:44:19.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.225+0000 7fc813fff640 1 Processor -- start 2024-09-19T06:44:19.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.225+0000 7fc813fff640 1 -- start start 2024-09-19T06:44:19.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.227+0000 7fc813fff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc80c04a680 0x7fc80c04aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:19.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.227+0000 7fc813fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc80c0e5f30 0x7fc80c0e63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:19.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.227+0000 7fc813fff640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc80c0e6d30 con 0x7fc80c0dcd90 2024-09-19T06:44:19.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.227+0000 7fc813fff640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fc80c044d40 con 0x7fc80c04a680 2024-09-19T06:44:19.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.227+0000 7fc813fff640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc80c0dd170 con 0x7fc80c0e5f30 2024-09-19T06:44:19.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.228+0000 7fc8127fc640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc80c04a680 0x7fc80c04aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:19.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.228+0000 7fc8127fc640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc80c04a680 0x7fc80c04aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:37358/0 (socket says 172.21.15.86:37358) 2024-09-19T06:44:19.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.228+0000 7fc8127fc640 1 -- 172.21.15.86:0/3636993878 learned_addr learned my addr 172.21.15.86:0/3636993878 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:19.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.229+0000 7fc8137fe640 1 --2- 172.21.15.86:0/3636993878 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc80c0e5f30 0x7fc80c0e63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:19.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.230+0000 7fc8127fc640 1 -- 172.21.15.86:0/3636993878 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc80c0e5f30 msgr2=0x7fc80c0e63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:19.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.230+0000 7fc8127fc640 1 --2- 172.21.15.86:0/3636993878 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc80c0e5f30 0x7fc80c0e63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:19.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.230+0000 7fc8127fc640 1 -- 172.21.15.86:0/3636993878 >> v1:172.21.15.86:6789/0 conn(0x7fc80c0dcd90 legacy=0x7fc80c045d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:19.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.230+0000 7fc8127fc640 1 -- 172.21.15.86:0/3636993878 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc80c044f90 con 0x7fc80c04a680 2024-09-19T06:44:19.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.235+0000 7fc8127fc640 1 --2- 172.21.15.86:0/3636993878 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc80c04a680 0x7fc80c04aab0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc808009870 tx=0x7fc80802a1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85138ef5f9d18928 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:19.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.235+0000 7fc811ffb640 1 -- 172.21.15.86:0/3636993878 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc808037070 con 0x7fc80c04a680 2024-09-19T06:44:19.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.235+0000 7fc811ffb640 1 -- 172.21.15.86:0/3636993878 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc808032440 con 0x7fc80c04a680 2024-09-19T06:44:19.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.235+0000 7fc811ffb640 1 -- 172.21.15.86:0/3636993878 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc808037070 con 0x7fc80c04a680 2024-09-19T06:44:19.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.237+0000 7fc813fff640 1 -- 172.21.15.86:0/3636993878 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc80c04a680 msgr2=0x7fc80c04aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:19.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.237+0000 7fc813fff640 1 --2- 172.21.15.86:0/3636993878 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc80c04a680 0x7fc80c04aab0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc808009870 tx=0x7fc80802a1f0 comp rx=0 tx=0).stop 2024-09-19T06:44:19.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.238+0000 7fc813fff640 1 -- 172.21.15.86:0/3636993878 shutdown_connections 2024-09-19T06:44:19.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.238+0000 7fc813fff640 1 --2- 172.21.15.86:0/3636993878 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc80c0e5f30 0x7fc80c0e63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:19.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.238+0000 7fc813fff640 1 --2- 172.21.15.86:0/3636993878 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc80c04a680 0x7fc80c04aab0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:19.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.238+0000 7fc813fff640 1 -- 172.21.15.86:0/3636993878 >> 172.21.15.86:0/3636993878 conn(0x7fc80c04fc50 msgr2=0x7fc80c050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:19.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.238+0000 7fc813fff640 1 -- 172.21.15.86:0/3636993878 shutdown_connections 2024-09-19T06:44:19.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.239+0000 7fc813fff640 1 -- 172.21.15.86:0/3636993878 wait complete. 2024-09-19T06:44:19.242 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.240+0000 7fc813fff640 1 Processor -- start 2024-09-19T06:44:19.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.242+0000 7fc813fff640 1 -- start start 2024-09-19T06:44:19.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.243+0000 7fc813fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc80c04a680 0x7fc80c0470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:19.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.243+0000 7fc813fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc80c0dcd90 0x7fc80c1849c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:19.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.243+0000 7fc813fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc80c0e5f30 0x7fc80c0e1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:19.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.243+0000 7fc813fff640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc80c045830 con 0x7fc80c0e5f30 2024-09-19T06:44:19.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.243+0000 7fc813fff640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc80c045550 con 0x7fc80c0dcd90 2024-09-19T06:44:19.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.243+0000 7fc813fff640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc80c0e2be0 con 0x7fc80c04a680 2024-09-19T06:44:19.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.243+0000 7fc8137fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc80c0e5f30 0x7fc80c0e1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:19.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.243+0000 7fc8137fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc80c0e5f30 0x7fc80c0e1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57330/0 (socket says 172.21.15.86:57330) 2024-09-19T06:44:19.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.243+0000 7fc8137fe640 1 -- 172.21.15.86:0/14157086 learned_addr learned my addr 172.21.15.86:0/14157086 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:19.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.244+0000 7fc8127fc640 1 --2- 172.21.15.86:0/14157086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc80c0dcd90 0x7fc80c1849c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:19.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.244+0000 7fc8137fe640 1 -- 172.21.15.86:0/14157086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc80c04a680 msgr2=0x7fc80c0470a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:44:19.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.244+0000 7fc8137fe640 1 --2- 172.21.15.86:0/14157086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc80c04a680 0x7fc80c0470a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:19.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.244+0000 7fc8137fe640 1 -- 172.21.15.86:0/14157086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc80c0dcd90 msgr2=0x7fc80c1849c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:19.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.244+0000 7fc8137fe640 1 --2- 172.21.15.86:0/14157086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc80c0dcd90 0x7fc80c1849c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:19.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.244+0000 7fc8137fe640 1 -- 172.21.15.86:0/14157086 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc80c185360 con 0x7fc80c0e5f30 2024-09-19T06:44:19.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.244+0000 7fc8137fe640 1 --2- 172.21.15.86:0/14157086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc80c0e5f30 0x7fc80c0e1530 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc8140504d0 tx=0x7fc8140692f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:19.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.245+0000 7fc7fbfff640 1 -- 172.21.15.86:0/14157086 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8140bc070 con 0x7fc80c0e5f30 2024-09-19T06:44:19.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.245+0000 7fc7fbfff640 1 -- 172.21.15.86:0/14157086 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8140746f0 con 0x7fc80c0e5f30 2024-09-19T06:44:19.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.245+0000 7fc7fbfff640 1 -- 172.21.15.86:0/14157086 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8140b7400 con 0x7fc80c0e5f30 2024-09-19T06:44:19.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.245+0000 7fc813fff640 1 -- 172.21.15.86:0/14157086 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc80c0e5b40 con 0x7fc80c0e5f30 2024-09-19T06:44:19.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.245+0000 7fc813fff640 1 -- 172.21.15.86:0/14157086 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc80c0db1f0 con 0x7fc80c0e5f30 2024-09-19T06:44:19.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.247+0000 7fc7fbfff640 1 -- 172.21.15.86:0/14157086 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc8140b75a0 con 0x7fc80c0e5f30 2024-09-19T06:44:19.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.248+0000 7fc7fbfff640 1 --2- 172.21.15.86:0/14157086 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc80006c3b0 0x7fc80006e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:19.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.248+0000 7fc7fbfff640 1 -- 172.21.15.86:0/14157086 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7079+0+0 (secure 0 0 0) 0x7fc814129ea0 con 0x7fc80c0e5f30 2024-09-19T06:44:19.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.248+0000 7fc813fff640 1 -- 172.21.15.86:0/14157086 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7f4005290 con 0x7fc80c0e5f30 2024-09-19T06:44:19.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.257+0000 7fc7fbfff640 1 -- 172.21.15.86:0/14157086 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc814069420 con 0x7fc80c0e5f30 2024-09-19T06:44:19.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.258+0000 7fc812ffd640 1 --2- 172.21.15.86:0/14157086 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc80006c3b0 0x7fc80006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:19.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.260+0000 7fc812ffd640 1 --2- 172.21.15.86:0/14157086 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc80006c3b0 0x7fc80006e870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc804000f60 tx=0x7fc804007990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:19.644 INFO:tasks.ceph.mds.e.smithi086.stdout:starting mds.e at 2024-09-19T06:44:19.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.680+0000 7fc813fff640 1 -- 172.21.15.86:0/14157086 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7f4005580 con 0x7fc80c0e5f30 2024-09-19T06:44:19.692 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:44:19.692 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":29,"btime":"2024-09-19T06:44:19:664861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":5211,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:16.648712+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"d","rank":0,"incarnation":25,"state":"up:active","state_seq":30,"addr":"172.21.15.169:6837/3116130916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":3116130916},{"type":"v1","addr":"172.21.15.169:6837","nonce":3116130916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4718,"qdb_cluster":[4718]},"id":1}]} 2024-09-19T06:44:19.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.687+0000 7fc7fbfff640 1 -- 172.21.15.86:0/14157086 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+6874 (secure 0 0 0) 0x7fc8140f79b0 con 0x7fc80c0e5f30 2024-09-19T06:44:19.692 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 29 2024-09-19T06:44:19.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.691+0000 7fc7f9ffb640 1 -- 172.21.15.86:0/14157086 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc80006c3b0 msgr2=0x7fc80006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:19.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.691+0000 7fc7f9ffb640 1 --2- 172.21.15.86:0/14157086 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc80006c3b0 0x7fc80006e870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc804000f60 tx=0x7fc804007990 comp rx=0 tx=0).stop 2024-09-19T06:44:19.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.691+0000 7fc7f9ffb640 1 -- 172.21.15.86:0/14157086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc80c0e5f30 msgr2=0x7fc80c0e1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:19.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.691+0000 7fc7f9ffb640 1 --2- 172.21.15.86:0/14157086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc80c0e5f30 0x7fc80c0e1530 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc8140504d0 tx=0x7fc8140692f0 comp rx=0 tx=0).stop 2024-09-19T06:44:19.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.691+0000 7fc7f9ffb640 1 -- 172.21.15.86:0/14157086 shutdown_connections 2024-09-19T06:44:19.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.691+0000 7fc7f9ffb640 1 --2- 172.21.15.86:0/14157086 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc80006c3b0 0x7fc80006e870 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:19.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.691+0000 7fc7f9ffb640 1 --2- 172.21.15.86:0/14157086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc80c0e5f30 0x7fc80c0e1530 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:19.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.691+0000 7fc7f9ffb640 1 --2- 172.21.15.86:0/14157086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc80c0dcd90 0x7fc80c1849c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:19.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.691+0000 7fc7f9ffb640 1 --2- 172.21.15.86:0/14157086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc80c04a680 0x7fc80c0470a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:19.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.691+0000 7fc7f9ffb640 1 -- 172.21.15.86:0/14157086 >> 172.21.15.86:0/14157086 conn(0x7fc80c04fc50 msgr2=0x7fc80c04b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:19.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.692+0000 7fc7f9ffb640 1 -- 172.21.15.86:0/14157086 shutdown_connections 2024-09-19T06:44:19.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.692+0000 7fc7f9ffb640 1 -- 172.21.15.86:0/14157086 wait complete. 2024-09-19T06:44:19.717 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e reported in up:standby state 2024-09-19T06:44:19.717 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:44:19.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.902+0000 7f3870eae640 1 Processor -- start 2024-09-19T06:44:19.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.902+0000 7f3870eae640 1 -- start start 2024-09-19T06:44:19.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.904+0000 7f3870eae640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f386c0c7a40 0x7f386c072730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:19.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.904+0000 7f3870eae640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f386c0c7e20 0x7f386c159230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:19.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.904+0000 7f3870eae640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f386c0713a0 con 0x7f386c06bbc0 2024-09-19T06:44:19.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.904+0000 7f3870eae640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f386c071170 con 0x7f386c0c7a40 2024-09-19T06:44:19.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.904+0000 7f3870eae640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f386c071a00 con 0x7f386c0c7e20 2024-09-19T06:44:19.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.904+0000 7f386a59c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f386c0c7a40 0x7f386c072730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:19.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.904+0000 7f386a59c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f386c0c7a40 0x7f386c072730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57358/0 (socket says 172.21.15.86:57358) 2024-09-19T06:44:19.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.904+0000 7f386a59c640 1 -- 172.21.15.86:0/1898456682 learned_addr learned my addr 172.21.15.86:0/1898456682 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:19.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.904+0000 7f386ad9d640 1 --2- 172.21.15.86:0/1898456682 >> v2:172.21.15.169:3300/0 conn(0x7f386c0c7e20 0x7f386c159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:19.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.905+0000 7f386a59c640 1 -- 172.21.15.86:0/1898456682 >> v2:172.21.15.169:3300/0 conn(0x7f386c0c7e20 msgr2=0x7f386c159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:19.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.905+0000 7f386a59c640 1 --2- 172.21.15.86:0/1898456682 >> v2:172.21.15.169:3300/0 conn(0x7f386c0c7e20 0x7f386c159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:19.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.905+0000 7f386a59c640 1 -- 172.21.15.86:0/1898456682 >> v1:172.21.15.169:6789/0 conn(0x7f386c06bbc0 legacy=0x7f386c1632d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:19.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.905+0000 7f386a59c640 1 -- 172.21.15.86:0/1898456682 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386c071680 con 0x7f386c0c7a40 2024-09-19T06:44:19.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.905+0000 7f386ad9d640 1 --2- 172.21.15.86:0/1898456682 >> v2:172.21.15.169:3300/0 conn(0x7f386c0c7e20 0x7f386c159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:44:19.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.906+0000 7f386a59c640 1 --2- 172.21.15.86:0/1898456682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f386c0c7a40 0x7f386c072730 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f386c1639e0 tx=0x7f386402a310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c27d823c736bbd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:19.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.907+0000 7f386959a640 1 -- 172.21.15.86:0/1898456682 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864037070 con 0x7f386c0c7a40 2024-09-19T06:44:19.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.907+0000 7f386959a640 1 -- 172.21.15.86:0/1898456682 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3864032640 con 0x7f386c0c7a40 2024-09-19T06:44:19.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.907+0000 7f386959a640 1 -- 172.21.15.86:0/1898456682 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386402ae60 con 0x7f386c0c7a40 2024-09-19T06:44:19.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.907+0000 7f3870eae640 1 -- 172.21.15.86:0/1898456682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f386c0c7a40 msgr2=0x7f386c072730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:19.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.907+0000 7f3870eae640 1 --2- 172.21.15.86:0/1898456682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f386c0c7a40 0x7f386c072730 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f386c1639e0 tx=0x7f386402a310 comp rx=0 tx=0).stop 2024-09-19T06:44:19.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.910+0000 7f3870eae640 1 -- 172.21.15.86:0/1898456682 shutdown_connections 2024-09-19T06:44:19.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.910+0000 7f3870eae640 1 --2- 172.21.15.86:0/1898456682 >> v2:172.21.15.169:3300/0 conn(0x7f386c0c7e20 0x7f386c159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:19.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.910+0000 7f3870eae640 1 --2- 172.21.15.86:0/1898456682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f386c0c7a40 0x7f386c072730 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:19.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.910+0000 7f3870eae640 1 -- 172.21.15.86:0/1898456682 >> 172.21.15.86:0/1898456682 conn(0x7f386c0c9280 msgr2=0x7f386c0c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:19.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.911+0000 7f3870eae640 1 -- 172.21.15.86:0/1898456682 shutdown_connections 2024-09-19T06:44:19.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.912+0000 7f3870eae640 1 -- 172.21.15.86:0/1898456682 wait complete. 2024-09-19T06:44:19.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.914+0000 7f3870eae640 1 Processor -- start 2024-09-19T06:44:19.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.914+0000 7f3870eae640 1 -- start start 2024-09-19T06:44:19.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.915+0000 7f3870eae640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f386c06bbc0 0x7f386c1f8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:19.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.915+0000 7f3870eae640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f386c0c7a40 0x7f386c1580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:19.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.915+0000 7f3870eae640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f386c0c7e20 0x7f386c155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:19.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.915+0000 7f3870eae640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f386c071f30 con 0x7f386c0c7e20 2024-09-19T06:44:19.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.915+0000 7f3870eae640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f386c06bff0 con 0x7f386c0c7a40 2024-09-19T06:44:19.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.915+0000 7f3870eae640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f386c0c8e70 con 0x7f386c06bbc0 2024-09-19T06:44:19.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.916+0000 7f386ad9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f386c0c7e20 0x7f386c155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:19.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.916+0000 7f386ad9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f386c0c7e20 0x7f386c155ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57362/0 (socket says 172.21.15.86:57362) 2024-09-19T06:44:19.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.916+0000 7f386ad9d640 1 -- 172.21.15.86:0/3477226184 learned_addr learned my addr 172.21.15.86:0/3477226184 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:19.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.917+0000 7f386ad9d640 1 -- 172.21.15.86:0/3477226184 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f386c06bbc0 msgr2=0x7f386c1f8ec0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:44:19.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.917+0000 7f386ad9d640 1 --2- 172.21.15.86:0/3477226184 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f386c06bbc0 0x7f386c1f8ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:19.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.917+0000 7f386ad9d640 1 -- 172.21.15.86:0/3477226184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f386c0c7a40 msgr2=0x7f386c1580e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:44:19.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.917+0000 7f386ad9d640 1 --2- 172.21.15.86:0/3477226184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f386c0c7a40 0x7f386c1580e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:19.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.917+0000 7f386ad9d640 1 -- 172.21.15.86:0/3477226184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386c14d060 con 0x7f386c0c7e20 2024-09-19T06:44:19.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.918+0000 7f386ad9d640 1 --2- 172.21.15.86:0/3477226184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f386c0c7e20 0x7f386c155ef0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f385c00efc0 tx=0x7f385c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:19.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.921+0000 7f3862ffd640 1 -- 172.21.15.86:0/3477226184 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c018030 con 0x7f386c0c7e20 2024-09-19T06:44:19.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.921+0000 7f3870eae640 1 -- 172.21.15.86:0/3477226184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f386c14d340 con 0x7f386c0c7e20 2024-09-19T06:44:19.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.921+0000 7f3870eae640 1 -- 172.21.15.86:0/3477226184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f386c14d900 con 0x7f386c0c7e20 2024-09-19T06:44:19.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.924+0000 7f3870eae640 1 -- 172.21.15.86:0/3477226184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f386c073410 con 0x7f386c0c7e20 2024-09-19T06:44:19.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.925+0000 7f3862ffd640 1 -- 172.21.15.86:0/3477226184 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f385c00cdf0 con 0x7f386c0c7e20 2024-09-19T06:44:19.927 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.925+0000 7f3862ffd640 1 -- 172.21.15.86:0/3477226184 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c003bb0 con 0x7f386c0c7e20 2024-09-19T06:44:19.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.930+0000 7f3862ffd640 1 -- 172.21.15.86:0/3477226184 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f385c005d10 con 0x7f386c0c7e20 2024-09-19T06:44:19.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.930+0000 7f3862ffd640 1 --2- 172.21.15.86:0/3477226184 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f384c06c3b0 0x7f384c06e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:19.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.931+0000 7f3862ffd640 1 -- 172.21.15.86:0/3477226184 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7079+0+0 (secure 0 0 0) 0x7f385c08cb40 con 0x7f386c0c7e20 2024-09-19T06:44:19.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.932+0000 7f386a59c640 1 --2- 172.21.15.86:0/3477226184 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f384c06c3b0 0x7f384c06e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:19.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.933+0000 7f386a59c640 1 --2- 172.21.15.86:0/3477226184 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f384c06c3b0 0x7f384c06e870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3864034000 tx=0x7f386402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:19.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:19.933+0000 7f3862ffd640 1 -- 172.21.15.86:0/3477226184 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f386c073410 con 0x7f386c0c7e20 2024-09-19T06:44:20.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.372+0000 7f3870eae640 1 -- 172.21.15.86:0/3477226184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f386c06d850 con 0x7f386c0c7e20 2024-09-19T06:44:20.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.373+0000 7f3862ffd640 1 -- 172.21.15.86:0/3477226184 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+6874 (secure 0 0 0) 0x7f386c06d850 con 0x7f386c0c7e20 2024-09-19T06:44:20.375 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:44:20.375 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":29,"btime":"2024-09-19T06:44:19:664861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":5211,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:16.648712+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"d","rank":0,"incarnation":25,"state":"up:active","state_seq":30,"addr":"172.21.15.169:6837/3116130916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":3116130916},{"type":"v1","addr":"172.21.15.169:6837","nonce":3116130916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4718,"qdb_cluster":[4718]},"id":1}]} 2024-09-19T06:44:20.375 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 29 2024-09-19T06:44:20.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.377+0000 7f3870eae640 1 -- 172.21.15.86:0/3477226184 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f384c06c3b0 msgr2=0x7f384c06e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:20.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.377+0000 7f3870eae640 1 --2- 172.21.15.86:0/3477226184 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f384c06c3b0 0x7f384c06e870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3864034000 tx=0x7f386402e000 comp rx=0 tx=0).stop 2024-09-19T06:44:20.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.377+0000 7f3870eae640 1 -- 172.21.15.86:0/3477226184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f386c0c7e20 msgr2=0x7f386c155ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:20.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.377+0000 7f3870eae640 1 --2- 172.21.15.86:0/3477226184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f386c0c7e20 0x7f386c155ef0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f385c00efc0 tx=0x7f385c00c490 comp rx=0 tx=0).stop 2024-09-19T06:44:20.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.377+0000 7f3870eae640 1 -- 172.21.15.86:0/3477226184 shutdown_connections 2024-09-19T06:44:20.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.377+0000 7f3870eae640 1 --2- 172.21.15.86:0/3477226184 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f384c06c3b0 0x7f384c06e870 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.377+0000 7f3870eae640 1 --2- 172.21.15.86:0/3477226184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f386c0c7e20 0x7f386c155ef0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.377+0000 7f3870eae640 1 --2- 172.21.15.86:0/3477226184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f386c0c7a40 0x7f386c1580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.377+0000 7f3870eae640 1 --2- 172.21.15.86:0/3477226184 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f386c06bbc0 0x7f386c1f8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.378+0000 7f3870eae640 1 -- 172.21.15.86:0/3477226184 >> 172.21.15.86:0/3477226184 conn(0x7f386c0c9280 msgr2=0x7f386c0cada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:20.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.378+0000 7f3870eae640 1 -- 172.21.15.86:0/3477226184 shutdown_connections 2024-09-19T06:44:20.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.378+0000 7f3870eae640 1 -- 172.21.15.86:0/3477226184 wait complete. 2024-09-19T06:44:20.398 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.d (rank=0) 2024-09-19T06:44:20.398 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T06:44:20.398 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:44:20.415 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T06:44:20.415 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:44:20.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.603+0000 7fd9043d6640 1 Processor -- start 2024-09-19T06:44:20.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.603+0000 7fd9043d6640 1 -- start start 2024-09-19T06:44:20.606 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.605+0000 7fd9043d6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd8fc0cbc90 0x7fd8fc15f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:20.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.605+0000 7fd9043d6640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd8fc0ccc10 0x7fd8fc0c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:20.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.605+0000 7fd9043d6640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8fc0cd150 con 0x7fd8fc155560 2024-09-19T06:44:20.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.605+0000 7fd9043d6640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fd8fc15f5c0 con 0x7fd8fc0ccc10 2024-09-19T06:44:20.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.605+0000 7fd9043d6640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fd8fc15b450 con 0x7fd8fc0cbc90 2024-09-19T06:44:20.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.605+0000 7fd902172640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fd8fc155560 0x7fd8fc0d0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:49724/0 (socket says 172.21.15.86:49724) 2024-09-19T06:44:20.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.605+0000 7fd902172640 1 -- 172.21.15.86:0/977222922 learned_addr learned my addr 172.21.15.86:0/977222922 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:44:20.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.605+0000 7fd902973640 1 --2- 172.21.15.86:0/977222922 >> v2:172.21.15.86:3300/0 conn(0x7fd8fc0ccc10 0x7fd8fc0c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:20.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.606+0000 7fd901170640 1 -- 172.21.15.86:0/977222922 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1119533678 0 0) 0x7fd8fc0cd150 con 0x7fd8fc155560 2024-09-19T06:44:20.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.606+0000 7fd902973640 1 -- 172.21.15.86:0/977222922 >> v2:172.21.15.169:3300/0 conn(0x7fd8fc0cbc90 msgr2=0x7fd8fc15f080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:44:20.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.606+0000 7fd902973640 1 --2- 172.21.15.86:0/977222922 >> v2:172.21.15.169:3300/0 conn(0x7fd8fc0cbc90 0x7fd8fc15f080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.606+0000 7fd902973640 1 -- 172.21.15.86:0/977222922 >> v1:172.21.15.169:6789/0 conn(0x7fd8fc155560 legacy=0x7fd8fc0d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:20.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.606+0000 7fd902973640 1 -- 172.21.15.86:0/977222922 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8fc15b730 con 0x7fd8fc0ccc10 2024-09-19T06:44:20.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.607+0000 7fd902973640 1 --2- 172.21.15.86:0/977222922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8fc0ccc10 0x7fd8fc0c59e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0d1b10 tx=0x7fd8f402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efffb0d237685b04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:20.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.608+0000 7fd901170640 1 -- 172.21.15.86:0/977222922 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f4007740 con 0x7fd8fc0ccc10 2024-09-19T06:44:20.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.608+0000 7fd901170640 1 -- 172.21.15.86:0/977222922 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f40078e0 con 0x7fd8fc0ccc10 2024-09-19T06:44:20.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.609+0000 7fd9043d6640 1 -- 172.21.15.86:0/977222922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8fc0ccc10 msgr2=0x7fd8fc0c59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:20.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.609+0000 7fd9043d6640 1 --2- 172.21.15.86:0/977222922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8fc0ccc10 0x7fd8fc0c59e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0d1b10 tx=0x7fd8f402a6a0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.609+0000 7fd9043d6640 1 -- 172.21.15.86:0/977222922 shutdown_connections 2024-09-19T06:44:20.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.609+0000 7fd9043d6640 1 --2- 172.21.15.86:0/977222922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8fc0ccc10 0x7fd8fc0c59e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.609+0000 7fd9043d6640 1 --2- 172.21.15.86:0/977222922 >> v2:172.21.15.169:3300/0 conn(0x7fd8fc0cbc90 0x7fd8fc15f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.609+0000 7fd9043d6640 1 -- 172.21.15.86:0/977222922 >> 172.21.15.86:0/977222922 conn(0x7fd8fc06d980 msgr2=0x7fd8fc06dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:20.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.612+0000 7fd9043d6640 1 -- 172.21.15.86:0/977222922 shutdown_connections 2024-09-19T06:44:20.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.614+0000 7fd9043d6640 1 -- 172.21.15.86:0/977222922 wait complete. 2024-09-19T06:44:20.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.616+0000 7fd9043d6640 1 Processor -- start 2024-09-19T06:44:20.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.616+0000 7fd9043d6640 1 -- start start 2024-09-19T06:44:20.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.617+0000 7fd9043d6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8fc0cbc90 0x7fd8fc157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:20.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.617+0000 7fd9043d6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd8fc155560 0x7fd8fc155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:20.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.617+0000 7fd9043d6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8fc201420 0x7fd8fc0cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:20.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.617+0000 7fd9043d6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd8fc15b100 con 0x7fd8fc0cbc90 2024-09-19T06:44:20.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.617+0000 7fd9043d6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd8fc15bcf0 con 0x7fd8fc201420 2024-09-19T06:44:20.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.617+0000 7fd9043d6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd8fc0d1140 con 0x7fd8fc155560 2024-09-19T06:44:20.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.618+0000 7fd902172640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8fc0cbc90 0x7fd8fc157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:20.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.618+0000 7fd902172640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8fc0cbc90 0x7fd8fc157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57384/0 (socket says 172.21.15.86:57384) 2024-09-19T06:44:20.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.618+0000 7fd902172640 1 -- 172.21.15.86:0/645425990 learned_addr learned my addr 172.21.15.86:0/645425990 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:20.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.618+0000 7fd901971640 1 --2- 172.21.15.86:0/645425990 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd8fc155560 0x7fd8fc155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:20.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.618+0000 7fd902172640 1 -- 172.21.15.86:0/645425990 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd8fc155560 msgr2=0x7fd8fc155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:20.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.618+0000 7fd902172640 1 --2- 172.21.15.86:0/645425990 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd8fc155560 0x7fd8fc155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.618+0000 7fd902172640 1 -- 172.21.15.86:0/645425990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8fc201420 msgr2=0x7fd8fc0cfc50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:44:20.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.618+0000 7fd902172640 1 --2- 172.21.15.86:0/645425990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8fc201420 0x7fd8fc0cfc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.618+0000 7fd902172640 1 -- 172.21.15.86:0/645425990 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8fc15aa30 con 0x7fd8fc0cbc90 2024-09-19T06:44:20.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.619+0000 7fd902172640 1 --2- 172.21.15.86:0/645425990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8fc0cbc90 0x7fd8fc157ee0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800c7b0 tx=0x7fd8f800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:20.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.619+0000 7fd8f2ffd640 1 -- 172.21.15.86:0/645425990 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8018070 con 0x7fd8fc0cbc90 2024-09-19T06:44:20.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.619+0000 7fd8f2ffd640 1 -- 172.21.15.86:0/645425990 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f80072f0 con 0x7fd8fc0cbc90 2024-09-19T06:44:20.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.620+0000 7fd8f2ffd640 1 -- 172.21.15.86:0/645425990 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f800ce60 con 0x7fd8fc0cbc90 2024-09-19T06:44:20.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.620+0000 7fd9043d6640 1 -- 172.21.15.86:0/645425990 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8fc15acd0 con 0x7fd8fc0cbc90 2024-09-19T06:44:20.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.620+0000 7fd9043d6640 1 -- 172.21.15.86:0/645425990 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8fc1576e0 con 0x7fd8fc0cbc90 2024-09-19T06:44:20.625 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.623+0000 7fd8f2ffd640 1 -- 172.21.15.86:0/645425990 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd8f801b070 con 0x7fd8fc0cbc90 2024-09-19T06:44:20.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.623+0000 7fd8f2ffd640 1 --2- 172.21.15.86:0/645425990 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd8e006c3b0 0x7fd8e006e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:20.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.624+0000 7fd901971640 1 --2- 172.21.15.86:0/645425990 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd8e006c3b0 0x7fd8e006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:20.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.624+0000 7fd8f2ffd640 1 -- 172.21.15.86:0/645425990 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7079+0+0 (secure 0 0 0) 0x7fd8f808add0 con 0x7fd8fc0cbc90 2024-09-19T06:44:20.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.622+0000 7fd9043d6640 1 -- 172.21.15.86:0/645425990 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8fc0ccc10 con 0x7fd8fc0cbc90 2024-09-19T06:44:20.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.629+0000 7fd901971640 1 --2- 172.21.15.86:0/645425990 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd8e006c3b0 0x7fd8e006e870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec006fd0 tx=0x7fd8ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:20.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:20.634+0000 7fd8f2ffd640 1 -- 172.21.15.86:0/645425990 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd8f8058f30 con 0x7fd8fc0cbc90 2024-09-19T06:44:21.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:21.062+0000 7fd9043d6640 1 -- 172.21.15.86:0/645425990 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd8fc0cc4a0 con 0x7fd8fc0cbc90 2024-09-19T06:44:21.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:21.064+0000 7fd8f2ffd640 1 -- 172.21.15.86:0/645425990 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+6874 (secure 0 0 0) 0x7fd8f8058830 con 0x7fd8fc0cbc90 2024-09-19T06:44:21.065 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:44:21.066 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":29,"btime":"2024-09-19T06:44:19:664861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":5211,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:16.648712+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"d","rank":0,"incarnation":25,"state":"up:active","state_seq":30,"addr":"172.21.15.169:6837/3116130916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":3116130916},{"type":"v1","addr":"172.21.15.169:6837","nonce":3116130916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4718,"qdb_cluster":[4718]},"id":1}]} 2024-09-19T06:44:21.066 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 29 2024-09-19T06:44:21.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:21.068+0000 7fd9043d6640 1 -- 172.21.15.86:0/645425990 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd8e006c3b0 msgr2=0x7fd8e006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:21.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:21.068+0000 7fd9043d6640 1 --2- 172.21.15.86:0/645425990 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd8e006c3b0 0x7fd8e006e870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec006fd0 tx=0x7fd8ec008040 comp rx=0 tx=0).stop 2024-09-19T06:44:21.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:21.068+0000 7fd9043d6640 1 -- 172.21.15.86:0/645425990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8fc0cbc90 msgr2=0x7fd8fc157ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:21.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:21.068+0000 7fd9043d6640 1 --2- 172.21.15.86:0/645425990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8fc0cbc90 0x7fd8fc157ee0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800c7b0 tx=0x7fd8f800cc70 comp rx=0 tx=0).stop 2024-09-19T06:44:21.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:21.068+0000 7fd9043d6640 1 -- 172.21.15.86:0/645425990 shutdown_connections 2024-09-19T06:44:21.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:21.068+0000 7fd9043d6640 1 --2- 172.21.15.86:0/645425990 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd8e006c3b0 0x7fd8e006e870 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:21.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:21.068+0000 7fd9043d6640 1 --2- 172.21.15.86:0/645425990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8fc201420 0x7fd8fc0cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:21.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:21.068+0000 7fd9043d6640 1 --2- 172.21.15.86:0/645425990 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd8fc155560 0x7fd8fc155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:21.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:21.068+0000 7fd9043d6640 1 --2- 172.21.15.86:0/645425990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8fc0cbc90 0x7fd8fc157ee0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:21.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:21.068+0000 7fd9043d6640 1 -- 172.21.15.86:0/645425990 >> 172.21.15.86:0/645425990 conn(0x7fd8fc06d980 msgr2=0x7fd8fc0b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:21.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:21.069+0000 7fd9043d6640 1 -- 172.21.15.86:0/645425990 shutdown_connections 2024-09-19T06:44:21.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:21.069+0000 7fd9043d6640 1 -- 172.21.15.86:0/645425990 wait complete. 2024-09-19T06:44:21.091 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-09-19T06:44:23.092 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:44:23.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.258+0000 7f184dd2a640 1 Processor -- start 2024-09-19T06:44:23.260 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.259+0000 7f184dd2a640 1 -- start start 2024-09-19T06:44:23.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.260+0000 7f184dd2a640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f18481553a0 0x7f18480cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:23.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.260+0000 7f184dd2a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f184815e6f0 0x7f18480d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:23.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.260+0000 7f184dd2a640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f18480d0ff0 0x7f18480c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:23.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.260+0000 7f184dd2a640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f184815ec50 con 0x7f18480d0ff0 2024-09-19T06:44:23.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.260+0000 7f184dd2a640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f184815ef30 con 0x7f18481553a0 2024-09-19T06:44:23.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.260+0000 7f184dd2a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f184815f210 con 0x7f184815e6f0 2024-09-19T06:44:23.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.261+0000 7f18477fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f18481553a0 0x7f18480cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:23.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.261+0000 7f18477fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f18481553a0 0x7f18480cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:33650/0 (socket says 172.21.15.86:33650) 2024-09-19T06:44:23.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.261+0000 7f18477fe640 1 -- 172.21.15.86:0/2876981932 learned_addr learned my addr 172.21.15.86:0/2876981932 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:23.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.261+0000 7f1847fff640 1 --2- 172.21.15.86:0/2876981932 >> v2:172.21.15.86:3300/0 conn(0x7f18480d0ff0 0x7f18480c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:23.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.261+0000 7f18477fe640 1 -- 172.21.15.86:0/2876981932 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f184815e6f0 msgr2=0x7f18480d0ab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:44:23.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.261+0000 7f18477fe640 1 --2- 172.21.15.86:0/2876981932 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f184815e6f0 0x7f18480d0ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:23.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.261+0000 7f18477fe640 1 -- 172.21.15.86:0/2876981932 >> v2:172.21.15.86:3300/0 conn(0x7f18480d0ff0 msgr2=0x7f18480c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:23.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.261+0000 7f18477fe640 1 --2- 172.21.15.86:0/2876981932 >> v2:172.21.15.86:3300/0 conn(0x7f18480d0ff0 0x7f18480c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:23.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.261+0000 7f18477fe640 1 -- 172.21.15.86:0/2876981932 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f184815f4f0 con 0x7f18481553a0 2024-09-19T06:44:23.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.262+0000 7f18477fe640 1 --2- 172.21.15.86:0/2876981932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18481553a0 0x7f18480cbaa0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f18480d0a30 tx=0x7f183c02a280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9931f7d5da468e8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:23.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.262+0000 7f18467fc640 1 -- 172.21.15.86:0/2876981932 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c037070 con 0x7f18481553a0 2024-09-19T06:44:23.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.262+0000 7f18467fc640 1 -- 172.21.15.86:0/2876981932 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f183c032440 con 0x7f18481553a0 2024-09-19T06:44:23.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.262+0000 7f18467fc640 1 -- 172.21.15.86:0/2876981932 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c032810 con 0x7f18481553a0 2024-09-19T06:44:23.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.263+0000 7f184dd2a640 1 -- 172.21.15.86:0/2876981932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18481553a0 msgr2=0x7f18480cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:23.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.263+0000 7f184dd2a640 1 --2- 172.21.15.86:0/2876981932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18481553a0 0x7f18480cbaa0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f18480d0a30 tx=0x7f183c02a280 comp rx=0 tx=0).stop 2024-09-19T06:44:23.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.264+0000 7f184dd2a640 1 -- 172.21.15.86:0/2876981932 shutdown_connections 2024-09-19T06:44:23.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.264+0000 7f184dd2a640 1 --2- 172.21.15.86:0/2876981932 >> v2:172.21.15.86:3300/0 conn(0x7f18480d0ff0 0x7f18480c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:23.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.264+0000 7f184dd2a640 1 --2- 172.21.15.86:0/2876981932 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f184815e6f0 0x7f18480d0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:23.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.264+0000 7f184dd2a640 1 --2- 172.21.15.86:0/2876981932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18481553a0 0x7f18480cbaa0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:23.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.264+0000 7f184dd2a640 1 -- 172.21.15.86:0/2876981932 >> 172.21.15.86:0/2876981932 conn(0x7f1848067890 msgr2=0x7f1848067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:23.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.265+0000 7f184dd2a640 1 -- 172.21.15.86:0/2876981932 shutdown_connections 2024-09-19T06:44:23.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.265+0000 7f184dd2a640 1 -- 172.21.15.86:0/2876981932 wait complete. 2024-09-19T06:44:23.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.267+0000 7f184dd2a640 1 Processor -- start 2024-09-19T06:44:23.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.267+0000 7f184dd2a640 1 -- start start 2024-09-19T06:44:23.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.268+0000 7f184dd2a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18480d0ff0 0x7f184814e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:23.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.269+0000 7f18477fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18480d0ff0 0x7f184814e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:23.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.269+0000 7f18477fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18480d0ff0 0x7f184814e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33182/0 (socket says 172.21.15.86:33182) 2024-09-19T06:44:23.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.269+0000 7f18477fe640 1 -- 172.21.15.86:0/3030814996 learned_addr learned my addr 172.21.15.86:0/3030814996 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:23.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.269+0000 7f184dd2a640 1 --2- 172.21.15.86:0/3030814996 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18481553a0 0x7f18480c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:23.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.269+0000 7f184dd2a640 1 --2- 172.21.15.86:0/3030814996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f184814d930 0x7f184814b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:23.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.270+0000 7f1846ffd640 1 --2- 172.21.15.86:0/3030814996 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18481553a0 0x7f18480c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:23.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.270+0000 7f1847fff640 1 --2- 172.21.15.86:0/3030814996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f184814d930 0x7f184814b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:23.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.270+0000 7f184dd2a640 1 -- 172.21.15.86:0/3030814996 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f18480c66d0 con 0x7f18480d0ff0 2024-09-19T06:44:23.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.270+0000 7f184dd2a640 1 -- 172.21.15.86:0/3030814996 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f18480cbfe0 con 0x7f184814d930 2024-09-19T06:44:23.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.270+0000 7f184dd2a640 1 -- 172.21.15.86:0/3030814996 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f18480cc2d0 con 0x7f18481553a0 2024-09-19T06:44:23.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.271+0000 7f18477fe640 1 -- 172.21.15.86:0/3030814996 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18481553a0 msgr2=0x7f18480c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:23.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.271+0000 7f18477fe640 1 --2- 172.21.15.86:0/3030814996 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18481553a0 0x7f18480c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:23.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.271+0000 7f18477fe640 1 -- 172.21.15.86:0/3030814996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f184814d930 msgr2=0x7f184814b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:23.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.271+0000 7f18477fe640 1 --2- 172.21.15.86:0/3030814996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f184814d930 0x7f184814b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:23.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.271+0000 7f18477fe640 1 -- 172.21.15.86:0/3030814996 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f184814c2d0 con 0x7f18480d0ff0 2024-09-19T06:44:23.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.271+0000 7f18477fe640 1 --2- 172.21.15.86:0/3030814996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18480d0ff0 0x7f184814e190 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f183c000c00 tx=0x7f183c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:23.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.272+0000 7f182ffff640 1 -- 172.21.15.86:0/3030814996 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c037040 con 0x7f18480d0ff0 2024-09-19T06:44:23.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.272+0000 7f184dd2a640 1 -- 172.21.15.86:0/3030814996 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f184814c550 con 0x7f18480d0ff0 2024-09-19T06:44:23.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.272+0000 7f184dd2a640 1 -- 172.21.15.86:0/3030814996 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f184814cb10 con 0x7f18480d0ff0 2024-09-19T06:44:23.277 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.273+0000 7f182ffff640 1 -- 172.21.15.86:0/3030814996 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f183c042070 con 0x7f18480d0ff0 2024-09-19T06:44:23.277 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.273+0000 7f182ffff640 1 -- 172.21.15.86:0/3030814996 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c030b70 con 0x7f18480d0ff0 2024-09-19T06:44:23.277 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.274+0000 7f184dd2a640 1 -- 172.21.15.86:0/3030814996 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f184814cd50 con 0x7f18480d0ff0 2024-09-19T06:44:23.277 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.276+0000 7f182ffff640 1 -- 172.21.15.86:0/3030814996 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f183c030d10 con 0x7f18480d0ff0 2024-09-19T06:44:23.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.277+0000 7f182ffff640 1 --2- 172.21.15.86:0/3030814996 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f183406c380 0x7f183406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:23.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.277+0000 7f182ffff640 1 -- 172.21.15.86:0/3030814996 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7079+0+0 (secure 0 0 0) 0x7f183c0acea0 con 0x7f18480d0ff0 2024-09-19T06:44:23.279 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.277+0000 7f1846ffd640 1 --2- 172.21.15.86:0/3030814996 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f183406c380 0x7f183406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:23.279 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.278+0000 7f1846ffd640 1 --2- 172.21.15.86:0/3030814996 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f183406c380 0x7f183406e840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f184814e6d0 tx=0x7f184000d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:23.285 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.283+0000 7f182ffff640 1 -- 172.21.15.86:0/3030814996 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f184814cd50 con 0x7f18480d0ff0 2024-09-19T06:44:23.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.705+0000 7f184dd2a640 1 -- 172.21.15.86:0/3030814996 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1848155780 con 0x7f18480d0ff0 2024-09-19T06:44:23.711 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:44:23.711 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":29,"btime":"2024-09-19T06:44:19:664861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":5211,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:16.648712+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"d","rank":0,"incarnation":25,"state":"up:active","state_seq":30,"addr":"172.21.15.169:6837/3116130916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":3116130916},{"type":"v1","addr":"172.21.15.169:6837","nonce":3116130916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4718,"qdb_cluster":[4718]},"id":1}]} 2024-09-19T06:44:23.712 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 29 2024-09-19T06:44:23.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.709+0000 7f182ffff640 1 -- 172.21.15.86:0/3030814996 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+6874 (secure 0 0 0) 0x7f184814c2d0 con 0x7f18480d0ff0 2024-09-19T06:44:23.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.713+0000 7f184dd2a640 1 -- 172.21.15.86:0/3030814996 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f183406c380 msgr2=0x7f183406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:23.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.713+0000 7f184dd2a640 1 --2- 172.21.15.86:0/3030814996 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f183406c380 0x7f183406e840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f184814e6d0 tx=0x7f184000d040 comp rx=0 tx=0).stop 2024-09-19T06:44:23.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.713+0000 7f184dd2a640 1 -- 172.21.15.86:0/3030814996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18480d0ff0 msgr2=0x7f184814e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:23.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.713+0000 7f184dd2a640 1 --2- 172.21.15.86:0/3030814996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18480d0ff0 0x7f184814e190 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f183c000c00 tx=0x7f183c0046c0 comp rx=0 tx=0).stop 2024-09-19T06:44:23.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.713+0000 7f184dd2a640 1 -- 172.21.15.86:0/3030814996 shutdown_connections 2024-09-19T06:44:23.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.714+0000 7f184dd2a640 1 --2- 172.21.15.86:0/3030814996 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f183406c380 0x7f183406e840 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:23.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.714+0000 7f184dd2a640 1 --2- 172.21.15.86:0/3030814996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f184814d930 0x7f184814b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:23.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.714+0000 7f184dd2a640 1 --2- 172.21.15.86:0/3030814996 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18481553a0 0x7f18480c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:23.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.714+0000 7f184dd2a640 1 --2- 172.21.15.86:0/3030814996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18480d0ff0 0x7f184814e190 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:23.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.714+0000 7f184dd2a640 1 -- 172.21.15.86:0/3030814996 >> 172.21.15.86:0/3030814996 conn(0x7f1848067890 msgr2=0x7f18481534d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:23.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.714+0000 7f184dd2a640 1 -- 172.21.15.86:0/3030814996 shutdown_connections 2024-09-19T06:44:23.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:23.714+0000 7f184dd2a640 1 -- 172.21.15.86:0/3030814996 wait complete. 2024-09-19T06:44:23.741 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-09-19T06:44:25.742 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:44:25.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.917+0000 7ffac9e43640 1 Processor -- start 2024-09-19T06:44:25.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.918+0000 7ffac9e43640 1 -- start start 2024-09-19T06:44:25.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.919+0000 7ffac9e43640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ffac406d540 0x7ffac40c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:25.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.919+0000 7ffac9e43640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ffac40c1f70 0x7ffac40b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:25.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.919+0000 7ffac9e43640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffac4157c30 con 0x7ffac406d920 2024-09-19T06:44:25.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.919+0000 7ffac9e43640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7ffac406ea50 con 0x7ffac40c1f70 2024-09-19T06:44:25.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.919+0000 7ffac9e43640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7ffac40c3440 con 0x7ffac406d540 2024-09-19T06:44:25.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.919+0000 7ffac9642640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ffac40c1f70 0x7ffac40b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:25.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.919+0000 7ffac9642640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ffac40c1f70 0x7ffac40b2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33186/0 (socket says 172.21.15.86:33186) 2024-09-19T06:44:25.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.919+0000 7ffac9642640 1 -- 172.21.15.86:0/3279869763 learned_addr learned my addr 172.21.15.86:0/3279869763 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:25.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.920+0000 7ffac9642640 1 -- 172.21.15.86:0/3279869763 >> v2:172.21.15.169:3300/0 conn(0x7ffac406d540 msgr2=0x7ffac40c2f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:44:25.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.920+0000 7ffac9642640 1 --2- 172.21.15.86:0/3279869763 >> v2:172.21.15.169:3300/0 conn(0x7ffac406d540 0x7ffac40c2f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.920+0000 7ffac9642640 1 -- 172.21.15.86:0/3279869763 >> v1:172.21.15.86:6789/0 conn(0x7ffac406d920 legacy=0x7ffac40b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:25.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.920+0000 7ffac9642640 1 -- 172.21.15.86:0/3279869763 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac406e770 con 0x7ffac40c1f70 2024-09-19T06:44:25.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.921+0000 7ffac9642640 1 --2- 172.21.15.86:0/3279869763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffac40c1f70 0x7ffac40b2f60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ffac40745b0 tx=0x7ffabc02c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4786d4472b9b017d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:25.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.922+0000 7ffac37fe640 1 -- 172.21.15.86:0/3279869763 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc03b070 con 0x7ffac40c1f70 2024-09-19T06:44:25.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.922+0000 7ffac37fe640 1 -- 172.21.15.86:0/3279869763 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffabc032050 con 0x7ffac40c1f70 2024-09-19T06:44:25.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.922+0000 7ffac37fe640 1 -- 172.21.15.86:0/3279869763 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc030030 con 0x7ffac40c1f70 2024-09-19T06:44:25.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.923+0000 7ffac9e43640 1 -- 172.21.15.86:0/3279869763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffac40c1f70 msgr2=0x7ffac40b2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:25.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.923+0000 7ffac9e43640 1 --2- 172.21.15.86:0/3279869763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffac40c1f70 0x7ffac40b2f60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ffac40745b0 tx=0x7ffabc02c900 comp rx=0 tx=0).stop 2024-09-19T06:44:25.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.923+0000 7ffac9e43640 1 -- 172.21.15.86:0/3279869763 shutdown_connections 2024-09-19T06:44:25.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.923+0000 7ffac9e43640 1 --2- 172.21.15.86:0/3279869763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffac40c1f70 0x7ffac40b2f60 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.923+0000 7ffac9e43640 1 --2- 172.21.15.86:0/3279869763 >> v2:172.21.15.169:3300/0 conn(0x7ffac406d540 0x7ffac40c2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.923+0000 7ffac9e43640 1 -- 172.21.15.86:0/3279869763 >> 172.21.15.86:0/3279869763 conn(0x7ffac40c9a50 msgr2=0x7ffac40c9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:25.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.924+0000 7ffac9e43640 1 -- 172.21.15.86:0/3279869763 shutdown_connections 2024-09-19T06:44:25.927 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.924+0000 7ffac9e43640 1 -- 172.21.15.86:0/3279869763 wait complete. 2024-09-19T06:44:25.927 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.925+0000 7ffac9e43640 1 Processor -- start 2024-09-19T06:44:25.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.926+0000 7ffac9e43640 1 -- start start 2024-09-19T06:44:25.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.928+0000 7ffac9e43640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffac406d540 0x7ffac4149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:25.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.928+0000 7ffac9e43640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffac406d920 0x7ffac414c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:25.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.928+0000 7ffac9e43640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffac40c1f70 0x7ffac4146cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:25.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.928+0000 7ffac9e43640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ffac40c2460 con 0x7ffac406d540 2024-09-19T06:44:25.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.928+0000 7ffac9e43640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffac41581b0 con 0x7ffac406d920 2024-09-19T06:44:25.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.928+0000 7ffac9e43640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ffac40c25e0 con 0x7ffac40c1f70 2024-09-19T06:44:25.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.928+0000 7ffac8e41640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffac406d540 0x7ffac4149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:25.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.928+0000 7ffac8e41640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffac406d540 0x7ffac4149e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33190/0 (socket says 172.21.15.86:33190) 2024-09-19T06:44:25.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.928+0000 7ffac8e41640 1 -- 172.21.15.86:0/388566551 learned_addr learned my addr 172.21.15.86:0/388566551 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:25.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.929+0000 7ffac8e41640 1 -- 172.21.15.86:0/388566551 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffac40c1f70 msgr2=0x7ffac4146cd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:44:25.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.929+0000 7ffac8e41640 1 --2- 172.21.15.86:0/388566551 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffac40c1f70 0x7ffac4146cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.929+0000 7ffac8e41640 1 -- 172.21.15.86:0/388566551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffac406d920 msgr2=0x7ffac414c250 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:44:25.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.929+0000 7ffac8e41640 1 --2- 172.21.15.86:0/388566551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffac406d920 0x7ffac414c250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.929+0000 7ffac8e41640 1 -- 172.21.15.86:0/388566551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac414c790 con 0x7ffac406d540 2024-09-19T06:44:25.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.930+0000 7ffac8e41640 1 --2- 172.21.15.86:0/388566551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffac406d540 0x7ffac4149e10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ffab800b700 tx=0x7ffab800bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:25.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.931+0000 7ffac17fa640 1 -- 172.21.15.86:0/388566551 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab8019070 con 0x7ffac406d540 2024-09-19T06:44:25.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.931+0000 7ffac17fa640 1 -- 172.21.15.86:0/388566551 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffab800c800 con 0x7ffac406d540 2024-09-19T06:44:25.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.931+0000 7ffac17fa640 1 -- 172.21.15.86:0/388566551 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab800cbf0 con 0x7ffac406d540 2024-09-19T06:44:25.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.931+0000 7ffac9e43640 1 -- 172.21.15.86:0/388566551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffac41f5ea0 con 0x7ffac406d540 2024-09-19T06:44:25.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.931+0000 7ffac9e43640 1 -- 172.21.15.86:0/388566551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffac414b000 con 0x7ffac406d540 2024-09-19T06:44:25.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.933+0000 7ffaaeffd640 1 -- 172.21.15.86:0/388566551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa9c005290 con 0x7ffac406d540 2024-09-19T06:44:25.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.935+0000 7ffac17fa640 1 -- 172.21.15.86:0/388566551 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ffab801c360 con 0x7ffac406d540 2024-09-19T06:44:25.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.939+0000 7ffac17fa640 1 --2- 172.21.15.86:0/388566551 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ffaa806c330 0x7ffaa806e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:25.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.939+0000 7ffac17fa640 1 -- 172.21.15.86:0/388566551 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7079+0+0 (secure 0 0 0) 0x7ffab808ac50 con 0x7ffac406d540 2024-09-19T06:44:25.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.949+0000 7ffac3fff640 1 --2- 172.21.15.86:0/388566551 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ffaa806c330 0x7ffaa806e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:25.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.950+0000 7ffac3fff640 1 --2- 172.21.15.86:0/388566551 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ffaa806c330 0x7ffaa806e7f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ffab0000f60 tx=0x7ffab0007990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:25.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:25.953+0000 7ffac17fa640 1 -- 172.21.15.86:0/388566551 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ffab8058fd0 con 0x7ffac406d540 2024-09-19T06:44:26.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:26.381+0000 7ffaaeffd640 1 -- 172.21.15.86:0/388566551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa9c005850 con 0x7ffac406d540 2024-09-19T06:44:26.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:26.383+0000 7ffac17fa640 1 -- 172.21.15.86:0/388566551 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+6874 (secure 0 0 0) 0x7ffab80588d0 con 0x7ffac406d540 2024-09-19T06:44:26.386 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:44:26.387 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":29,"btime":"2024-09-19T06:44:19:664861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":5211,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:16.648712+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"d","rank":0,"incarnation":25,"state":"up:active","state_seq":30,"addr":"172.21.15.169:6837/3116130916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":3116130916},{"type":"v1","addr":"172.21.15.169:6837","nonce":3116130916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4718,"qdb_cluster":[4718]},"id":1}]} 2024-09-19T06:44:26.388 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 29 2024-09-19T06:44:26.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:26.392+0000 7ffaaeffd640 1 -- 172.21.15.86:0/388566551 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ffaa806c330 msgr2=0x7ffaa806e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:26.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:26.392+0000 7ffaaeffd640 1 --2- 172.21.15.86:0/388566551 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ffaa806c330 0x7ffaa806e7f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ffab0000f60 tx=0x7ffab0007990 comp rx=0 tx=0).stop 2024-09-19T06:44:26.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:26.392+0000 7ffaaeffd640 1 -- 172.21.15.86:0/388566551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffac406d540 msgr2=0x7ffac4149e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:26.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:26.392+0000 7ffaaeffd640 1 --2- 172.21.15.86:0/388566551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffac406d540 0x7ffac4149e10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ffab800b700 tx=0x7ffab800bbc0 comp rx=0 tx=0).stop 2024-09-19T06:44:26.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:26.397+0000 7ffaaeffd640 1 -- 172.21.15.86:0/388566551 shutdown_connections 2024-09-19T06:44:26.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:26.397+0000 7ffaaeffd640 1 --2- 172.21.15.86:0/388566551 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ffaa806c330 0x7ffaa806e7f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:26.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:26.397+0000 7ffaaeffd640 1 --2- 172.21.15.86:0/388566551 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffac40c1f70 0x7ffac4146cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:26.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:26.397+0000 7ffaaeffd640 1 --2- 172.21.15.86:0/388566551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffac406d920 0x7ffac414c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:26.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:26.397+0000 7ffaaeffd640 1 --2- 172.21.15.86:0/388566551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffac406d540 0x7ffac4149e10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:26.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:26.397+0000 7ffaaeffd640 1 -- 172.21.15.86:0/388566551 >> 172.21.15.86:0/388566551 conn(0x7ffac40c9a50 msgr2=0x7ffac40cc330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:26.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:26.403+0000 7ffaaeffd640 1 -- 172.21.15.86:0/388566551 shutdown_connections 2024-09-19T06:44:26.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:26.403+0000 7ffaaeffd640 1 -- 172.21.15.86:0/388566551 wait complete. 2024-09-19T06:44:26.427 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-09-19T06:44:28.427 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:44:28.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.631+0000 7f270d2a8640 1 Processor -- start 2024-09-19T06:44:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.633+0000 7f270d2a8640 1 -- start start 2024-09-19T06:44:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.634+0000 7f270d2a8640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f27000d8870 0x7f2700049950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.634+0000 7f270d2a8640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f27000dee40 0x7f2700049e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.634+0000 7f270d2a8640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2700050850 con 0x7f27000502d0 2024-09-19T06:44:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.634+0000 7f270d2a8640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f27000e1c60 con 0x7f27000d8870 2024-09-19T06:44:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.634+0000 7f270d2a8640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f27000e1f40 con 0x7f27000dee40 2024-09-19T06:44:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.635+0000 7f27077fe640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f27000502d0 0x7f27000de730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33438/0 (socket says 172.21.15.86:33438) 2024-09-19T06:44:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.635+0000 7f27077fe640 1 -- 172.21.15.86:0/573847196 learned_addr learned my addr 172.21.15.86:0/573847196 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:44:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.635+0000 7f2707fff640 1 --2- 172.21.15.86:0/573847196 >> v2:172.21.15.86:3300/0 conn(0x7f27000d8870 0x7f2700049950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:28.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.636+0000 7f270caa7640 1 --2- 172.21.15.86:0/573847196 >> v2:172.21.15.169:3300/0 conn(0x7f27000dee40 0x7f2700049e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:28.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.636+0000 7f2707fff640 1 -- 172.21.15.86:0/573847196 >> v2:172.21.15.169:3300/0 conn(0x7f27000dee40 msgr2=0x7f2700049e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:28.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.636+0000 7f2707fff640 1 --2- 172.21.15.86:0/573847196 >> v2:172.21.15.169:3300/0 conn(0x7f27000dee40 0x7f2700049e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.636+0000 7f2707fff640 1 -- 172.21.15.86:0/573847196 >> v1:172.21.15.86:6789/0 conn(0x7f27000502d0 legacy=0x7f27000de730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:28.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.636+0000 7f2707fff640 1 -- 172.21.15.86:0/573847196 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27000e2220 con 0x7f27000d8870 2024-09-19T06:44:28.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.638+0000 7f2707fff640 1 --2- 172.21.15.86:0/573847196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27000d8870 0x7f2700049950 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f270004af70 tx=0x7f26fc02a010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2f875c1604478a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:28.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.645+0000 7f2706ffd640 1 -- 172.21.15.86:0/573847196 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26fc037070 con 0x7f27000d8870 2024-09-19T06:44:28.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.646+0000 7f2706ffd640 1 -- 172.21.15.86:0/573847196 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26fc02aca0 con 0x7f27000d8870 2024-09-19T06:44:28.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.646+0000 7f2706ffd640 1 -- 172.21.15.86:0/573847196 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26fc032660 con 0x7f27000d8870 2024-09-19T06:44:28.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.647+0000 7f270d2a8640 1 -- 172.21.15.86:0/573847196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27000d8870 msgr2=0x7f2700049950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:28.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.647+0000 7f270d2a8640 1 --2- 172.21.15.86:0/573847196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27000d8870 0x7f2700049950 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f270004af70 tx=0x7f26fc02a010 comp rx=0 tx=0).stop 2024-09-19T06:44:28.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.652+0000 7f270d2a8640 1 -- 172.21.15.86:0/573847196 shutdown_connections 2024-09-19T06:44:28.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.652+0000 7f270d2a8640 1 --2- 172.21.15.86:0/573847196 >> v2:172.21.15.169:3300/0 conn(0x7f27000dee40 0x7f2700049e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.652+0000 7f270d2a8640 1 --2- 172.21.15.86:0/573847196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27000d8870 0x7f2700049950 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.652+0000 7f270d2a8640 1 -- 172.21.15.86:0/573847196 >> 172.21.15.86:0/573847196 conn(0x7f2700054450 msgr2=0x7f2700054860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:28.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.653+0000 7f270d2a8640 1 -- 172.21.15.86:0/573847196 shutdown_connections 2024-09-19T06:44:28.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.653+0000 7f270d2a8640 1 -- 172.21.15.86:0/573847196 wait complete. 2024-09-19T06:44:28.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.655+0000 7f270d2a8640 1 Processor -- start 2024-09-19T06:44:28.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.656+0000 7f270d2a8640 1 -- start start 2024-09-19T06:44:28.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.657+0000 7f270d2a8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27000502d0 0x7f27000dd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.659+0000 7f270d2a8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27000d8870 0x7f270004f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.659+0000 7f270d2a8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27000dee40 0x7f27000dabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.659+0000 7f270d2a8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f27000d8c50 con 0x7f27000d8870 2024-09-19T06:44:28.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.659+0000 7f270d2a8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f270000f720 con 0x7f27000502d0 2024-09-19T06:44:28.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.659+0000 7f270d2a8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f27000d8dd0 con 0x7f27000dee40 2024-09-19T06:44:28.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.660+0000 7f27077fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27000d8870 0x7f270004f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:28.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.660+0000 7f27077fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27000d8870 0x7f270004f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33210/0 (socket says 172.21.15.86:33210) 2024-09-19T06:44:28.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.660+0000 7f27077fe640 1 -- 172.21.15.86:0/4060170995 learned_addr learned my addr 172.21.15.86:0/4060170995 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:28.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.660+0000 7f2707fff640 1 --2- 172.21.15.86:0/4060170995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27000502d0 0x7f27000dd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:28.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.660+0000 7f270caa7640 1 --2- 172.21.15.86:0/4060170995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27000dee40 0x7f27000dabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:28.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.660+0000 7f27077fe640 1 -- 172.21.15.86:0/4060170995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27000dee40 msgr2=0x7f27000dabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:28.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.660+0000 7f27077fe640 1 --2- 172.21.15.86:0/4060170995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27000dee40 0x7f27000dabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.660+0000 7f27077fe640 1 -- 172.21.15.86:0/4060170995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27000502d0 msgr2=0x7f27000dd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:28.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.660+0000 7f27077fe640 1 --2- 172.21.15.86:0/4060170995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27000502d0 0x7f27000dd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.660+0000 7f27077fe640 1 -- 172.21.15.86:0/4060170995 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27000da430 con 0x7f27000d8870 2024-09-19T06:44:28.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.661+0000 7f27077fe640 1 --2- 172.21.15.86:0/4060170995 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27000d8870 0x7f270004f7a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2708050d60 tx=0x7f27080692f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:28.664 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.662+0000 7f2704ff9640 1 -- 172.21.15.86:0/4060170995 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270806bbc0 con 0x7f27000d8870 2024-09-19T06:44:28.664 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.662+0000 7f2704ff9640 1 -- 172.21.15.86:0/4060170995 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f270806bd60 con 0x7f27000d8870 2024-09-19T06:44:28.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.662+0000 7f270d2a8640 1 -- 172.21.15.86:0/4060170995 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27000ddc90 con 0x7f27000d8870 2024-09-19T06:44:28.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.662+0000 7f270d2a8640 1 -- 172.21.15.86:0/4060170995 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2700185240 con 0x7f27000d8870 2024-09-19T06:44:28.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.664+0000 7f26f27fc640 1 -- 172.21.15.86:0/4060170995 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2700036e20 con 0x7f27000d8870 2024-09-19T06:44:28.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.674+0000 7f2704ff9640 1 -- 172.21.15.86:0/4060170995 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2708074730 con 0x7f27000d8870 2024-09-19T06:44:28.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.675+0000 7f2704ff9640 1 -- 172.21.15.86:0/4060170995 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2708095020 con 0x7f27000d8870 2024-09-19T06:44:28.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.676+0000 7f2704ff9640 1 --2- 172.21.15.86:0/4060170995 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f26ec06c3b0 0x7f26ec06e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.676+0000 7f2704ff9640 1 -- 172.21.15.86:0/4060170995 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7079+0+0 (secure 0 0 0) 0x7f27081081e0 con 0x7f27000d8870 2024-09-19T06:44:28.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.677+0000 7f2707fff640 1 --2- 172.21.15.86:0/4060170995 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f26ec06c3b0 0x7f26ec06e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:28.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.678+0000 7f2707fff640 1 --2- 172.21.15.86:0/4060170995 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f26ec06c3b0 0x7f26ec06e870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f26fc034000 tx=0x7f26fc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:28.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:28.678+0000 7f2704ff9640 1 -- 172.21.15.86:0/4060170995 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2708108650 con 0x7f27000d8870 2024-09-19T06:44:29.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:29.125+0000 7f26f27fc640 1 -- 172.21.15.86:0/4060170995 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27000dbdb0 con 0x7f27000d8870 2024-09-19T06:44:29.127 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:44:29.127 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":29,"btime":"2024-09-19T06:44:19:664861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":5211,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:16.648712+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"d","rank":0,"incarnation":25,"state":"up:active","state_seq":30,"addr":"172.21.15.169:6837/3116130916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":3116130916},{"type":"v1","addr":"172.21.15.169:6837","nonce":3116130916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4718,"qdb_cluster":[4718]},"id":1}]} 2024-09-19T06:44:29.128 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 29 2024-09-19T06:44:29.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:29.126+0000 7f2704ff9640 1 -- 172.21.15.86:0/4060170995 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+6874 (secure 0 0 0) 0x7f27080d6340 con 0x7f27000d8870 2024-09-19T06:44:29.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:29.128+0000 7f26f27fc640 1 -- 172.21.15.86:0/4060170995 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f26ec06c3b0 msgr2=0x7f26ec06e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:29.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:29.128+0000 7f26f27fc640 1 --2- 172.21.15.86:0/4060170995 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f26ec06c3b0 0x7f26ec06e870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f26fc034000 tx=0x7f26fc02e000 comp rx=0 tx=0).stop 2024-09-19T06:44:29.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:29.128+0000 7f26f27fc640 1 -- 172.21.15.86:0/4060170995 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27000d8870 msgr2=0x7f270004f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:29.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:29.128+0000 7f26f27fc640 1 --2- 172.21.15.86:0/4060170995 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27000d8870 0x7f270004f7a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2708050d60 tx=0x7f27080692f0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:29.128+0000 7f26f27fc640 1 -- 172.21.15.86:0/4060170995 shutdown_connections 2024-09-19T06:44:29.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:29.128+0000 7f26f27fc640 1 --2- 172.21.15.86:0/4060170995 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f26ec06c3b0 0x7f26ec06e870 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:29.128+0000 7f26f27fc640 1 --2- 172.21.15.86:0/4060170995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27000dee40 0x7f27000dabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:29.128+0000 7f26f27fc640 1 --2- 172.21.15.86:0/4060170995 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27000d8870 0x7f270004f7a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:29.128+0000 7f26f27fc640 1 --2- 172.21.15.86:0/4060170995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27000502d0 0x7f27000dd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:29.128+0000 7f26f27fc640 1 -- 172.21.15.86:0/4060170995 >> 172.21.15.86:0/4060170995 conn(0x7f2700054450 msgr2=0x7f27000067b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:29.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:29.128+0000 7f26f27fc640 1 -- 172.21.15.86:0/4060170995 shutdown_connections 2024-09-19T06:44:29.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:29.128+0000 7f26f27fc640 1 -- 172.21.15.86:0/4060170995 wait complete. 2024-09-19T06:44:29.155 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-09-19T06:44:31.155 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:44:31.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.357+0000 7f5134874640 1 Processor -- start 2024-09-19T06:44:31.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.357+0000 7f5134874640 1 -- start start 2024-09-19T06:44:31.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.358+0000 7f5134874640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5130159580 0x7f513015a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.358+0000 7f5134874640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5130072d90 con 0x7f5130159980 2024-09-19T06:44:31.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.358+0000 7f5134874640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f513006d020 con 0x7f51301591a0 2024-09-19T06:44:31.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.358+0000 7f5134874640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f513006d300 con 0x7f5130159580 2024-09-19T06:44:31.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.359+0000 7f512dd9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5130159580 0x7f513015a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:31.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.359+0000 7f512e59c640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f51301591a0 0x7f5130072680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:38656/0 (socket says 172.21.15.86:38656) 2024-09-19T06:44:31.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.359+0000 7f512e59c640 1 -- 172.21.15.86:0/4192172303 learned_addr learned my addr 172.21.15.86:0/4192172303 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:44:31.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.359+0000 7f512dd9b640 1 -- 172.21.15.86:0/4192172303 >> v1:172.21.15.169:6789/0 conn(0x7f51301591a0 legacy=0x7f5130072680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:31.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.359+0000 7f512dd9b640 1 -- 172.21.15.86:0/4192172303 >> v1:172.21.15.86:6789/0 conn(0x7f5130159980 legacy=0x7f5130152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:31.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.359+0000 7f512dd9b640 1 -- 172.21.15.86:0/4192172303 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513006d5e0 con 0x7f5130159580 2024-09-19T06:44:31.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.362+0000 7f512dd9b640 1 --2- 172.21.15.86:0/4192172303 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5130159580 0x7f513015a390 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5128009e40 tx=0x7f512802eb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36c38084df47f0eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:31.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.363+0000 7f512d59a640 1 -- 172.21.15.86:0/4192172303 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128030890 con 0x7f5130159580 2024-09-19T06:44:31.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.363+0000 7f512d59a640 1 -- 172.21.15.86:0/4192172303 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5128030a30 con 0x7f5130159580 2024-09-19T06:44:31.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.363+0000 7f512d59a640 1 -- 172.21.15.86:0/4192172303 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128030e40 con 0x7f5130159580 2024-09-19T06:44:31.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.364+0000 7f5134874640 1 -- 172.21.15.86:0/4192172303 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5130159580 msgr2=0x7f513015a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:31.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.364+0000 7f5134874640 1 --2- 172.21.15.86:0/4192172303 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5130159580 0x7f513015a390 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5128009e40 tx=0x7f512802eb30 comp rx=0 tx=0).stop 2024-09-19T06:44:31.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.364+0000 7f5134874640 1 -- 172.21.15.86:0/4192172303 shutdown_connections 2024-09-19T06:44:31.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.364+0000 7f5134874640 1 --2- 172.21.15.86:0/4192172303 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5130159580 0x7f513015a390 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.364+0000 7f5134874640 1 -- 172.21.15.86:0/4192172303 >> 172.21.15.86:0/4192172303 conn(0x7f513006eb60 msgr2=0x7f513006ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:31.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.366+0000 7f5134874640 1 -- 172.21.15.86:0/4192172303 shutdown_connections 2024-09-19T06:44:31.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.366+0000 7f5134874640 1 -- 172.21.15.86:0/4192172303 wait complete. 2024-09-19T06:44:31.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.368+0000 7f5134874640 1 Processor -- start 2024-09-19T06:44:31.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.368+0000 7f5134874640 1 -- start start 2024-09-19T06:44:31.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.369+0000 7f5134874640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51301591a0 0x7f513015c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.369+0000 7f5134874640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5130159580 0x7f51301f5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.369+0000 7f5134874640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5130159980 0x7f51301f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.369+0000 7f5134874640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f513006de80 con 0x7f51301591a0 2024-09-19T06:44:31.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.369+0000 7f5134874640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f513006dba0 con 0x7f5130159580 2024-09-19T06:44:31.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.369+0000 7f5134874640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f51300b31a0 con 0x7f5130159980 2024-09-19T06:44:31.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.370+0000 7f512e59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51301591a0 0x7f513015c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:31.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.370+0000 7f512e59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51301591a0 0x7f513015c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33226/0 (socket says 172.21.15.86:33226) 2024-09-19T06:44:31.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.370+0000 7f512e59c640 1 -- 172.21.15.86:0/57594424 learned_addr learned my addr 172.21.15.86:0/57594424 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:31.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.371+0000 7f512dd9b640 1 --2- 172.21.15.86:0/57594424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5130159580 0x7f51301f5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:31.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.371+0000 7f512ed9d640 1 --2- 172.21.15.86:0/57594424 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5130159980 0x7f51301f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:31.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.371+0000 7f512e59c640 1 -- 172.21.15.86:0/57594424 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5130159980 msgr2=0x7f51301f5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:31.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.371+0000 7f512e59c640 1 --2- 172.21.15.86:0/57594424 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5130159980 0x7f51301f5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.371+0000 7f512e59c640 1 -- 172.21.15.86:0/57594424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5130159580 msgr2=0x7f51301f5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:31.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.371+0000 7f512e59c640 1 --2- 172.21.15.86:0/57594424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5130159580 0x7f51301f5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.371+0000 7f512e59c640 1 -- 172.21.15.86:0/57594424 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51301f88c0 con 0x7f51301591a0 2024-09-19T06:44:31.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.371+0000 7f512e59c640 1 --2- 172.21.15.86:0/57594424 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51301591a0 0x7f513015c690 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f512000c480 tx=0x7f512000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:31.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.373+0000 7f511effd640 1 -- 172.21.15.86:0/57594424 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5120017070 con 0x7f51301591a0 2024-09-19T06:44:31.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.373+0000 7f5134874640 1 -- 172.21.15.86:0/57594424 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51301f8b40 con 0x7f51301591a0 2024-09-19T06:44:31.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.373+0000 7f5134874640 1 -- 172.21.15.86:0/57594424 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51301f9100 con 0x7f51301591a0 2024-09-19T06:44:31.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.375+0000 7f5134874640 1 -- 172.21.15.86:0/57594424 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5130072680 con 0x7f51301591a0 2024-09-19T06:44:31.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.386+0000 7f511effd640 1 -- 172.21.15.86:0/57594424 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5120005ce0 con 0x7f51301591a0 2024-09-19T06:44:31.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.386+0000 7f511effd640 1 -- 172.21.15.86:0/57594424 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51200072d0 con 0x7f51301591a0 2024-09-19T06:44:31.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.387+0000 7f511effd640 1 -- 172.21.15.86:0/57594424 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f512001a070 con 0x7f51301591a0 2024-09-19T06:44:31.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.388+0000 7f511effd640 1 --2- 172.21.15.86:0/57594424 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f511006c3b0 0x7f511006e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.388+0000 7f511effd640 1 -- 172.21.15.86:0/57594424 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7079+0+0 (secure 0 0 0) 0x7f512008ad70 con 0x7f51301591a0 2024-09-19T06:44:31.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.388+0000 7f511effd640 1 -- 172.21.15.86:0/57594424 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f51301f88c0 con 0x7f51301591a0 2024-09-19T06:44:31.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.389+0000 7f512dd9b640 1 --2- 172.21.15.86:0/57594424 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f511006c3b0 0x7f511006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:31.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.390+0000 7f512dd9b640 1 --2- 172.21.15.86:0/57594424 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f511006c3b0 0x7f511006e870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5128039000 tx=0x7f5128034000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:31.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.831+0000 7f5134874640 1 -- 172.21.15.86:0/57594424 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5130071840 con 0x7f51301591a0 2024-09-19T06:44:31.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.835+0000 7f511effd640 1 -- 172.21.15.86:0/57594424 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+6874 (secure 0 0 0) 0x7f51200589a0 con 0x7f51301591a0 2024-09-19T06:44:31.837 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:44:31.839 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":29,"btime":"2024-09-19T06:44:19:664861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":5211,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:16.648712+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"d","rank":0,"incarnation":25,"state":"up:active","state_seq":30,"addr":"172.21.15.169:6837/3116130916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":3116130916},{"type":"v1","addr":"172.21.15.169:6837","nonce":3116130916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4718,"qdb_cluster":[4718]},"id":1}]} 2024-09-19T06:44:31.839 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 29 2024-09-19T06:44:31.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.839+0000 7f5134874640 1 -- 172.21.15.86:0/57594424 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f511006c3b0 msgr2=0x7f511006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:31.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.839+0000 7f5134874640 1 --2- 172.21.15.86:0/57594424 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f511006c3b0 0x7f511006e870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5128039000 tx=0x7f5128034000 comp rx=0 tx=0).stop 2024-09-19T06:44:31.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.839+0000 7f5134874640 1 -- 172.21.15.86:0/57594424 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51301591a0 msgr2=0x7f513015c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:31.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.839+0000 7f5134874640 1 --2- 172.21.15.86:0/57594424 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51301591a0 0x7f513015c690 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f512000c480 tx=0x7f512000c940 comp rx=0 tx=0).stop 2024-09-19T06:44:31.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.840+0000 7f5134874640 1 -- 172.21.15.86:0/57594424 shutdown_connections 2024-09-19T06:44:31.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.840+0000 7f5134874640 1 --2- 172.21.15.86:0/57594424 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f511006c3b0 0x7f511006e870 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.840+0000 7f5134874640 1 --2- 172.21.15.86:0/57594424 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5130159980 0x7f51301f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.840+0000 7f5134874640 1 --2- 172.21.15.86:0/57594424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5130159580 0x7f51301f5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.840+0000 7f5134874640 1 --2- 172.21.15.86:0/57594424 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51301591a0 0x7f513015c690 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.840+0000 7f5134874640 1 -- 172.21.15.86:0/57594424 >> 172.21.15.86:0/57594424 conn(0x7f513006eb60 msgr2=0x7f51301587f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:31.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.840+0000 7f5134874640 1 -- 172.21.15.86:0/57594424 shutdown_connections 2024-09-19T06:44:31.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:31.841+0000 7f5134874640 1 -- 172.21.15.86:0/57594424 wait complete. 2024-09-19T06:44:31.864 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-09-19T06:44:33.865 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:44:34.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.044+0000 7faf5c54b640 1 Processor -- start 2024-09-19T06:44:34.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.044+0000 7faf5c54b640 1 -- start start 2024-09-19T06:44:34.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.045+0000 7faf5c54b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7faf54073f30 0x7faf540c2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:34.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.045+0000 7faf5c54b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf5406de50 0x7faf5415f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:34.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.045+0000 7faf5c54b640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf54067aa0 con 0x7faf54159660 2024-09-19T06:44:34.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.045+0000 7faf5c54b640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7faf5406ccf0 con 0x7faf54073f30 2024-09-19T06:44:34.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.045+0000 7faf5c54b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7faf5406d2b0 con 0x7faf5406de50 2024-09-19T06:44:34.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.046+0000 7faf5aae8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf5406de50 0x7faf5415f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:34.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.046+0000 7faf5a2e7640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7faf54159660 0x7faf5406d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56110/0 (socket says 172.21.15.86:56110) 2024-09-19T06:44:34.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.046+0000 7faf5a2e7640 1 -- 172.21.15.86:0/2553976827 learned_addr learned my addr 172.21.15.86:0/2553976827 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:44:34.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.046+0000 7faf5aae8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf5406de50 0x7faf5415f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:50094/0 (socket says 172.21.15.86:50094) 2024-09-19T06:44:34.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.046+0000 7faf59ae6640 1 --2- 172.21.15.86:0/2553976827 >> v2:172.21.15.169:3300/0 conn(0x7faf54073f30 0x7faf540c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:34.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.047+0000 7faf5aae8640 1 -- 172.21.15.86:0/2553976827 >> v2:172.21.15.169:3300/0 conn(0x7faf54073f30 msgr2=0x7faf540c2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:34.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.047+0000 7faf5aae8640 1 --2- 172.21.15.86:0/2553976827 >> v2:172.21.15.169:3300/0 conn(0x7faf54073f30 0x7faf540c2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:34.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.047+0000 7faf5aae8640 1 -- 172.21.15.86:0/2553976827 >> v1:172.21.15.86:6789/0 conn(0x7faf54159660 legacy=0x7faf5406d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:34.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.047+0000 7faf5aae8640 1 -- 172.21.15.86:0/2553976827 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf54067d80 con 0x7faf5406de50 2024-09-19T06:44:34.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.047+0000 7faf59ae6640 1 --2- 172.21.15.86:0/2553976827 >> v2:172.21.15.169:3300/0 conn(0x7faf54073f30 0x7faf540c2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:44:34.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.052+0000 7faf5aae8640 1 --2- 172.21.15.86:0/2553976827 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf5406de50 0x7faf5415f4a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009d90 tx=0x7faf4c02a550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c308725fb2fe18d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:34.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.052+0000 7faf592e5640 1 -- 172.21.15.86:0/2553976827 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c007740 con 0x7faf5406de50 2024-09-19T06:44:34.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.052+0000 7faf592e5640 1 -- 172.21.15.86:0/2553976827 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf4c0078e0 con 0x7faf5406de50 2024-09-19T06:44:34.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.053+0000 7faf5c54b640 1 -- 172.21.15.86:0/2553976827 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf5406de50 msgr2=0x7faf5415f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:34.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.053+0000 7faf5c54b640 1 --2- 172.21.15.86:0/2553976827 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf5406de50 0x7faf5415f4a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009d90 tx=0x7faf4c02a550 comp rx=0 tx=0).stop 2024-09-19T06:44:34.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.054+0000 7faf5c54b640 1 -- 172.21.15.86:0/2553976827 shutdown_connections 2024-09-19T06:44:34.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.054+0000 7faf5c54b640 1 --2- 172.21.15.86:0/2553976827 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf5406de50 0x7faf5415f4a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:34.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.054+0000 7faf5c54b640 1 --2- 172.21.15.86:0/2553976827 >> v2:172.21.15.169:3300/0 conn(0x7faf54073f30 0x7faf540c2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:34.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.054+0000 7faf5c54b640 1 -- 172.21.15.86:0/2553976827 >> 172.21.15.86:0/2553976827 conn(0x7faf5406bbc0 msgr2=0x7faf5406bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:34.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.056+0000 7faf5c54b640 1 -- 172.21.15.86:0/2553976827 shutdown_connections 2024-09-19T06:44:34.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.056+0000 7faf5c54b640 1 -- 172.21.15.86:0/2553976827 wait complete. 2024-09-19T06:44:34.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.057+0000 7faf5c54b640 1 Processor -- start 2024-09-19T06:44:34.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.058+0000 7faf5c54b640 1 -- start start 2024-09-19T06:44:34.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.059+0000 7faf5c54b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf54073f30 0x7faf541e7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:34.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.059+0000 7faf5c54b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf54159660 0x7faf540b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:34.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.059+0000 7faf5c54b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf540b0dc0 0x7faf540b2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:34.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.059+0000 7faf5c54b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faf54159bc0 con 0x7faf540b0dc0 2024-09-19T06:44:34.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.059+0000 7faf5c54b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faf54159a40 con 0x7faf54159660 2024-09-19T06:44:34.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.059+0000 7faf5c54b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7faf5415f9e0 con 0x7faf54073f30 2024-09-19T06:44:34.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.059+0000 7faf59ae6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf54159660 0x7faf540b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:34.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.059+0000 7faf5a2e7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf54073f30 0x7faf541e7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:34.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.059+0000 7faf59ae6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf54159660 0x7faf540b2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:43254/0 (socket says 172.21.15.86:43254) 2024-09-19T06:44:34.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.060+0000 7faf59ae6640 1 -- 172.21.15.86:0/1477319321 learned_addr learned my addr 172.21.15.86:0/1477319321 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:34.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.060+0000 7faf5aae8640 1 --2- 172.21.15.86:0/1477319321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf540b0dc0 0x7faf540b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:34.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.060+0000 7faf5a2e7640 1 -- 172.21.15.86:0/1477319321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf54159660 msgr2=0x7faf540b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:34.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.060+0000 7faf5a2e7640 1 --2- 172.21.15.86:0/1477319321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf54159660 0x7faf540b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:34.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.060+0000 7faf5a2e7640 1 -- 172.21.15.86:0/1477319321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf540b0dc0 msgr2=0x7faf540b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:34.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.060+0000 7faf5a2e7640 1 --2- 172.21.15.86:0/1477319321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf540b0dc0 0x7faf540b2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:34.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.060+0000 7faf5a2e7640 1 -- 172.21.15.86:0/1477319321 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf540c7280 con 0x7faf54073f30 2024-09-19T06:44:34.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.060+0000 7faf5aae8640 1 --2- 172.21.15.86:0/1477319321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf540b0dc0 0x7faf540b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:44:34.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.061+0000 7faf5a2e7640 1 --2- 172.21.15.86:0/1477319321 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf54073f30 0x7faf541e7960 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faf5000c520 tx=0x7faf5000c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:34.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.063+0000 7faf4affd640 1 -- 172.21.15.86:0/1477319321 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf50018070 con 0x7faf54073f30 2024-09-19T06:44:34.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.063+0000 7faf4affd640 1 -- 172.21.15.86:0/1477319321 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf50007560 con 0x7faf54073f30 2024-09-19T06:44:34.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.064+0000 7faf4affd640 1 -- 172.21.15.86:0/1477319321 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf500049e0 con 0x7faf54073f30 2024-09-19T06:44:34.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.065+0000 7faf5c54b640 1 -- 172.21.15.86:0/1477319321 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf540c7540 con 0x7faf54073f30 2024-09-19T06:44:34.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.065+0000 7faf5c54b640 1 -- 172.21.15.86:0/1477319321 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faf542129a0 con 0x7faf54073f30 2024-09-19T06:44:34.076 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.071+0000 7faf4affd640 1 -- 172.21.15.86:0/1477319321 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7faf5001b070 con 0x7faf54073f30 2024-09-19T06:44:34.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.071+0000 7faf4affd640 1 --2- 172.21.15.86:0/1477319321 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7faf3806c380 0x7faf3806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:34.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.071+0000 7faf4affd640 1 -- 172.21.15.86:0/1477319321 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 7079+0+0 (secure 0 0 0) 0x7faf5008ace0 con 0x7faf54073f30 2024-09-19T06:44:34.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.070+0000 7faf5c54b640 1 -- 172.21.15.86:0/1477319321 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf5415f4a0 con 0x7faf54073f30 2024-09-19T06:44:34.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.075+0000 7faf59ae6640 1 --2- 172.21.15.86:0/1477319321 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7faf3806c380 0x7faf3806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:34.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.076+0000 7faf59ae6640 1 --2- 172.21.15.86:0/1477319321 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7faf3806c380 0x7faf3806e840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7faf44009560 tx=0x7faf44009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:34.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.080+0000 7faf4affd640 1 -- 172.21.15.86:0/1477319321 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7faf50058880 con 0x7faf54073f30 2024-09-19T06:44:34.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.524+0000 7faf5c54b640 1 -- 172.21.15.86:0/1477319321 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf54073b00 con 0x7faf54073f30 2024-09-19T06:44:34.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.526+0000 7faf4affd640 1 -- 172.21.15.86:0/1477319321 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+6874 (secure 0 0 0) 0x7faf5005cb80 con 0x7faf54073f30 2024-09-19T06:44:34.528 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:44:34.528 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":29,"btime":"2024-09-19T06:44:19:664861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":5211,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:16.648712+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"d","rank":0,"incarnation":25,"state":"up:active","state_seq":30,"addr":"172.21.15.169:6837/3116130916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":3116130916},{"type":"v1","addr":"172.21.15.169:6837","nonce":3116130916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4718,"qdb_cluster":[4718]},"id":1}]} 2024-09-19T06:44:34.528 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 29 2024-09-19T06:44:34.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.531+0000 7faf48ff9640 1 -- 172.21.15.86:0/1477319321 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7faf3806c380 msgr2=0x7faf3806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:34.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.531+0000 7faf48ff9640 1 --2- 172.21.15.86:0/1477319321 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7faf3806c380 0x7faf3806e840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7faf44009560 tx=0x7faf44009190 comp rx=0 tx=0).stop 2024-09-19T06:44:34.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.532+0000 7faf48ff9640 1 -- 172.21.15.86:0/1477319321 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf54073f30 msgr2=0x7faf541e7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:34.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.532+0000 7faf48ff9640 1 --2- 172.21.15.86:0/1477319321 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf54073f30 0x7faf541e7960 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faf5000c520 tx=0x7faf5000c9e0 comp rx=0 tx=0).stop 2024-09-19T06:44:34.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.532+0000 7faf48ff9640 1 -- 172.21.15.86:0/1477319321 shutdown_connections 2024-09-19T06:44:34.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.532+0000 7faf48ff9640 1 --2- 172.21.15.86:0/1477319321 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7faf3806c380 0x7faf3806e840 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:34.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.532+0000 7faf48ff9640 1 --2- 172.21.15.86:0/1477319321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf540b0dc0 0x7faf540b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:34.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.532+0000 7faf48ff9640 1 --2- 172.21.15.86:0/1477319321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf54159660 0x7faf540b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:34.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.532+0000 7faf48ff9640 1 --2- 172.21.15.86:0/1477319321 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf54073f30 0x7faf541e7960 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:34.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.532+0000 7faf48ff9640 1 -- 172.21.15.86:0/1477319321 >> 172.21.15.86:0/1477319321 conn(0x7faf5406bbc0 msgr2=0x7faf5415d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:34.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.532+0000 7faf48ff9640 1 -- 172.21.15.86:0/1477319321 shutdown_connections 2024-09-19T06:44:34.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:34.532+0000 7faf48ff9640 1 -- 172.21.15.86:0/1477319321 wait complete. 2024-09-19T06:44:34.552 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-09-19T06:44:36.553 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:44:36.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.744+0000 7f64ed244640 1 Processor -- start 2024-09-19T06:44:36.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.744+0000 7f64ed244640 1 -- start start 2024-09-19T06:44:36.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.746+0000 7f64ed244640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f64e80c9c40 0x7f64e815f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:36.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.746+0000 7f64ed244640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f64e815f790 0x7f64e8159060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:36.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.746+0000 7f64ed244640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64e815fe00 con 0x7f64e80c9860 2024-09-19T06:44:36.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.746+0000 7f64ed244640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f64e806f1f0 con 0x7f64e80c9c40 2024-09-19T06:44:36.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.746+0000 7f64ed244640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f64e815fbe0 con 0x7f64e815f790 2024-09-19T06:44:36.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.746+0000 7f64e77fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f64e80c9c40 0x7f64e815f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:36.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.746+0000 7f64e77fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f64e80c9c40 0x7f64e815f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59062/0 (socket says 172.21.15.86:59062) 2024-09-19T06:44:36.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.746+0000 7f64e77fe640 1 -- 172.21.15.86:0/3435366076 learned_addr learned my addr 172.21.15.86:0/3435366076 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:36.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.747+0000 7f64e77fe640 1 -- 172.21.15.86:0/3435366076 >> v2:172.21.15.169:3300/0 conn(0x7f64e815f790 msgr2=0x7f64e8159060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:44:36.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.747+0000 7f64e77fe640 1 --2- 172.21.15.86:0/3435366076 >> v2:172.21.15.169:3300/0 conn(0x7f64e815f790 0x7f64e8159060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:36.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.747+0000 7f64e77fe640 1 -- 172.21.15.86:0/3435366076 >> v1:172.21.15.169:6789/0 conn(0x7f64e80c9860 legacy=0x7f64e81606c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:36.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.747+0000 7f64e77fe640 1 -- 172.21.15.86:0/3435366076 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e81600c0 con 0x7f64e80c9c40 2024-09-19T06:44:36.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.748+0000 7f64e77fe640 1 --2- 172.21.15.86:0/3435366076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64e80c9c40 0x7f64e815f250 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f64e806f7a0 tx=0x7f64e002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ac452e2d3643f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:36.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.749+0000 7f64e6ffd640 1 -- 172.21.15.86:0/3435366076 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e0036070 con 0x7f64e80c9c40 2024-09-19T06:44:36.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.750+0000 7f64e6ffd640 1 -- 172.21.15.86:0/3435366076 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e0031600 con 0x7f64e80c9c40 2024-09-19T06:44:36.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.751+0000 7f64ed244640 1 -- 172.21.15.86:0/3435366076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64e80c9c40 msgr2=0x7f64e815f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:36.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.751+0000 7f64ed244640 1 --2- 172.21.15.86:0/3435366076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64e80c9c40 0x7f64e815f250 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f64e806f7a0 tx=0x7f64e002a7a0 comp rx=0 tx=0).stop 2024-09-19T06:44:36.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.751+0000 7f64ed244640 1 -- 172.21.15.86:0/3435366076 shutdown_connections 2024-09-19T06:44:36.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.751+0000 7f64ed244640 1 --2- 172.21.15.86:0/3435366076 >> v2:172.21.15.169:3300/0 conn(0x7f64e815f790 0x7f64e8159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:36.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.751+0000 7f64ed244640 1 --2- 172.21.15.86:0/3435366076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64e80c9c40 0x7f64e815f250 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:36.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.751+0000 7f64ed244640 1 -- 172.21.15.86:0/3435366076 >> 172.21.15.86:0/3435366076 conn(0x7f64e806bda0 msgr2=0x7f64e806c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:36.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.756+0000 7f64ed244640 1 -- 172.21.15.86:0/3435366076 shutdown_connections 2024-09-19T06:44:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.756+0000 7f64ed244640 1 -- 172.21.15.86:0/3435366076 wait complete. 2024-09-19T06:44:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.757+0000 7f64ed244640 1 Processor -- start 2024-09-19T06:44:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.758+0000 7f64ed244640 1 -- start start 2024-09-19T06:44:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.760+0000 7f64ed244640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64e815f790 0x7f64e8072310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.760+0000 7f64ed244640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64e815c4f0 0x7f64e80c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.760+0000 7f64ed244640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64e815c930 0x7f64e80c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.760+0000 7f64ed244640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f64e806e710 con 0x7f64e815f790 2024-09-19T06:44:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.760+0000 7f64ed244640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f64e806e430 con 0x7f64e815c930 2024-09-19T06:44:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.760+0000 7f64ed244640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f64e806e9f0 con 0x7f64e815c4f0 2024-09-19T06:44:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.761+0000 7f64eca43640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64e815c930 0x7f64e80c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.761+0000 7f64eca43640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64e815c930 0x7f64e80c57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:43266/0 (socket says 172.21.15.86:43266) 2024-09-19T06:44:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.761+0000 7f64eca43640 1 -- 172.21.15.86:0/2534535530 learned_addr learned my addr 172.21.15.86:0/2534535530 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:36.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.761+0000 7f64e77fe640 1 --2- 172.21.15.86:0/2534535530 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64e815c4f0 0x7f64e80c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:36.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.761+0000 7f64e7fff640 1 --2- 172.21.15.86:0/2534535530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64e815f790 0x7f64e8072310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:36.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.761+0000 7f64e77fe640 1 -- 172.21.15.86:0/2534535530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64e815c930 msgr2=0x7f64e80c57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:36.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.761+0000 7f64e77fe640 1 --2- 172.21.15.86:0/2534535530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64e815c930 0x7f64e80c57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:36.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.761+0000 7f64e77fe640 1 -- 172.21.15.86:0/2534535530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64e815f790 msgr2=0x7f64e8072310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:36.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.761+0000 7f64e77fe640 1 --2- 172.21.15.86:0/2534535530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64e815f790 0x7f64e8072310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:36.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.761+0000 7f64e77fe640 1 -- 172.21.15.86:0/2534535530 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e817b890 con 0x7f64e815c4f0 2024-09-19T06:44:36.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.767+0000 7f64e77fe640 1 --2- 172.21.15.86:0/2534535530 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64e815c4f0 0x7f64e80c52b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f64e0030000 tx=0x7f64e0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:36.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.768+0000 7f64e4ff9640 1 -- 172.21.15.86:0/2534535530 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e0041030 con 0x7f64e815c4f0 2024-09-19T06:44:36.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.768+0000 7f64ed244640 1 -- 172.21.15.86:0/2534535530 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64e8071240 con 0x7f64e815c4f0 2024-09-19T06:44:36.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.768+0000 7f64ed244640 1 -- 172.21.15.86:0/2534535530 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f64e815b720 con 0x7f64e815c4f0 2024-09-19T06:44:36.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.768+0000 7f64e4ff9640 1 -- 172.21.15.86:0/2534535530 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e0009ae0 con 0x7f64e815c4f0 2024-09-19T06:44:36.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.768+0000 7f64e4ff9640 1 -- 172.21.15.86:0/2534535530 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e0036040 con 0x7f64e815c4f0 2024-09-19T06:44:36.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.773+0000 7f64e4ff9640 1 -- 172.21.15.86:0/2534535530 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f64e0044070 con 0x7f64e815c4f0 2024-09-19T06:44:36.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.776+0000 7f64e4ff9640 1 --2- 172.21.15.86:0/2534535530 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f64d406c2b0 0x7f64d406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:36.779 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.778+0000 7f64e4ff9640 1 -- 172.21.15.86:0/2534535530 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 7165+0+0 (secure 0 0 0) 0x7f64e00ac9e0 con 0x7f64e815c4f0 2024-09-19T06:44:36.781 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.778+0000 7f64e7fff640 1 --2- 172.21.15.86:0/2534535530 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f64d406c2b0 0x7f64d406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:36.781 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.780+0000 7f64ed244640 1 -- 172.21.15.86:0/2534535530 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64c8005290 con 0x7f64e815c4f0 2024-09-19T06:44:36.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.781+0000 7f64e7fff640 1 --2- 172.21.15.86:0/2534535530 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f64d406c2b0 0x7f64d406e770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f64e80c90a0 tx=0x7f64dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:36.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:36.795+0000 7f64e4ff9640 1 -- 172.21.15.86:0/2534535530 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f64e007ab90 con 0x7f64e815c4f0 2024-09-19T06:44:37.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.225+0000 7f64ed244640 1 -- 172.21.15.86:0/2534535530 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64c8005580 con 0x7f64e815c4f0 2024-09-19T06:44:37.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.229+0000 7f64e4ff9640 1 -- 172.21.15.86:0/2534535530 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+6038 (secure 0 0 0) 0x7f64e007a490 con 0x7f64e815c4f0 2024-09-19T06:44:37.231 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:44:37.231 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":30,"btime":"2024-09-19T06:44:35:536179+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:35.536175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"e","rank":0,"incarnation":30,"state":"up:replay","state_seq":1,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:44:37.231 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 30 2024-09-19T06:44:37.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.236+0000 7f64ce7fc640 1 -- 172.21.15.86:0/2534535530 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f64d406c2b0 msgr2=0x7f64d406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:37.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.236+0000 7f64ce7fc640 1 --2- 172.21.15.86:0/2534535530 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f64d406c2b0 0x7f64d406e770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f64e80c90a0 tx=0x7f64dc009040 comp rx=0 tx=0).stop 2024-09-19T06:44:37.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.236+0000 7f64ce7fc640 1 -- 172.21.15.86:0/2534535530 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64e815c4f0 msgr2=0x7f64e80c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:37.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.236+0000 7f64ce7fc640 1 --2- 172.21.15.86:0/2534535530 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64e815c4f0 0x7f64e80c52b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f64e0030000 tx=0x7f64e0004a40 comp rx=0 tx=0).stop 2024-09-19T06:44:37.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.236+0000 7f64ce7fc640 1 -- 172.21.15.86:0/2534535530 shutdown_connections 2024-09-19T06:44:37.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.236+0000 7f64ce7fc640 1 --2- 172.21.15.86:0/2534535530 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f64d406c2b0 0x7f64d406e770 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:37.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.236+0000 7f64ce7fc640 1 --2- 172.21.15.86:0/2534535530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64e815c930 0x7f64e80c57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:37.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.236+0000 7f64ce7fc640 1 --2- 172.21.15.86:0/2534535530 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64e815c4f0 0x7f64e80c52b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:37.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.236+0000 7f64ce7fc640 1 --2- 172.21.15.86:0/2534535530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64e815f790 0x7f64e8072310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:37.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.236+0000 7f64ce7fc640 1 -- 172.21.15.86:0/2534535530 >> 172.21.15.86:0/2534535530 conn(0x7f64e806bda0 msgr2=0x7f64e80cc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:37.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.236+0000 7f64ce7fc640 1 -- 172.21.15.86:0/2534535530 shutdown_connections 2024-09-19T06:44:37.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.237+0000 7f64ce7fc640 1 -- 172.21.15.86:0/2534535530 wait complete. 2024-09-19T06:44:37.267 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d down, removed from mdsmap 2024-09-19T06:44:37.267 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-09-19T06:44:37.268 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:44:37.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.450+0000 7f67f99da640 1 Processor -- start 2024-09-19T06:44:37.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.450+0000 7f67f99da640 1 -- start start 2024-09-19T06:44:37.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.451+0000 7f67f99da640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f67ec0d45f0 0x7f67ec0da540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:37.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.451+0000 7f67f99da640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f67ec005a00 0x7f67ec034250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:37.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.451+0000 7f67f99da640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67ec0d49d0 con 0x7f67ec034790 2024-09-19T06:44:37.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.451+0000 7f67f99da640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f67ec032c10 con 0x7f67ec005a00 2024-09-19T06:44:37.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.451+0000 7f67f99da640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f67ec005fd0 con 0x7f67ec0d45f0 2024-09-19T06:44:37.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.451+0000 7f67f3fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f67ec005a00 0x7f67ec034250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:37.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.451+0000 7f67f3fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f67ec005a00 0x7f67ec034250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59082/0 (socket says 172.21.15.86:59082) 2024-09-19T06:44:37.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.451+0000 7f67f3fff640 1 -- 172.21.15.86:0/2091804288 learned_addr learned my addr 172.21.15.86:0/2091804288 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:37.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.452+0000 7f67f3fff640 1 -- 172.21.15.86:0/2091804288 >> v2:172.21.15.169:3300/0 conn(0x7f67ec0d45f0 msgr2=0x7f67ec0da540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:44:37.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.452+0000 7f67f3fff640 1 --2- 172.21.15.86:0/2091804288 >> v2:172.21.15.169:3300/0 conn(0x7f67ec0d45f0 0x7f67ec0da540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:37.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.452+0000 7f67f3fff640 1 -- 172.21.15.86:0/2091804288 >> v1:172.21.15.169:6789/0 conn(0x7f67ec034790 legacy=0x7f67ec04ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:37.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.452+0000 7f67f3fff640 1 -- 172.21.15.86:0/2091804288 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67ec0062b0 con 0x7f67ec005a00 2024-09-19T06:44:37.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.453+0000 7f67f3fff640 1 --2- 172.21.15.86:0/2091804288 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67ec005a00 0x7f67ec034250 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f67ec00d7f0 tx=0x7f67e002c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ce814d2fde6d16 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:37.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.454+0000 7f67f37fe640 1 -- 172.21.15.86:0/2091804288 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e003a070 con 0x7f67ec005a00 2024-09-19T06:44:37.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.454+0000 7f67f37fe640 1 -- 172.21.15.86:0/2091804288 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67e0032480 con 0x7f67ec005a00 2024-09-19T06:44:37.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.454+0000 7f67f37fe640 1 -- 172.21.15.86:0/2091804288 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e0032850 con 0x7f67ec005a00 2024-09-19T06:44:37.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.455+0000 7f67f99da640 1 -- 172.21.15.86:0/2091804288 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67ec005a00 msgr2=0x7f67ec034250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:37.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.455+0000 7f67f99da640 1 --2- 172.21.15.86:0/2091804288 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67ec005a00 0x7f67ec034250 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f67ec00d7f0 tx=0x7f67e002c730 comp rx=0 tx=0).stop 2024-09-19T06:44:37.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.456+0000 7f67f99da640 1 -- 172.21.15.86:0/2091804288 shutdown_connections 2024-09-19T06:44:37.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.456+0000 7f67f99da640 1 --2- 172.21.15.86:0/2091804288 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67ec005a00 0x7f67ec034250 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:37.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.456+0000 7f67f99da640 1 --2- 172.21.15.86:0/2091804288 >> v2:172.21.15.169:3300/0 conn(0x7f67ec0d45f0 0x7f67ec0da540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:37.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.456+0000 7f67f99da640 1 -- 172.21.15.86:0/2091804288 >> 172.21.15.86:0/2091804288 conn(0x7f67ec04fc50 msgr2=0x7f67ec050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:37.460 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.457+0000 7f67f99da640 1 -- 172.21.15.86:0/2091804288 shutdown_connections 2024-09-19T06:44:37.460 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.458+0000 7f67f99da640 1 -- 172.21.15.86:0/2091804288 wait complete. 2024-09-19T06:44:37.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.460+0000 7f67f99da640 1 Processor -- start 2024-09-19T06:44:37.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.460+0000 7f67f99da640 1 -- start start 2024-09-19T06:44:37.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.461+0000 7f67f99da640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67ec005a00 0x7f67ec046f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:37.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.461+0000 7f67f99da640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67ec034790 0x7f67ec1794e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:37.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.461+0000 7f67f99da640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67ec0d45f0 0x7f67ec17c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:37.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.461+0000 7f67f99da640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec006b50 con 0x7f67ec005a00 2024-09-19T06:44:37.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.461+0000 7f67f99da640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec006870 con 0x7f67ec0d45f0 2024-09-19T06:44:37.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.461+0000 7f67f99da640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f67ec006e30 con 0x7f67ec034790 2024-09-19T06:44:37.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.462+0000 7f67f91d9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67ec0d45f0 0x7f67ec17c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:37.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.462+0000 7f67f91d9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67ec0d45f0 0x7f67ec17c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:43278/0 (socket says 172.21.15.86:43278) 2024-09-19T06:44:37.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.462+0000 7f67f91d9640 1 -- 172.21.15.86:0/912074035 learned_addr learned my addr 172.21.15.86:0/912074035 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:37.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.462+0000 7f67f3fff640 1 --2- 172.21.15.86:0/912074035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67ec034790 0x7f67ec1794e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:37.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.464+0000 7f67f91d9640 1 -- 172.21.15.86:0/912074035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67ec034790 msgr2=0x7f67ec1794e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:37.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.464+0000 7f67f91d9640 1 --2- 172.21.15.86:0/912074035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67ec034790 0x7f67ec1794e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:37.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.464+0000 7f67f91d9640 1 -- 172.21.15.86:0/912074035 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67ec005a00 msgr2=0x7f67ec046f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:37.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.464+0000 7f67f91d9640 1 --2- 172.21.15.86:0/912074035 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67ec005a00 0x7f67ec046f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:37.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.464+0000 7f67f91d9640 1 -- 172.21.15.86:0/912074035 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67ec049790 con 0x7f67ec0d45f0 2024-09-19T06:44:37.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.466+0000 7f67f91d9640 1 --2- 172.21.15.86:0/912074035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67ec0d45f0 0x7f67ec17c9a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f67e800c580 tx=0x7f67e800ca40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:37.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.467+0000 7f67f17fa640 1 -- 172.21.15.86:0/912074035 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e8017070 con 0x7f67ec0d45f0 2024-09-19T06:44:37.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.467+0000 7f67f99da640 1 -- 172.21.15.86:0/912074035 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67ec178a20 con 0x7f67ec0d45f0 2024-09-19T06:44:37.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.467+0000 7f67f99da640 1 -- 172.21.15.86:0/912074035 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67ec049a30 con 0x7f67ec0d45f0 2024-09-19T06:44:37.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.467+0000 7f67f17fa640 1 -- 172.21.15.86:0/912074035 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67e80035f0 con 0x7f67ec0d45f0 2024-09-19T06:44:37.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.467+0000 7f67f17fa640 1 -- 172.21.15.86:0/912074035 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e80039e0 con 0x7f67ec0d45f0 2024-09-19T06:44:37.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.470+0000 7f67f17fa640 1 -- 172.21.15.86:0/912074035 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f67e801a070 con 0x7f67ec0d45f0 2024-09-19T06:44:37.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.470+0000 7f67f17fa640 1 --2- 172.21.15.86:0/912074035 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f67d806c3b0 0x7f67d806e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:37.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.471+0000 7f67f17fa640 1 -- 172.21.15.86:0/912074035 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7165+0+0 (secure 0 0 0) 0x7f67e808ae10 con 0x7f67ec0d45f0 2024-09-19T06:44:37.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.471+0000 7f67f89d8640 1 --2- 172.21.15.86:0/912074035 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f67d806c3b0 0x7f67d806e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:37.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.472+0000 7f67f89d8640 1 --2- 172.21.15.86:0/912074035 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f67d806c3b0 0x7f67d806e870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f67f4065710 tx=0x7f67f406b6d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:37.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.472+0000 7f67f99da640 1 -- 172.21.15.86:0/912074035 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67d4005290 con 0x7f67ec0d45f0 2024-09-19T06:44:37.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.482+0000 7f67f17fa640 1 -- 172.21.15.86:0/912074035 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f67e8059040 con 0x7f67ec0d45f0 2024-09-19T06:44:37.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.898+0000 7f67f99da640 1 -- 172.21.15.86:0/912074035 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67d4005580 con 0x7f67ec0d45f0 2024-09-19T06:44:37.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.900+0000 7f67f17fa640 1 -- 172.21.15.86:0/912074035 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+6038 (secure 0 0 0) 0x7f67e8058940 con 0x7f67ec0d45f0 2024-09-19T06:44:37.902 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:44:37.902 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":30,"btime":"2024-09-19T06:44:35:536179+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:35.536175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"e","rank":0,"incarnation":30,"state":"up:replay","state_seq":1,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:44:37.902 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 30 2024-09-19T06:44:37.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.905+0000 7f67f99da640 1 -- 172.21.15.86:0/912074035 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f67d806c3b0 msgr2=0x7f67d806e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:37.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.905+0000 7f67f99da640 1 --2- 172.21.15.86:0/912074035 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f67d806c3b0 0x7f67d806e870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f67f4065710 tx=0x7f67f406b6d0 comp rx=0 tx=0).stop 2024-09-19T06:44:37.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.906+0000 7f67f99da640 1 -- 172.21.15.86:0/912074035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67ec0d45f0 msgr2=0x7f67ec17c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:37.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.906+0000 7f67f99da640 1 --2- 172.21.15.86:0/912074035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67ec0d45f0 0x7f67ec17c9a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f67e800c580 tx=0x7f67e800ca40 comp rx=0 tx=0).stop 2024-09-19T06:44:37.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.906+0000 7f67f99da640 1 -- 172.21.15.86:0/912074035 shutdown_connections 2024-09-19T06:44:37.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.906+0000 7f67f99da640 1 --2- 172.21.15.86:0/912074035 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f67d806c3b0 0x7f67d806e870 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:37.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.906+0000 7f67f99da640 1 --2- 172.21.15.86:0/912074035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67ec0d45f0 0x7f67ec17c9a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:37.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.906+0000 7f67f99da640 1 --2- 172.21.15.86:0/912074035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67ec034790 0x7f67ec1794e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:37.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.906+0000 7f67f99da640 1 --2- 172.21.15.86:0/912074035 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67ec005a00 0x7f67ec046f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:37.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.906+0000 7f67f99da640 1 -- 172.21.15.86:0/912074035 >> 172.21.15.86:0/912074035 conn(0x7f67ec04fc50 msgr2=0x7f67ec04c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:37.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.908+0000 7f67f99da640 1 -- 172.21.15.86:0/912074035 shutdown_connections 2024-09-19T06:44:37.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:37.911+0000 7f67f99da640 1 -- 172.21.15.86:0/912074035 wait complete. 2024-09-19T06:44:37.932 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "btime": "2024-09-19T06:44:35:536179+0000", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 30, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-19T06:37:08.763572+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 30, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_5211": { "addr": "172.21.15.86:6839/22518982", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6838", "nonce": 22518982, "type": "v2" }, { "addr": "172.21.15.86:6839", "nonce": 22518982, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5211, "incarnation": 30, "join_fscid": -1, "name": "e", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 33, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-09-19T06:44:35.536175+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5211 } } } ], "standbys": [ { "addr": "172.21.15.86:6837/728803297", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6835", "nonce": 728803297, "type": "v2" }, { "addr": "172.21.15.86:6837", "nonce": 728803297, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4247, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.169:6835/2537509253", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6833", "nonce": 2537509253, "type": "v2" }, { "addr": "172.21.15.169:6835", "nonce": 2537509253, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4262, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.169:6834/1723647527", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6832", "nonce": 1723647527, "type": "v2" }, { "addr": "172.21.15.169:6834", "nonce": 1723647527, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4265, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.86:6836/4135959816", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6834", "nonce": 4135959816, "type": "v2" }, { "addr": "172.21.15.86:6836", "nonce": 4135959816, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4270, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-09-19T06:44:39.933 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:44:40.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.132+0000 7facf493d640 1 Processor -- start 2024-09-19T06:44:40.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.132+0000 7facf493d640 1 -- start start 2024-09-19T06:44:40.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.134+0000 7facf493d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7facf00ce930 0x7facf00c9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:40.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.134+0000 7facef7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7facf00ce930 0x7facf00c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:40.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.134+0000 7facef7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7facf00ce930 0x7facf00c9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59104/0 (socket says 172.21.15.86:59104) 2024-09-19T06:44:40.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.135+0000 7faceeffd640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7facf00ced10 0x7facf00c5370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:60504/0 (socket says 172.21.15.86:60504) 2024-09-19T06:44:40.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.135+0000 7faceffff640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7facf015fb90 0x7facf0158d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56126/0 (socket says 172.21.15.86:56126) 2024-09-19T06:44:40.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.135+0000 7facf493d640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facf015f3d0 con 0x7facf015fb90 2024-09-19T06:44:40.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.135+0000 7facf493d640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facf006d010 con 0x7facf00ced10 2024-09-19T06:44:40.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.135+0000 7facf493d640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7facf006d2f0 con 0x7facf00ce930 2024-09-19T06:44:40.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.135+0000 7facef7fe640 1 -- 172.21.15.86:0/3911443059 learned_addr learned my addr 172.21.15.86:0/3911443059 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:40.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.136+0000 7facef7fe640 1 -- 172.21.15.86:0/3911443059 >> v1:172.21.15.169:6789/0 conn(0x7facf00ced10 legacy=0x7facf00c5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:40.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.136+0000 7facef7fe640 1 -- 172.21.15.86:0/3911443059 >> v1:172.21.15.86:6789/0 conn(0x7facf015fb90 legacy=0x7facf0158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:40.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.136+0000 7facef7fe640 1 -- 172.21.15.86:0/3911443059 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf006d5d0 con 0x7facf00ce930 2024-09-19T06:44:40.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.138+0000 7facef7fe640 1 --2- 172.21.15.86:0/3911443059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facf00ce930 0x7facf00c9130 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7face4009ad0 tx=0x7face402a400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9974c5cf1d26508 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:40.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.139+0000 7facee7fc640 1 -- 172.21.15.86:0/3911443059 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4037070 con 0x7facf00ce930 2024-09-19T06:44:40.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.139+0000 7facee7fc640 1 -- 172.21.15.86:0/3911443059 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face4032440 con 0x7facf00ce930 2024-09-19T06:44:40.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.139+0000 7facee7fc640 1 -- 172.21.15.86:0/3911443059 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4032810 con 0x7facf00ce930 2024-09-19T06:44:40.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.140+0000 7facf493d640 1 -- 172.21.15.86:0/3911443059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facf00ce930 msgr2=0x7facf00c9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:40.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.140+0000 7facf493d640 1 --2- 172.21.15.86:0/3911443059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facf00ce930 0x7facf00c9130 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7face4009ad0 tx=0x7face402a400 comp rx=0 tx=0).stop 2024-09-19T06:44:40.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.140+0000 7facf493d640 1 -- 172.21.15.86:0/3911443059 shutdown_connections 2024-09-19T06:44:40.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.140+0000 7facf493d640 1 --2- 172.21.15.86:0/3911443059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facf00ce930 0x7facf00c9130 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:40.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.140+0000 7facf493d640 1 -- 172.21.15.86:0/3911443059 >> 172.21.15.86:0/3911443059 conn(0x7facf006c010 msgr2=0x7facf0067890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:40.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.142+0000 7facf493d640 1 -- 172.21.15.86:0/3911443059 shutdown_connections 2024-09-19T06:44:40.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.142+0000 7facf493d640 1 -- 172.21.15.86:0/3911443059 wait complete. 2024-09-19T06:44:40.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.144+0000 7facf493d640 1 Processor -- start 2024-09-19T06:44:40.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.144+0000 7facf493d640 1 -- start start 2024-09-19T06:44:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.146+0000 7facf493d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7facf00ce930 0x7facf0151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.146+0000 7facf493d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7facf00ced10 0x7facf015d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.146+0000 7facf493d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facf015fb90 0x7facf015bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.146+0000 7faceffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facf015fb90 0x7facf015bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.146+0000 7faceffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facf015fb90 0x7facf015bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59112/0 (socket says 172.21.15.86:59112) 2024-09-19T06:44:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.146+0000 7faceffff640 1 -- 172.21.15.86:0/3813839679 learned_addr learned my addr 172.21.15.86:0/3813839679 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.146+0000 7facf493d640 1 -- 172.21.15.86:0/3813839679 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7facf006ccd0 con 0x7facf015fb90 2024-09-19T06:44:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.147+0000 7facf493d640 1 -- 172.21.15.86:0/3813839679 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7facf006d8b0 con 0x7facf00ced10 2024-09-19T06:44:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.147+0000 7facf493d640 1 -- 172.21.15.86:0/3813839679 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7facf0162820 con 0x7facf00ce930 2024-09-19T06:44:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.147+0000 7faceeffd640 1 --2- 172.21.15.86:0/3813839679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7facf00ced10 0x7facf015d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.147+0000 7facef7fe640 1 --2- 172.21.15.86:0/3813839679 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7facf00ce930 0x7facf0151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:40.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.147+0000 7faceffff640 1 -- 172.21.15.86:0/3813839679 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7facf00ce930 msgr2=0x7facf0151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:40.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.147+0000 7faceffff640 1 --2- 172.21.15.86:0/3813839679 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7facf00ce930 0x7facf0151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:40.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.147+0000 7faceffff640 1 -- 172.21.15.86:0/3813839679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7facf00ced10 msgr2=0x7facf015d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:40.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.147+0000 7faceffff640 1 --2- 172.21.15.86:0/3813839679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7facf00ced10 0x7facf015d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:40.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.147+0000 7faceffff640 1 -- 172.21.15.86:0/3813839679 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf015f020 con 0x7facf015fb90 2024-09-19T06:44:40.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.148+0000 7faceffff640 1 --2- 172.21.15.86:0/3813839679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facf015fb90 0x7facf015bb40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7face800c8f0 tx=0x7face800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:40.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.148+0000 7facd7fff640 1 -- 172.21.15.86:0/3813839679 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8018070 con 0x7facf015fb90 2024-09-19T06:44:40.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.148+0000 7facd7fff640 1 -- 172.21.15.86:0/3813839679 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face800a640 con 0x7facf015fb90 2024-09-19T06:44:40.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.148+0000 7facd7fff640 1 -- 172.21.15.86:0/3813839679 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face800aa30 con 0x7facf015fb90 2024-09-19T06:44:40.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.148+0000 7facf493d640 1 -- 172.21.15.86:0/3813839679 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facf01f5e70 con 0x7facf015fb90 2024-09-19T06:44:40.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.150+0000 7facf493d640 1 -- 172.21.15.86:0/3813839679 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facf01f50b0 con 0x7facf015fb90 2024-09-19T06:44:40.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.152+0000 7facd7fff640 1 -- 172.21.15.86:0/3813839679 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7face800abd0 con 0x7facf015fb90 2024-09-19T06:44:40.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.152+0000 7facd7fff640 1 --2- 172.21.15.86:0/3813839679 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7facdc06c2b0 0x7facdc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:40.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.153+0000 7facd7fff640 1 -- 172.21.15.86:0/3813839679 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7165+0+0 (secure 0 0 0) 0x7face808b270 con 0x7facf015fb90 2024-09-19T06:44:40.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.153+0000 7facef7fe640 1 --2- 172.21.15.86:0/3813839679 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7facdc06c2b0 0x7facdc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:40.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.153+0000 7facf493d640 1 -- 172.21.15.86:0/3813839679 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facf0160000 con 0x7facf015fb90 2024-09-19T06:44:40.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.153+0000 7facef7fe640 1 --2- 172.21.15.86:0/3813839679 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7facdc06c2b0 0x7facdc06e770 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7face4034000 tx=0x7face402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:40.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.163+0000 7facd7fff640 1 -- 172.21.15.86:0/3813839679 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7facf015f020 con 0x7facf015fb90 2024-09-19T06:44:40.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.612+0000 7facf493d640 1 -- 172.21.15.86:0/3813839679 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7facf0073430 con 0x7facf015fb90 2024-09-19T06:44:40.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.613+0000 7facd7fff640 1 -- 172.21.15.86:0/3813839679 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+6038 (secure 0 0 0) 0x7face8058c30 con 0x7facf015fb90 2024-09-19T06:44:40.615 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:44:40.615 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":30,"btime":"2024-09-19T06:44:35:536179+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:35.536175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"e","rank":0,"incarnation":30,"state":"up:replay","state_seq":1,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:44:40.615 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 30 2024-09-19T06:44:40.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.617+0000 7facd5ffb640 1 -- 172.21.15.86:0/3813839679 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7facdc06c2b0 msgr2=0x7facdc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:40.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.617+0000 7facd5ffb640 1 --2- 172.21.15.86:0/3813839679 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7facdc06c2b0 0x7facdc06e770 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7face4034000 tx=0x7face402e000 comp rx=0 tx=0).stop 2024-09-19T06:44:40.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.618+0000 7facd5ffb640 1 -- 172.21.15.86:0/3813839679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facf015fb90 msgr2=0x7facf015bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:40.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.618+0000 7facd5ffb640 1 --2- 172.21.15.86:0/3813839679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facf015fb90 0x7facf015bb40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7face800c8f0 tx=0x7face800cdb0 comp rx=0 tx=0).stop 2024-09-19T06:44:40.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.618+0000 7facd5ffb640 1 -- 172.21.15.86:0/3813839679 shutdown_connections 2024-09-19T06:44:40.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.618+0000 7facd5ffb640 1 --2- 172.21.15.86:0/3813839679 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7facdc06c2b0 0x7facdc06e770 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:40.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.618+0000 7facd5ffb640 1 --2- 172.21.15.86:0/3813839679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facf015fb90 0x7facf015bb40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:40.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.618+0000 7facd5ffb640 1 --2- 172.21.15.86:0/3813839679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7facf00ced10 0x7facf015d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:40.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.618+0000 7facd5ffb640 1 --2- 172.21.15.86:0/3813839679 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7facf00ce930 0x7facf0151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:40.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.618+0000 7facd5ffb640 1 -- 172.21.15.86:0/3813839679 >> 172.21.15.86:0/3813839679 conn(0x7facf006c010 msgr2=0x7facf0073af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:40.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.625+0000 7facd5ffb640 1 -- 172.21.15.86:0/3813839679 shutdown_connections 2024-09-19T06:44:40.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:40.626+0000 7facd5ffb640 1 -- 172.21.15.86:0/3813839679 wait complete. 2024-09-19T06:44:40.647 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:44:42.648 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:44:42.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.833+0000 7fe4d4ffd640 1 Processor -- start 2024-09-19T06:44:42.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.833+0000 7fe4d4ffd640 1 -- start start 2024-09-19T06:44:42.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.834+0000 7fe4d4ffd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe4d0165280 0x7fe4d00c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:42.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.834+0000 7fe4d4ffd640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4d00c3760 con 0x7fe4d0072150 2024-09-19T06:44:42.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.834+0000 7fe4d4ffd640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4d0167ad0 con 0x7fe4d0068850 2024-09-19T06:44:42.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.834+0000 7fe4d4ffd640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fe4d00c6fc0 con 0x7fe4d0165280 2024-09-19T06:44:42.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.835+0000 7fe4cdd9b640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe4d0072150 0x7fe4d00c7450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:59190/0 (socket says 172.21.15.86:59190) 2024-09-19T06:44:42.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.835+0000 7fe4cdd9b640 1 -- 172.21.15.86:0/3162978062 learned_addr learned my addr 172.21.15.86:0/3162978062 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:44:42.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.835+0000 7fe4ce59c640 1 --2- 172.21.15.86:0/3162978062 >> v2:172.21.15.86:3300/0 conn(0x7fe4d0165280 0x7fe4d00c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:42.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.836+0000 7fe4ce59c640 1 -- 172.21.15.86:0/3162978062 >> v1:172.21.15.169:6789/0 conn(0x7fe4d0068850 legacy=0x7fe4d0172370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:42.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.836+0000 7fe4ce59c640 1 -- 172.21.15.86:0/3162978062 >> v1:172.21.15.86:6789/0 conn(0x7fe4d0072150 legacy=0x7fe4d00c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:42.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.836+0000 7fe4ce59c640 1 -- 172.21.15.86:0/3162978062 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d0165660 con 0x7fe4d0165280 2024-09-19T06:44:42.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.837+0000 7fe4ce59c640 1 --2- 172.21.15.86:0/3162978062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4d0165280 0x7fe4d00c84e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0006d10 tx=0x7fe4c002e6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709e2cd5feac339f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:42.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.838+0000 7fe4cd59a640 1 -- 172.21.15.86:0/3162978062 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c003a070 con 0x7fe4d0165280 2024-09-19T06:44:42.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.838+0000 7fe4cd59a640 1 -- 172.21.15.86:0/3162978062 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c002ee50 con 0x7fe4d0165280 2024-09-19T06:44:42.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.838+0000 7fe4cd59a640 1 -- 172.21.15.86:0/3162978062 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c00076b0 con 0x7fe4d0165280 2024-09-19T06:44:42.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.839+0000 7fe4d4ffd640 1 -- 172.21.15.86:0/3162978062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4d0165280 msgr2=0x7fe4d00c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:42.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.839+0000 7fe4d4ffd640 1 --2- 172.21.15.86:0/3162978062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4d0165280 0x7fe4d00c84e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0006d10 tx=0x7fe4c002e6f0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.839+0000 7fe4d4ffd640 1 -- 172.21.15.86:0/3162978062 shutdown_connections 2024-09-19T06:44:42.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.839+0000 7fe4d4ffd640 1 --2- 172.21.15.86:0/3162978062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4d0165280 0x7fe4d00c84e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.839+0000 7fe4d4ffd640 1 -- 172.21.15.86:0/3162978062 >> 172.21.15.86:0/3162978062 conn(0x7fe4d006e820 msgr2=0x7fe4d006ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:42.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.840+0000 7fe4d4ffd640 1 -- 172.21.15.86:0/3162978062 shutdown_connections 2024-09-19T06:44:42.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.840+0000 7fe4d4ffd640 1 -- 172.21.15.86:0/3162978062 wait complete. 2024-09-19T06:44:42.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.841+0000 7fe4d4ffd640 1 Processor -- start 2024-09-19T06:44:42.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.841+0000 7fe4d4ffd640 1 -- start start 2024-09-19T06:44:42.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.843+0000 7fe4d4ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4d0068850 0x7fe4d016bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:42.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.843+0000 7fe4d4ffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4d0165280 0x7fe4d00c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:42.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.843+0000 7fe4d4ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4d00c9490 0x7fe4d015fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:42.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.843+0000 7fe4d4ffd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d0168330 con 0x7fe4d0068850 2024-09-19T06:44:42.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.843+0000 7fe4d4ffd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d0168050 con 0x7fe4d00c9490 2024-09-19T06:44:42.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.843+0000 7fe4d4ffd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe4d0168610 con 0x7fe4d0165280 2024-09-19T06:44:42.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.843+0000 7fe4cdd9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4d0165280 0x7fe4d00c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:42.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.843+0000 7fe4cdd9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4d0165280 0x7fe4d00c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:37824/0 (socket says 172.21.15.86:37824) 2024-09-19T06:44:42.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.843+0000 7fe4cdd9b640 1 -- 172.21.15.86:0/2838271669 learned_addr learned my addr 172.21.15.86:0/2838271669 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:42.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.843+0000 7fe4ce59c640 1 --2- 172.21.15.86:0/2838271669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4d0068850 0x7fe4d016bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:42.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.843+0000 7fe4cdd9b640 1 -- 172.21.15.86:0/2838271669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4d00c9490 msgr2=0x7fe4d015fec0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:44:42.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.843+0000 7fe4cdd9b640 1 --2- 172.21.15.86:0/2838271669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4d00c9490 0x7fe4d015fec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.843+0000 7fe4cdd9b640 1 -- 172.21.15.86:0/2838271669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4d0068850 msgr2=0x7fe4d016bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:42.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.843+0000 7fe4cdd9b640 1 --2- 172.21.15.86:0/2838271669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4d0068850 0x7fe4d016bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.843+0000 7fe4cdd9b640 1 -- 172.21.15.86:0/2838271669 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d00c9980 con 0x7fe4d0165280 2024-09-19T06:44:42.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.844+0000 7fe4ce59c640 1 --2- 172.21.15.86:0/2838271669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4d0068850 0x7fe4d016bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:44:42.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.844+0000 7fe4cdd9b640 1 --2- 172.21.15.86:0/2838271669 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4d0165280 0x7fe4d00c8750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800cb20 tx=0x7fe4c80020c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:42.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.844+0000 7fe4beffd640 1 -- 172.21.15.86:0/2838271669 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8018070 con 0x7fe4d0165280 2024-09-19T06:44:42.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.844+0000 7fe4beffd640 1 -- 172.21.15.86:0/2838271669 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c800a700 con 0x7fe4d0165280 2024-09-19T06:44:42.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.844+0000 7fe4beffd640 1 -- 172.21.15.86:0/2838271669 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c800aad0 con 0x7fe4d0165280 2024-09-19T06:44:42.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.844+0000 7fe4d4ffd640 1 -- 172.21.15.86:0/2838271669 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4d01fe020 con 0x7fe4d0165280 2024-09-19T06:44:42.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.844+0000 7fe4d4ffd640 1 -- 172.21.15.86:0/2838271669 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4d01fe5e0 con 0x7fe4d0165280 2024-09-19T06:44:42.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.848+0000 7fe4beffd640 1 -- 172.21.15.86:0/2838271669 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe4c801b070 con 0x7fe4d0165280 2024-09-19T06:44:42.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.849+0000 7fe4beffd640 1 --2- 172.21.15.86:0/2838271669 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe4b006c3b0 0x7fe4b006e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:42.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.849+0000 7fe4beffd640 1 -- 172.21.15.86:0/2838271669 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 7165+0+0 (secure 0 0 0) 0x7fe4c808b360 con 0x7fe4d0165280 2024-09-19T06:44:42.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.849+0000 7fe4ce59c640 1 --2- 172.21.15.86:0/2838271669 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe4b006c3b0 0x7fe4b006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:42.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.850+0000 7fe4ce59c640 1 --2- 172.21.15.86:0/2838271669 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe4b006c3b0 0x7fe4b006e870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0037000 tx=0x7fe4c0009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:42.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.850+0000 7fe4bcff9640 1 -- 172.21.15.86:0/2838271669 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4b4005290 con 0x7fe4d0165280 2024-09-19T06:44:42.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:42.858+0000 7fe4beffd640 1 -- 172.21.15.86:0/2838271669 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe4c8059500 con 0x7fe4d0165280 2024-09-19T06:44:43.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:43.281+0000 7fe4bcff9640 1 -- 172.21.15.86:0/2838271669 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4b4005580 con 0x7fe4d0165280 2024-09-19T06:44:43.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:43.285+0000 7fe4beffd640 1 -- 172.21.15.86:0/2838271669 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+6038 (secure 0 0 0) 0x7fe4c8058e00 con 0x7fe4d0165280 2024-09-19T06:44:43.287 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:44:43.287 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":30,"btime":"2024-09-19T06:44:35:536179+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:35.536175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"e","rank":0,"incarnation":30,"state":"up:replay","state_seq":1,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:44:43.287 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 30 2024-09-19T06:44:43.290 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:43.289+0000 7fe4bcff9640 1 -- 172.21.15.86:0/2838271669 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe4b006c3b0 msgr2=0x7fe4b006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:43.290 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:43.289+0000 7fe4bcff9640 1 --2- 172.21.15.86:0/2838271669 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe4b006c3b0 0x7fe4b006e870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0037000 tx=0x7fe4c0009000 comp rx=0 tx=0).stop 2024-09-19T06:44:43.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:43.289+0000 7fe4bcff9640 1 -- 172.21.15.86:0/2838271669 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4d0165280 msgr2=0x7fe4d00c8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:43.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:43.289+0000 7fe4bcff9640 1 --2- 172.21.15.86:0/2838271669 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4d0165280 0x7fe4d00c8750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800cb20 tx=0x7fe4c80020c0 comp rx=0 tx=0).stop 2024-09-19T06:44:43.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:43.289+0000 7fe4bcff9640 1 -- 172.21.15.86:0/2838271669 shutdown_connections 2024-09-19T06:44:43.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:43.289+0000 7fe4bcff9640 1 --2- 172.21.15.86:0/2838271669 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe4b006c3b0 0x7fe4b006e870 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:43.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:43.289+0000 7fe4bcff9640 1 --2- 172.21.15.86:0/2838271669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4d00c9490 0x7fe4d015fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:43.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:43.289+0000 7fe4bcff9640 1 --2- 172.21.15.86:0/2838271669 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4d0165280 0x7fe4d00c8750 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:43.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:43.289+0000 7fe4bcff9640 1 --2- 172.21.15.86:0/2838271669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4d0068850 0x7fe4d016bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:43.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:43.289+0000 7fe4bcff9640 1 -- 172.21.15.86:0/2838271669 >> 172.21.15.86:0/2838271669 conn(0x7fe4d006e820 msgr2=0x7fe4d006c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:43.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:43.292+0000 7fe4bcff9640 1 -- 172.21.15.86:0/2838271669 shutdown_connections 2024-09-19T06:44:43.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:43.292+0000 7fe4bcff9640 1 -- 172.21.15.86:0/2838271669 wait complete. 2024-09-19T06:44:43.311 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:44:45.312 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:44:45.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.459+0000 7f494a6dd640 1 Processor -- start 2024-09-19T06:44:45.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.459+0000 7f494a6dd640 1 -- start start 2024-09-19T06:44:45.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.460+0000 7f494a6dd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f494415e170 0x7f49440b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:45.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.460+0000 7f494a6dd640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f494415c9c0 con 0x7f49440d1120 2024-09-19T06:44:45.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.460+0000 7f494a6dd640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f494415cca0 con 0x7f49440d0d40 2024-09-19T06:44:45.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.460+0000 7f494a6dd640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f494415c770 con 0x7f494415e170 2024-09-19T06:44:45.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.460+0000 7f493bfff640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f49440d1120 0x7f494415da60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:59200/0 (socket says 172.21.15.86:59200) 2024-09-19T06:44:45.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.460+0000 7f493bfff640 1 -- 172.21.15.86:0/1653853437 learned_addr learned my addr 172.21.15.86:0/1653853437 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:44:45.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.460+0000 7f4948c7a640 1 --2- 172.21.15.86:0/1653853437 >> v2:172.21.15.169:3300/0 conn(0x7f494415e170 0x7f49440b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:45.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.460+0000 7f49437fe640 1 -- 172.21.15.86:0/1653853437 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 955818432 0 0) 0x7f494415c9c0 con 0x7f49440d1120 2024-09-19T06:44:45.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.460+0000 7f49437fe640 1 -- 172.21.15.86:0/1653853437 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4930003520 con 0x7f49440d1120 2024-09-19T06:44:45.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.460+0000 7f49437fe640 1 -- 172.21.15.86:0/1653853437 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2890696825 0 0) 0x7f4930003520 con 0x7f49440d1120 2024-09-19T06:44:45.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.460+0000 7f49437fe640 1 -- 172.21.15.86:0/1653853437 >> v2:172.21.15.169:3300/0 conn(0x7f494415e170 msgr2=0x7f49440b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:45.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.460+0000 7f49437fe640 1 --2- 172.21.15.86:0/1653853437 >> v2:172.21.15.169:3300/0 conn(0x7f494415e170 0x7f49440b4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:45.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.460+0000 7f49437fe640 1 -- 172.21.15.86:0/1653853437 >> v1:172.21.15.169:6789/0 conn(0x7f49440d0d40 legacy=0x7f49440ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:45.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.460+0000 7f49437fe640 1 -- 172.21.15.86:0/1653853437 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f494415cf80 con 0x7f49440d1120 2024-09-19T06:44:45.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.460+0000 7f49437fe640 1 -- 172.21.15.86:0/1653853437 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f492c001670 con 0x7f49440d1120 2024-09-19T06:44:45.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.461+0000 7f49437fe640 1 -- 172.21.15.86:0/1653853437 >> v1:172.21.15.86:6789/0 conn(0x7f49440d1120 legacy=0x7f494415da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:45.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.461+0000 7f49437fe640 1 --2- 172.21.15.86:0/1653853437 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49300039b0 0x7f4930003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:45.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.461+0000 7f49437fe640 1 --2- 172.21.15.86:0/1653853437 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4930004800 0x7f4930004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:45.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.461+0000 7f49437fe640 1 --2- 172.21.15.86:0/1653853437 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49300051c0 0x7f493000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:45.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.461+0000 7f49437fe640 1 -- 172.21.15.86:0/1653853437 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f494415c770 con 0x7f49300039b0 2024-09-19T06:44:45.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.461+0000 7f49437fe640 1 -- 172.21.15.86:0/1653853437 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f493000c110 con 0x7f49300051c0 2024-09-19T06:44:45.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.461+0000 7f49437fe640 1 -- 172.21.15.86:0/1653853437 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f493000c310 con 0x7f4930004800 2024-09-19T06:44:45.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.461+0000 7f4943fff640 1 --2- 172.21.15.86:0/1653853437 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49300039b0 0x7f4930003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:45.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.461+0000 7f4948c7a640 1 --2- 172.21.15.86:0/1653853437 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49300051c0 0x7f493000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:45.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.461+0000 7f493bfff640 1 --2- 172.21.15.86:0/1653853437 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4930004800 0x7f4930004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:45.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.461+0000 7f4943fff640 1 -- 172.21.15.86:0/1653853437 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4930004800 msgr2=0x7f4930004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:45.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.461+0000 7f4943fff640 1 --2- 172.21.15.86:0/1653853437 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4930004800 0x7f4930004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:45.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.461+0000 7f4943fff640 1 -- 172.21.15.86:0/1653853437 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49300051c0 msgr2=0x7f493000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:45.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.461+0000 7f4943fff640 1 --2- 172.21.15.86:0/1653853437 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49300051c0 0x7f493000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:45.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.461+0000 7f4943fff640 1 -- 172.21.15.86:0/1653853437 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4930003520 con 0x7f49300039b0 2024-09-19T06:44:45.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.461+0000 7f4948c7a640 1 -- 172.21.15.86:0/1653853437 reap_dead start 2024-09-19T06:44:45.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.461+0000 7f493bfff640 1 --2- 172.21.15.86:0/1653853437 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4930004800 0x7f4930004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:44:45.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.462+0000 7f4943fff640 1 --2- 172.21.15.86:0/1653853437 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49300039b0 0x7f4930003dd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4934001750 tx=0x7f4930005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fff6a011314e26a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:45.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.462+0000 7f49437fe640 1 -- 172.21.15.86:0/1653853437 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4934001370 con 0x7f49300039b0 2024-09-19T06:44:45.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.462+0000 7f49437fe640 1 -- 172.21.15.86:0/1653853437 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49340052d0 con 0x7f49300039b0 2024-09-19T06:44:45.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.462+0000 7f49437fe640 1 -- 172.21.15.86:0/1653853437 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493402abc0 con 0x7f49300039b0 2024-09-19T06:44:45.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.463+0000 7f494a6dd640 1 -- 172.21.15.86:0/1653853437 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49300039b0 msgr2=0x7f4930003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:45.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.463+0000 7f494a6dd640 1 --2- 172.21.15.86:0/1653853437 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49300039b0 0x7f4930003dd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4934001750 tx=0x7f4930005830 comp rx=0 tx=0).stop 2024-09-19T06:44:45.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.463+0000 7f494a6dd640 1 -- 172.21.15.86:0/1653853437 shutdown_connections 2024-09-19T06:44:45.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.463+0000 7f494a6dd640 1 --2- 172.21.15.86:0/1653853437 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49300039b0 0x7f4930003dd0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:45.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.463+0000 7f494a6dd640 1 -- 172.21.15.86:0/1653853437 >> 172.21.15.86:0/1653853437 conn(0x7f494406d910 msgr2=0x7f494406dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:45.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.463+0000 7f494a6dd640 1 -- 172.21.15.86:0/1653853437 shutdown_connections 2024-09-19T06:44:45.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.463+0000 7f494a6dd640 1 -- 172.21.15.86:0/1653853437 wait complete. 2024-09-19T06:44:45.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.464+0000 7f494a6dd640 1 Processor -- start 2024-09-19T06:44:45.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.464+0000 7f494a6dd640 1 -- start start 2024-09-19T06:44:45.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.466+0000 7f494a6dd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49300039b0 0x7f49441584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:45.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.466+0000 7f494a6dd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4944154500 0x7f4944150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:45.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.466+0000 7f494a6dd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4944154920 0x7f49441514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:45.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.466+0000 7f494a6dd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f494415da60 con 0x7f4944154500 2024-09-19T06:44:45.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.466+0000 7f494a6dd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f49440b3f20 con 0x7f49300039b0 2024-09-19T06:44:45.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.466+0000 7f494a6dd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f494415dbe0 con 0x7f4944154920 2024-09-19T06:44:45.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.466+0000 7f493bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4944154500 0x7f4944150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:45.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.466+0000 7f493bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4944154500 0x7f4944150fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45306/0 (socket says 172.21.15.86:45306) 2024-09-19T06:44:45.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.466+0000 7f493bfff640 1 -- 172.21.15.86:0/3996321304 learned_addr learned my addr 172.21.15.86:0/3996321304 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:45.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.466+0000 7f493bfff640 1 -- 172.21.15.86:0/3996321304 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4944154920 msgr2=0x7f49441514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:45.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.466+0000 7f4948c7a640 1 --2- 172.21.15.86:0/3996321304 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4944154920 0x7f49441514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:45.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.466+0000 7f493bfff640 1 --2- 172.21.15.86:0/3996321304 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4944154920 0x7f49441514f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:45.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.466+0000 7f493bfff640 1 -- 172.21.15.86:0/3996321304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49300039b0 msgr2=0x7f49441584d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:44:45.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.466+0000 7f493bfff640 1 --2- 172.21.15.86:0/3996321304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49300039b0 0x7f49441584d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:45.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.467+0000 7f493bfff640 1 -- 172.21.15.86:0/3996321304 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49441f1340 con 0x7f4944154500 2024-09-19T06:44:45.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.467+0000 7f493bfff640 1 --2- 172.21.15.86:0/3996321304 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4944154500 0x7f4944150fb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f492c00d7d0 tx=0x7f492c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:45.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.467+0000 7f49417fa640 1 -- 172.21.15.86:0/3996321304 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c019070 con 0x7f4944154500 2024-09-19T06:44:45.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.467+0000 7f494a6dd640 1 -- 172.21.15.86:0/3996321304 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49441f1620 con 0x7f4944154500 2024-09-19T06:44:45.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.468+0000 7f49417fa640 1 -- 172.21.15.86:0/3996321304 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f492c0074e0 con 0x7f4944154500 2024-09-19T06:44:45.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.468+0000 7f494a6dd640 1 -- 172.21.15.86:0/3996321304 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49441f1be0 con 0x7f4944154500 2024-09-19T06:44:45.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.468+0000 7f49417fa640 1 -- 172.21.15.86:0/3996321304 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c0049e0 con 0x7f4944154500 2024-09-19T06:44:45.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.469+0000 7f494a6dd640 1 -- 172.21.15.86:0/3996321304 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4928005290 con 0x7f4944154500 2024-09-19T06:44:45.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.469+0000 7f49417fa640 1 -- 172.21.15.86:0/3996321304 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f492c01c070 con 0x7f4944154500 2024-09-19T06:44:45.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.470+0000 7f49417fa640 1 --2- 172.21.15.86:0/3996321304 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f492406c2b0 0x7f492406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:45.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.470+0000 7f49417fa640 1 -- 172.21.15.86:0/3996321304 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7165+0+0 (secure 0 0 0) 0x7f492c08b230 con 0x7f4944154500 2024-09-19T06:44:45.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.470+0000 7f4943fff640 1 --2- 172.21.15.86:0/3996321304 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f492406c2b0 0x7f492406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:45.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.471+0000 7f4943fff640 1 --2- 172.21.15.86:0/3996321304 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f492406c2b0 0x7f492406e770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4934032000 tx=0x7f493402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:45.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.475+0000 7f49417fa640 1 -- 172.21.15.86:0/3996321304 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f492c058d90 con 0x7f4944154500 2024-09-19T06:44:45.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.804+0000 7f494a6dd640 1 -- 172.21.15.86:0/3996321304 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4928005580 con 0x7f4944154500 2024-09-19T06:44:45.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.805+0000 7f49417fa640 1 -- 172.21.15.86:0/3996321304 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+6038 (secure 0 0 0) 0x7f492c05d090 con 0x7f4944154500 2024-09-19T06:44:45.807 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:44:45.807 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":30,"btime":"2024-09-19T06:44:35:536179+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:35.536175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"e","rank":0,"incarnation":30,"state":"up:replay","state_seq":1,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:44:45.807 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 30 2024-09-19T06:44:45.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.808+0000 7f494a6dd640 1 -- 172.21.15.86:0/3996321304 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f492406c2b0 msgr2=0x7f492406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:45.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.808+0000 7f494a6dd640 1 --2- 172.21.15.86:0/3996321304 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f492406c2b0 0x7f492406e770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4934032000 tx=0x7f493402e000 comp rx=0 tx=0).stop 2024-09-19T06:44:45.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.808+0000 7f494a6dd640 1 -- 172.21.15.86:0/3996321304 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4944154500 msgr2=0x7f4944150fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:45.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.808+0000 7f494a6dd640 1 --2- 172.21.15.86:0/3996321304 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4944154500 0x7f4944150fb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f492c00d7d0 tx=0x7f492c00dc90 comp rx=0 tx=0).stop 2024-09-19T06:44:45.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.809+0000 7f494a6dd640 1 -- 172.21.15.86:0/3996321304 shutdown_connections 2024-09-19T06:44:45.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.809+0000 7f494a6dd640 1 --2- 172.21.15.86:0/3996321304 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f492406c2b0 0x7f492406e770 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:45.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.809+0000 7f494a6dd640 1 --2- 172.21.15.86:0/3996321304 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4944154920 0x7f49441514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:45.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.809+0000 7f494a6dd640 1 --2- 172.21.15.86:0/3996321304 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4944154500 0x7f4944150fb0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:45.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.809+0000 7f494a6dd640 1 --2- 172.21.15.86:0/3996321304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49300039b0 0x7f49441584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:45.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.809+0000 7f494a6dd640 1 -- 172.21.15.86:0/3996321304 >> 172.21.15.86:0/3996321304 conn(0x7f494406d910 msgr2=0x7f49440c9920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:45.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.809+0000 7f494a6dd640 1 -- 172.21.15.86:0/3996321304 shutdown_connections 2024-09-19T06:44:45.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:45.809+0000 7f494a6dd640 1 -- 172.21.15.86:0/3996321304 wait complete. 2024-09-19T06:44:45.825 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:44:47.826 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:44:47.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.955+0000 7f544dff6640 1 Processor -- start 2024-09-19T06:44:47.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.956+0000 7f544dff6640 1 -- start start 2024-09-19T06:44:47.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.956+0000 7f544dff6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f54480d0d40 0x7f54480ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:47.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.956+0000 7f544dff6640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f54480d1120 0x7f54480cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:47.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.956+0000 7f544dff6640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f544815c9c0 con 0x7f544815da60 2024-09-19T06:44:47.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.956+0000 7f544dff6640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f544815c770 con 0x7f54480d1120 2024-09-19T06:44:47.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.956+0000 7f544dff6640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f54480b3f20 con 0x7f54480d0d40 2024-09-19T06:44:47.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.956+0000 7f5446ffd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f54480d1120 0x7f54480cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:47.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.956+0000 7f5446ffd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f54480d1120 0x7f54480cac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45320/0 (socket says 172.21.15.86:45320) 2024-09-19T06:44:47.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.956+0000 7f5446ffd640 1 -- 172.21.15.86:0/2177097165 learned_addr learned my addr 172.21.15.86:0/2177097165 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:47.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.957+0000 7f54477fe640 1 --2- 172.21.15.86:0/2177097165 >> v2:172.21.15.169:3300/0 conn(0x7f54480d0d40 0x7f54480ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:47.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.957+0000 7f5446ffd640 1 -- 172.21.15.86:0/2177097165 >> v2:172.21.15.169:3300/0 conn(0x7f54480d0d40 msgr2=0x7f54480ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:47.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.957+0000 7f5446ffd640 1 --2- 172.21.15.86:0/2177097165 >> v2:172.21.15.169:3300/0 conn(0x7f54480d0d40 0x7f54480ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:47.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.957+0000 7f5446ffd640 1 -- 172.21.15.86:0/2177097165 >> v1:172.21.15.86:6789/0 conn(0x7f544815da60 legacy=0x7f544815ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:47.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.957+0000 7f5446ffd640 1 -- 172.21.15.86:0/2177097165 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f544815cca0 con 0x7f54480d1120 2024-09-19T06:44:47.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.957+0000 7f5446ffd640 1 --2- 172.21.15.86:0/2177097165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54480d1120 0x7f54480cac00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f54480ce600 tx=0x7f543802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a48a71aa685368c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:47.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.957+0000 7f54467fc640 1 -- 172.21.15.86:0/2177097165 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5438037070 con 0x7f54480d1120 2024-09-19T06:44:47.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.958+0000 7f54467fc640 1 -- 172.21.15.86:0/2177097165 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5438032440 con 0x7f54480d1120 2024-09-19T06:44:47.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.958+0000 7f54467fc640 1 -- 172.21.15.86:0/2177097165 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5438032810 con 0x7f54480d1120 2024-09-19T06:44:47.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.958+0000 7f544dff6640 1 -- 172.21.15.86:0/2177097165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54480d1120 msgr2=0x7f54480cac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:47.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.958+0000 7f544dff6640 1 --2- 172.21.15.86:0/2177097165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54480d1120 0x7f54480cac00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f54480ce600 tx=0x7f543802a270 comp rx=0 tx=0).stop 2024-09-19T06:44:47.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.958+0000 7f544dff6640 1 -- 172.21.15.86:0/2177097165 shutdown_connections 2024-09-19T06:44:47.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.958+0000 7f544dff6640 1 --2- 172.21.15.86:0/2177097165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54480d1120 0x7f54480cac00 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:47.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.958+0000 7f544dff6640 1 --2- 172.21.15.86:0/2177097165 >> v2:172.21.15.169:3300/0 conn(0x7f54480d0d40 0x7f54480ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:47.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.958+0000 7f544dff6640 1 -- 172.21.15.86:0/2177097165 >> 172.21.15.86:0/2177097165 conn(0x7f544806d910 msgr2=0x7f544806dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:47.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.958+0000 7f544dff6640 1 -- 172.21.15.86:0/2177097165 shutdown_connections 2024-09-19T06:44:47.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.958+0000 7f544dff6640 1 -- 172.21.15.86:0/2177097165 wait complete. 2024-09-19T06:44:47.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.960+0000 7f544dff6640 1 Processor -- start 2024-09-19T06:44:47.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.960+0000 7f544dff6640 1 -- start start 2024-09-19T06:44:47.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.961+0000 7f544dff6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54480d0d40 0x7f544815e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:47.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.961+0000 7f544dff6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54480d1120 0x7f54481f4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:47.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.961+0000 7f544dff6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f544815da60 0x7f544814dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:47.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.962+0000 7f544dff6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f54480b4b60 con 0x7f54480d0d40 2024-09-19T06:44:47.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.962+0000 7f544dff6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f544815d260 con 0x7f54480d1120 2024-09-19T06:44:47.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.962+0000 7f54477fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54480d0d40 0x7f544815e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:47.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.962+0000 7f54477fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54480d0d40 0x7f544815e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45332/0 (socket says 172.21.15.86:45332) 2024-09-19T06:44:47.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.962+0000 7f54477fe640 1 -- 172.21.15.86:0/641040564 learned_addr learned my addr 172.21.15.86:0/641040564 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:47.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.962+0000 7f544dff6640 1 -- 172.21.15.86:0/641040564 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f54480b4ce0 con 0x7f544815da60 2024-09-19T06:44:47.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.962+0000 7f5446ffd640 1 --2- 172.21.15.86:0/641040564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54480d1120 0x7f54481f4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:47.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.962+0000 7f5447fff640 1 --2- 172.21.15.86:0/641040564 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f544815da60 0x7f544814dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:47.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.962+0000 7f5447fff640 1 -- 172.21.15.86:0/641040564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54480d1120 msgr2=0x7f54481f4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:47.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.962+0000 7f5447fff640 1 --2- 172.21.15.86:0/641040564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54480d1120 0x7f54481f4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:47.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.962+0000 7f5447fff640 1 -- 172.21.15.86:0/641040564 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54480d0d40 msgr2=0x7f544815e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:47.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.962+0000 7f5447fff640 1 --2- 172.21.15.86:0/641040564 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54480d0d40 0x7f544815e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:47.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.963+0000 7f5447fff640 1 -- 172.21.15.86:0/641040564 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54480c5f60 con 0x7f544815da60 2024-09-19T06:44:47.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.963+0000 7f5447fff640 1 --2- 172.21.15.86:0/641040564 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f544815da60 0x7f544814dc50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f544000c700 tx=0x7f544000cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:47.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.963+0000 7f542ffff640 1 -- 172.21.15.86:0/641040564 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5440003b70 con 0x7f544815da60 2024-09-19T06:44:47.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.963+0000 7f542ffff640 1 -- 172.21.15.86:0/641040564 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5440003d10 con 0x7f544815da60 2024-09-19T06:44:47.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.963+0000 7f544dff6640 1 -- 172.21.15.86:0/641040564 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54480c5c80 con 0x7f544815da60 2024-09-19T06:44:47.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.963+0000 7f542ffff640 1 -- 172.21.15.86:0/641040564 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5440005310 con 0x7f544815da60 2024-09-19T06:44:47.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.963+0000 7f544dff6640 1 -- 172.21.15.86:0/641040564 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f54481f4f30 con 0x7f544815da60 2024-09-19T06:44:47.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.965+0000 7f544dff6640 1 -- 172.21.15.86:0/641040564 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f544815ded0 con 0x7f544815da60 2024-09-19T06:44:47.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.965+0000 7f542ffff640 1 -- 172.21.15.86:0/641040564 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f54400054b0 con 0x7f544815da60 2024-09-19T06:44:47.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.966+0000 7f542ffff640 1 --2- 172.21.15.86:0/641040564 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f543406c2e0 0x7f543406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:47.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.966+0000 7f542ffff640 1 -- 172.21.15.86:0/641040564 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 7165+0+0 (secure 0 0 0) 0x7f544008b590 con 0x7f544815da60 2024-09-19T06:44:47.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.966+0000 7f54477fe640 1 --2- 172.21.15.86:0/641040564 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f543406c2e0 0x7f543406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:47.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.967+0000 7f54477fe640 1 --2- 172.21.15.86:0/641040564 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f543406c2e0 0x7f543406e7a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f543c009c00 tx=0x7f543c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:47.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:47.975+0000 7f542ffff640 1 -- 172.21.15.86:0/641040564 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5440059190 con 0x7f544815da60 2024-09-19T06:44:48.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:48.295+0000 7f544dff6640 1 -- 172.21.15.86:0/641040564 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f54480b3cb0 con 0x7f544815da60 2024-09-19T06:44:48.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:48.296+0000 7f542ffff640 1 -- 172.21.15.86:0/641040564 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6041 (secure 0 0 0) 0x7f544005d490 con 0x7f544815da60 2024-09-19T06:44:48.299 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:44:48.299 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":31,"btime":"2024-09-19T06:44:45:818681+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:45.675778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"e","rank":0,"incarnation":30,"state":"up:reconnect","state_seq":8,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:44:48.299 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 31 2024-09-19T06:44:48.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:48.299+0000 7f544dff6640 1 -- 172.21.15.86:0/641040564 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f543406c2e0 msgr2=0x7f543406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:48.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:48.299+0000 7f544dff6640 1 --2- 172.21.15.86:0/641040564 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f543406c2e0 0x7f543406e7a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f543c009c00 tx=0x7f543c009190 comp rx=0 tx=0).stop 2024-09-19T06:44:48.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:48.299+0000 7f544dff6640 1 -- 172.21.15.86:0/641040564 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f544815da60 msgr2=0x7f544814dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:48.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:48.299+0000 7f544dff6640 1 --2- 172.21.15.86:0/641040564 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f544815da60 0x7f544814dc50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f544000c700 tx=0x7f544000cbc0 comp rx=0 tx=0).stop 2024-09-19T06:44:48.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:48.299+0000 7f544dff6640 1 -- 172.21.15.86:0/641040564 shutdown_connections 2024-09-19T06:44:48.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:48.299+0000 7f544dff6640 1 --2- 172.21.15.86:0/641040564 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f543406c2e0 0x7f543406e7a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:48.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:48.299+0000 7f544dff6640 1 --2- 172.21.15.86:0/641040564 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f544815da60 0x7f544814dc50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:48.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:48.299+0000 7f544dff6640 1 --2- 172.21.15.86:0/641040564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54480d1120 0x7f54481f4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:48.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:48.299+0000 7f544dff6640 1 --2- 172.21.15.86:0/641040564 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54480d0d40 0x7f544815e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:48.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:48.299+0000 7f544dff6640 1 -- 172.21.15.86:0/641040564 >> 172.21.15.86:0/641040564 conn(0x7f544806d910 msgr2=0x7f54480c8920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:48.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:48.301+0000 7f544dff6640 1 -- 172.21.15.86:0/641040564 shutdown_connections 2024-09-19T06:44:48.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:48.301+0000 7f544dff6640 1 -- 172.21.15.86:0/641040564 wait complete. 2024-09-19T06:44:48.319 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:44:50.320 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:44:50.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.490+0000 7f683359e640 1 Processor -- start 2024-09-19T06:44:50.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.490+0000 7f683359e640 1 -- start start 2024-09-19T06:44:50.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.492+0000 7f683359e640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f683414da80 0x7f68341578b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:50.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.492+0000 7f683259c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f683414da80 0x7f68341578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:50.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.492+0000 7f683259c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f683414da80 0x7f68341578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45344/0 (socket says 172.21.15.86:45344) 2024-09-19T06:44:50.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.493+0000 7f683259c640 1 -- 172.21.15.86:0/4091404183 learned_addr learned my addr 172.21.15.86:0/4091404183 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:50.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.493+0000 7f683359e640 1 -- 172.21.15.86:0/4091404183 --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6834157df0 con 0x7f683406f010 2024-09-19T06:44:50.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.493+0000 7f683359e640 1 -- 172.21.15.86:0/4091404183 --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f683406f4e0 con 0x7f683406e0c0 2024-09-19T06:44:50.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.493+0000 7f683359e640 1 -- 172.21.15.86:0/4091404183 --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f683406f7a0 con 0x7f683414da80 2024-09-19T06:44:50.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.494+0000 7f683159a640 1 -- 172.21.15.86:0/4091404183 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 575377069 0 0) 0x7f6828001110 con 0x7f683406f010 2024-09-19T06:44:50.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.494+0000 7f683159a640 1 -- 172.21.15.86:0/4091404183 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f681c003520 con 0x7f683406f010 2024-09-19T06:44:50.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.494+0000 7f683159a640 1 -- 172.21.15.86:0/4091404183 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3851426891 0 0) 0x7f683406f4e0 con 0x7f683406e0c0 2024-09-19T06:44:50.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.494+0000 7f683159a640 1 -- 172.21.15.86:0/4091404183 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6828001110 con 0x7f683406e0c0 2024-09-19T06:44:50.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.494+0000 7f683259c640 1 -- 172.21.15.86:0/4091404183 >> v1:172.21.15.169:6789/0 conn(0x7f683406e0c0 legacy=0x7f68341617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:50.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.494+0000 7f683159a640 1 -- 172.21.15.86:0/4091404183 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1656770583 0 0) 0x7f681c003520 con 0x7f683406f010 2024-09-19T06:44:50.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.494+0000 7f683259c640 1 -- 172.21.15.86:0/4091404183 >> v1:172.21.15.86:6789/0 conn(0x7f683406f010 legacy=0x7f68340c3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:50.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.494+0000 7f683259c640 1 -- 172.21.15.86:0/4091404183 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68340c8c20 con 0x7f683414da80 2024-09-19T06:44:50.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.495+0000 7f683259c640 1 --2- 172.21.15.86:0/4091404183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f683414da80 0x7f68341578b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6824009870 tx=0x7f682402a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5bcf0c2b7d52f92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:50.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.496+0000 7f683159a640 1 -- 172.21.15.86:0/4091404183 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6824037070 con 0x7f683414da80 2024-09-19T06:44:50.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.496+0000 7f683159a640 1 -- 172.21.15.86:0/4091404183 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f682402ad10 con 0x7f683414da80 2024-09-19T06:44:50.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.496+0000 7f683159a640 1 -- 172.21.15.86:0/4091404183 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6828001840 con 0x7f683414da80 2024-09-19T06:44:50.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.497+0000 7f683359e640 1 -- 172.21.15.86:0/4091404183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f683414da80 msgr2=0x7f68341578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:50.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.497+0000 7f683359e640 1 --2- 172.21.15.86:0/4091404183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f683414da80 0x7f68341578b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6824009870 tx=0x7f682402a280 comp rx=0 tx=0).stop 2024-09-19T06:44:50.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.498+0000 7f683359e640 1 -- 172.21.15.86:0/4091404183 shutdown_connections 2024-09-19T06:44:50.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.498+0000 7f683359e640 1 --2- 172.21.15.86:0/4091404183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f683414da80 0x7f68341578b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:50.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.498+0000 7f683359e640 1 -- 172.21.15.86:0/4091404183 >> 172.21.15.86:0/4091404183 conn(0x7f68340cc450 msgr2=0x7f68340cc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:50.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.498+0000 7f683359e640 1 -- 172.21.15.86:0/4091404183 shutdown_connections 2024-09-19T06:44:50.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.498+0000 7f683359e640 1 -- 172.21.15.86:0/4091404183 wait complete. 2024-09-19T06:44:50.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.501+0000 7f683359e640 1 Processor -- start 2024-09-19T06:44:50.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.501+0000 7f683359e640 1 -- start start 2024-09-19T06:44:50.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.502+0000 7f683359e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f683406e0c0 0x7f6834154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:50.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.503+0000 7f683359e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f683406f010 0x7f68341e05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:50.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.503+0000 7f683259c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f683406e0c0 0x7f6834154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:50.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.503+0000 7f683259c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f683406e0c0 0x7f6834154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:37858/0 (socket says 172.21.15.86:37858) 2024-09-19T06:44:50.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.503+0000 7f683259c640 1 -- 172.21.15.86:0/3979423864 learned_addr learned my addr 172.21.15.86:0/3979423864 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:50.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.503+0000 7f6831d9b640 1 --2- 172.21.15.86:0/3979423864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f683406f010 0x7f68341e05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:50.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.503+0000 7f683359e640 1 --2- 172.21.15.86:0/3979423864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f683414da80 0x7f68341e0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:50.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.504+0000 7f6832d9d640 1 --2- 172.21.15.86:0/3979423864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f683414da80 0x7f68341e0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:50.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.504+0000 7f683359e640 1 -- 172.21.15.86:0/3979423864 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f68340c7260 con 0x7f683414da80 2024-09-19T06:44:50.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.504+0000 7f683359e640 1 -- 172.21.15.86:0/3979423864 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f68340c7b90 con 0x7f683406f010 2024-09-19T06:44:50.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.504+0000 7f683359e640 1 -- 172.21.15.86:0/3979423864 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f68340c7540 con 0x7f683406e0c0 2024-09-19T06:44:50.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.505+0000 7f6832d9d640 1 -- 172.21.15.86:0/3979423864 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f683406e0c0 msgr2=0x7f6834154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:50.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.505+0000 7f6832d9d640 1 --2- 172.21.15.86:0/3979423864 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f683406e0c0 0x7f6834154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:50.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.505+0000 7f6832d9d640 1 -- 172.21.15.86:0/3979423864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f683406f010 msgr2=0x7f68341e05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:50.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.505+0000 7f6832d9d640 1 --2- 172.21.15.86:0/3979423864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f683406f010 0x7f68341e05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:50.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.505+0000 7f6832d9d640 1 -- 172.21.15.86:0/3979423864 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f683414d040 con 0x7f683414da80 2024-09-19T06:44:50.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.505+0000 7f6832d9d640 1 --2- 172.21.15.86:0/3979423864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f683414da80 0x7f68341e0b10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f682c00c8f0 tx=0x7f682c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:50.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.506+0000 7f6822ffd640 1 -- 172.21.15.86:0/3979423864 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c003b70 con 0x7f683414da80 2024-09-19T06:44:50.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.506+0000 7f6822ffd640 1 -- 172.21.15.86:0/3979423864 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f682c003d30 con 0x7f683414da80 2024-09-19T06:44:50.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.506+0000 7f683359e640 1 -- 172.21.15.86:0/3979423864 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f683414cda0 con 0x7f683414da80 2024-09-19T06:44:50.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.506+0000 7f683359e640 1 -- 172.21.15.86:0/3979423864 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68341ed430 con 0x7f683414da80 2024-09-19T06:44:50.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.508+0000 7f6822ffd640 1 -- 172.21.15.86:0/3979423864 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c005310 con 0x7f683414da80 2024-09-19T06:44:50.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.509+0000 7f6822ffd640 1 -- 172.21.15.86:0/3979423864 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f682c005530 con 0x7f683414da80 2024-09-19T06:44:50.513 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.512+0000 7f6822ffd640 1 --2- 172.21.15.86:0/3979423864 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f681406c3e0 0x7f681406e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:50.514 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.513+0000 7f683259c640 1 --2- 172.21.15.86:0/3979423864 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f681406c3e0 0x7f681406e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:50.514 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.513+0000 7f6822ffd640 1 -- 172.21.15.86:0/3979423864 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7165+0+0 (secure 0 0 0) 0x7f682c08b990 con 0x7f683414da80 2024-09-19T06:44:50.517 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.515+0000 7f683259c640 1 --2- 172.21.15.86:0/3979423864 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f681406c3e0 0x7f681406e8a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f682402a2c0 tx=0x7f682402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:50.517 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.515+0000 7f683359e640 1 -- 172.21.15.86:0/3979423864 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68340c7820 con 0x7f683414da80 2024-09-19T06:44:50.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.526+0000 7f6822ffd640 1 -- 172.21.15.86:0/3979423864 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f682c059aa0 con 0x7f683414da80 2024-09-19T06:44:50.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.946+0000 7f683359e640 1 -- 172.21.15.86:0/3979423864 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6834156da0 con 0x7f683414da80 2024-09-19T06:44:50.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.948+0000 7f6822ffd640 1 -- 172.21.15.86:0/3979423864 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6041 (secure 0 0 0) 0x7f682c0593a0 con 0x7f683414da80 2024-09-19T06:44:50.949 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:44:50.949 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":31,"btime":"2024-09-19T06:44:45:818681+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:45.675778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"e","rank":0,"incarnation":30,"state":"up:reconnect","state_seq":8,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:44:50.950 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 31 2024-09-19T06:44:50.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.953+0000 7f6820ff9640 1 -- 172.21.15.86:0/3979423864 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f681406c3e0 msgr2=0x7f681406e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:50.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.953+0000 7f6820ff9640 1 --2- 172.21.15.86:0/3979423864 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f681406c3e0 0x7f681406e8a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f682402a2c0 tx=0x7f682402e000 comp rx=0 tx=0).stop 2024-09-19T06:44:50.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.953+0000 7f6820ff9640 1 -- 172.21.15.86:0/3979423864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f683414da80 msgr2=0x7f68341e0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:50.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.953+0000 7f6820ff9640 1 --2- 172.21.15.86:0/3979423864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f683414da80 0x7f68341e0b10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f682c00c8f0 tx=0x7f682c00cdb0 comp rx=0 tx=0).stop 2024-09-19T06:44:50.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.953+0000 7f6820ff9640 1 -- 172.21.15.86:0/3979423864 shutdown_connections 2024-09-19T06:44:50.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.953+0000 7f6820ff9640 1 --2- 172.21.15.86:0/3979423864 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f681406c3e0 0x7f681406e8a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:50.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.953+0000 7f6820ff9640 1 --2- 172.21.15.86:0/3979423864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f683414da80 0x7f68341e0b10 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:50.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.953+0000 7f6820ff9640 1 --2- 172.21.15.86:0/3979423864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f683406f010 0x7f68341e05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:50.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.953+0000 7f6820ff9640 1 --2- 172.21.15.86:0/3979423864 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f683406e0c0 0x7f6834154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:50.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.953+0000 7f6820ff9640 1 -- 172.21.15.86:0/3979423864 >> 172.21.15.86:0/3979423864 conn(0x7f68340cc450 msgr2=0x7f68340c47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:50.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.953+0000 7f6820ff9640 1 -- 172.21.15.86:0/3979423864 shutdown_connections 2024-09-19T06:44:50.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:50.953+0000 7f6820ff9640 1 -- 172.21.15.86:0/3979423864 wait complete. 2024-09-19T06:44:50.974 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "btime": "2024-09-19T06:44:45:818681+0000", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 31, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-19T06:37:08.763572+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 31, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_5211": { "addr": "172.21.15.86:6839/22518982", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6838", "nonce": 22518982, "type": "v2" }, { "addr": "172.21.15.86:6839", "nonce": 22518982, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5211, "incarnation": 30, "join_fscid": -1, "name": "e", "rank": 0, "state": "up:reconnect", "state_seq": 8 } }, "last_failure": 0, "last_failure_osd_epoch": 33, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-09-19T06:44:45.675778+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5211 } } } ], "standbys": [ { "addr": "172.21.15.86:6837/728803297", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6835", "nonce": 728803297, "type": "v2" }, { "addr": "172.21.15.86:6837", "nonce": 728803297, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4247, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.169:6835/2537509253", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6833", "nonce": 2537509253, "type": "v2" }, { "addr": "172.21.15.169:6835", "nonce": 2537509253, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4262, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.169:6834/1723647527", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6832", "nonce": 1723647527, "type": "v2" }, { "addr": "172.21.15.169:6834", "nonce": 1723647527, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4265, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.86:6836/4135959816", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6834", "nonce": 4135959816, "type": "v2" }, { "addr": "172.21.15.86:6836", "nonce": 4135959816, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4270, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-09-19T06:44:52.975 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:44:53.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.138+0000 7f802d277640 1 Processor -- start 2024-09-19T06:44:53.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.138+0000 7f802d277640 1 -- start start 2024-09-19T06:44:53.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.138+0000 7f802d277640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8028155240 0x7f8028072470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:53.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.139+0000 7f80277fe640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f802815eb30 0x7f8028165870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42446/0 (socket says 172.21.15.86:42446) 2024-09-19T06:44:53.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.139+0000 7f802d277640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8028074210 con 0x7f802815eb30 2024-09-19T06:44:53.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.139+0000 7f80277fe640 1 -- 172.21.15.86:0/3888903619 learned_addr learned my addr 172.21.15.86:0/3888903619 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:44:53.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.139+0000 7f802d277640 1 -- 172.21.15.86:0/3888903619 --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80280729b0 con 0x7f8028072020 2024-09-19T06:44:53.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.139+0000 7f802d277640 1 -- 172.21.15.86:0/3888903619 --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f802815bef0 con 0x7f8028155240 2024-09-19T06:44:53.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.139+0000 7f8026ffd640 1 --2- 172.21.15.86:0/3888903619 >> v2:172.21.15.86:3300/0 conn(0x7f8028155240 0x7f8028072470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:53.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.139+0000 7f8025ffb640 1 -- 172.21.15.86:0/3888903619 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 618889035 0 0) 0x7f8020001490 con 0x7f802815eb30 2024-09-19T06:44:53.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.139+0000 7f8025ffb640 1 -- 172.21.15.86:0/3888903619 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8010003520 con 0x7f802815eb30 2024-09-19T06:44:53.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.139+0000 7f8025ffb640 1 -- 172.21.15.86:0/3888903619 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 99136692 0 0) 0x7f80280729b0 con 0x7f8028072020 2024-09-19T06:44:53.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.139+0000 7f8025ffb640 1 -- 172.21.15.86:0/3888903619 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8020001490 con 0x7f8028072020 2024-09-19T06:44:53.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.139+0000 7f8026ffd640 1 -- 172.21.15.86:0/3888903619 >> v1:172.21.15.169:6789/0 conn(0x7f8028072020 legacy=0x7f8028072c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:53.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.139+0000 7f8026ffd640 1 -- 172.21.15.86:0/3888903619 >> v1:172.21.15.86:6789/0 conn(0x7f802815eb30 legacy=0x7f8028165870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:53.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.139+0000 7f8026ffd640 1 -- 172.21.15.86:0/3888903619 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f802815b370 con 0x7f8028155240 2024-09-19T06:44:53.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.140+0000 7f8026ffd640 1 --2- 172.21.15.86:0/3888903619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8028155240 0x7f8028072470 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f80180097a0 tx=0x7f801802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8f02783b9d7ef3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:53.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.140+0000 7f8025ffb640 1 -- 172.21.15.86:0/3888903619 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8018037070 con 0x7f8028155240 2024-09-19T06:44:53.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.140+0000 7f8025ffb640 1 -- 172.21.15.86:0/3888903619 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8018032440 con 0x7f8028155240 2024-09-19T06:44:53.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.140+0000 7f8025ffb640 1 -- 172.21.15.86:0/3888903619 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8018032810 con 0x7f8028155240 2024-09-19T06:44:53.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.141+0000 7f802d277640 1 -- 172.21.15.86:0/3888903619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8028155240 msgr2=0x7f8028072470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:53.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.141+0000 7f802d277640 1 --2- 172.21.15.86:0/3888903619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8028155240 0x7f8028072470 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f80180097a0 tx=0x7f801802a230 comp rx=0 tx=0).stop 2024-09-19T06:44:53.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.141+0000 7f802d277640 1 -- 172.21.15.86:0/3888903619 shutdown_connections 2024-09-19T06:44:53.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.141+0000 7f802d277640 1 --2- 172.21.15.86:0/3888903619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8028155240 0x7f8028072470 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:53.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.141+0000 7f802d277640 1 -- 172.21.15.86:0/3888903619 >> 172.21.15.86:0/3888903619 conn(0x7f80280cdd80 msgr2=0x7f80280ca220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:53.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.141+0000 7f802d277640 1 -- 172.21.15.86:0/3888903619 shutdown_connections 2024-09-19T06:44:53.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.141+0000 7f802d277640 1 -- 172.21.15.86:0/3888903619 wait complete. 2024-09-19T06:44:53.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.143+0000 7f802d277640 1 Processor -- start 2024-09-19T06:44:53.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.143+0000 7f802d277640 1 -- start start 2024-09-19T06:44:53.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.144+0000 7f802d277640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8028072020 0x7f8028159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:53.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.144+0000 7f802d277640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8028155240 0x7f80280c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:53.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.144+0000 7f802d277640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f802815eb30 0x7f80280c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:53.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.144+0000 7f802d277640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f802815bc10 con 0x7f8028072020 2024-09-19T06:44:53.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.144+0000 7f802d277640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f802815b930 con 0x7f802815eb30 2024-09-19T06:44:53.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.144+0000 7f802d277640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f802815e610 con 0x7f8028155240 2024-09-19T06:44:53.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.144+0000 7f8026ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8028072020 0x7f8028159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:53.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.144+0000 7f8026ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8028072020 0x7f8028159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37146/0 (socket says 172.21.15.86:37146) 2024-09-19T06:44:53.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.144+0000 7f8026ffd640 1 -- 172.21.15.86:0/3716625227 learned_addr learned my addr 172.21.15.86:0/3716625227 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:53.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.144+0000 7f80277fe640 1 --2- 172.21.15.86:0/3716625227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f802815eb30 0x7f80280c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:53.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.144+0000 7f80267fc640 1 --2- 172.21.15.86:0/3716625227 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8028155240 0x7f80280c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:53.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.144+0000 7f8026ffd640 1 -- 172.21.15.86:0/3716625227 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8028155240 msgr2=0x7f80280c4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:53.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.144+0000 7f8026ffd640 1 --2- 172.21.15.86:0/3716625227 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8028155240 0x7f80280c4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:53.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.144+0000 7f8026ffd640 1 -- 172.21.15.86:0/3716625227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f802815eb30 msgr2=0x7f80280c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:53.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.144+0000 7f8026ffd640 1 --2- 172.21.15.86:0/3716625227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f802815eb30 0x7f80280c5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:53.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.144+0000 7f8026ffd640 1 -- 172.21.15.86:0/3716625227 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80280c89e0 con 0x7f8028072020 2024-09-19T06:44:53.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.144+0000 7f80277fe640 1 --2- 172.21.15.86:0/3716625227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f802815eb30 0x7f80280c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:44:53.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.144+0000 7f80267fc640 1 --2- 172.21.15.86:0/3716625227 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8028155240 0x7f80280c4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:44:53.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.145+0000 7f8026ffd640 1 --2- 172.21.15.86:0/3716625227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8028072020 0x7f8028159e50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8018035040 tx=0x7f80180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:53.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.145+0000 7f800f7fe640 1 -- 172.21.15.86:0/3716625227 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8018041030 con 0x7f8028072020 2024-09-19T06:44:53.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.145+0000 7f802d277640 1 -- 172.21.15.86:0/3716625227 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80281f12f0 con 0x7f8028072020 2024-09-19T06:44:53.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.145+0000 7f800f7fe640 1 -- 172.21.15.86:0/3716625227 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f801803d4e0 con 0x7f8028072020 2024-09-19T06:44:53.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.145+0000 7f802d277640 1 -- 172.21.15.86:0/3716625227 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80281f18b0 con 0x7f8028072020 2024-09-19T06:44:53.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.145+0000 7f800f7fe640 1 -- 172.21.15.86:0/3716625227 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8018041030 con 0x7f8028072020 2024-09-19T06:44:53.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.147+0000 7f802d277640 1 -- 172.21.15.86:0/3716625227 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8008005290 con 0x7f8028072020 2024-09-19T06:44:53.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.149+0000 7f800f7fe640 1 -- 172.21.15.86:0/3716625227 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8018044070 con 0x7f8028072020 2024-09-19T06:44:53.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.150+0000 7f800f7fe640 1 --2- 172.21.15.86:0/3716625227 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f801406c6b0 0x7f801406eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:53.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.150+0000 7f800f7fe640 1 -- 172.21.15.86:0/3716625227 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7165+0+0 (secure 0 0 0) 0x7f8018042070 con 0x7f8028072020 2024-09-19T06:44:53.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.151+0000 7f80267fc640 1 --2- 172.21.15.86:0/3716625227 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f801406c6b0 0x7f801406eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:53.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.153+0000 7f80267fc640 1 --2- 172.21.15.86:0/3716625227 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f801406c6b0 0x7f801406eb70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f802814a190 tx=0x7f801c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:53.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.159+0000 7f800f7fe640 1 -- 172.21.15.86:0/3716625227 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8018079da0 con 0x7f8028072020 2024-09-19T06:44:53.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.493+0000 7f802d277640 1 -- 172.21.15.86:0/3716625227 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8008005580 con 0x7f8028072020 2024-09-19T06:44:53.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.493+0000 7f800f7fe640 1 -- 172.21.15.86:0/3716625227 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6039 (secure 0 0 0) 0x7f8018079da0 con 0x7f8028072020 2024-09-19T06:44:53.495 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:44:53.495 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":32,"btime":"2024-09-19T06:44:51:550627+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:50.858140+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"e","rank":0,"incarnation":30,"state":"up:rejoin","state_seq":10,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:44:53.495 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 32 2024-09-19T06:44:53.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.495+0000 7f802d277640 1 -- 172.21.15.86:0/3716625227 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f801406c6b0 msgr2=0x7f801406eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:53.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.495+0000 7f802d277640 1 --2- 172.21.15.86:0/3716625227 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f801406c6b0 0x7f801406eb70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f802814a190 tx=0x7f801c009040 comp rx=0 tx=0).stop 2024-09-19T06:44:53.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.495+0000 7f802d277640 1 -- 172.21.15.86:0/3716625227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8028072020 msgr2=0x7f8028159e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:53.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.495+0000 7f802d277640 1 --2- 172.21.15.86:0/3716625227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8028072020 0x7f8028159e50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8018035040 tx=0x7f80180046c0 comp rx=0 tx=0).stop 2024-09-19T06:44:53.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.495+0000 7f802d277640 1 -- 172.21.15.86:0/3716625227 shutdown_connections 2024-09-19T06:44:53.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.495+0000 7f802d277640 1 --2- 172.21.15.86:0/3716625227 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f801406c6b0 0x7f801406eb70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:53.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.495+0000 7f802d277640 1 --2- 172.21.15.86:0/3716625227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f802815eb30 0x7f80280c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:53.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.495+0000 7f802d277640 1 --2- 172.21.15.86:0/3716625227 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8028155240 0x7f80280c4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:53.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.495+0000 7f802d277640 1 --2- 172.21.15.86:0/3716625227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8028072020 0x7f8028159e50 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:53.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.495+0000 7f802d277640 1 -- 172.21.15.86:0/3716625227 >> 172.21.15.86:0/3716625227 conn(0x7f80280cdd80 msgr2=0x7f802814b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:53.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.495+0000 7f802d277640 1 -- 172.21.15.86:0/3716625227 shutdown_connections 2024-09-19T06:44:53.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:53.495+0000 7f802d277640 1 -- 172.21.15.86:0/3716625227 wait complete. 2024-09-19T06:44:53.512 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:44:55.513 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:44:55.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.671+0000 7fc5a1ff1640 1 Processor -- start 2024-09-19T06:44:55.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.671+0000 7fc5a1ff1640 1 -- start start 2024-09-19T06:44:55.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.672+0000 7fc5a1ff1640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc5940dbdd0 0x7fc59404cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.672+0000 7fc5a1ff1640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc594045c40 con 0x7fc5940d5690 2024-09-19T06:44:55.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.672+0000 7fc5a1ff1640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc594007770 con 0x7fc59404d000 2024-09-19T06:44:55.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.672+0000 7fc5a1ff1640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fc5940dc1b0 con 0x7fc5940dbdd0 2024-09-19T06:44:55.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.673+0000 7fc59bfff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc5940dbdd0 0x7fc59404cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:55.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.673+0000 7fc59bfff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc5940dbdd0 0x7fc59404cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37154/0 (socket says 172.21.15.86:37154) 2024-09-19T06:44:55.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.673+0000 7fc59bfff640 1 -- 172.21.15.86:0/1398403776 learned_addr learned my addr 172.21.15.86:0/1398403776 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:55.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.674+0000 7fc59bfff640 1 -- 172.21.15.86:0/1398403776 >> v1:172.21.15.169:6789/0 conn(0x7fc59404d000 legacy=0x7fc59404bae0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:44:55.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.674+0000 7fc59bfff640 1 -- 172.21.15.86:0/1398403776 >> v1:172.21.15.86:6789/0 conn(0x7fc5940d5690 legacy=0x7fc5940087d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:55.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.674+0000 7fc59bfff640 1 -- 172.21.15.86:0/1398403776 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc594007a10 con 0x7fc5940dbdd0 2024-09-19T06:44:55.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.676+0000 7fc59bfff640 1 --2- 172.21.15.86:0/1398403776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5940dbdd0 0x7fc59404cac0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc5940348a0 tx=0x7fc5880329b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef334e3e65e26110 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:55.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.676+0000 7fc59b7fe640 1 -- 172.21.15.86:0/1398403776 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5880114e0 con 0x7fc5940dbdd0 2024-09-19T06:44:55.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.676+0000 7fc59b7fe640 1 -- 172.21.15.86:0/1398403776 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc58803d070 con 0x7fc5940dbdd0 2024-09-19T06:44:55.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.676+0000 7fc59b7fe640 1 -- 172.21.15.86:0/1398403776 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58800fa70 con 0x7fc5940dbdd0 2024-09-19T06:44:55.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.678+0000 7fc5a1ff1640 1 -- 172.21.15.86:0/1398403776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5940dbdd0 msgr2=0x7fc59404cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:55.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.678+0000 7fc5a1ff1640 1 --2- 172.21.15.86:0/1398403776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5940dbdd0 0x7fc59404cac0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc5940348a0 tx=0x7fc5880329b0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.678+0000 7fc5a1ff1640 1 -- 172.21.15.86:0/1398403776 shutdown_connections 2024-09-19T06:44:55.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.678+0000 7fc5a1ff1640 1 --2- 172.21.15.86:0/1398403776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5940dbdd0 0x7fc59404cac0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.678+0000 7fc5a1ff1640 1 -- 172.21.15.86:0/1398403776 >> 172.21.15.86:0/1398403776 conn(0x7fc594050d60 msgr2=0x7fc594051170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:55.681 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.681+0000 7fc5a1ff1640 1 -- 172.21.15.86:0/1398403776 shutdown_connections 2024-09-19T06:44:55.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.682+0000 7fc5a1ff1640 1 -- 172.21.15.86:0/1398403776 wait complete. 2024-09-19T06:44:55.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.684+0000 7fc5a1ff1640 1 Processor -- start 2024-09-19T06:44:55.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.684+0000 7fc5a1ff1640 1 -- start start 2024-09-19T06:44:55.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.685+0000 7fc5a1ff1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc59404d000 0x7fc5940c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.685+0000 7fc5a1ff1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5940d5690 0x7fc594177e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.685+0000 7fc5a1ff1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5940dbdd0 0x7fc594178350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.685+0000 7fc5a1ff1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc59404d580 con 0x7fc5940dbdd0 2024-09-19T06:44:55.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.685+0000 7fc5a1ff1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc594007fd0 con 0x7fc59404d000 2024-09-19T06:44:55.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.685+0000 7fc5a1ff1640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc594008ee0 con 0x7fc5940d5690 2024-09-19T06:44:55.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.686+0000 7fc59bfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5940d5690 0x7fc594177e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:55.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.686+0000 7fc59bfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5940d5690 0x7fc594177e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:53158/0 (socket says 172.21.15.86:53158) 2024-09-19T06:44:55.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.686+0000 7fc59bfff640 1 -- 172.21.15.86:0/835695940 learned_addr learned my addr 172.21.15.86:0/835695940 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:55.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.687+0000 7fc59bfff640 1 -- 172.21.15.86:0/835695940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc59404d000 msgr2=0x7fc5940c8eb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:44:55.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.687+0000 7fc59bfff640 1 --2- 172.21.15.86:0/835695940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc59404d000 0x7fc5940c8eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.687+0000 7fc59bfff640 1 -- 172.21.15.86:0/835695940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5940dbdd0 msgr2=0x7fc594178350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:44:55.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.687+0000 7fc59bfff640 1 --2- 172.21.15.86:0/835695940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5940dbdd0 0x7fc594178350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.687+0000 7fc59bfff640 1 -- 172.21.15.86:0/835695940 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5940c93f0 con 0x7fc5940d5690 2024-09-19T06:44:55.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.688+0000 7fc59bfff640 1 --2- 172.21.15.86:0/835695940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5940d5690 0x7fc594177e10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc588032fa0 tx=0x7fc588004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:55.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.695+0000 7fc5997fa640 1 -- 172.21.15.86:0/835695940 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc588046070 con 0x7fc5940d5690 2024-09-19T06:44:55.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.695+0000 7fc5997fa640 1 -- 172.21.15.86:0/835695940 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc588041410 con 0x7fc5940d5690 2024-09-19T06:44:55.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.695+0000 7fc5997fa640 1 -- 172.21.15.86:0/835695940 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5880417c0 con 0x7fc5940d5690 2024-09-19T06:44:55.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.695+0000 7fc5a1ff1640 1 -- 172.21.15.86:0/835695940 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5940d3720 con 0x7fc5940d5690 2024-09-19T06:44:55.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.695+0000 7fc5a1ff1640 1 -- 172.21.15.86:0/835695940 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5940c86b0 con 0x7fc5940d5690 2024-09-19T06:44:55.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.699+0000 7fc5a1ff1640 1 -- 172.21.15.86:0/835695940 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc57c005290 con 0x7fc5940d5690 2024-09-19T06:44:55.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.699+0000 7fc5997fa640 1 -- 172.21.15.86:0/835695940 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc588049070 con 0x7fc5940d5690 2024-09-19T06:44:55.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.700+0000 7fc5997fa640 1 --2- 172.21.15.86:0/835695940 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc58006c380 0x7fc58006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.700+0000 7fc5997fa640 1 -- 172.21.15.86:0/835695940 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 7165+0+0 (secure 0 0 0) 0x7fc5880ac1c0 con 0x7fc5940d5690 2024-09-19T06:44:55.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.700+0000 7fc5a0fef640 1 --2- 172.21.15.86:0/835695940 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc58006c380 0x7fc58006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:55.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.701+0000 7fc5a0fef640 1 --2- 172.21.15.86:0/835695940 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc58006c380 0x7fc58006e840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc590000f60 tx=0x7fc5900079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:55.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:55.705+0000 7fc5997fa640 1 -- 172.21.15.86:0/835695940 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc5940c93f0 con 0x7fc5940d5690 2024-09-19T06:44:56.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:56.056+0000 7fc5a1ff1640 1 -- 172.21.15.86:0/835695940 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc57c005580 con 0x7fc5940d5690 2024-09-19T06:44:56.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:56.058+0000 7fc5997fa640 1 -- 172.21.15.86:0/835695940 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6039 (secure 0 0 0) 0x7fc588079e10 con 0x7fc5940d5690 2024-09-19T06:44:56.058 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:44:56.059 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":32,"btime":"2024-09-19T06:44:51:550627+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:50.858140+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"e","rank":0,"incarnation":30,"state":"up:rejoin","state_seq":10,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:44:56.059 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 32 2024-09-19T06:44:56.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:56.062+0000 7fc5a1ff1640 1 -- 172.21.15.86:0/835695940 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc58006c380 msgr2=0x7fc58006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:56.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:56.062+0000 7fc5a1ff1640 1 --2- 172.21.15.86:0/835695940 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc58006c380 0x7fc58006e840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc590000f60 tx=0x7fc5900079b0 comp rx=0 tx=0).stop 2024-09-19T06:44:56.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:56.062+0000 7fc5a1ff1640 1 -- 172.21.15.86:0/835695940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5940d5690 msgr2=0x7fc594177e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:56.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:56.062+0000 7fc5a1ff1640 1 --2- 172.21.15.86:0/835695940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5940d5690 0x7fc594177e10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc588032fa0 tx=0x7fc588004730 comp rx=0 tx=0).stop 2024-09-19T06:44:56.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:56.062+0000 7fc5a1ff1640 1 -- 172.21.15.86:0/835695940 shutdown_connections 2024-09-19T06:44:56.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:56.062+0000 7fc5a1ff1640 1 --2- 172.21.15.86:0/835695940 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc58006c380 0x7fc58006e840 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:56.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:56.062+0000 7fc5a1ff1640 1 --2- 172.21.15.86:0/835695940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5940dbdd0 0x7fc594178350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:56.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:56.062+0000 7fc5a1ff1640 1 --2- 172.21.15.86:0/835695940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5940d5690 0x7fc594177e10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:56.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:56.062+0000 7fc5a1ff1640 1 --2- 172.21.15.86:0/835695940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc59404d000 0x7fc5940c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:56.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:56.062+0000 7fc5a1ff1640 1 -- 172.21.15.86:0/835695940 >> 172.21.15.86:0/835695940 conn(0x7fc594050d60 msgr2=0x7fc594045e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:56.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:56.063+0000 7fc5a1ff1640 1 -- 172.21.15.86:0/835695940 shutdown_connections 2024-09-19T06:44:56.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:56.063+0000 7fc5a1ff1640 1 -- 172.21.15.86:0/835695940 wait complete. 2024-09-19T06:44:56.078 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:44:58.079 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:44:58.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.240+0000 7fb30ead0640 1 Processor -- start 2024-09-19T06:44:58.242 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.240+0000 7fb30ead0640 1 -- start start 2024-09-19T06:44:58.242 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.241+0000 7fb30ead0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb300050900 0x7fb3000dc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:58.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.241+0000 7fb30ead0640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb30004b960 0x7fb3000dceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:58.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.241+0000 7fb30ead0640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb300035e40 con 0x7fb3000d65a0 2024-09-19T06:44:58.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.241+0000 7fb30ead0640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fb3000dc4e0 con 0x7fb30004b960 2024-09-19T06:44:58.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.241+0000 7fb30ead0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb30004ad60 con 0x7fb300050900 2024-09-19T06:44:58.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.242+0000 7fb307fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb300050900 0x7fb3000dc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:58.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.242+0000 7fb307fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb300050900 0x7fb3000dc970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:53170/0 (socket says 172.21.15.86:53170) 2024-09-19T06:44:58.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.242+0000 7fb307fff640 1 -- 172.21.15.86:0/2529490271 learned_addr learned my addr 172.21.15.86:0/2529490271 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:58.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.243+0000 7fb3077fe640 1 -- 172.21.15.86:0/2529490271 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4187342495 0 0) 0x7fb300035e40 con 0x7fb3000d65a0 2024-09-19T06:44:58.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.243+0000 7fb3077fe640 1 -- 172.21.15.86:0/2529490271 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2f8003520 con 0x7fb3000d65a0 2024-09-19T06:44:58.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.243+0000 7fb307fff640 1 -- 172.21.15.86:0/2529490271 >> v2:172.21.15.169:3300/0 conn(0x7fb30004b960 msgr2=0x7fb3000dceb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:44:58.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.243+0000 7fb307fff640 1 --2- 172.21.15.86:0/2529490271 >> v2:172.21.15.169:3300/0 conn(0x7fb30004b960 0x7fb3000dceb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.243+0000 7fb307fff640 1 -- 172.21.15.86:0/2529490271 >> v1:172.21.15.86:6789/0 conn(0x7fb3000d65a0 legacy=0x7fb300044b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:58.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.243+0000 7fb307fff640 1 -- 172.21.15.86:0/2529490271 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30004b040 con 0x7fb300050900 2024-09-19T06:44:58.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.244+0000 7fb307fff640 1 --2- 172.21.15.86:0/2529490271 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb300050900 0x7fb3000dc970 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4009870 tx=0x7fb2f402a310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ad6f1c87fdd43b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:58.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.245+0000 7fb3077fe640 1 -- 172.21.15.86:0/2529490271 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4037070 con 0x7fb300050900 2024-09-19T06:44:58.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.245+0000 7fb3077fe640 1 -- 172.21.15.86:0/2529490271 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2f4032640 con 0x7fb300050900 2024-09-19T06:44:58.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.245+0000 7fb3077fe640 1 -- 172.21.15.86:0/2529490271 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4037070 con 0x7fb300050900 2024-09-19T06:44:58.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.246+0000 7fb30ead0640 1 -- 172.21.15.86:0/2529490271 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb300050900 msgr2=0x7fb3000dc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:58.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.246+0000 7fb30ead0640 1 --2- 172.21.15.86:0/2529490271 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb300050900 0x7fb3000dc970 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4009870 tx=0x7fb2f402a310 comp rx=0 tx=0).stop 2024-09-19T06:44:58.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.246+0000 7fb30ead0640 1 -- 172.21.15.86:0/2529490271 shutdown_connections 2024-09-19T06:44:58.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.246+0000 7fb30ead0640 1 --2- 172.21.15.86:0/2529490271 >> v2:172.21.15.169:3300/0 conn(0x7fb30004b960 0x7fb3000dceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.246+0000 7fb30ead0640 1 --2- 172.21.15.86:0/2529490271 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb300050900 0x7fb3000dc970 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.246+0000 7fb30ead0640 1 -- 172.21.15.86:0/2529490271 >> 172.21.15.86:0/2529490271 conn(0x7fb30004fc50 msgr2=0x7fb300050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:58.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.247+0000 7fb30ead0640 1 -- 172.21.15.86:0/2529490271 shutdown_connections 2024-09-19T06:44:58.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.247+0000 7fb30ead0640 1 -- 172.21.15.86:0/2529490271 wait complete. 2024-09-19T06:44:58.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.250+0000 7fb30ead0640 1 Processor -- start 2024-09-19T06:44:58.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.253+0000 7fb30ead0640 1 -- start start 2024-09-19T06:44:58.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.255+0000 7fb30ead0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb30004b960 0x7fb3000dbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:58.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.255+0000 7fb30ead0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb300050900 0x7fb3000d3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:58.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.255+0000 7fb30c86c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb30004b960 0x7fb3000dbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:58.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.255+0000 7fb30c86c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb30004b960 0x7fb3000dbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:53184/0 (socket says 172.21.15.86:53184) 2024-09-19T06:44:58.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.255+0000 7fb30c86c640 1 -- 172.21.15.86:0/1448531366 learned_addr learned my addr 172.21.15.86:0/1448531366 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:44:58.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.256+0000 7fb307fff640 1 --2- 172.21.15.86:0/1448531366 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb300050900 0x7fb3000d3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:58.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.256+0000 7fb30ead0640 1 --2- 172.21.15.86:0/1448531366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3000d65a0 0x7fb3000d36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:58.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.256+0000 7fb30ead0640 1 -- 172.21.15.86:0/1448531366 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb3000d6980 con 0x7fb300050900 2024-09-19T06:44:58.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.256+0000 7fb30ead0640 1 -- 172.21.15.86:0/1448531366 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb30004c390 con 0x7fb3000d65a0 2024-09-19T06:44:58.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.256+0000 7fb30ead0640 1 -- 172.21.15.86:0/1448531366 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb3000d6b00 con 0x7fb30004b960 2024-09-19T06:44:58.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.256+0000 7fb30d06d640 1 --2- 172.21.15.86:0/1448531366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3000d65a0 0x7fb3000d36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:58.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.257+0000 7fb307fff640 1 -- 172.21.15.86:0/1448531366 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb30004b960 msgr2=0x7fb3000dbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:58.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.257+0000 7fb307fff640 1 --2- 172.21.15.86:0/1448531366 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb30004b960 0x7fb3000dbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.257+0000 7fb307fff640 1 -- 172.21.15.86:0/1448531366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3000d65a0 msgr2=0x7fb3000d36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:58.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.257+0000 7fb307fff640 1 --2- 172.21.15.86:0/1448531366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3000d65a0 0x7fb3000d36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.257+0000 7fb307fff640 1 -- 172.21.15.86:0/1448531366 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb300034870 con 0x7fb300050900 2024-09-19T06:44:58.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.257+0000 7fb30c86c640 1 --2- 172.21.15.86:0/1448531366 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb30004b960 0x7fb3000dbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:44:58.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.257+0000 7fb307fff640 1 --2- 172.21.15.86:0/1448531366 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb300050900 0x7fb3000d3180 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb300036010 tx=0x7fb2f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:58.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.258+0000 7fb3057fa640 1 -- 172.21.15.86:0/1448531366 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f402ae60 con 0x7fb300050900 2024-09-19T06:44:58.260 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.258+0000 7fb3057fa640 1 -- 172.21.15.86:0/1448531366 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2f4004490 con 0x7fb300050900 2024-09-19T06:44:58.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.258+0000 7fb30ead0640 1 -- 172.21.15.86:0/1448531366 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb300034b50 con 0x7fb300050900 2024-09-19T06:44:58.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.258+0000 7fb30ead0640 1 -- 172.21.15.86:0/1448531366 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb300049dd0 con 0x7fb300050900 2024-09-19T06:44:58.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.259+0000 7fb3057fa640 1 -- 172.21.15.86:0/1448531366 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4037070 con 0x7fb300050900 2024-09-19T06:44:58.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.261+0000 7fb30ead0640 1 -- 172.21.15.86:0/1448531366 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb30004b410 con 0x7fb300050900 2024-09-19T06:44:58.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.270+0000 7fb3057fa640 1 -- 172.21.15.86:0/1448531366 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb2f4003a20 con 0x7fb300050900 2024-09-19T06:44:58.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.271+0000 7fb3057fa640 1 --2- 172.21.15.86:0/1448531366 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb2ec06c2b0 0x7fb2ec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:58.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.272+0000 7fb30c86c640 1 --2- 172.21.15.86:0/1448531366 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb2ec06c2b0 0x7fb2ec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:58.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.272+0000 7fb3057fa640 1 -- 172.21.15.86:0/1448531366 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7165+0+0 (secure 0 0 0) 0x7fb2f40ac560 con 0x7fb300050900 2024-09-19T06:44:58.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.272+0000 7fb3057fa640 1 -- 172.21.15.86:0/1448531366 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb2f4041020 con 0x7fb300050900 2024-09-19T06:44:58.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.272+0000 7fb30c86c640 1 --2- 172.21.15.86:0/1448531366 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb2ec06c2b0 0x7fb2ec06e770 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc007fd0 tx=0x7fb2fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:58.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.640+0000 7fb30ead0640 1 -- 172.21.15.86:0/1448531366 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb300045700 con 0x7fb300050900 2024-09-19T06:44:58.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.645+0000 7fb3057fa640 1 -- 172.21.15.86:0/1448531366 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+6046 (secure 0 0 0) 0x7fb2f407a030 con 0x7fb300050900 2024-09-19T06:44:58.646 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:44:58.646 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":33,"btime":"2024-09-19T06:44:57:575760+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:57.575752+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"e","rank":0,"incarnation":30,"state":"up:active","state_seq":12,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":1}]} 2024-09-19T06:44:58.647 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 33 2024-09-19T06:44:58.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.648+0000 7fb30ead0640 1 -- 172.21.15.86:0/1448531366 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb2ec06c2b0 msgr2=0x7fb2ec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:58.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.648+0000 7fb30ead0640 1 --2- 172.21.15.86:0/1448531366 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb2ec06c2b0 0x7fb2ec06e770 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc007fd0 tx=0x7fb2fc009040 comp rx=0 tx=0).stop 2024-09-19T06:44:58.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.648+0000 7fb30ead0640 1 -- 172.21.15.86:0/1448531366 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb300050900 msgr2=0x7fb3000d3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:58.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.648+0000 7fb30ead0640 1 --2- 172.21.15.86:0/1448531366 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb300050900 0x7fb3000d3180 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb300036010 tx=0x7fb2f40046c0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.648+0000 7fb30ead0640 1 -- 172.21.15.86:0/1448531366 shutdown_connections 2024-09-19T06:44:58.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.648+0000 7fb30ead0640 1 --2- 172.21.15.86:0/1448531366 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb2ec06c2b0 0x7fb2ec06e770 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.648+0000 7fb30ead0640 1 --2- 172.21.15.86:0/1448531366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3000d65a0 0x7fb3000d36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.648+0000 7fb30ead0640 1 --2- 172.21.15.86:0/1448531366 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb300050900 0x7fb3000d3180 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.648+0000 7fb30ead0640 1 --2- 172.21.15.86:0/1448531366 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb30004b960 0x7fb3000dbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.648+0000 7fb30ead0640 1 -- 172.21.15.86:0/1448531366 >> 172.21.15.86:0/1448531366 conn(0x7fb30004fc50 msgr2=0x7fb3000da020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:58.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.649+0000 7fb30ead0640 1 -- 172.21.15.86:0/1448531366 shutdown_connections 2024-09-19T06:44:58.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:44:58.649+0000 7fb30ead0640 1 -- 172.21.15.86:0/1448531366 wait complete. 2024-09-19T06:44:58.664 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e has gained rank=0, replacing gid=4718 2024-09-19T06:44:58.665 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 8 secs before reviving mds.d 2024-09-19T06:45:04.725 INFO:tasks.ceph.mds.e.smithi086.stderr:2024-09-19T06:45:04.723+0000 7fe306023640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T06:45:06.665 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.d 2024-09-19T06:45:06.666 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T06:45:06.666 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T06:45:06.669 INFO:tasks.ceph.mds.d:Started 2024-09-19T06:45:06.669 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:45:06.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.872+0000 7f94a2e5e640 1 Processor -- start 2024-09-19T06:45:06.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.872+0000 7f94a2e5e640 1 -- start start 2024-09-19T06:45:06.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.874+0000 7f94a2e5e640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f949c151270 0x7f949c15af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.874+0000 7f94a2e5e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f949c072260 0x7f949c0726f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.874+0000 7f94a2e5e640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f949c072c30 con 0x7f949c0c32b0 2024-09-19T06:45:06.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.874+0000 7f94a2e5e640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f949c0718e0 con 0x7f949c151270 2024-09-19T06:45:06.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.874+0000 7f94a2e5e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f949c0c8bc0 con 0x7f949c072260 2024-09-19T06:45:06.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.874+0000 7f94a0bfa640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f949c151270 0x7f949c15af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.874+0000 7f94a0bfa640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f949c151270 0x7f949c15af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38372/0 (socket says 172.21.15.86:38372) 2024-09-19T06:45:06.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.874+0000 7f94a0bfa640 1 -- 172.21.15.86:0/1610399363 learned_addr learned my addr 172.21.15.86:0/1610399363 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:45:06.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.875+0000 7f94a13fb640 1 --2- 172.21.15.86:0/1610399363 >> v2:172.21.15.169:3300/0 conn(0x7f949c072260 0x7f949c0726f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.875+0000 7f94a13fb640 1 -- 172.21.15.86:0/1610399363 >> v2:172.21.15.86:3300/0 conn(0x7f949c151270 msgr2=0x7f949c15af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:06.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.875+0000 7f94a13fb640 1 --2- 172.21.15.86:0/1610399363 >> v2:172.21.15.86:3300/0 conn(0x7f949c151270 0x7f949c15af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.875+0000 7f94a13fb640 1 -- 172.21.15.86:0/1610399363 >> v1:172.21.15.86:6789/0 conn(0x7f949c0c32b0 legacy=0x7f949c0c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:06.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.875+0000 7f94a13fb640 1 -- 172.21.15.86:0/1610399363 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f949c0c8ea0 con 0x7f949c072260 2024-09-19T06:45:06.878 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.877+0000 7f94a13fb640 1 --2- 172.21.15.86:0/1610399363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f949c072260 0x7f949c0726f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f949c0c6e20 tx=0x7f949402c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cad0700b49ba37c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:06.878 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.877+0000 7f949b7fe640 1 -- 172.21.15.86:0/1610399363 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9494033790 con 0x7f949c072260 2024-09-19T06:45:06.878 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.877+0000 7f949b7fe640 1 -- 172.21.15.86:0/1610399363 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9494039070 con 0x7f949c072260 2024-09-19T06:45:06.878 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.877+0000 7f949b7fe640 1 -- 172.21.15.86:0/1610399363 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9494033b50 con 0x7f949c072260 2024-09-19T06:45:06.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.878+0000 7f94a2e5e640 1 -- 172.21.15.86:0/1610399363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f949c072260 msgr2=0x7f949c0726f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:06.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.878+0000 7f94a2e5e640 1 --2- 172.21.15.86:0/1610399363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f949c072260 0x7f949c0726f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f949c0c6e20 tx=0x7f949402c920 comp rx=0 tx=0).stop 2024-09-19T06:45:06.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.878+0000 7f94a2e5e640 1 -- 172.21.15.86:0/1610399363 shutdown_connections 2024-09-19T06:45:06.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.878+0000 7f94a2e5e640 1 --2- 172.21.15.86:0/1610399363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f949c072260 0x7f949c0726f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.878+0000 7f94a2e5e640 1 --2- 172.21.15.86:0/1610399363 >> v2:172.21.15.86:3300/0 conn(0x7f949c151270 0x7f949c15af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.878+0000 7f94a2e5e640 1 -- 172.21.15.86:0/1610399363 >> 172.21.15.86:0/1610399363 conn(0x7f949c0c9280 msgr2=0x7f949c0c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:06.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.878+0000 7f94a2e5e640 1 -- 172.21.15.86:0/1610399363 shutdown_connections 2024-09-19T06:45:06.881 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.879+0000 7f94a2e5e640 1 -- 172.21.15.86:0/1610399363 wait complete. 2024-09-19T06:45:06.881 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.880+0000 7f94a2e5e640 1 Processor -- start 2024-09-19T06:45:06.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.880+0000 7f94a2e5e640 1 -- start start 2024-09-19T06:45:06.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.882+0000 7f94a2e5e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f949c072260 0x7f949c14d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.882+0000 7f94a2e5e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f949c0c32b0 0x7f949c1f5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.882+0000 7f94a2e5e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f949c151270 0x7f949c14c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.882+0000 7f94a2e5e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f949c0c3890 con 0x7f949c0c32b0 2024-09-19T06:45:06.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.882+0000 7f94a2e5e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f949c071d40 con 0x7f949c072260 2024-09-19T06:45:06.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.882+0000 7f94a2e5e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f949c151650 con 0x7f949c151270 2024-09-19T06:45:06.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.882+0000 7f949bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f949c0c32b0 0x7f949c1f5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.882+0000 7f949bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f949c0c32b0 0x7f949c1f5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38376/0 (socket says 172.21.15.86:38376) 2024-09-19T06:45:06.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.882+0000 7f949bfff640 1 -- 172.21.15.86:0/3692430811 learned_addr learned my addr 172.21.15.86:0/3692430811 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:45:06.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.883+0000 7f949bfff640 1 -- 172.21.15.86:0/3692430811 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f949c151270 msgr2=0x7f949c14c910 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:45:06.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.883+0000 7f949bfff640 1 --2- 172.21.15.86:0/3692430811 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f949c151270 0x7f949c14c910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.883+0000 7f949bfff640 1 -- 172.21.15.86:0/3692430811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f949c072260 msgr2=0x7f949c14d2f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:45:06.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.883+0000 7f949bfff640 1 --2- 172.21.15.86:0/3692430811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f949c072260 0x7f949c14d2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.883+0000 7f949bfff640 1 -- 172.21.15.86:0/3692430811 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f949c1f4f70 con 0x7f949c0c32b0 2024-09-19T06:45:06.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.883+0000 7f949bfff640 1 --2- 172.21.15.86:0/3692430811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f949c0c32b0 0x7f949c1f5a30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f948800c3c0 tx=0x7f948800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:06.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.884+0000 7f94997fa640 1 -- 172.21.15.86:0/3692430811 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94880052d0 con 0x7f949c0c32b0 2024-09-19T06:45:06.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.884+0000 7f94997fa640 1 -- 172.21.15.86:0/3692430811 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9488005470 con 0x7f949c0c32b0 2024-09-19T06:45:06.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.884+0000 7f94997fa640 1 -- 172.21.15.86:0/3692430811 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9488007260 con 0x7f949c0c32b0 2024-09-19T06:45:06.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.889+0000 7f94a2e5e640 1 -- 172.21.15.86:0/3692430811 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f949c149d70 con 0x7f949c0c32b0 2024-09-19T06:45:06.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.889+0000 7f94a2e5e640 1 -- 172.21.15.86:0/3692430811 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f949c14a330 con 0x7f949c0c32b0 2024-09-19T06:45:06.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.892+0000 7f94a2e5e640 1 -- 172.21.15.86:0/3692430811 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f949c0cbcb0 con 0x7f949c0c32b0 2024-09-19T06:45:06.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.892+0000 7f94997fa640 1 -- 172.21.15.86:0/3692430811 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9488007400 con 0x7f949c0c32b0 2024-09-19T06:45:06.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.893+0000 7f94997fa640 1 --2- 172.21.15.86:0/3692430811 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f948006c330 0x7f948006e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.893+0000 7f94997fa640 1 -- 172.21.15.86:0/3692430811 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7165+0+0 (secure 0 0 0) 0x7f948808af30 con 0x7f949c0c32b0 2024-09-19T06:45:06.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.893+0000 7f94a0bfa640 1 --2- 172.21.15.86:0/3692430811 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f948006c330 0x7f948006e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.894+0000 7f94a0bfa640 1 --2- 172.21.15.86:0/3692430811 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f948006c330 0x7f948006e7f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9490009fd0 tx=0x7f949000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:06.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:06.901+0000 7f94997fa640 1 -- 172.21.15.86:0/3692430811 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f949c0cbcb0 con 0x7f949c0c32b0 2024-09-19T06:45:07.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:07.329+0000 7f94a2e5e640 1 -- 172.21.15.86:0/3692430811 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f949c06c5c0 con 0x7f949c0c32b0 2024-09-19T06:45:07.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:07.330+0000 7f94997fa640 1 -- 172.21.15.86:0/3692430811 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+6046 (secure 0 0 0) 0x7f9488059040 con 0x7f949c0c32b0 2024-09-19T06:45:07.333 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:45:07.333 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":33,"btime":"2024-09-19T06:44:57:575760+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:57.575752+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"e","rank":0,"incarnation":30,"state":"up:active","state_seq":12,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":1}]} 2024-09-19T06:45:07.333 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 33 2024-09-19T06:45:07.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:07.338+0000 7f94a2e5e640 1 -- 172.21.15.86:0/3692430811 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f948006c330 msgr2=0x7f948006e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:07.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:07.338+0000 7f94a2e5e640 1 --2- 172.21.15.86:0/3692430811 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f948006c330 0x7f948006e7f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9490009fd0 tx=0x7f949000b040 comp rx=0 tx=0).stop 2024-09-19T06:45:07.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:07.338+0000 7f94a2e5e640 1 -- 172.21.15.86:0/3692430811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f949c0c32b0 msgr2=0x7f949c1f5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:07.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:07.338+0000 7f94a2e5e640 1 --2- 172.21.15.86:0/3692430811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f949c0c32b0 0x7f949c1f5a30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f948800c3c0 tx=0x7f948800c880 comp rx=0 tx=0).stop 2024-09-19T06:45:07.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:07.339+0000 7f94a2e5e640 1 -- 172.21.15.86:0/3692430811 shutdown_connections 2024-09-19T06:45:07.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:07.339+0000 7f94a2e5e640 1 --2- 172.21.15.86:0/3692430811 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f948006c330 0x7f948006e7f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:07.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:07.339+0000 7f94a2e5e640 1 --2- 172.21.15.86:0/3692430811 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f949c151270 0x7f949c14c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:07.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:07.339+0000 7f94a2e5e640 1 --2- 172.21.15.86:0/3692430811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f949c0c32b0 0x7f949c1f5a30 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:07.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:07.339+0000 7f94a2e5e640 1 --2- 172.21.15.86:0/3692430811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f949c072260 0x7f949c14d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:07.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:07.339+0000 7f94a2e5e640 1 -- 172.21.15.86:0/3692430811 >> 172.21.15.86:0/3692430811 conn(0x7f949c0c9280 msgr2=0x7f949c0c7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:07.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:07.339+0000 7f94a2e5e640 1 -- 172.21.15.86:0/3692430811 shutdown_connections 2024-09-19T06:45:07.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:07.339+0000 7f94a2e5e640 1 -- 172.21.15.86:0/3692430811 wait complete. 2024-09-19T06:45:07.359 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is in active, standby or standby-replay 2024-09-19T06:45:09.360 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:45:09.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.541+0000 7f2551fd6640 1 Processor -- start 2024-09-19T06:45:09.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.541+0000 7f2551fd6640 1 -- start start 2024-09-19T06:45:09.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.542+0000 7f2551fd6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f254c0d1120 0x7f254c0cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:09.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.543+0000 7f2551fd6640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f254c0b6d70 con 0x7f254c0b43e0 2024-09-19T06:45:09.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.543+0000 7f2551fd6640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f254c0cbda0 con 0x7f254c0d0d40 2024-09-19T06:45:09.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.543+0000 7f2551fd6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f254c0cc080 con 0x7f254c0d1120 2024-09-19T06:45:09.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.543+0000 7f254affd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f254c0d1120 0x7f254c0cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:09.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.543+0000 7f254affd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f254c0d1120 0x7f254c0cdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:48320/0 (socket says 172.21.15.86:48320) 2024-09-19T06:45:09.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.543+0000 7f254affd640 1 -- 172.21.15.86:0/1217046202 learned_addr learned my addr 172.21.15.86:0/1217046202 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:45:09.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.545+0000 7f254affd640 1 -- 172.21.15.86:0/1217046202 >> v1:172.21.15.169:6789/0 conn(0x7f254c0d0d40 legacy=0x7f254c0b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:09.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.545+0000 7f254affd640 1 -- 172.21.15.86:0/1217046202 >> v1:172.21.15.86:6789/0 conn(0x7f254c0b43e0 legacy=0x7f254c15fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:09.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.545+0000 7f254affd640 1 -- 172.21.15.86:0/1217046202 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f254c0cc360 con 0x7f254c0d1120 2024-09-19T06:45:09.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.545+0000 7f254a7fc640 1 -- 172.21.15.86:0/1217046202 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3586832374 0 0) 0x7f254c0b6d70 con 0x7f254c0b43e0 2024-09-19T06:45:09.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.546+0000 7f254affd640 1 --2- 172.21.15.86:0/1217046202 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f254c0d1120 0x7f254c0cdf60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f25400098a0 tx=0x7f254002a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be74a2a8bcf65067 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:09.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.546+0000 7f254a7fc640 1 -- 172.21.15.86:0/1217046202 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2540037070 con 0x7f254c0d1120 2024-09-19T06:45:09.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.547+0000 7f254a7fc640 1 -- 172.21.15.86:0/1217046202 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2540032440 con 0x7f254c0d1120 2024-09-19T06:45:09.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.547+0000 7f254a7fc640 1 -- 172.21.15.86:0/1217046202 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2540032810 con 0x7f254c0d1120 2024-09-19T06:45:09.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.548+0000 7f2551fd6640 1 -- 172.21.15.86:0/1217046202 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f254c0d1120 msgr2=0x7f254c0cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:09.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.548+0000 7f2551fd6640 1 --2- 172.21.15.86:0/1217046202 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f254c0d1120 0x7f254c0cdf60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f25400098a0 tx=0x7f254002a290 comp rx=0 tx=0).stop 2024-09-19T06:45:09.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.548+0000 7f2551fd6640 1 -- 172.21.15.86:0/1217046202 shutdown_connections 2024-09-19T06:45:09.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.548+0000 7f2551fd6640 1 --2- 172.21.15.86:0/1217046202 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f254c0d1120 0x7f254c0cdf60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:09.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.548+0000 7f2551fd6640 1 -- 172.21.15.86:0/1217046202 >> 172.21.15.86:0/1217046202 conn(0x7f254c06d910 msgr2=0x7f254c06dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:09.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.549+0000 7f2551fd6640 1 -- 172.21.15.86:0/1217046202 shutdown_connections 2024-09-19T06:45:09.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.549+0000 7f2551fd6640 1 -- 172.21.15.86:0/1217046202 wait complete. 2024-09-19T06:45:09.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.551+0000 7f2551fd6640 1 Processor -- start 2024-09-19T06:45:09.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.551+0000 7f2551fd6640 1 -- start start 2024-09-19T06:45:09.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.552+0000 7f2551fd6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f254c0b43e0 0x7f254c15ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:09.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.552+0000 7f2551fd6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f254c0d0d40 0x7f254c1610a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:09.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.552+0000 7f2551fd6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f254c0d1120 0x7f254c072350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:09.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.553+0000 7f2551fd6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f254c0ccc00 con 0x7f254c0d1120 2024-09-19T06:45:09.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.553+0000 7f2551fd6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f254c0cc920 con 0x7f254c0d0d40 2024-09-19T06:45:09.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.553+0000 7f254b7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f254c0b43e0 0x7f254c15ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:09.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.553+0000 7f254b7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f254c0b43e0 0x7f254c15ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:48336/0 (socket says 172.21.15.86:48336) 2024-09-19T06:45:09.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.553+0000 7f254b7fe640 1 -- 172.21.15.86:0/546258984 learned_addr learned my addr 172.21.15.86:0/546258984 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:45:09.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.553+0000 7f254affd640 1 --2- 172.21.15.86:0/546258984 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f254c0d0d40 0x7f254c1610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:09.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.553+0000 7f2551fd6640 1 -- 172.21.15.86:0/546258984 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f254c0cb9d0 con 0x7f254c0b43e0 2024-09-19T06:45:09.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.553+0000 7f254bfff640 1 --2- 172.21.15.86:0/546258984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f254c0d1120 0x7f254c072350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:09.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.553+0000 7f254bfff640 1 -- 172.21.15.86:0/546258984 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f254c0b43e0 msgr2=0x7f254c15ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:09.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.553+0000 7f254bfff640 1 --2- 172.21.15.86:0/546258984 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f254c0b43e0 0x7f254c15ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:09.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.553+0000 7f254bfff640 1 -- 172.21.15.86:0/546258984 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f254c0d0d40 msgr2=0x7f254c1610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:09.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.553+0000 7f254bfff640 1 --2- 172.21.15.86:0/546258984 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f254c0d0d40 0x7f254c1610a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:09.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.553+0000 7f254bfff640 1 -- 172.21.15.86:0/546258984 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f254c200f20 con 0x7f254c0d1120 2024-09-19T06:45:09.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.554+0000 7f254bfff640 1 --2- 172.21.15.86:0/546258984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f254c0d1120 0x7f254c072350 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2544002230 tx=0x7f254400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:09.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.555+0000 7f2533fff640 1 -- 172.21.15.86:0/546258984 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2544017070 con 0x7f254c0d1120 2024-09-19T06:45:09.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.555+0000 7f2533fff640 1 -- 172.21.15.86:0/546258984 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2544003da0 con 0x7f254c0d1120 2024-09-19T06:45:09.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.556+0000 7f2533fff640 1 -- 172.21.15.86:0/546258984 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25440052b0 con 0x7f254c0d1120 2024-09-19T06:45:09.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.557+0000 7f2551fd6640 1 -- 172.21.15.86:0/546258984 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f254c201ca0 con 0x7f254c0d1120 2024-09-19T06:45:09.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.557+0000 7f2551fd6640 1 -- 172.21.15.86:0/546258984 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f254c2011c0 con 0x7f254c0d1120 2024-09-19T06:45:09.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.561+0000 7f2533fff640 1 -- 172.21.15.86:0/546258984 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f254401a070 con 0x7f254c0d1120 2024-09-19T06:45:09.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.562+0000 7f2533fff640 1 --2- 172.21.15.86:0/546258984 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f253806c380 0x7f253806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:09.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.562+0000 7f2533fff640 1 -- 172.21.15.86:0/546258984 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7165+0+0 (secure 0 0 0) 0x7f254408aff0 con 0x7f254c0d1120 2024-09-19T06:45:09.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.562+0000 7f2551fd6640 1 -- 172.21.15.86:0/546258984 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f254c0b6d00 con 0x7f254c0d1120 2024-09-19T06:45:09.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.563+0000 7f254b7fe640 1 --2- 172.21.15.86:0/546258984 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f253806c380 0x7f253806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:09.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.564+0000 7f254b7fe640 1 --2- 172.21.15.86:0/546258984 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f253806c380 0x7f253806e840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f253c0019e0 tx=0x7f253c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:09.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:09.572+0000 7f2533fff640 1 -- 172.21.15.86:0/546258984 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f254c0b6d00 con 0x7f254c0d1120 2024-09-19T06:45:10.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:10.012+0000 7f2551fd6640 1 -- 172.21.15.86:0/546258984 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f254c0c9220 con 0x7f254c0d1120 2024-09-19T06:45:10.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:10.014+0000 7f2533fff640 1 -- 172.21.15.86:0/546258984 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+6046 (secure 0 0 0) 0x7f254c0c9220 con 0x7f254c0d1120 2024-09-19T06:45:10.015 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:45:10.015 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":33,"btime":"2024-09-19T06:44:57:575760+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:57.575752+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"e","rank":0,"incarnation":30,"state":"up:active","state_seq":12,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":1}]} 2024-09-19T06:45:10.016 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 33 2024-09-19T06:45:10.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:10.017+0000 7f2531ffb640 1 -- 172.21.15.86:0/546258984 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f253806c380 msgr2=0x7f253806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:10.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:10.017+0000 7f2531ffb640 1 --2- 172.21.15.86:0/546258984 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f253806c380 0x7f253806e840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f253c0019e0 tx=0x7f253c009040 comp rx=0 tx=0).stop 2024-09-19T06:45:10.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:10.017+0000 7f2531ffb640 1 -- 172.21.15.86:0/546258984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f254c0d1120 msgr2=0x7f254c072350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:10.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:10.017+0000 7f2531ffb640 1 --2- 172.21.15.86:0/546258984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f254c0d1120 0x7f254c072350 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2544002230 tx=0x7f254400cbe0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:10.022+0000 7f2531ffb640 1 -- 172.21.15.86:0/546258984 shutdown_connections 2024-09-19T06:45:10.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:10.022+0000 7f2531ffb640 1 --2- 172.21.15.86:0/546258984 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f253806c380 0x7f253806e840 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:10.022+0000 7f2531ffb640 1 --2- 172.21.15.86:0/546258984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f254c0d1120 0x7f254c072350 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:10.022+0000 7f2531ffb640 1 --2- 172.21.15.86:0/546258984 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f254c0d0d40 0x7f254c1610a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:10.022+0000 7f2531ffb640 1 --2- 172.21.15.86:0/546258984 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f254c0b43e0 0x7f254c15ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:10.022+0000 7f2531ffb640 1 -- 172.21.15.86:0/546258984 >> 172.21.15.86:0/546258984 conn(0x7f254c06d910 msgr2=0x7f254c0b3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:10.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:10.023+0000 7f2531ffb640 1 -- 172.21.15.86:0/546258984 shutdown_connections 2024-09-19T06:45:10.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:10.023+0000 7f2531ffb640 1 -- 172.21.15.86:0/546258984 wait complete. 2024-09-19T06:45:10.042 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is in active, standby or standby-replay 2024-09-19T06:45:11.604 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2024-09-19T06:45:12.044 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:45:12.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.246+0000 7f2a9c3c4640 1 Processor -- start 2024-09-19T06:45:12.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.246+0000 7f2a9c3c4640 1 -- start start 2024-09-19T06:45:12.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.248+0000 7f2a9c3c4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a9415e6f0 0x7f2a940d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:12.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.248+0000 7f2a9c3c4640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2a940d0ff0 0x7f2a940c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:12.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.248+0000 7f2a9c3c4640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a9415ec50 con 0x7f2a941553a0 2024-09-19T06:45:12.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.248+0000 7f2a9c3c4640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f2a9415ef30 con 0x7f2a940d0ff0 2024-09-19T06:45:12.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.248+0000 7f2a9c3c4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2a9415f210 con 0x7f2a9415e6f0 2024-09-19T06:45:12.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.249+0000 7f2a9995f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a9415e6f0 0x7f2a940d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:12.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.249+0000 7f2a9995f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a9415e6f0 0x7f2a940d0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:41408/0 (socket says 172.21.15.86:41408) 2024-09-19T06:45:12.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.249+0000 7f2a9995f640 1 -- 172.21.15.86:0/1987287085 learned_addr learned my addr 172.21.15.86:0/1987287085 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:45:12.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.252+0000 7f2a9915e640 1 -- 172.21.15.86:0/1987287085 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1224074267 0 0) 0x7f2a9415ec50 con 0x7f2a941553a0 2024-09-19T06:45:12.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.252+0000 7f2a9a961640 1 --2- 172.21.15.86:0/1987287085 >> v2:172.21.15.86:3300/0 conn(0x7f2a940d0ff0 0x7f2a940c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:12.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.252+0000 7f2a9915e640 1 -- 172.21.15.86:0/1987287085 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a80003520 con 0x7f2a941553a0 2024-09-19T06:45:12.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.252+0000 7f2a9a961640 1 -- 172.21.15.86:0/1987287085 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a9415e6f0 msgr2=0x7f2a940d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:12.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.252+0000 7f2a9a961640 1 --2- 172.21.15.86:0/1987287085 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a9415e6f0 0x7f2a940d0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.252+0000 7f2a9a961640 1 -- 172.21.15.86:0/1987287085 >> v1:172.21.15.169:6789/0 conn(0x7f2a941553a0 legacy=0x7f2a940cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:12.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.252+0000 7f2a9a961640 1 -- 172.21.15.86:0/1987287085 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a9415f4f0 con 0x7f2a940d0ff0 2024-09-19T06:45:12.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.253+0000 7f2a9a961640 1 --2- 172.21.15.86:0/1987287085 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a940d0ff0 0x7f2a940c6f40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2a84009a00 tx=0x7f2a84032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13faa9f50b6dd5f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:12.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.254+0000 7f2a9915e640 1 -- 172.21.15.86:0/1987287085 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a84040070 con 0x7f2a940d0ff0 2024-09-19T06:45:12.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.254+0000 7f2a9915e640 1 -- 172.21.15.86:0/1987287085 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a84033760 con 0x7f2a940d0ff0 2024-09-19T06:45:12.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.254+0000 7f2a9915e640 1 -- 172.21.15.86:0/1987287085 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a84033b10 con 0x7f2a940d0ff0 2024-09-19T06:45:12.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.255+0000 7f2a9c3c4640 1 -- 172.21.15.86:0/1987287085 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a940d0ff0 msgr2=0x7f2a940c6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:12.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.255+0000 7f2a9c3c4640 1 --2- 172.21.15.86:0/1987287085 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a940d0ff0 0x7f2a940c6f40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2a84009a00 tx=0x7f2a84032c60 comp rx=0 tx=0).stop 2024-09-19T06:45:12.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.258+0000 7f2a9c3c4640 1 -- 172.21.15.86:0/1987287085 shutdown_connections 2024-09-19T06:45:12.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.258+0000 7f2a9c3c4640 1 --2- 172.21.15.86:0/1987287085 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a940d0ff0 0x7f2a940c6f40 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.258+0000 7f2a9c3c4640 1 --2- 172.21.15.86:0/1987287085 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a9415e6f0 0x7f2a940d0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.258+0000 7f2a9c3c4640 1 -- 172.21.15.86:0/1987287085 >> 172.21.15.86:0/1987287085 conn(0x7f2a94067890 msgr2=0x7f2a94067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:12.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.261+0000 7f2a9c3c4640 1 -- 172.21.15.86:0/1987287085 shutdown_connections 2024-09-19T06:45:12.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.262+0000 7f2a9c3c4640 1 -- 172.21.15.86:0/1987287085 wait complete. 2024-09-19T06:45:12.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.263+0000 7f2a9c3c4640 1 Processor -- start 2024-09-19T06:45:12.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.263+0000 7f2a9c3c4640 1 -- start start 2024-09-19T06:45:12.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.264+0000 7f2a9c3c4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a940d0ff0 0x7f2a9415cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:12.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.264+0000 7f2a9c3c4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a941553a0 0x7f2a9415dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:12.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.264+0000 7f2a9c3c4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a9415e6f0 0x7f2a941f0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:12.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.265+0000 7f2a9c3c4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2a940cc2d0 con 0x7f2a940d0ff0 2024-09-19T06:45:12.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.265+0000 7f2a9c3c4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2a940c66d0 con 0x7f2a941553a0 2024-09-19T06:45:12.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.265+0000 7f2a9c3c4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2a94155780 con 0x7f2a9415e6f0 2024-09-19T06:45:12.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.265+0000 7f2a9a160640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a940d0ff0 0x7f2a9415cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:12.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.265+0000 7f2a9a160640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a940d0ff0 0x7f2a9415cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33276/0 (socket says 172.21.15.86:33276) 2024-09-19T06:45:12.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.265+0000 7f2a9a160640 1 -- 172.21.15.86:0/1763886274 learned_addr learned my addr 172.21.15.86:0/1763886274 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:45:12.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.265+0000 7f2a9995f640 1 --2- 172.21.15.86:0/1763886274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a941553a0 0x7f2a9415dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:12.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.265+0000 7f2a9a160640 1 -- 172.21.15.86:0/1763886274 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a9415e6f0 msgr2=0x7f2a941f0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:12.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.265+0000 7f2a9a160640 1 --2- 172.21.15.86:0/1763886274 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a9415e6f0 0x7f2a941f0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.265+0000 7f2a9a160640 1 -- 172.21.15.86:0/1763886274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a941553a0 msgr2=0x7f2a9415dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:12.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.265+0000 7f2a9a160640 1 --2- 172.21.15.86:0/1763886274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a941553a0 0x7f2a9415dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.265+0000 7f2a9a160640 1 -- 172.21.15.86:0/1763886274 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a941edbe0 con 0x7f2a940d0ff0 2024-09-19T06:45:12.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.266+0000 7f2a9a160640 1 --2- 172.21.15.86:0/1763886274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a940d0ff0 0x7f2a9415cec0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2a9000c760 tx=0x7f2a9000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:12.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.266+0000 7f2a8affd640 1 -- 172.21.15.86:0/1763886274 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90017070 con 0x7f2a940d0ff0 2024-09-19T06:45:12.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.267+0000 7f2a8affd640 1 -- 172.21.15.86:0/1763886274 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a90005270 con 0x7f2a940d0ff0 2024-09-19T06:45:12.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.267+0000 7f2a8affd640 1 -- 172.21.15.86:0/1763886274 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9000a840 con 0x7f2a940d0ff0 2024-09-19T06:45:12.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.267+0000 7f2a9c3c4640 1 -- 172.21.15.86:0/1763886274 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a940b5000 con 0x7f2a940d0ff0 2024-09-19T06:45:12.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.267+0000 7f2a9c3c4640 1 -- 172.21.15.86:0/1763886274 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a940b55c0 con 0x7f2a940d0ff0 2024-09-19T06:45:12.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.271+0000 7f2a8affd640 1 -- 172.21.15.86:0/1763886274 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2a9001a070 con 0x7f2a940d0ff0 2024-09-19T06:45:12.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.271+0000 7f2a8affd640 1 --2- 172.21.15.86:0/1763886274 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2a7806c380 0x7f2a7806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:12.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.272+0000 7f2a8affd640 1 -- 172.21.15.86:0/1763886274 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7165+0+0 (secure 0 0 0) 0x7f2a9008ad50 con 0x7f2a940d0ff0 2024-09-19T06:45:12.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.272+0000 7f2a9995f640 1 --2- 172.21.15.86:0/1763886274 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2a7806c380 0x7f2a7806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:12.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.273+0000 7f2a9995f640 1 --2- 172.21.15.86:0/1763886274 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2a7806c380 0x7f2a7806e840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2a941efc40 tx=0x7f2a8c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:12.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.273+0000 7f2a88ff9640 1 -- 172.21.15.86:0/1763886274 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a940d0ab0 con 0x7f2a940d0ff0 2024-09-19T06:45:12.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.283+0000 7f2a8affd640 1 -- 172.21.15.86:0/1763886274 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2a900588a0 con 0x7f2a940d0ff0 2024-09-19T06:45:12.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.701+0000 7f2a88ff9640 1 -- 172.21.15.86:0/1763886274 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a94152f90 con 0x7f2a940d0ff0 2024-09-19T06:45:12.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.703+0000 7f2a8affd640 1 -- 172.21.15.86:0/1763886274 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+6874 (secure 0 0 0) 0x7f2a9005cba0 con 0x7f2a940d0ff0 2024-09-19T06:45:12.704 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:45:12.704 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":34,"btime":"2024-09-19T06:45:11:648449+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":5092,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/1148622307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1148622307},{"type":"v1","addr":"172.21.15.169:6837","nonce":1148622307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:57.575752+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"e","rank":0,"incarnation":30,"state":"up:active","state_seq":12,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":1}]} 2024-09-19T06:45:12.705 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 34 2024-09-19T06:45:12.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.708+0000 7f2a88ff9640 1 -- 172.21.15.86:0/1763886274 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2a7806c380 msgr2=0x7f2a7806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:12.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.708+0000 7f2a88ff9640 1 --2- 172.21.15.86:0/1763886274 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2a7806c380 0x7f2a7806e840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2a941efc40 tx=0x7f2a8c00b040 comp rx=0 tx=0).stop 2024-09-19T06:45:12.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.708+0000 7f2a88ff9640 1 -- 172.21.15.86:0/1763886274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a940d0ff0 msgr2=0x7f2a9415cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:12.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.708+0000 7f2a88ff9640 1 --2- 172.21.15.86:0/1763886274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a940d0ff0 0x7f2a9415cec0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2a9000c760 tx=0x7f2a9000cc20 comp rx=0 tx=0).stop 2024-09-19T06:45:12.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.709+0000 7f2a88ff9640 1 -- 172.21.15.86:0/1763886274 shutdown_connections 2024-09-19T06:45:12.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.709+0000 7f2a88ff9640 1 --2- 172.21.15.86:0/1763886274 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2a7806c380 0x7f2a7806e840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.709+0000 7f2a88ff9640 1 --2- 172.21.15.86:0/1763886274 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a9415e6f0 0x7f2a941f0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.709+0000 7f2a88ff9640 1 --2- 172.21.15.86:0/1763886274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a941553a0 0x7f2a9415dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.709+0000 7f2a88ff9640 1 --2- 172.21.15.86:0/1763886274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a940d0ff0 0x7f2a9415cec0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.709+0000 7f2a88ff9640 1 -- 172.21.15.86:0/1763886274 >> 172.21.15.86:0/1763886274 conn(0x7f2a94067890 msgr2=0x7f2a940c5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:12.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.709+0000 7f2a88ff9640 1 -- 172.21.15.86:0/1763886274 shutdown_connections 2024-09-19T06:45:12.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:12.709+0000 7f2a88ff9640 1 -- 172.21.15.86:0/1763886274 wait complete. 2024-09-19T06:45:12.739 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d reported in up:standby state 2024-09-19T06:45:12.740 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 34 secs before thrashing 2024-09-19T06:45:41.972 INFO:tasks.workunit.client.0.smithi086.stdout:Syncing()...26 sec 2024-09-19T06:45:41.972 INFO:tasks.workunit.client.0.smithi086.stdout:FFSB benchmark finished at: Thu Sep 19 06:45:41 2024 2024-09-19T06:45:41.973 INFO:tasks.workunit.client.0.smithi086.stdout: 2024-09-19T06:45:41.973 INFO:tasks.workunit.client.0.smithi086.stdout:Results: 2024-09-19T06:45:41.973 INFO:tasks.workunit.client.0.smithi086.stdout:Benchmark took 342.43 sec 2024-09-19T06:45:41.973 INFO:tasks.workunit.client.0.smithi086.stdout: 2024-09-19T06:45:41.973 INFO:tasks.workunit.client.0.smithi086.stdout:Total Results 2024-09-19T06:45:41.973 INFO:tasks.workunit.client.0.smithi086.stdout:=============== 2024-09-19T06:45:41.973 INFO:tasks.workunit.client.0.smithi086.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-09-19T06:45:41.973 INFO:tasks.workunit.client.0.smithi086.stdout: ======= ============ ========= ======= =========== ========== 2024-09-19T06:45:41.973 INFO:tasks.workunit.client.0.smithi086.stdout: write : 5107200 14914.55 100.000% 100.000% 58.3MB/sec 2024-09-19T06:45:41.973 INFO:tasks.workunit.client.0.smithi086.stdout:- 2024-09-19T06:45:41.973 INFO:tasks.workunit.client.0.smithi086.stdout:14914.55 Transactions per Second 2024-09-19T06:45:41.973 INFO:tasks.workunit.client.0.smithi086.stdout: 2024-09-19T06:45:41.974 INFO:tasks.workunit.client.0.smithi086.stdout:Throughput Results 2024-09-19T06:45:41.974 INFO:tasks.workunit.client.0.smithi086.stdout:=================== 2024-09-19T06:45:41.974 INFO:tasks.workunit.client.0.smithi086.stdout:Write Throughput: 58.3MB/sec 2024-09-19T06:45:41.996 INFO:tasks.workunit.client.0.smithi086.stdout: 2024-09-19T06:45:41.996 INFO:tasks.workunit.client.0.smithi086.stdout:System Call Latency statistics in millisecs 2024-09-19T06:45:41.996 INFO:tasks.workunit.client.0.smithi086.stdout:===== 2024-09-19T06:45:41.996 INFO:tasks.workunit.client.0.smithi086.stdout: Min Avg Max Total Calls 2024-09-19T06:45:41.996 INFO:tasks.workunit.client.0.smithi086.stdout: ======== ======== ======== ============ 2024-09-19T06:45:41.996 INFO:tasks.workunit.client.0.smithi086.stdout:[ open] 0.005000 364.914175 84501.578125 3990 2024-09-19T06:45:41.996 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[0] 5000.000000 - 10000.000000 : 2 2024-09-19T06:45:41.997 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-19T06:45:41.997 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[2] 1000.000000 - 2000.000000 : 24 2024-09-19T06:45:41.997 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[3] 500.000000 - 1000.000000 : 22 2024-09-19T06:45:41.997 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[4] 200.000000 - 500.000000 : 10 2024-09-19T06:45:41.997 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[5] 100.000000 - 200.000000 : 19 2024-09-19T06:45:41.997 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[6] 50.000000 - 100.000000 : 18 2024-09-19T06:45:41.997 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[7] 20.000000 - 50.000000 : 38 2024-09-19T06:45:41.997 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[8] 10.000000 - 20.000000 : 43 2024-09-19T06:45:41.997 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[9] 5.000000 - 10.000000 : 46 2024-09-19T06:45:41.997 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[10] 2.000000 - 5.000000 : 62 2024-09-19T06:45:41.997 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[11] 1.000000 - 2.000000 : 22 2024-09-19T06:45:41.997 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[12] 0.500000 - 1.000000 : 6 2024-09-19T06:45:41.997 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[13] 0.200000 - 0.500000 : 4 2024-09-19T06:45:41.998 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[14] 0.100000 - 0.200000 : 5 2024-09-19T06:45:41.998 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[15] 0.050000 - 0.100000 : 25 2024-09-19T06:45:41.998 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[16] 0.020000 - 0.050000 : 655 2024-09-19T06:45:41.998 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[17] 0.010000 - 0.020000 : 2459 2024-09-19T06:45:41.998 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[18] 0.000000 - 0.010000 : 507 2024-09-19T06:45:41.998 INFO:tasks.workunit.client.0.smithi086.stdout: 2024-09-19T06:45:41.998 INFO:tasks.workunit.client.0.smithi086.stdout:[ write] 0.001000 1.564571 83877.992188 5107200 2024-09-19T06:45:41.998 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[0] 5000.000000 - 10000.000000 : 92 2024-09-19T06:45:41.998 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[1] 2000.000000 - 5000.000000 : 319 2024-09-19T06:45:41.998 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[2] 1000.000000 - 2000.000000 : 183 2024-09-19T06:45:41.998 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[3] 500.000000 - 1000.000000 : 218 2024-09-19T06:45:41.999 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[4] 200.000000 - 500.000000 : 2994 2024-09-19T06:45:41.999 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[5] 100.000000 - 200.000000 : 10601 2024-09-19T06:45:41.999 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[6] 50.000000 - 100.000000 : 6980 2024-09-19T06:45:41.999 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[7] 20.000000 - 50.000000 : 1231 2024-09-19T06:45:41.999 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[8] 10.000000 - 20.000000 : 496 2024-09-19T06:45:41.999 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[9] 5.000000 - 10.000000 : 497 2024-09-19T06:45:41.999 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[10] 2.000000 - 5.000000 : 808 2024-09-19T06:45:41.999 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[11] 1.000000 - 2.000000 : 537 2024-09-19T06:45:41.999 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[12] 0.500000 - 1.000000 : 435 2024-09-19T06:45:42.000 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[13] 0.200000 - 0.500000 : 615 2024-09-19T06:45:42.000 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[14] 0.100000 - 0.200000 : 811 2024-09-19T06:45:42.000 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[15] 0.050000 - 0.100000 : 1527 2024-09-19T06:45:42.000 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[16] 0.020000 - 0.050000 : 8228 2024-09-19T06:45:42.001 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[17] 0.010000 - 0.020000 : 37712 2024-09-19T06:45:42.001 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[18] 0.000000 - 0.010000 : 5032819 2024-09-19T06:45:42.001 INFO:tasks.workunit.client.0.smithi086.stdout: 2024-09-19T06:45:42.001 INFO:tasks.workunit.client.0.smithi086.stdout:[ lseek] 0.000000 0.000611 47.574001 5107200 2024-09-19T06:45:42.001 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-19T06:45:42.001 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-19T06:45:42.001 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-19T06:45:42.001 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-19T06:45:42.002 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-19T06:45:42.002 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-19T06:45:42.002 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-09-19T06:45:42.002 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[7] 20.000000 - 50.000000 : 13 2024-09-19T06:45:42.002 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[8] 10.000000 - 20.000000 : 18 2024-09-19T06:45:42.002 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[9] 5.000000 - 10.000000 : 27 2024-09-19T06:45:42.002 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[10] 2.000000 - 5.000000 : 51 2024-09-19T06:45:42.002 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[11] 1.000000 - 2.000000 : 37 2024-09-19T06:45:42.003 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[12] 0.500000 - 1.000000 : 36 2024-09-19T06:45:42.003 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[13] 0.200000 - 0.500000 : 58 2024-09-19T06:45:42.003 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[14] 0.100000 - 0.200000 : 59 2024-09-19T06:45:42.003 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[15] 0.050000 - 0.100000 : 103 2024-09-19T06:45:42.003 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[16] 0.020000 - 0.050000 : 469 2024-09-19T06:45:42.003 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[17] 0.010000 - 0.020000 : 1269 2024-09-19T06:45:42.003 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[18] 0.000000 - 0.010000 : 5105060 2024-09-19T06:45:42.004 INFO:tasks.workunit.client.0.smithi086.stdout: 2024-09-19T06:45:42.004 INFO:tasks.workunit.client.0.smithi086.stdout:[ close] 0.001000 0.005829 4.801000 3990 2024-09-19T06:45:42.004 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-19T06:45:42.004 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-19T06:45:42.004 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-19T06:45:42.004 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-19T06:45:42.005 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-19T06:45:42.005 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-19T06:45:42.005 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-09-19T06:45:42.005 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-09-19T06:45:42.005 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2024-09-19T06:45:42.005 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[9] 5.000000 - 10.000000 : 0 2024-09-19T06:45:42.005 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[10] 2.000000 - 5.000000 : 1 2024-09-19T06:45:42.005 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[11] 1.000000 - 2.000000 : 0 2024-09-19T06:45:42.005 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[12] 0.500000 - 1.000000 : 0 2024-09-19T06:45:42.006 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[13] 0.200000 - 0.500000 : 0 2024-09-19T06:45:42.006 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[14] 0.100000 - 0.200000 : 0 2024-09-19T06:45:42.006 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[15] 0.050000 - 0.100000 : 1 2024-09-19T06:45:42.006 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[16] 0.020000 - 0.050000 : 3 2024-09-19T06:45:42.006 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[17] 0.010000 - 0.020000 : 25 2024-09-19T06:45:42.007 INFO:tasks.workunit.client.0.smithi086.stdout: msec_range[18] 0.000000 - 0.010000 : 3960 2024-09-19T06:45:42.007 INFO:tasks.workunit.client.0.smithi086.stdout: 2024-09-19T06:45:42.007 INFO:tasks.workunit.client.0.smithi086.stdout: 2024-09-19T06:45:42.007 INFO:tasks.workunit.client.0.smithi086.stdout: 2024-09-19T06:45:42.007 INFO:tasks.workunit.client.0.smithi086.stdout: 2024-09-19T06:45:42.007 INFO:tasks.workunit.client.0.smithi086.stdout:0.7% User Time 2024-09-19T06:45:42.007 INFO:tasks.workunit.client.0.smithi086.stdout:5.8% System Time 2024-09-19T06:45:42.007 INFO:tasks.workunit.client.0.smithi086.stdout:6.5% CPU Utilization 2024-09-19T06:45:42.008 INFO:tasks.workunit.client.0.smithi086.stderr:+ cd .. 2024-09-19T06:45:42.009 INFO:tasks.workunit.client.0.smithi086.stderr:+ rm -r tmp ffsb 2024-09-19T06:45:46.330 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T06:45:46.330 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T06:45:46.360 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-09-19T06:45:46.360 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T06:45:46.741 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:45:46.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.843+0000 7f5d86903640 1 Processor -- start 2024-09-19T06:45:46.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.843+0000 7f5d86903640 1 -- start start 2024-09-19T06:45:46.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.844+0000 7f5d86903640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5d800730e0 0x7f5d800734f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:46.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.844+0000 7f5d86903640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d80153470 con 0x7f5d80153000 2024-09-19T06:45:46.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.844+0000 7f5d86903640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d80158d70 con 0x7f5d80152c20 2024-09-19T06:45:46.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.844+0000 7f5d86903640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f5d80073a30 con 0x7f5d800730e0 2024-09-19T06:45:46.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.844+0000 7f5d84ea0640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5d800730e0 0x7f5d800734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:46.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.844+0000 7f5d84ea0640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5d800730e0 0x7f5d800734f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41574/0 (socket says 172.21.15.86:41574) 2024-09-19T06:45:46.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.844+0000 7f5d84ea0640 1 -- 172.21.15.86:0/3054567704 learned_addr learned my addr 172.21.15.86:0/3054567704 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:45:46.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.845+0000 7f5d84ea0640 1 -- 172.21.15.86:0/3054567704 >> v1:172.21.15.169:6789/0 conn(0x7f5d80152c20 legacy=0x7f5d800c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:46.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.845+0000 7f5d84ea0640 1 -- 172.21.15.86:0/3054567704 >> v1:172.21.15.86:6789/0 conn(0x7f5d80153000 legacy=0x7f5d800c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:46.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.845+0000 7f5d84ea0640 1 -- 172.21.15.86:0/3054567704 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d800c3d20 con 0x7f5d800730e0 2024-09-19T06:45:46.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.845+0000 7f5d84ea0640 1 --2- 172.21.15.86:0/3054567704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d800730e0 0x7f5d800734f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5d78009e50 tx=0x7f5d7802a840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc47425e63935fba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:46.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.845+0000 7f5d7effd640 1 -- 172.21.15.86:0/3054567704 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d78037070 con 0x7f5d800730e0 2024-09-19T06:45:46.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.846+0000 7f5d7effd640 1 -- 172.21.15.86:0/3054567704 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d78032630 con 0x7f5d800730e0 2024-09-19T06:45:46.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.846+0000 7f5d7effd640 1 -- 172.21.15.86:0/3054567704 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7802e050 con 0x7f5d800730e0 2024-09-19T06:45:46.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.846+0000 7f5d86903640 1 -- 172.21.15.86:0/3054567704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d800730e0 msgr2=0x7f5d800734f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:46.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.846+0000 7f5d86903640 1 --2- 172.21.15.86:0/3054567704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d800730e0 0x7f5d800734f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5d78009e50 tx=0x7f5d7802a840 comp rx=0 tx=0).stop 2024-09-19T06:45:46.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.846+0000 7f5d86903640 1 -- 172.21.15.86:0/3054567704 shutdown_connections 2024-09-19T06:45:46.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.846+0000 7f5d86903640 1 --2- 172.21.15.86:0/3054567704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d800730e0 0x7f5d800734f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:46.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.846+0000 7f5d86903640 1 -- 172.21.15.86:0/3054567704 >> 172.21.15.86:0/3054567704 conn(0x7f5d800c9280 msgr2=0x7f5d800c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:46.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.846+0000 7f5d86903640 1 -- 172.21.15.86:0/3054567704 shutdown_connections 2024-09-19T06:45:46.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.846+0000 7f5d86903640 1 -- 172.21.15.86:0/3054567704 wait complete. 2024-09-19T06:45:46.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.847+0000 7f5d86903640 1 Processor -- start 2024-09-19T06:45:46.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.847+0000 7f5d86903640 1 -- start start 2024-09-19T06:45:46.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.848+0000 7f5d86903640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d800730e0 0x7f5d80151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:46.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.848+0000 7f5d86903640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d80152c20 0x7f5d801f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:46.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.848+0000 7f5d86903640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d80153000 0x7f5d801f28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:46.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.848+0000 7f5d86903640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5d800c45c0 con 0x7f5d80153000 2024-09-19T06:45:46.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.848+0000 7f5d86903640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5d800c42e0 con 0x7f5d80152c20 2024-09-19T06:45:46.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.848+0000 7f5d86903640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5d8006d900 con 0x7f5d800730e0 2024-09-19T06:45:46.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.848+0000 7f5d84ea0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d80153000 0x7f5d801f28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:46.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.848+0000 7f5d84ea0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d80153000 0x7f5d801f28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41582/0 (socket says 172.21.15.86:41582) 2024-09-19T06:45:46.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.848+0000 7f5d84ea0640 1 -- 172.21.15.86:0/124076744 learned_addr learned my addr 172.21.15.86:0/124076744 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:45:46.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.848+0000 7f5d7f7fe640 1 --2- 172.21.15.86:0/124076744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d80152c20 0x7f5d801f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:46.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.848+0000 7f5d84ea0640 1 -- 172.21.15.86:0/124076744 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d800730e0 msgr2=0x7f5d80151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:46.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.848+0000 7f5d7ffff640 1 --2- 172.21.15.86:0/124076744 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d800730e0 0x7f5d80151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:46.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.848+0000 7f5d84ea0640 1 --2- 172.21.15.86:0/124076744 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d800730e0 0x7f5d80151b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:46.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.848+0000 7f5d84ea0640 1 -- 172.21.15.86:0/124076744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d80152c20 msgr2=0x7f5d801f23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:46.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.848+0000 7f5d84ea0640 1 --2- 172.21.15.86:0/124076744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d80152c20 0x7f5d801f23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:46.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.848+0000 7f5d84ea0640 1 -- 172.21.15.86:0/124076744 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d80155e80 con 0x7f5d80153000 2024-09-19T06:45:46.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.848+0000 7f5d7f7fe640 1 --2- 172.21.15.86:0/124076744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d80152c20 0x7f5d801f23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:45:46.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.849+0000 7f5d84ea0640 1 --2- 172.21.15.86:0/124076744 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d80153000 0x7f5d801f28e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5d78035040 tx=0x7f5d78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:46.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.849+0000 7f5d7cff9640 1 -- 172.21.15.86:0/124076744 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d78037050 con 0x7f5d80153000 2024-09-19T06:45:46.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.849+0000 7f5d7cff9640 1 -- 172.21.15.86:0/124076744 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d78043070 con 0x7f5d80153000 2024-09-19T06:45:46.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.849+0000 7f5d86903640 1 -- 172.21.15.86:0/124076744 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d80156160 con 0x7f5d80153000 2024-09-19T06:45:46.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.849+0000 7f5d7cff9640 1 -- 172.21.15.86:0/124076744 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d78009510 con 0x7f5d80153000 2024-09-19T06:45:46.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.849+0000 7f5d86903640 1 -- 172.21.15.86:0/124076744 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d80155140 con 0x7f5d80153000 2024-09-19T06:45:46.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.850+0000 7f5d86903640 1 -- 172.21.15.86:0/124076744 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d80154c60 con 0x7f5d80153000 2024-09-19T06:45:46.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.850+0000 7f5d7cff9640 1 -- 172.21.15.86:0/124076744 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5d78007b70 con 0x7f5d80153000 2024-09-19T06:45:46.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.851+0000 7f5d7cff9640 1 --2- 172.21.15.86:0/124076744 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5d6c06c2b0 0x7f5d6c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:46.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.851+0000 7f5d7cff9640 1 -- 172.21.15.86:0/124076744 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7165+0+0 (secure 0 0 0) 0x7f5d780ac520 con 0x7f5d80153000 2024-09-19T06:45:46.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.851+0000 7f5d7ffff640 1 --2- 172.21.15.86:0/124076744 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5d6c06c2b0 0x7f5d6c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:46.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.851+0000 7f5d7ffff640 1 --2- 172.21.15.86:0/124076744 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5d6c06c2b0 0x7f5d6c06e770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5d700015a0 tx=0x7f5d70009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:46.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:46.855+0000 7f5d7cff9640 1 -- 172.21.15.86:0/124076744 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5d7807a090 con 0x7f5d80153000 2024-09-19T06:45:47.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.062+0000 7f5d86903640 1 -- 172.21.15.86:0/124076744 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d800c2f90 con 0x7f5d80153000 2024-09-19T06:45:47.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.062+0000 7f5d7cff9640 1 -- 172.21.15.86:0/124076744 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+6874 (secure 0 0 0) 0x7f5d7807e390 con 0x7f5d80153000 2024-09-19T06:45:47.064 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:45:47.064 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":34,"btime":"2024-09-19T06:45:11:648449+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":5092,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/1148622307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1148622307},{"type":"v1","addr":"172.21.15.169:6837","nonce":1148622307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:57.575752+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"e","rank":0,"incarnation":30,"state":"up:active","state_seq":12,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":1}]} 2024-09-19T06:45:47.064 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 34 2024-09-19T06:45:47.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.065+0000 7f5d86903640 1 -- 172.21.15.86:0/124076744 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5d6c06c2b0 msgr2=0x7f5d6c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:47.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.065+0000 7f5d86903640 1 --2- 172.21.15.86:0/124076744 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5d6c06c2b0 0x7f5d6c06e770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5d700015a0 tx=0x7f5d70009040 comp rx=0 tx=0).stop 2024-09-19T06:45:47.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.065+0000 7f5d86903640 1 -- 172.21.15.86:0/124076744 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d80153000 msgr2=0x7f5d801f28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:47.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.065+0000 7f5d86903640 1 --2- 172.21.15.86:0/124076744 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d80153000 0x7f5d801f28e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5d78035040 tx=0x7f5d78004a40 comp rx=0 tx=0).stop 2024-09-19T06:45:47.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.065+0000 7f5d86903640 1 -- 172.21.15.86:0/124076744 shutdown_connections 2024-09-19T06:45:47.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.065+0000 7f5d86903640 1 --2- 172.21.15.86:0/124076744 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5d6c06c2b0 0x7f5d6c06e770 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.065+0000 7f5d86903640 1 --2- 172.21.15.86:0/124076744 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d80153000 0x7f5d801f28e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.065+0000 7f5d86903640 1 --2- 172.21.15.86:0/124076744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d80152c20 0x7f5d801f23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.065+0000 7f5d86903640 1 --2- 172.21.15.86:0/124076744 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d800730e0 0x7f5d80151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.065+0000 7f5d86903640 1 -- 172.21.15.86:0/124076744 >> 172.21.15.86:0/124076744 conn(0x7f5d800c9280 msgr2=0x7f5d800c9660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:47.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.065+0000 7f5d86903640 1 -- 172.21.15.86:0/124076744 shutdown_connections 2024-09-19T06:45:47.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.065+0000 7f5d86903640 1 -- 172.21.15.86:0/124076744 wait complete. 2024-09-19T06:45:47.077 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.e (rank=0) 2024-09-19T06:45:47.078 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-09-19T06:45:47.078 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:45:47.088 INFO:tasks.ceph.mds.e:Stopped 2024-09-19T06:45:47.088 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:45:47.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.231+0000 7f21657ed640 1 Processor -- start 2024-09-19T06:45:47.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.231+0000 7f21657ed640 1 -- start start 2024-09-19T06:45:47.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.232+0000 7f21657ed640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2160155290 0x7f216015c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:47.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.232+0000 7f21657ed640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f216015bc70 0x7f216015f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:47.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.232+0000 7f21657ed640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f216015c070 con 0x7f216006ccd0 2024-09-19T06:45:47.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.232+0000 7f21657ed640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f216015f580 con 0x7f2160155290 2024-09-19T06:45:47.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.232+0000 7f21657ed640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f21600c9a10 con 0x7f216015bc70 2024-09-19T06:45:47.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.232+0000 7f215effd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2160155290 0x7f216015c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:47.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.232+0000 7f215effd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2160155290 0x7f216015c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41598/0 (socket says 172.21.15.86:41598) 2024-09-19T06:45:47.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.232+0000 7f215effd640 1 -- 172.21.15.86:0/3353981206 learned_addr learned my addr 172.21.15.86:0/3353981206 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:45:47.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.233+0000 7f215effd640 1 -- 172.21.15.86:0/3353981206 >> v2:172.21.15.169:3300/0 conn(0x7f216015bc70 msgr2=0x7f216015f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:47.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.233+0000 7f215effd640 1 --2- 172.21.15.86:0/3353981206 >> v2:172.21.15.169:3300/0 conn(0x7f216015bc70 0x7f216015f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.233+0000 7f215effd640 1 -- 172.21.15.86:0/3353981206 >> v1:172.21.15.169:6789/0 conn(0x7f216006ccd0 legacy=0x7f216006d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:47.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.233+0000 7f215effd640 1 -- 172.21.15.86:0/3353981206 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21600c9cf0 con 0x7f2160155290 2024-09-19T06:45:47.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.233+0000 7f215effd640 1 --2- 172.21.15.86:0/3353981206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2160155290 0x7f216015c570 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2160072ab0 tx=0x7f214802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2872d7def5aa3040 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:47.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.233+0000 7f215dffb640 1 -- 172.21.15.86:0/3353981206 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2148037070 con 0x7f2160155290 2024-09-19T06:45:47.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.233+0000 7f215dffb640 1 -- 172.21.15.86:0/3353981206 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2148032440 con 0x7f2160155290 2024-09-19T06:45:47.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.233+0000 7f215dffb640 1 -- 172.21.15.86:0/3353981206 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2148032810 con 0x7f2160155290 2024-09-19T06:45:47.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.234+0000 7f21657ed640 1 -- 172.21.15.86:0/3353981206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2160155290 msgr2=0x7f216015c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:47.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.234+0000 7f21657ed640 1 --2- 172.21.15.86:0/3353981206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2160155290 0x7f216015c570 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2160072ab0 tx=0x7f214802a230 comp rx=0 tx=0).stop 2024-09-19T06:45:47.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.234+0000 7f21657ed640 1 -- 172.21.15.86:0/3353981206 shutdown_connections 2024-09-19T06:45:47.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.234+0000 7f21657ed640 1 --2- 172.21.15.86:0/3353981206 >> v2:172.21.15.169:3300/0 conn(0x7f216015bc70 0x7f216015f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.234+0000 7f21657ed640 1 --2- 172.21.15.86:0/3353981206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2160155290 0x7f216015c570 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.234+0000 7f21657ed640 1 -- 172.21.15.86:0/3353981206 >> 172.21.15.86:0/3353981206 conn(0x7f2160070c10 msgr2=0x7f2160071020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:47.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.234+0000 7f21657ed640 1 -- 172.21.15.86:0/3353981206 shutdown_connections 2024-09-19T06:45:47.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.234+0000 7f21657ed640 1 -- 172.21.15.86:0/3353981206 wait complete. 2024-09-19T06:45:47.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.235+0000 7f21657ed640 1 Processor -- start 2024-09-19T06:45:47.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.235+0000 7f21657ed640 1 -- start start 2024-09-19T06:45:47.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.236+0000 7f21657ed640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f216006ccd0 0x7f21600ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:47.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.236+0000 7f21657ed640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2160155290 0x7f21601f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:47.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.236+0000 7f21657ed640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f216015bc70 0x7f21601f4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:47.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.236+0000 7f21657ed640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f216015b470 con 0x7f2160155290 2024-09-19T06:45:47.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.236+0000 7f21657ed640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f216015b190 con 0x7f216006ccd0 2024-09-19T06:45:47.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.236+0000 7f21657ed640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f216015b750 con 0x7f216015bc70 2024-09-19T06:45:47.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.236+0000 7f215e7fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2160155290 0x7f21601f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:47.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.236+0000 7f215e7fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2160155290 0x7f21601f4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41604/0 (socket says 172.21.15.86:41604) 2024-09-19T06:45:47.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.236+0000 7f215e7fc640 1 -- 172.21.15.86:0/2786482485 learned_addr learned my addr 172.21.15.86:0/2786482485 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:45:47.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.236+0000 7f215effd640 1 --2- 172.21.15.86:0/2786482485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f216006ccd0 0x7f21600ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:47.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.236+0000 7f215f7fe640 1 --2- 172.21.15.86:0/2786482485 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f216015bc70 0x7f21601f4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:47.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.236+0000 7f215e7fc640 1 -- 172.21.15.86:0/2786482485 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f216015bc70 msgr2=0x7f21601f4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:47.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.237+0000 7f215e7fc640 1 --2- 172.21.15.86:0/2786482485 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f216015bc70 0x7f21601f4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.237+0000 7f215e7fc640 1 -- 172.21.15.86:0/2786482485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f216006ccd0 msgr2=0x7f21600ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:47.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.237+0000 7f215e7fc640 1 --2- 172.21.15.86:0/2786482485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f216006ccd0 0x7f21600ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.237+0000 7f215e7fc640 1 -- 172.21.15.86:0/2786482485 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f216015aa10 con 0x7f2160155290 2024-09-19T06:45:47.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.237+0000 7f215e7fc640 1 --2- 172.21.15.86:0/2786482485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2160155290 0x7f21601f4610 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f215000b4d0 tx=0x7f215000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:47.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.237+0000 7f21577fe640 1 -- 172.21.15.86:0/2786482485 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2150014070 con 0x7f2160155290 2024-09-19T06:45:47.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.237+0000 7f21577fe640 1 -- 172.21.15.86:0/2786482485 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2150010870 con 0x7f2160155290 2024-09-19T06:45:47.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.237+0000 7f21657ed640 1 -- 172.21.15.86:0/2786482485 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21600cecd0 con 0x7f2160155290 2024-09-19T06:45:47.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.237+0000 7f21577fe640 1 -- 172.21.15.86:0/2786482485 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2150010c60 con 0x7f2160155290 2024-09-19T06:45:47.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.237+0000 7f21657ed640 1 -- 172.21.15.86:0/2786482485 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21600cf290 con 0x7f2160155290 2024-09-19T06:45:47.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.238+0000 7f21657ed640 1 -- 172.21.15.86:0/2786482485 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2160155670 con 0x7f2160155290 2024-09-19T06:45:47.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.238+0000 7f21577fe640 1 -- 172.21.15.86:0/2786482485 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2150017070 con 0x7f2160155290 2024-09-19T06:45:47.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.239+0000 7f21577fe640 1 --2- 172.21.15.86:0/2786482485 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f214006c2b0 0x7f214006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:47.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.239+0000 7f215effd640 1 --2- 172.21.15.86:0/2786482485 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f214006c2b0 0x7f214006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:47.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.239+0000 7f21577fe640 1 -- 172.21.15.86:0/2786482485 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7165+0+0 (secure 0 0 0) 0x7f215008b800 con 0x7f2160155290 2024-09-19T06:45:47.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.240+0000 7f215effd640 1 --2- 172.21.15.86:0/2786482485 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f214006c2b0 0x7f214006e770 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2148034000 tx=0x7f214802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:47.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.243+0000 7f21577fe640 1 -- 172.21.15.86:0/2786482485 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f21500592e0 con 0x7f2160155290 2024-09-19T06:45:47.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.456+0000 7f21657ed640 1 -- 172.21.15.86:0/2786482485 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21600c5840 con 0x7f2160155290 2024-09-19T06:45:47.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.457+0000 7f21577fe640 1 -- 172.21.15.86:0/2786482485 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+6874 (secure 0 0 0) 0x7f215005d5e0 con 0x7f2160155290 2024-09-19T06:45:47.458 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:45:47.458 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":34,"btime":"2024-09-19T06:45:11:648449+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":5092,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/1148622307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1148622307},{"type":"v1","addr":"172.21.15.169:6837","nonce":1148622307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:57.575752+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"e","rank":0,"incarnation":30,"state":"up:active","state_seq":12,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":1}]} 2024-09-19T06:45:47.459 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 34 2024-09-19T06:45:47.460 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.459+0000 7f21657ed640 1 -- 172.21.15.86:0/2786482485 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f214006c2b0 msgr2=0x7f214006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:47.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.459+0000 7f21657ed640 1 --2- 172.21.15.86:0/2786482485 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f214006c2b0 0x7f214006e770 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2148034000 tx=0x7f214802e000 comp rx=0 tx=0).stop 2024-09-19T06:45:47.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.459+0000 7f21657ed640 1 -- 172.21.15.86:0/2786482485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2160155290 msgr2=0x7f21601f4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:47.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.459+0000 7f21657ed640 1 --2- 172.21.15.86:0/2786482485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2160155290 0x7f21601f4610 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f215000b4d0 tx=0x7f215000b990 comp rx=0 tx=0).stop 2024-09-19T06:45:47.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.459+0000 7f21657ed640 1 -- 172.21.15.86:0/2786482485 shutdown_connections 2024-09-19T06:45:47.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.459+0000 7f21657ed640 1 --2- 172.21.15.86:0/2786482485 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f214006c2b0 0x7f214006e770 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.459+0000 7f21657ed640 1 --2- 172.21.15.86:0/2786482485 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f216015bc70 0x7f21601f4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.459+0000 7f21657ed640 1 --2- 172.21.15.86:0/2786482485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2160155290 0x7f21601f4610 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.459+0000 7f21657ed640 1 --2- 172.21.15.86:0/2786482485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f216006ccd0 0x7f21600ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.459+0000 7f21657ed640 1 -- 172.21.15.86:0/2786482485 >> 172.21.15.86:0/2786482485 conn(0x7f2160070c10 msgr2=0x7f216014f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:47.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.459+0000 7f21657ed640 1 -- 172.21.15.86:0/2786482485 shutdown_connections 2024-09-19T06:45:47.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:47.459+0000 7f21657ed640 1 -- 172.21.15.86:0/2786482485 wait complete. 2024-09-19T06:45:47.472 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-09-19T06:45:47.680 DEBUG:teuthology.parallel:result is None 2024-09-19T06:45:47.685 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T06:45:49.473 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:45:49.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.573+0000 7f6f89c5a640 1 Processor -- start 2024-09-19T06:45:49.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.573+0000 7f6f89c5a640 1 -- start start 2024-09-19T06:45:49.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.574+0000 7f6f89c5a640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6f8415e6f0 0x7f6f840d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.574+0000 7f6f89c5a640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6f840d0ff0 0x7f6f840c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.574+0000 7f6f89c5a640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f8415ec50 con 0x7f6f841553a0 2024-09-19T06:45:49.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.574+0000 7f6f89c5a640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f6f8415ef30 con 0x7f6f8415e6f0 2024-09-19T06:45:49.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.574+0000 7f6f89c5a640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f6f8415f210 con 0x7f6f840d0ff0 2024-09-19T06:45:49.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.574+0000 7f6f7bfff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6f8415e6f0 0x7f6f840d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.574+0000 7f6f7bfff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6f8415e6f0 0x7f6f840d0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41618/0 (socket says 172.21.15.86:41618) 2024-09-19T06:45:49.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.574+0000 7f6f7bfff640 1 -- 172.21.15.86:0/3112278926 learned_addr learned my addr 172.21.15.86:0/3112278926 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:45:49.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.574+0000 7f6f83fff640 1 --2- 172.21.15.86:0/3112278926 >> v2:172.21.15.169:3300/0 conn(0x7f6f840d0ff0 0x7f6f840c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.574+0000 7f6f7bfff640 1 -- 172.21.15.86:0/3112278926 >> v2:172.21.15.169:3300/0 conn(0x7f6f840d0ff0 msgr2=0x7f6f840c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:49.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.574+0000 7f6f7bfff640 1 --2- 172.21.15.86:0/3112278926 >> v2:172.21.15.169:3300/0 conn(0x7f6f840d0ff0 0x7f6f840c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.574+0000 7f6f7bfff640 1 -- 172.21.15.86:0/3112278926 >> v1:172.21.15.169:6789/0 conn(0x7f6f841553a0 legacy=0x7f6f840cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:49.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.574+0000 7f6f7bfff640 1 -- 172.21.15.86:0/3112278926 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f8415f4f0 con 0x7f6f8415e6f0 2024-09-19T06:45:49.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.575+0000 7f6f7bfff640 1 --2- 172.21.15.86:0/3112278926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f8415e6f0 0x7f6f840d0ab0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6f840b3730 tx=0x7f6f6c02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce71449622d9f99b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:49.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.575+0000 7f6f82ffd640 1 -- 172.21.15.86:0/3112278926 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c037070 con 0x7f6f8415e6f0 2024-09-19T06:45:49.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.575+0000 7f6f82ffd640 1 -- 172.21.15.86:0/3112278926 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f6c032440 con 0x7f6f8415e6f0 2024-09-19T06:45:49.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.575+0000 7f6f82ffd640 1 -- 172.21.15.86:0/3112278926 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c032810 con 0x7f6f8415e6f0 2024-09-19T06:45:49.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.576+0000 7f6f89c5a640 1 -- 172.21.15.86:0/3112278926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f8415e6f0 msgr2=0x7f6f840d0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:49.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.576+0000 7f6f89c5a640 1 --2- 172.21.15.86:0/3112278926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f8415e6f0 0x7f6f840d0ab0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6f840b3730 tx=0x7f6f6c02a2c0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.576+0000 7f6f89c5a640 1 -- 172.21.15.86:0/3112278926 shutdown_connections 2024-09-19T06:45:49.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.576+0000 7f6f89c5a640 1 --2- 172.21.15.86:0/3112278926 >> v2:172.21.15.169:3300/0 conn(0x7f6f840d0ff0 0x7f6f840c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.576+0000 7f6f89c5a640 1 --2- 172.21.15.86:0/3112278926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f8415e6f0 0x7f6f840d0ab0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.576+0000 7f6f89c5a640 1 -- 172.21.15.86:0/3112278926 >> 172.21.15.86:0/3112278926 conn(0x7f6f84067890 msgr2=0x7f6f84067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:49.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.576+0000 7f6f89c5a640 1 -- 172.21.15.86:0/3112278926 shutdown_connections 2024-09-19T06:45:49.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.576+0000 7f6f89c5a640 1 -- 172.21.15.86:0/3112278926 wait complete. 2024-09-19T06:45:49.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.577+0000 7f6f89c5a640 1 Processor -- start 2024-09-19T06:45:49.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.577+0000 7f6f89c5a640 1 -- start start 2024-09-19T06:45:49.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.578+0000 7f6f89c5a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f840d0ff0 0x7f6f8415c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.578+0000 7f6f89c5a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f841553a0 0x7f6f8414a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.578+0000 7f6f89c5a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f8415e6f0 0x7f6f841f47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.578+0000 7f6f89c5a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6f840cc2d0 con 0x7f6f840d0ff0 2024-09-19T06:45:49.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.578+0000 7f6f89c5a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6f840c66d0 con 0x7f6f841553a0 2024-09-19T06:45:49.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.578+0000 7f6f89c5a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6f84155780 con 0x7f6f8415e6f0 2024-09-19T06:45:49.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.578+0000 7f6f837fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f840d0ff0 0x7f6f8415c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.578+0000 7f6f837fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f840d0ff0 0x7f6f8415c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41628/0 (socket says 172.21.15.86:41628) 2024-09-19T06:45:49.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.578+0000 7f6f837fe640 1 -- 172.21.15.86:0/182511962 learned_addr learned my addr 172.21.15.86:0/182511962 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:45:49.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.578+0000 7f6f7bfff640 1 --2- 172.21.15.86:0/182511962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f841553a0 0x7f6f8414a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.578+0000 7f6f83fff640 1 --2- 172.21.15.86:0/182511962 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f8415e6f0 0x7f6f841f47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.578+0000 7f6f837fe640 1 -- 172.21.15.86:0/182511962 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f8415e6f0 msgr2=0x7f6f841f47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:49.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.578+0000 7f6f837fe640 1 --2- 172.21.15.86:0/182511962 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f8415e6f0 0x7f6f841f47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.578+0000 7f6f837fe640 1 -- 172.21.15.86:0/182511962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f841553a0 msgr2=0x7f6f8414a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:49.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.578+0000 7f6f837fe640 1 --2- 172.21.15.86:0/182511962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f841553a0 0x7f6f8414a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.578+0000 7f6f837fe640 1 -- 172.21.15.86:0/182511962 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f8415c940 con 0x7f6f840d0ff0 2024-09-19T06:45:49.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.578+0000 7f6f837fe640 1 --2- 172.21.15.86:0/182511962 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f840d0ff0 0x7f6f8415c2e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400c460 tx=0x7f6f7400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:49.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.579+0000 7f6f80ff9640 1 -- 172.21.15.86:0/182511962 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f74016020 con 0x7f6f840d0ff0 2024-09-19T06:45:49.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.579+0000 7f6f80ff9640 1 -- 172.21.15.86:0/182511962 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f74012870 con 0x7f6f840d0ff0 2024-09-19T06:45:49.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.579+0000 7f6f89c5a640 1 -- 172.21.15.86:0/182511962 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f8415cbe0 con 0x7f6f840d0ff0 2024-09-19T06:45:49.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.579+0000 7f6f80ff9640 1 -- 172.21.15.86:0/182511962 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f74012c60 con 0x7f6f840d0ff0 2024-09-19T06:45:49.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.579+0000 7f6f89c5a640 1 -- 172.21.15.86:0/182511962 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f840cfd50 con 0x7f6f840d0ff0 2024-09-19T06:45:49.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.580+0000 7f6f89c5a640 1 -- 172.21.15.86:0/182511962 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f840d0ab0 con 0x7f6f840d0ff0 2024-09-19T06:45:49.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.580+0000 7f6f80ff9640 1 -- 172.21.15.86:0/182511962 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6f74019020 con 0x7f6f840d0ff0 2024-09-19T06:45:49.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.581+0000 7f6f80ff9640 1 --2- 172.21.15.86:0/182511962 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6f6406c2b0 0x7f6f6406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.581+0000 7f6f80ff9640 1 -- 172.21.15.86:0/182511962 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7165+0+0 (secure 0 0 0) 0x7f6f7408b3a0 con 0x7f6f840d0ff0 2024-09-19T06:45:49.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.581+0000 7f6f7bfff640 1 --2- 172.21.15.86:0/182511962 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6f6406c2b0 0x7f6f6406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.581+0000 7f6f7bfff640 1 --2- 172.21.15.86:0/182511962 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6f6406c2b0 0x7f6f6406e770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c034000 tx=0x7f6f6c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:49.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.585+0000 7f6f80ff9640 1 -- 172.21.15.86:0/182511962 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6f74020070 con 0x7f6f840d0ff0 2024-09-19T06:45:49.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.788+0000 7f6f89c5a640 1 -- 172.21.15.86:0/182511962 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f8414be70 con 0x7f6f840d0ff0 2024-09-19T06:45:49.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.788+0000 7f6f80ff9640 1 -- 172.21.15.86:0/182511962 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+6874 (secure 0 0 0) 0x7f6f74059560 con 0x7f6f840d0ff0 2024-09-19T06:45:49.790 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:45:49.790 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":34,"btime":"2024-09-19T06:45:11:648449+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":5092,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/1148622307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1148622307},{"type":"v1","addr":"172.21.15.169:6837","nonce":1148622307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:57.575752+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"e","rank":0,"incarnation":30,"state":"up:active","state_seq":12,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":1}]} 2024-09-19T06:45:49.790 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 34 2024-09-19T06:45:49.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.790+0000 7f6f89c5a640 1 -- 172.21.15.86:0/182511962 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6f6406c2b0 msgr2=0x7f6f6406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:49.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.790+0000 7f6f89c5a640 1 --2- 172.21.15.86:0/182511962 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6f6406c2b0 0x7f6f6406e770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c034000 tx=0x7f6f6c02e000 comp rx=0 tx=0).stop 2024-09-19T06:45:49.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.790+0000 7f6f89c5a640 1 -- 172.21.15.86:0/182511962 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f840d0ff0 msgr2=0x7f6f8415c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:49.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.790+0000 7f6f89c5a640 1 --2- 172.21.15.86:0/182511962 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f840d0ff0 0x7f6f8415c2e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400c460 tx=0x7f6f7400c920 comp rx=0 tx=0).stop 2024-09-19T06:45:49.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.790+0000 7f6f89c5a640 1 -- 172.21.15.86:0/182511962 shutdown_connections 2024-09-19T06:45:49.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.790+0000 7f6f89c5a640 1 --2- 172.21.15.86:0/182511962 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6f6406c2b0 0x7f6f6406e770 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.790+0000 7f6f89c5a640 1 --2- 172.21.15.86:0/182511962 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f8415e6f0 0x7f6f841f47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.790+0000 7f6f89c5a640 1 --2- 172.21.15.86:0/182511962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f841553a0 0x7f6f8414a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.790+0000 7f6f89c5a640 1 --2- 172.21.15.86:0/182511962 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f840d0ff0 0x7f6f8415c2e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.790+0000 7f6f89c5a640 1 -- 172.21.15.86:0/182511962 >> 172.21.15.86:0/182511962 conn(0x7f6f84067890 msgr2=0x7f6f8406d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:49.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.790+0000 7f6f89c5a640 1 -- 172.21.15.86:0/182511962 shutdown_connections 2024-09-19T06:45:49.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:49.790+0000 7f6f89c5a640 1 -- 172.21.15.86:0/182511962 wait complete. 2024-09-19T06:45:49.802 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-09-19T06:45:51.804 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:45:51.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.901+0000 7fcc05c5c640 1 Processor -- start 2024-09-19T06:45:51.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.901+0000 7fcc05c5c640 1 -- start start 2024-09-19T06:45:51.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.902+0000 7fcc05c5c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcc000d0d40 0x7fcc000ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:51.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.902+0000 7fcc05c5c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcc000d1120 0x7fcc000cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:51.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.902+0000 7fcc05c5c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc0015c9c0 con 0x7fcc0015da60 2024-09-19T06:45:51.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.902+0000 7fcc05c5c640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fcc0015c770 con 0x7fcc000d1120 2024-09-19T06:45:51.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.902+0000 7fcc05c5c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fcc000b3f20 con 0x7fcc000d0d40 2024-09-19T06:45:51.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.902+0000 7fcbfeffd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcc000d1120 0x7fcc000cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:51.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.902+0000 7fcbfeffd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcc000d1120 0x7fcc000cac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41630/0 (socket says 172.21.15.86:41630) 2024-09-19T06:45:51.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.902+0000 7fcbfeffd640 1 -- 172.21.15.86:0/3528678318 learned_addr learned my addr 172.21.15.86:0/3528678318 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:45:51.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.902+0000 7fcbfeffd640 1 -- 172.21.15.86:0/3528678318 >> v2:172.21.15.169:3300/0 conn(0x7fcc000d0d40 msgr2=0x7fcc000ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:51.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.902+0000 7fcbfeffd640 1 --2- 172.21.15.86:0/3528678318 >> v2:172.21.15.169:3300/0 conn(0x7fcc000d0d40 0x7fcc000ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:51.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.902+0000 7fcbfeffd640 1 -- 172.21.15.86:0/3528678318 >> v1:172.21.15.169:6789/0 conn(0x7fcc0015da60 legacy=0x7fcc0015ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:51.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.902+0000 7fcbfeffd640 1 -- 172.21.15.86:0/3528678318 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc0015cca0 con 0x7fcc000d1120 2024-09-19T06:45:51.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.903+0000 7fcbfeffd640 1 --2- 172.21.15.86:0/3528678318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc000d1120 0x7fcc000cac00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcc000ce600 tx=0x7fcbf402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634d029d1c9ac67c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:51.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.903+0000 7fcbfe7fc640 1 -- 172.21.15.86:0/3528678318 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4037070 con 0x7fcc000d1120 2024-09-19T06:45:51.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.903+0000 7fcbfe7fc640 1 -- 172.21.15.86:0/3528678318 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbf4032440 con 0x7fcc000d1120 2024-09-19T06:45:51.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.903+0000 7fcbfe7fc640 1 -- 172.21.15.86:0/3528678318 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4032810 con 0x7fcc000d1120 2024-09-19T06:45:51.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.904+0000 7fcc05c5c640 1 -- 172.21.15.86:0/3528678318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc000d1120 msgr2=0x7fcc000cac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:51.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.904+0000 7fcc05c5c640 1 --2- 172.21.15.86:0/3528678318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc000d1120 0x7fcc000cac00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcc000ce600 tx=0x7fcbf402a230 comp rx=0 tx=0).stop 2024-09-19T06:45:51.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.904+0000 7fcc05c5c640 1 -- 172.21.15.86:0/3528678318 shutdown_connections 2024-09-19T06:45:51.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.904+0000 7fcc05c5c640 1 --2- 172.21.15.86:0/3528678318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc000d1120 0x7fcc000cac00 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:51.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.904+0000 7fcc05c5c640 1 --2- 172.21.15.86:0/3528678318 >> v2:172.21.15.169:3300/0 conn(0x7fcc000d0d40 0x7fcc000ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:51.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.904+0000 7fcc05c5c640 1 -- 172.21.15.86:0/3528678318 >> 172.21.15.86:0/3528678318 conn(0x7fcc0006d910 msgr2=0x7fcc0006dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:51.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.904+0000 7fcc05c5c640 1 -- 172.21.15.86:0/3528678318 shutdown_connections 2024-09-19T06:45:51.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.904+0000 7fcc05c5c640 1 -- 172.21.15.86:0/3528678318 wait complete. 2024-09-19T06:45:51.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.905+0000 7fcc05c5c640 1 Processor -- start 2024-09-19T06:45:51.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.905+0000 7fcc05c5c640 1 -- start start 2024-09-19T06:45:51.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.906+0000 7fcc05c5c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc000d0d40 0x7fcc000c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:51.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.906+0000 7fcc05c5c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc000d1120 0x7fcc000c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:51.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.906+0000 7fcc05c5c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc0015da60 0x7fcc000c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:51.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.906+0000 7fcc05c5c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcc000b4b60 con 0x7fcc000d1120 2024-09-19T06:45:51.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.906+0000 7fcc05c5c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0015d260 con 0x7fcc000d0d40 2024-09-19T06:45:51.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.906+0000 7fcc05c5c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcc000b4ce0 con 0x7fcc0015da60 2024-09-19T06:45:51.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.906+0000 7fcbfeffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc000d1120 0x7fcc000c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:51.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.906+0000 7fcbfeffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc000d1120 0x7fcc000c4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41640/0 (socket says 172.21.15.86:41640) 2024-09-19T06:45:51.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.906+0000 7fcbfeffd640 1 -- 172.21.15.86:0/130863546 learned_addr learned my addr 172.21.15.86:0/130863546 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:45:51.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.906+0000 7fcbfeffd640 1 -- 172.21.15.86:0/130863546 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc0015da60 msgr2=0x7fcc000c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:51.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.906+0000 7fcbff7fe640 1 --2- 172.21.15.86:0/130863546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc000d0d40 0x7fcc000c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:51.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.906+0000 7fcbfeffd640 1 --2- 172.21.15.86:0/130863546 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc0015da60 0x7fcc000c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:51.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.906+0000 7fcbfeffd640 1 -- 172.21.15.86:0/130863546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc000d0d40 msgr2=0x7fcc000c5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:51.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.906+0000 7fcbfeffd640 1 --2- 172.21.15.86:0/130863546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc000d0d40 0x7fcc000c5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:51.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.906+0000 7fcbfeffd640 1 -- 172.21.15.86:0/130863546 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc000cd850 con 0x7fcc000d1120 2024-09-19T06:45:51.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.906+0000 7fcbfeffd640 1 --2- 172.21.15.86:0/130863546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc000d1120 0x7fcc000c4910 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4000c00 tx=0x7fcbf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:51.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.906+0000 7fcbe7fff640 1 -- 172.21.15.86:0/130863546 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4041070 con 0x7fcc000d1120 2024-09-19T06:45:51.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.906+0000 7fcbe7fff640 1 -- 172.21.15.86:0/130863546 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbf403c870 con 0x7fcc000d1120 2024-09-19T06:45:51.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.906+0000 7fcc05c5c640 1 -- 172.21.15.86:0/130863546 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc001f4db0 con 0x7fcc000d1120 2024-09-19T06:45:51.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.906+0000 7fcbe7fff640 1 -- 172.21.15.86:0/130863546 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4037040 con 0x7fcc000d1120 2024-09-19T06:45:51.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.906+0000 7fcc05c5c640 1 -- 172.21.15.86:0/130863546 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc000c53d0 con 0x7fcc000d1120 2024-09-19T06:45:51.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.908+0000 7fcc05c5c640 1 -- 172.21.15.86:0/130863546 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc000cb210 con 0x7fcc000d1120 2024-09-19T06:45:51.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.908+0000 7fcbe7fff640 1 -- 172.21.15.86:0/130863546 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcbf4044070 con 0x7fcc000d1120 2024-09-19T06:45:51.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.908+0000 7fcbe7fff640 1 --2- 172.21.15.86:0/130863546 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fcbec06c2e0 0x7fcbec06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:51.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.909+0000 7fcbe7fff640 1 -- 172.21.15.86:0/130863546 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7165+0+0 (secure 0 0 0) 0x7fcbf40ac670 con 0x7fcc000d1120 2024-09-19T06:45:51.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.909+0000 7fcbff7fe640 1 --2- 172.21.15.86:0/130863546 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fcbec06c2e0 0x7fcbec06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:51.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.909+0000 7fcbff7fe640 1 --2- 172.21.15.86:0/130863546 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fcbec06c2e0 0x7fcbec06e7a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000a810 tx=0x7fcbf0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:51.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:51.913+0000 7fcbe7fff640 1 -- 172.21.15.86:0/130863546 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fcc000cb210 con 0x7fcc000d1120 2024-09-19T06:45:52.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:52.115+0000 7fcc05c5c640 1 -- 172.21.15.86:0/130863546 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc0015ded0 con 0x7fcc000d1120 2024-09-19T06:45:52.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:52.116+0000 7fcbe7fff640 1 -- 172.21.15.86:0/130863546 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+6874 (secure 0 0 0) 0x7fcbf407a950 con 0x7fcc000d1120 2024-09-19T06:45:52.117 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:45:52.118 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":34,"btime":"2024-09-19T06:45:11:648449+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":5092,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/1148622307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1148622307},{"type":"v1","addr":"172.21.15.169:6837","nonce":1148622307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:57.575752+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"e","rank":0,"incarnation":30,"state":"up:active","state_seq":12,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":1}]} 2024-09-19T06:45:52.118 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 34 2024-09-19T06:45:52.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:52.118+0000 7fcc05c5c640 1 -- 172.21.15.86:0/130863546 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fcbec06c2e0 msgr2=0x7fcbec06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:52.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:52.118+0000 7fcc05c5c640 1 --2- 172.21.15.86:0/130863546 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fcbec06c2e0 0x7fcbec06e7a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000a810 tx=0x7fcbf0008040 comp rx=0 tx=0).stop 2024-09-19T06:45:52.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:52.118+0000 7fcc05c5c640 1 -- 172.21.15.86:0/130863546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc000d1120 msgr2=0x7fcc000c4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:52.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:52.118+0000 7fcc05c5c640 1 --2- 172.21.15.86:0/130863546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc000d1120 0x7fcc000c4910 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4000c00 tx=0x7fcbf40046c0 comp rx=0 tx=0).stop 2024-09-19T06:45:52.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:52.118+0000 7fcc05c5c640 1 -- 172.21.15.86:0/130863546 shutdown_connections 2024-09-19T06:45:52.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:52.118+0000 7fcc05c5c640 1 --2- 172.21.15.86:0/130863546 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fcbec06c2e0 0x7fcbec06e7a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:52.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:52.118+0000 7fcc05c5c640 1 --2- 172.21.15.86:0/130863546 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc0015da60 0x7fcc000c4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:52.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:52.118+0000 7fcc05c5c640 1 --2- 172.21.15.86:0/130863546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc000d1120 0x7fcc000c4910 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:52.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:52.118+0000 7fcc05c5c640 1 --2- 172.21.15.86:0/130863546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc000d0d40 0x7fcc000c5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:52.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:52.118+0000 7fcc05c5c640 1 -- 172.21.15.86:0/130863546 >> 172.21.15.86:0/130863546 conn(0x7fcc0006d910 msgr2=0x7fcc000b40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:52.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:52.118+0000 7fcc05c5c640 1 -- 172.21.15.86:0/130863546 shutdown_connections 2024-09-19T06:45:52.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:52.118+0000 7fcc05c5c640 1 -- 172.21.15.86:0/130863546 wait complete. 2024-09-19T06:45:52.130 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-09-19T06:45:54.132 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:45:54.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.231+0000 7fe4db8e4640 1 Processor -- start 2024-09-19T06:45:54.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.231+0000 7fe4db8e4640 1 -- start start 2024-09-19T06:45:54.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.232+0000 7fe4db8e4640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe4d4155200 0x7fe4d415afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.232+0000 7fe4db8e4640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4d415ec10 con 0x7fe4d40ca020 2024-09-19T06:45:54.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.232+0000 7fe4db8e4640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4d415eed0 con 0x7fe4d4154e20 2024-09-19T06:45:54.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.232+0000 7fe4db8e4640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fe4d415f1b0 con 0x7fe4d4155200 2024-09-19T06:45:54.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.232+0000 7fe4d8e7f640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe4d4155200 0x7fe4d415afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:54.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.232+0000 7fe4d9e81640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe4d40ca020 0x7fe4d4165940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:38948/0 (socket says 172.21.15.86:38948) 2024-09-19T06:45:54.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.232+0000 7fe4d9e81640 1 -- 172.21.15.86:0/3287756842 learned_addr learned my addr 172.21.15.86:0/3287756842 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:45:54.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.232+0000 7fe4d8e7f640 1 -- 172.21.15.86:0/3287756842 >> v1:172.21.15.169:6789/0 conn(0x7fe4d4154e20 legacy=0x7fe4d4073840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:54.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.232+0000 7fe4cbfff640 1 -- 172.21.15.86:0/3287756842 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 880927866 0 0) 0x7fe4d415ec10 con 0x7fe4d40ca020 2024-09-19T06:45:54.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.233+0000 7fe4d8e7f640 1 -- 172.21.15.86:0/3287756842 >> v1:172.21.15.86:6789/0 conn(0x7fe4d40ca020 legacy=0x7fe4d4165940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:54.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.233+0000 7fe4d8e7f640 1 -- 172.21.15.86:0/3287756842 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d415f490 con 0x7fe4d4155200 2024-09-19T06:45:54.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.233+0000 7fe4d8e7f640 1 --2- 172.21.15.86:0/3287756842 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4d4155200 0x7fe4d415afc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00097a0 tx=0x7fe4d002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6a983a58b9518e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:54.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.233+0000 7fe4cbfff640 1 -- 172.21.15.86:0/3287756842 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0037070 con 0x7fe4d4155200 2024-09-19T06:45:54.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.233+0000 7fe4cbfff640 1 -- 172.21.15.86:0/3287756842 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d0032640 con 0x7fe4d4155200 2024-09-19T06:45:54.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.233+0000 7fe4cbfff640 1 -- 172.21.15.86:0/3287756842 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0032a10 con 0x7fe4d4155200 2024-09-19T06:45:54.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.234+0000 7fe4db8e4640 1 -- 172.21.15.86:0/3287756842 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4d4155200 msgr2=0x7fe4d415afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:54.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.234+0000 7fe4db8e4640 1 --2- 172.21.15.86:0/3287756842 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4d4155200 0x7fe4d415afc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00097a0 tx=0x7fe4d002a2c0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.234+0000 7fe4db8e4640 1 -- 172.21.15.86:0/3287756842 shutdown_connections 2024-09-19T06:45:54.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.234+0000 7fe4db8e4640 1 --2- 172.21.15.86:0/3287756842 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4d4155200 0x7fe4d415afc0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.234+0000 7fe4db8e4640 1 -- 172.21.15.86:0/3287756842 >> 172.21.15.86:0/3287756842 conn(0x7fe4d4067890 msgr2=0x7fe4d4067c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:54.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.234+0000 7fe4db8e4640 1 -- 172.21.15.86:0/3287756842 shutdown_connections 2024-09-19T06:45:54.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.234+0000 7fe4db8e4640 1 -- 172.21.15.86:0/3287756842 wait complete. 2024-09-19T06:45:54.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.235+0000 7fe4db8e4640 1 Processor -- start 2024-09-19T06:45:54.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.235+0000 7fe4db8e4640 1 -- start start 2024-09-19T06:45:54.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.236+0000 7fe4db8e4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4d40ca020 0x7fe4d40c0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.236+0000 7fe4db8e4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4d4154e20 0x7fe4d40be580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.236+0000 7fe4db8e4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4d4155200 0x7fe4d40beac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.236+0000 7fe4db8e4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d4070f10 con 0x7fe4d4155200 2024-09-19T06:45:54.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.236+0000 7fe4db8e4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d4070c30 con 0x7fe4d40ca020 2024-09-19T06:45:54.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.236+0000 7fe4db8e4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe4d40c9460 con 0x7fe4d4154e20 2024-09-19T06:45:54.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.236+0000 7fe4d9e81640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4d4155200 0x7fe4d40beac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:54.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.236+0000 7fe4d9e81640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4d4155200 0x7fe4d40beac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55026/0 (socket says 172.21.15.86:55026) 2024-09-19T06:45:54.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.236+0000 7fe4d9e81640 1 -- 172.21.15.86:0/4028493917 learned_addr learned my addr 172.21.15.86:0/4028493917 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:45:54.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.236+0000 7fe4d9680640 1 --2- 172.21.15.86:0/4028493917 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4d40ca020 0x7fe4d40c0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:54.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.236+0000 7fe4d8e7f640 1 --2- 172.21.15.86:0/4028493917 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4d4154e20 0x7fe4d40be580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:54.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.236+0000 7fe4d9e81640 1 -- 172.21.15.86:0/4028493917 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4d4154e20 msgr2=0x7fe4d40be580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:54.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.236+0000 7fe4d9e81640 1 --2- 172.21.15.86:0/4028493917 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4d4154e20 0x7fe4d40be580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.236+0000 7fe4d9e81640 1 -- 172.21.15.86:0/4028493917 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4d40ca020 msgr2=0x7fe4d40c0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:54.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.236+0000 7fe4d9e81640 1 --2- 172.21.15.86:0/4028493917 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4d40ca020 0x7fe4d40c0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.236+0000 7fe4d9e81640 1 -- 172.21.15.86:0/4028493917 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d41f0750 con 0x7fe4d4155200 2024-09-19T06:45:54.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.237+0000 7fe4d9e81640 1 --2- 172.21.15.86:0/4028493917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4d4155200 0x7fe4d40beac0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00c730 tx=0x7fe4cc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:54.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.237+0000 7fe4c9ffb640 1 -- 172.21.15.86:0/4028493917 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc018070 con 0x7fe4d4155200 2024-09-19T06:45:54.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.237+0000 7fe4c9ffb640 1 -- 172.21.15.86:0/4028493917 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4cc004d60 con 0x7fe4d4155200 2024-09-19T06:45:54.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.237+0000 7fe4c9ffb640 1 -- 172.21.15.86:0/4028493917 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc00a820 con 0x7fe4d4155200 2024-09-19T06:45:54.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.237+0000 7fe4db8e4640 1 -- 172.21.15.86:0/4028493917 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4d41f0a30 con 0x7fe4d4155200 2024-09-19T06:45:54.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.237+0000 7fe4db8e4640 1 -- 172.21.15.86:0/4028493917 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4d41f0ff0 con 0x7fe4d4155200 2024-09-19T06:45:54.242 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.238+0000 7fe4db8e4640 1 -- 172.21.15.86:0/4028493917 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4d415afc0 con 0x7fe4d4155200 2024-09-19T06:45:54.242 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.238+0000 7fe4c9ffb640 1 -- 172.21.15.86:0/4028493917 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe4cc01b070 con 0x7fe4d4155200 2024-09-19T06:45:54.242 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.239+0000 7fe4c9ffb640 1 --2- 172.21.15.86:0/4028493917 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe4b806c2b0 0x7fe4b806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.242 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.239+0000 7fe4c9ffb640 1 -- 172.21.15.86:0/4028493917 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7165+0+0 (secure 0 0 0) 0x7fe4cc08b090 con 0x7fe4d4155200 2024-09-19T06:45:54.242 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.239+0000 7fe4d9680640 1 --2- 172.21.15.86:0/4028493917 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe4b806c2b0 0x7fe4b806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:54.242 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.239+0000 7fe4d9680640 1 --2- 172.21.15.86:0/4028493917 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe4b806c2b0 0x7fe4b806e770 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4000f60 tx=0x7fe4c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:54.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.247+0000 7fe4c9ffb640 1 -- 172.21.15.86:0/4028493917 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe4cc0592e0 con 0x7fe4d4155200 2024-09-19T06:45:54.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.453+0000 7fe4db8e4640 1 -- 172.21.15.86:0/4028493917 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4d415ac10 con 0x7fe4d4155200 2024-09-19T06:45:54.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.454+0000 7fe4c9ffb640 1 -- 172.21.15.86:0/4028493917 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+6874 (secure 0 0 0) 0x7fe4cc058be0 con 0x7fe4d4155200 2024-09-19T06:45:54.456 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:45:54.456 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":34,"btime":"2024-09-19T06:45:11:648449+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":5092,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/1148622307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1148622307},{"type":"v1","addr":"172.21.15.169:6837","nonce":1148622307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:57.575752+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"e","rank":0,"incarnation":30,"state":"up:active","state_seq":12,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":1}]} 2024-09-19T06:45:54.456 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 34 2024-09-19T06:45:54.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.456+0000 7fe4db8e4640 1 -- 172.21.15.86:0/4028493917 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe4b806c2b0 msgr2=0x7fe4b806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:54.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.456+0000 7fe4db8e4640 1 --2- 172.21.15.86:0/4028493917 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe4b806c2b0 0x7fe4b806e770 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4000f60 tx=0x7fe4c4009040 comp rx=0 tx=0).stop 2024-09-19T06:45:54.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.456+0000 7fe4db8e4640 1 -- 172.21.15.86:0/4028493917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4d4155200 msgr2=0x7fe4d40beac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:54.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.456+0000 7fe4db8e4640 1 --2- 172.21.15.86:0/4028493917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4d4155200 0x7fe4d40beac0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00c730 tx=0x7fe4cc00cbf0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.456+0000 7fe4db8e4640 1 -- 172.21.15.86:0/4028493917 shutdown_connections 2024-09-19T06:45:54.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.456+0000 7fe4db8e4640 1 --2- 172.21.15.86:0/4028493917 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe4b806c2b0 0x7fe4b806e770 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.459 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.456+0000 7fe4db8e4640 1 --2- 172.21.15.86:0/4028493917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4d4155200 0x7fe4d40beac0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.459 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.456+0000 7fe4db8e4640 1 --2- 172.21.15.86:0/4028493917 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4d4154e20 0x7fe4d40be580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.459 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.456+0000 7fe4db8e4640 1 --2- 172.21.15.86:0/4028493917 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4d40ca020 0x7fe4d40c0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.459 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.456+0000 7fe4db8e4640 1 -- 172.21.15.86:0/4028493917 >> 172.21.15.86:0/4028493917 conn(0x7fe4d4067890 msgr2=0x7fe4d40cd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:54.459 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.456+0000 7fe4db8e4640 1 -- 172.21.15.86:0/4028493917 shutdown_connections 2024-09-19T06:45:54.459 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:54.456+0000 7fe4db8e4640 1 -- 172.21.15.86:0/4028493917 wait complete. 2024-09-19T06:45:54.469 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-09-19T06:45:56.469 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:45:56.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.570+0000 7f41ea18d640 1 Processor -- start 2024-09-19T06:45:56.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.570+0000 7f41ea18d640 1 -- start start 2024-09-19T06:45:56.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.571+0000 7f41ea18d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41e4155240 0x7f41e4072470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.571+0000 7f41ea18d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f41e415eb30 0x7f41e415efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.571+0000 7f41ea18d640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e4074210 con 0x7f41e4072020 2024-09-19T06:45:56.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.571+0000 7f41ea18d640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f41e415bef0 con 0x7f41e415eb30 2024-09-19T06:45:56.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.571+0000 7f41ea18d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f41e40729b0 con 0x7f41e4155240 2024-09-19T06:45:56.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.571+0000 7f41e3fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f41e415eb30 0x7f41e415efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.571+0000 7f41e3fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f41e415eb30 0x7f41e415efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55030/0 (socket says 172.21.15.86:55030) 2024-09-19T06:45:56.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.571+0000 7f41e3fff640 1 -- 172.21.15.86:0/452128779 learned_addr learned my addr 172.21.15.86:0/452128779 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:45:56.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.571+0000 7f41e37fe640 1 --2- 172.21.15.86:0/452128779 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41e4155240 0x7f41e4072470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.572+0000 7f41e3fff640 1 -- 172.21.15.86:0/452128779 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41e4155240 msgr2=0x7f41e4072470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:56.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.572+0000 7f41e3fff640 1 --2- 172.21.15.86:0/452128779 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41e4155240 0x7f41e4072470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.572+0000 7f41e3fff640 1 -- 172.21.15.86:0/452128779 >> v1:172.21.15.169:6789/0 conn(0x7f41e4072020 legacy=0x7f41e4072c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:56.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.572+0000 7f41e3fff640 1 -- 172.21.15.86:0/452128779 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e415b370 con 0x7f41e415eb30 2024-09-19T06:45:56.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.572+0000 7f41e3fff640 1 --2- 172.21.15.86:0/452128779 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41e415eb30 0x7f41e415efc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f41dc009e50 tx=0x7f41dc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f168e0a0f3471b4d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:56.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.572+0000 7f41e27fc640 1 -- 172.21.15.86:0/452128779 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc036070 con 0x7f41e415eb30 2024-09-19T06:45:56.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.572+0000 7f41e27fc640 1 -- 172.21.15.86:0/452128779 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41dc031600 con 0x7f41e415eb30 2024-09-19T06:45:56.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.572+0000 7f41e27fc640 1 -- 172.21.15.86:0/452128779 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc0319d0 con 0x7f41e415eb30 2024-09-19T06:45:56.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.573+0000 7f41ea18d640 1 -- 172.21.15.86:0/452128779 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41e415eb30 msgr2=0x7f41e415efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:56.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.573+0000 7f41ea18d640 1 --2- 172.21.15.86:0/452128779 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41e415eb30 0x7f41e415efc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f41dc009e50 tx=0x7f41dc02a710 comp rx=0 tx=0).stop 2024-09-19T06:45:56.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.573+0000 7f41ea18d640 1 -- 172.21.15.86:0/452128779 shutdown_connections 2024-09-19T06:45:56.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.573+0000 7f41ea18d640 1 --2- 172.21.15.86:0/452128779 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41e415eb30 0x7f41e415efc0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.573+0000 7f41ea18d640 1 --2- 172.21.15.86:0/452128779 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41e4155240 0x7f41e4072470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.573+0000 7f41ea18d640 1 -- 172.21.15.86:0/452128779 >> 172.21.15.86:0/452128779 conn(0x7f41e40cdd80 msgr2=0x7f41e40ca220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:56.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.573+0000 7f41ea18d640 1 -- 172.21.15.86:0/452128779 shutdown_connections 2024-09-19T06:45:56.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.573+0000 7f41ea18d640 1 -- 172.21.15.86:0/452128779 wait complete. 2024-09-19T06:45:56.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.574+0000 7f41ea18d640 1 Processor -- start 2024-09-19T06:45:56.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.575+0000 7f41ea18d640 1 -- start start 2024-09-19T06:45:56.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.575+0000 7f41ea18d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41e4072020 0x7f41e415a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.575+0000 7f41ea18d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41e4155240 0x7f41e41f47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.575+0000 7f41ea18d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41e415eb30 0x7f41e4148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.575+0000 7f41ea18d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f41e415bc10 con 0x7f41e4155240 2024-09-19T06:45:56.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.575+0000 7f41ea18d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f41e415b930 con 0x7f41e4072020 2024-09-19T06:45:56.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.575+0000 7f41ea18d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f41e415e610 con 0x7f41e415eb30 2024-09-19T06:45:56.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.575+0000 7f41e2ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41e4155240 0x7f41e41f47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.575+0000 7f41e2ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41e4155240 0x7f41e41f47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55044/0 (socket says 172.21.15.86:55044) 2024-09-19T06:45:56.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.575+0000 7f41e2ffd640 1 -- 172.21.15.86:0/3171474107 learned_addr learned my addr 172.21.15.86:0/3171474107 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:45:56.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.575+0000 7f41e37fe640 1 --2- 172.21.15.86:0/3171474107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41e4072020 0x7f41e415a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.575+0000 7f41e3fff640 1 --2- 172.21.15.86:0/3171474107 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41e415eb30 0x7f41e4148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.576+0000 7f41e2ffd640 1 -- 172.21.15.86:0/3171474107 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41e415eb30 msgr2=0x7f41e4148370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:56.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.576+0000 7f41e2ffd640 1 --2- 172.21.15.86:0/3171474107 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41e415eb30 0x7f41e4148370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.576+0000 7f41e2ffd640 1 -- 172.21.15.86:0/3171474107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41e4072020 msgr2=0x7f41e415a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:56.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.576+0000 7f41e2ffd640 1 --2- 172.21.15.86:0/3171474107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41e4072020 0x7f41e415a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.576+0000 7f41e2ffd640 1 -- 172.21.15.86:0/3171474107 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e41f1370 con 0x7f41e4155240 2024-09-19T06:45:56.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.576+0000 7f41e2ffd640 1 --2- 172.21.15.86:0/3171474107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41e4155240 0x7f41e41f47d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f41d800c440 tx=0x7f41d8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:56.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.576+0000 7f41cbfff640 1 -- 172.21.15.86:0/3171474107 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d80052d0 con 0x7f41e4155240 2024-09-19T06:45:56.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.576+0000 7f41cbfff640 1 -- 172.21.15.86:0/3171474107 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d8005470 con 0x7f41e4155240 2024-09-19T06:45:56.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.576+0000 7f41cbfff640 1 -- 172.21.15.86:0/3171474107 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d8007260 con 0x7f41e4155240 2024-09-19T06:45:56.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.576+0000 7f41ea18d640 1 -- 172.21.15.86:0/3171474107 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e41576f0 con 0x7f41e4155240 2024-09-19T06:45:56.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.576+0000 7f41ea18d640 1 -- 172.21.15.86:0/3171474107 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e41f1610 con 0x7f41e4155240 2024-09-19T06:45:56.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.577+0000 7f41ea18d640 1 -- 172.21.15.86:0/3171474107 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41e40776e0 con 0x7f41e4155240 2024-09-19T06:45:56.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.578+0000 7f41cbfff640 1 -- 172.21.15.86:0/3171474107 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f41d8007400 con 0x7f41e4155240 2024-09-19T06:45:56.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.578+0000 7f41cbfff640 1 --2- 172.21.15.86:0/3171474107 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f41d006c2b0 0x7f41d006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.578+0000 7f41cbfff640 1 -- 172.21.15.86:0/3171474107 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7165+0+0 (secure 0 0 0) 0x7f41d808ace0 con 0x7f41e4155240 2024-09-19T06:45:56.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.578+0000 7f41e37fe640 1 --2- 172.21.15.86:0/3171474107 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f41d006c2b0 0x7f41d006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.579+0000 7f41e37fe640 1 --2- 172.21.15.86:0/3171474107 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f41d006c2b0 0x7f41d006e770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f41d4006fd0 tx=0x7f41d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:56.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.583+0000 7f41cbfff640 1 -- 172.21.15.86:0/3171474107 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f41e40776e0 con 0x7f41e4155240 2024-09-19T06:45:56.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.794+0000 7f41ea18d640 1 -- 172.21.15.86:0/3171474107 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41e4155620 con 0x7f41e4155240 2024-09-19T06:45:56.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.794+0000 7f41cbfff640 1 -- 172.21.15.86:0/3171474107 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+6874 (secure 0 0 0) 0x7f41e4074210 con 0x7f41e4155240 2024-09-19T06:45:56.797 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:45:56.797 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":34,"btime":"2024-09-19T06:45:11:648449+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":5092,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/1148622307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1148622307},{"type":"v1","addr":"172.21.15.169:6837","nonce":1148622307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:57.575752+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"e","rank":0,"incarnation":30,"state":"up:active","state_seq":12,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":1}]} 2024-09-19T06:45:56.798 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 34 2024-09-19T06:45:56.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.796+0000 7f41ea18d640 1 -- 172.21.15.86:0/3171474107 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f41d006c2b0 msgr2=0x7f41d006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:56.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.796+0000 7f41ea18d640 1 --2- 172.21.15.86:0/3171474107 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f41d006c2b0 0x7f41d006e770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f41d4006fd0 tx=0x7f41d4008040 comp rx=0 tx=0).stop 2024-09-19T06:45:56.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.796+0000 7f41ea18d640 1 -- 172.21.15.86:0/3171474107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41e4155240 msgr2=0x7f41e41f47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:56.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.796+0000 7f41ea18d640 1 --2- 172.21.15.86:0/3171474107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41e4155240 0x7f41e41f47d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f41d800c440 tx=0x7f41d8001e70 comp rx=0 tx=0).stop 2024-09-19T06:45:56.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.796+0000 7f41ea18d640 1 -- 172.21.15.86:0/3171474107 shutdown_connections 2024-09-19T06:45:56.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.796+0000 7f41ea18d640 1 --2- 172.21.15.86:0/3171474107 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f41d006c2b0 0x7f41d006e770 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.796+0000 7f41ea18d640 1 --2- 172.21.15.86:0/3171474107 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41e415eb30 0x7f41e4148370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.796+0000 7f41ea18d640 1 --2- 172.21.15.86:0/3171474107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41e4155240 0x7f41e41f47d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.796+0000 7f41ea18d640 1 --2- 172.21.15.86:0/3171474107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41e4072020 0x7f41e415a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.796+0000 7f41ea18d640 1 -- 172.21.15.86:0/3171474107 >> 172.21.15.86:0/3171474107 conn(0x7f41e40cdd80 msgr2=0x7f41e4072bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:56.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.797+0000 7f41ea18d640 1 -- 172.21.15.86:0/3171474107 shutdown_connections 2024-09-19T06:45:56.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:56.797+0000 7f41ea18d640 1 -- 172.21.15.86:0/3171474107 wait complete. 2024-09-19T06:45:56.810 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-09-19T06:45:58.811 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:45:58.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.910+0000 7f9f30c27640 1 Processor -- start 2024-09-19T06:45:58.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.910+0000 7f9f30c27640 1 -- start start 2024-09-19T06:45:58.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.911+0000 7f9f30c27640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9f2c15c440 0x7f9f2c0c9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.911+0000 7f9f30c27640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9f2c073840 0x7f9f2c073cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.911+0000 7f9f30c27640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f2c15c870 con 0x7f9f2c152fe0 2024-09-19T06:45:58.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.911+0000 7f9f30c27640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f9f2c15d390 con 0x7f9f2c15c440 2024-09-19T06:45:58.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.911+0000 7f9f30c27640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f9f2c15caf0 con 0x7f9f2c073840 2024-09-19T06:45:58.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.911+0000 7f9f29d9b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9f2c15c440 0x7f9f2c0c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:58.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.911+0000 7f9f29d9b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9f2c15c440 0x7f9f2c0c9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55054/0 (socket says 172.21.15.86:55054) 2024-09-19T06:45:58.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.911+0000 7f9f29d9b640 1 -- 172.21.15.86:0/412079289 learned_addr learned my addr 172.21.15.86:0/412079289 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:45:58.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.911+0000 7f9f29d9b640 1 -- 172.21.15.86:0/412079289 >> v2:172.21.15.169:3300/0 conn(0x7f9f2c073840 msgr2=0x7f9f2c073cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:58.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.911+0000 7f9f2ad9d640 1 --2- 172.21.15.86:0/412079289 >> v2:172.21.15.169:3300/0 conn(0x7f9f2c073840 0x7f9f2c073cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:58.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.911+0000 7f9f29d9b640 1 --2- 172.21.15.86:0/412079289 >> v2:172.21.15.169:3300/0 conn(0x7f9f2c073840 0x7f9f2c073cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.911+0000 7f9f29d9b640 1 -- 172.21.15.86:0/412079289 >> v1:172.21.15.169:6789/0 conn(0x7f9f2c152fe0 legacy=0x7f9f2c1597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:58.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.911+0000 7f9f29d9b640 1 -- 172.21.15.86:0/412079289 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2c15cdd0 con 0x7f9f2c15c440 2024-09-19T06:45:58.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.912+0000 7f9f29d9b640 1 --2- 172.21.15.86:0/412079289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f2c15c440 0x7f9f2c0c9710 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9f20009870 tx=0x7f9f2002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8121f2a3b332fe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:58.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.912+0000 7f9f2959a640 1 -- 172.21.15.86:0/412079289 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f20037070 con 0x7f9f2c15c440 2024-09-19T06:45:58.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.912+0000 7f9f2959a640 1 -- 172.21.15.86:0/412079289 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f20032440 con 0x7f9f2c15c440 2024-09-19T06:45:58.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.912+0000 7f9f2959a640 1 -- 172.21.15.86:0/412079289 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f20032810 con 0x7f9f2c15c440 2024-09-19T06:45:58.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.912+0000 7f9f30c27640 1 -- 172.21.15.86:0/412079289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f2c15c440 msgr2=0x7f9f2c0c9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:58.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.912+0000 7f9f30c27640 1 --2- 172.21.15.86:0/412079289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f2c15c440 0x7f9f2c0c9710 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9f20009870 tx=0x7f9f2002a270 comp rx=0 tx=0).stop 2024-09-19T06:45:58.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.912+0000 7f9f30c27640 1 -- 172.21.15.86:0/412079289 shutdown_connections 2024-09-19T06:45:58.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.912+0000 7f9f30c27640 1 --2- 172.21.15.86:0/412079289 >> v2:172.21.15.169:3300/0 conn(0x7f9f2c073840 0x7f9f2c073cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.912+0000 7f9f30c27640 1 --2- 172.21.15.86:0/412079289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f2c15c440 0x7f9f2c0c9710 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.912+0000 7f9f30c27640 1 -- 172.21.15.86:0/412079289 >> 172.21.15.86:0/412079289 conn(0x7f9f2c067890 msgr2=0x7f9f2c067c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:58.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.912+0000 7f9f30c27640 1 -- 172.21.15.86:0/412079289 shutdown_connections 2024-09-19T06:45:58.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.912+0000 7f9f30c27640 1 -- 172.21.15.86:0/412079289 wait complete. 2024-09-19T06:45:58.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.914+0000 7f9f30c27640 1 Processor -- start 2024-09-19T06:45:58.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.914+0000 7f9f30c27640 1 -- start start 2024-09-19T06:45:58.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.914+0000 7f9f30c27640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f2c073840 0x7f9f2c0cda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.914+0000 7f9f30c27640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f2c152fe0 0x7f9f2c1e4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.914+0000 7f9f30c27640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f2c15c440 0x7f9f2c14d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.914+0000 7f9f30c27640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c1533c0 con 0x7f9f2c073840 2024-09-19T06:45:58.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.914+0000 7f9f30c27640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c158ff0 con 0x7f9f2c152fe0 2024-09-19T06:45:58.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.914+0000 7f9f30c27640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9f2c153540 con 0x7f9f2c15c440 2024-09-19T06:45:58.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.915+0000 7f9f2a59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f2c073840 0x7f9f2c0cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:58.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.915+0000 7f9f2a59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f2c073840 0x7f9f2c0cda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55066/0 (socket says 172.21.15.86:55066) 2024-09-19T06:45:58.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.915+0000 7f9f2a59c640 1 -- 172.21.15.86:0/861384208 learned_addr learned my addr 172.21.15.86:0/861384208 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:45:58.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.915+0000 7f9f2a59c640 1 -- 172.21.15.86:0/861384208 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f2c15c440 msgr2=0x7f9f2c14d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:58.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.915+0000 7f9f2a59c640 1 --2- 172.21.15.86:0/861384208 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f2c15c440 0x7f9f2c14d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.915+0000 7f9f2a59c640 1 -- 172.21.15.86:0/861384208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f2c152fe0 msgr2=0x7f9f2c1e4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:58.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.915+0000 7f9f2a59c640 1 --2- 172.21.15.86:0/861384208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f2c152fe0 0x7f9f2c1e4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.915+0000 7f9f2a59c640 1 -- 172.21.15.86:0/861384208 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2c1e4d60 con 0x7f9f2c073840 2024-09-19T06:45:58.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.915+0000 7f9f2a59c640 1 --2- 172.21.15.86:0/861384208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f2c073840 0x7f9f2c0cda70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00c440 tx=0x7f9f1c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:58.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.915+0000 7f9f1affd640 1 -- 172.21.15.86:0/861384208 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c017070 con 0x7f9f2c073840 2024-09-19T06:45:58.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.915+0000 7f9f1affd640 1 -- 172.21.15.86:0/861384208 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f1c0035f0 con 0x7f9f2c073840 2024-09-19T06:45:58.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.915+0000 7f9f1affd640 1 -- 172.21.15.86:0/861384208 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c0039e0 con 0x7f9f2c073840 2024-09-19T06:45:58.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.915+0000 7f9f30c27640 1 -- 172.21.15.86:0/861384208 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f2c1e23c0 con 0x7f9f2c073840 2024-09-19T06:45:58.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.915+0000 7f9f30c27640 1 -- 172.21.15.86:0/861384208 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f2c1e2980 con 0x7f9f2c073840 2024-09-19T06:45:58.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.916+0000 7f9f30c27640 1 -- 172.21.15.86:0/861384208 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f2c0708b0 con 0x7f9f2c073840 2024-09-19T06:45:58.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.917+0000 7f9f1affd640 1 -- 172.21.15.86:0/861384208 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9f1c003b80 con 0x7f9f2c073840 2024-09-19T06:45:58.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.917+0000 7f9f1affd640 1 --2- 172.21.15.86:0/861384208 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9f0c06c2b0 0x7f9f0c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.917+0000 7f9f1affd640 1 -- 172.21.15.86:0/861384208 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7165+0+0 (secure 0 0 0) 0x7f9f1c08aba0 con 0x7f9f2c073840 2024-09-19T06:45:58.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.917+0000 7f9f29d9b640 1 --2- 172.21.15.86:0/861384208 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9f0c06c2b0 0x7f9f0c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:58.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.918+0000 7f9f29d9b640 1 --2- 172.21.15.86:0/861384208 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9f0c06c2b0 0x7f9f0c06e770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9f20034000 tx=0x7f9f2002c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:58.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:58.921+0000 7f9f1affd640 1 -- 172.21.15.86:0/861384208 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9f1c058df0 con 0x7f9f2c073840 2024-09-19T06:45:59.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:59.130+0000 7f9f30c27640 1 -- 172.21.15.86:0/861384208 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f2c0c94f0 con 0x7f9f2c073840 2024-09-19T06:45:59.132 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:59.130+0000 7f9f1affd640 1 -- 172.21.15.86:0/861384208 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+6874 (secure 0 0 0) 0x7f9f1c0010c0 con 0x7f9f2c073840 2024-09-19T06:45:59.132 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:45:59.132 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":34,"btime":"2024-09-19T06:45:11:648449+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":5092,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/1148622307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1148622307},{"type":"v1","addr":"172.21.15.169:6837","nonce":1148622307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:44:57.575752+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"e","rank":0,"incarnation":30,"state":"up:active","state_seq":12,"addr":"172.21.15.86:6839/22518982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":22518982},{"type":"v1","addr":"172.21.15.86:6839","nonce":22518982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":1}]} 2024-09-19T06:45:59.132 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 34 2024-09-19T06:45:59.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:59.132+0000 7f9f30c27640 1 -- 172.21.15.86:0/861384208 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9f0c06c2b0 msgr2=0x7f9f0c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:59.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:59.132+0000 7f9f30c27640 1 --2- 172.21.15.86:0/861384208 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9f0c06c2b0 0x7f9f0c06e770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9f20034000 tx=0x7f9f2002c000 comp rx=0 tx=0).stop 2024-09-19T06:45:59.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:59.132+0000 7f9f30c27640 1 -- 172.21.15.86:0/861384208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f2c073840 msgr2=0x7f9f2c0cda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:59.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:59.132+0000 7f9f30c27640 1 --2- 172.21.15.86:0/861384208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f2c073840 0x7f9f2c0cda70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00c440 tx=0x7f9f1c00c900 comp rx=0 tx=0).stop 2024-09-19T06:45:59.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:59.132+0000 7f9f30c27640 1 -- 172.21.15.86:0/861384208 shutdown_connections 2024-09-19T06:45:59.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:59.132+0000 7f9f30c27640 1 --2- 172.21.15.86:0/861384208 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9f0c06c2b0 0x7f9f0c06e770 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:59.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:59.132+0000 7f9f30c27640 1 --2- 172.21.15.86:0/861384208 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f2c15c440 0x7f9f2c14d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:59.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:59.132+0000 7f9f30c27640 1 --2- 172.21.15.86:0/861384208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f2c152fe0 0x7f9f2c1e4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:59.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:59.132+0000 7f9f30c27640 1 --2- 172.21.15.86:0/861384208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f2c073840 0x7f9f2c0cda70 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:59.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:59.132+0000 7f9f30c27640 1 -- 172.21.15.86:0/861384208 >> 172.21.15.86:0/861384208 conn(0x7f9f2c067890 msgr2=0x7f9f2c157940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:59.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:59.132+0000 7f9f30c27640 1 -- 172.21.15.86:0/861384208 shutdown_connections 2024-09-19T06:45:59.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:45:59.132+0000 7f9f30c27640 1 -- 172.21.15.86:0/861384208 wait complete. 2024-09-19T06:45:59.145 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-09-19T06:46:01.146 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:46:01.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.255+0000 7f05f0627640 1 Processor -- start 2024-09-19T06:46:01.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.255+0000 7f05f0627640 1 -- start start 2024-09-19T06:46:01.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.256+0000 7f05f0627640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05e8155240 0x7f05e8072470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.256+0000 7f05f0627640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f05e815eb30 0x7f05e815efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.256+0000 7f05f0627640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05e8074210 con 0x7f05e8072020 2024-09-19T06:46:01.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.256+0000 7f05f0627640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f05e815bef0 con 0x7f05e815eb30 2024-09-19T06:46:01.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.256+0000 7f05f0627640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f05e80729b0 con 0x7f05e8155240 2024-09-19T06:46:01.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.256+0000 7f05eebc4640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f05e815eb30 0x7f05e815efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.256+0000 7f05ee3c3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05e8155240 0x7f05e8072470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.256+0000 7f05edbc2640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f05e8072020 0x7f05e8072c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:54220/0 (socket says 172.21.15.86:54220) 2024-09-19T06:46:01.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.256+0000 7f05edbc2640 1 -- 172.21.15.86:0/2960800128 learned_addr learned my addr 172.21.15.86:0/2960800128 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:46:01.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.257+0000 7f05eebc4640 1 -- 172.21.15.86:0/2960800128 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05e8155240 msgr2=0x7f05e8072470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:01.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.257+0000 7f05eebc4640 1 --2- 172.21.15.86:0/2960800128 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05e8155240 0x7f05e8072470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.257+0000 7f05eebc4640 1 -- 172.21.15.86:0/2960800128 >> v1:172.21.15.169:6789/0 conn(0x7f05e8072020 legacy=0x7f05e8072c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:01.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.257+0000 7f05eebc4640 1 -- 172.21.15.86:0/2960800128 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e815b370 con 0x7f05e815eb30 2024-09-19T06:46:01.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.257+0000 7f05ee3c3640 1 --2- 172.21.15.86:0/2960800128 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05e8155240 0x7f05e8072470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:01.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.258+0000 7f05eebc4640 1 --2- 172.21.15.86:0/2960800128 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05e815eb30 0x7f05e815efc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f05e0009d90 tx=0x7f05e002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=428b2bfcf3be3757 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:01.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.258+0000 7f05ed3c1640 1 -- 172.21.15.86:0/2960800128 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e0007740 con 0x7f05e815eb30 2024-09-19T06:46:01.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.258+0000 7f05ed3c1640 1 -- 172.21.15.86:0/2960800128 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e00078e0 con 0x7f05e815eb30 2024-09-19T06:46:01.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.258+0000 7f05ed3c1640 1 -- 172.21.15.86:0/2960800128 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e0007cb0 con 0x7f05e815eb30 2024-09-19T06:46:01.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.258+0000 7f05f0627640 1 -- 172.21.15.86:0/2960800128 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05e815eb30 msgr2=0x7f05e815efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:01.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.258+0000 7f05f0627640 1 --2- 172.21.15.86:0/2960800128 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05e815eb30 0x7f05e815efc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f05e0009d90 tx=0x7f05e002a660 comp rx=0 tx=0).stop 2024-09-19T06:46:01.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.258+0000 7f05f0627640 1 -- 172.21.15.86:0/2960800128 shutdown_connections 2024-09-19T06:46:01.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.258+0000 7f05f0627640 1 --2- 172.21.15.86:0/2960800128 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05e815eb30 0x7f05e815efc0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.258+0000 7f05f0627640 1 --2- 172.21.15.86:0/2960800128 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05e8155240 0x7f05e8072470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.258+0000 7f05f0627640 1 -- 172.21.15.86:0/2960800128 >> 172.21.15.86:0/2960800128 conn(0x7f05e80cdd80 msgr2=0x7f05e80ca220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:01.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.259+0000 7f05f0627640 1 -- 172.21.15.86:0/2960800128 shutdown_connections 2024-09-19T06:46:01.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.259+0000 7f05f0627640 1 -- 172.21.15.86:0/2960800128 wait complete. 2024-09-19T06:46:01.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.260+0000 7f05f0627640 1 Processor -- start 2024-09-19T06:46:01.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.260+0000 7f05f0627640 1 -- start start 2024-09-19T06:46:01.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.260+0000 7f05f0627640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e8072020 0x7f05e814c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.260+0000 7f05f0627640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05e8155240 0x7f05e814ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.260+0000 7f05f0627640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05e815eb30 0x7f05e814e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.260+0000 7f05f0627640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f05e815bc10 con 0x7f05e8072020 2024-09-19T06:46:01.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.260+0000 7f05f0627640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f05e815b930 con 0x7f05e815eb30 2024-09-19T06:46:01.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.260+0000 7f05f0627640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f05e815e610 con 0x7f05e8155240 2024-09-19T06:46:01.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.261+0000 7f05ee3c3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e8072020 0x7f05e814c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.261+0000 7f05ee3c3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e8072020 0x7f05e814c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55074/0 (socket says 172.21.15.86:55074) 2024-09-19T06:46:01.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.261+0000 7f05ee3c3640 1 -- 172.21.15.86:0/1347960545 learned_addr learned my addr 172.21.15.86:0/1347960545 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:01.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.261+0000 7f05eebc4640 1 --2- 172.21.15.86:0/1347960545 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05e815eb30 0x7f05e814e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.261+0000 7f05edbc2640 1 --2- 172.21.15.86:0/1347960545 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05e8155240 0x7f05e814ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.261+0000 7f05ee3c3640 1 -- 172.21.15.86:0/1347960545 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05e8155240 msgr2=0x7f05e814ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:01.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.261+0000 7f05ee3c3640 1 --2- 172.21.15.86:0/1347960545 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05e8155240 0x7f05e814ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.261+0000 7f05ee3c3640 1 -- 172.21.15.86:0/1347960545 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05e815eb30 msgr2=0x7f05e814e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:01.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.261+0000 7f05ee3c3640 1 --2- 172.21.15.86:0/1347960545 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05e815eb30 0x7f05e814e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.261+0000 7f05ee3c3640 1 -- 172.21.15.86:0/1347960545 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e8157770 con 0x7f05e8072020 2024-09-19T06:46:01.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.261+0000 7f05ee3c3640 1 --2- 172.21.15.86:0/1347960545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e8072020 0x7f05e814c0c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f05d800ebe0 tx=0x7f05d800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:01.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.261+0000 7f05deffd640 1 -- 172.21.15.86:0/1347960545 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d8017070 con 0x7f05e8072020 2024-09-19T06:46:01.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.261+0000 7f05deffd640 1 -- 172.21.15.86:0/1347960545 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d800cc30 con 0x7f05e8072020 2024-09-19T06:46:01.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.261+0000 7f05f0627640 1 -- 172.21.15.86:0/1347960545 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e814c600 con 0x7f05e8072020 2024-09-19T06:46:01.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.261+0000 7f05deffd640 1 -- 172.21.15.86:0/1347960545 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d8013470 con 0x7f05e8072020 2024-09-19T06:46:01.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.261+0000 7f05f0627640 1 -- 172.21.15.86:0/1347960545 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e81f1d10 con 0x7f05e8072020 2024-09-19T06:46:01.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.262+0000 7f05f0627640 1 -- 172.21.15.86:0/1347960545 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05e8069630 con 0x7f05e8072020 2024-09-19T06:46:01.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.263+0000 7f05deffd640 1 -- 172.21.15.86:0/1347960545 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f05d801a070 con 0x7f05e8072020 2024-09-19T06:46:01.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.263+0000 7f05deffd640 1 --2- 172.21.15.86:0/1347960545 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f05cc06c2b0 0x7f05cc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.263+0000 7f05deffd640 1 -- 172.21.15.86:0/1347960545 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7f05d808b9d0 con 0x7f05e8072020 2024-09-19T06:46:01.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.263+0000 7f05edbc2640 1 --2- 172.21.15.86:0/1347960545 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f05cc06c2b0 0x7f05cc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.264+0000 7f05edbc2640 1 --2- 172.21.15.86:0/1347960545 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f05cc06c2b0 0x7f05cc06e770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f05e8149d80 tx=0x7f05e4007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:01.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.268+0000 7f05deffd640 1 -- 172.21.15.86:0/1347960545 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f05e8069630 con 0x7f05e8072020 2024-09-19T06:46:01.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.479+0000 7f05f0627640 1 -- 172.21.15.86:0/1347960545 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05e8155620 con 0x7f05e8072020 2024-09-19T06:46:01.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.479+0000 7f05deffd640 1 -- 172.21.15.86:0/1347960545 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+6047 (secure 0 0 0) 0x7f05d8059450 con 0x7f05e8072020 2024-09-19T06:46:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:46:01.482 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":35,"btime":"2024-09-19T06:46:00:558535+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:46:00.558532+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5092},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5092":{"gid":5092,"name":"d","rank":0,"incarnation":35,"state":"up:replay","state_seq":1,"addr":"172.21.15.169:6837/1148622307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1148622307},{"type":"v1","addr":"172.21.15.169:6837","nonce":1148622307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:46:01.482 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 35 2024-09-19T06:46:01.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.482+0000 7f05f0627640 1 -- 172.21.15.86:0/1347960545 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f05cc06c2b0 msgr2=0x7f05cc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:01.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.482+0000 7f05f0627640 1 --2- 172.21.15.86:0/1347960545 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f05cc06c2b0 0x7f05cc06e770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f05e8149d80 tx=0x7f05e4007e80 comp rx=0 tx=0).stop 2024-09-19T06:46:01.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.482+0000 7f05f0627640 1 -- 172.21.15.86:0/1347960545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e8072020 msgr2=0x7f05e814c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:01.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.482+0000 7f05f0627640 1 --2- 172.21.15.86:0/1347960545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e8072020 0x7f05e814c0c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f05d800ebe0 tx=0x7f05d800c520 comp rx=0 tx=0).stop 2024-09-19T06:46:01.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.482+0000 7f05f0627640 1 -- 172.21.15.86:0/1347960545 shutdown_connections 2024-09-19T06:46:01.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.482+0000 7f05f0627640 1 --2- 172.21.15.86:0/1347960545 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f05cc06c2b0 0x7f05cc06e770 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.482+0000 7f05f0627640 1 --2- 172.21.15.86:0/1347960545 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05e815eb30 0x7f05e814e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.482+0000 7f05f0627640 1 --2- 172.21.15.86:0/1347960545 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05e8155240 0x7f05e814ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.482+0000 7f05f0627640 1 --2- 172.21.15.86:0/1347960545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e8072020 0x7f05e814c0c0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.482+0000 7f05f0627640 1 -- 172.21.15.86:0/1347960545 >> 172.21.15.86:0/1347960545 conn(0x7f05e80cdd80 msgr2=0x7f05e8072bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:01.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.482+0000 7f05f0627640 1 -- 172.21.15.86:0/1347960545 shutdown_connections 2024-09-19T06:46:01.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.482+0000 7f05f0627640 1 -- 172.21.15.86:0/1347960545 wait complete. 2024-09-19T06:46:01.494 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e down, removed from mdsmap 2024-09-19T06:46:01.494 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-09-19T06:46:01.494 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:46:01.594 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.593+0000 7f719ab91640 1 Processor -- start 2024-09-19T06:46:01.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.593+0000 7f719ab91640 1 -- start start 2024-09-19T06:46:01.596 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.594+0000 7f719ab91640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f71940c9a60 0x7f71940c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.596 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.594+0000 7f719ab91640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f71940c9e40 0x7f71940c8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.596 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.594+0000 7f719ab91640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71940c8d80 con 0x7f7194073120 2024-09-19T06:46:01.596 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.594+0000 7f719ab91640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f7194159c80 con 0x7f71940c9a60 2024-09-19T06:46:01.596 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.594+0000 7f719ab91640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f71940c9060 con 0x7f71940c9e40 2024-09-19T06:46:01.596 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.594+0000 7f7193fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f71940c9e40 0x7f71940c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.594+0000 7f719892d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f71940c9a60 0x7f71940c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.594+0000 7f719912e640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f7194073120 0x7f719413b3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:54224/0 (socket says 172.21.15.86:54224) 2024-09-19T06:46:01.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.594+0000 7f719912e640 1 -- 172.21.15.86:0/3489254130 learned_addr learned my addr 172.21.15.86:0/3489254130 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:46:01.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.595+0000 7f71937fe640 1 -- 172.21.15.86:0/3489254130 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3828594958 0 0) 0x7f71940c8d80 con 0x7f7194073120 2024-09-19T06:46:01.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.595+0000 7f71937fe640 1 -- 172.21.15.86:0/3489254130 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7184003520 con 0x7f7194073120 2024-09-19T06:46:01.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.595+0000 7f719892d640 1 -- 172.21.15.86:0/3489254130 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f71940c9e40 msgr2=0x7f71940c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:01.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.595+0000 7f719892d640 1 --2- 172.21.15.86:0/3489254130 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f71940c9e40 0x7f71940c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.595+0000 7f719892d640 1 -- 172.21.15.86:0/3489254130 >> v1:172.21.15.169:6789/0 conn(0x7f7194073120 legacy=0x7f719413b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:01.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.595+0000 7f719892d640 1 -- 172.21.15.86:0/3489254130 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7194158ec0 con 0x7f71940c9a60 2024-09-19T06:46:01.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.595+0000 7f719892d640 1 --2- 172.21.15.86:0/3489254130 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71940c9a60 0x7f71940c6b00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f71880097d0 tx=0x7f718802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ad11bbf81a5c37c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:01.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.596+0000 7f71937fe640 1 -- 172.21.15.86:0/3489254130 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7188037070 con 0x7f71940c9a60 2024-09-19T06:46:01.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.596+0000 7f71937fe640 1 -- 172.21.15.86:0/3489254130 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f718802ae40 con 0x7f71940c9a60 2024-09-19T06:46:01.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.596+0000 7f71937fe640 1 -- 172.21.15.86:0/3489254130 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7188032660 con 0x7f71940c9a60 2024-09-19T06:46:01.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.596+0000 7f719ab91640 1 -- 172.21.15.86:0/3489254130 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71940c9a60 msgr2=0x7f71940c6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:01.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.596+0000 7f719ab91640 1 --2- 172.21.15.86:0/3489254130 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71940c9a60 0x7f71940c6b00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f71880097d0 tx=0x7f718802a130 comp rx=0 tx=0).stop 2024-09-19T06:46:01.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.596+0000 7f719ab91640 1 -- 172.21.15.86:0/3489254130 shutdown_connections 2024-09-19T06:46:01.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.596+0000 7f719ab91640 1 --2- 172.21.15.86:0/3489254130 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f71940c9e40 0x7f71940c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.596+0000 7f719ab91640 1 --2- 172.21.15.86:0/3489254130 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71940c9a60 0x7f71940c6b00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.596+0000 7f719ab91640 1 -- 172.21.15.86:0/3489254130 >> 172.21.15.86:0/3489254130 conn(0x7f7194070c30 msgr2=0x7f7194071040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:01.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.596+0000 7f719ab91640 1 -- 172.21.15.86:0/3489254130 shutdown_connections 2024-09-19T06:46:01.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.596+0000 7f719ab91640 1 -- 172.21.15.86:0/3489254130 wait complete. 2024-09-19T06:46:01.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.597+0000 7f719ab91640 1 Processor -- start 2024-09-19T06:46:01.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.598+0000 7f719ab91640 1 -- start start 2024-09-19T06:46:01.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.598+0000 7f719ab91640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7194073120 0x7f71941f2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.598+0000 7f719ab91640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f71940c9a60 0x7f71941e5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.598+0000 7f719ab91640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71940c9e40 0x7f7194153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.598+0000 7f719ab91640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7194159480 con 0x7f7194073120 2024-09-19T06:46:01.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.598+0000 7f719ab91640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f71941597f0 con 0x7f71940c9e40 2024-09-19T06:46:01.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.598+0000 7f719ab91640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7194071a10 con 0x7f71940c9a60 2024-09-19T06:46:01.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.598+0000 7f719892d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7194073120 0x7f71941f2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.599+0000 7f719892d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7194073120 0x7f71941f2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55090/0 (socket says 172.21.15.86:55090) 2024-09-19T06:46:01.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.599+0000 7f719892d640 1 -- 172.21.15.86:0/111103261 learned_addr learned my addr 172.21.15.86:0/111103261 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:01.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.599+0000 7f719912e640 1 --2- 172.21.15.86:0/111103261 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71940c9e40 0x7f7194153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.599+0000 7f7193fff640 1 --2- 172.21.15.86:0/111103261 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f71940c9a60 0x7f71941e5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.599+0000 7f719892d640 1 -- 172.21.15.86:0/111103261 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f71940c9a60 msgr2=0x7f71941e5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:01.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.599+0000 7f719892d640 1 --2- 172.21.15.86:0/111103261 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f71940c9a60 0x7f71941e5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.599+0000 7f719892d640 1 -- 172.21.15.86:0/111103261 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71940c9e40 msgr2=0x7f7194153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:01.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.599+0000 7f719892d640 1 --2- 172.21.15.86:0/111103261 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71940c9e40 0x7f7194153c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.599+0000 7f719892d640 1 -- 172.21.15.86:0/111103261 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7194156920 con 0x7f7194073120 2024-09-19T06:46:01.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.599+0000 7f719912e640 1 --2- 172.21.15.86:0/111103261 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71940c9e40 0x7f7194153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:01.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.599+0000 7f719892d640 1 --2- 172.21.15.86:0/111103261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7194073120 0x7f71941f2cb0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f71880098f0 tx=0x7f71880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:01.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.599+0000 7f71917fa640 1 -- 172.21.15.86:0/111103261 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7188041030 con 0x7f7194073120 2024-09-19T06:46:01.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.599+0000 7f71917fa640 1 -- 172.21.15.86:0/111103261 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f718802ac40 con 0x7f7194073120 2024-09-19T06:46:01.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.599+0000 7f719ab91640 1 -- 172.21.15.86:0/111103261 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7194155dc0 con 0x7f7194073120 2024-09-19T06:46:01.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.599+0000 7f71917fa640 1 -- 172.21.15.86:0/111103261 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7188037040 con 0x7f7194073120 2024-09-19T06:46:01.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.599+0000 7f719ab91640 1 -- 172.21.15.86:0/111103261 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7194156360 con 0x7f7194073120 2024-09-19T06:46:01.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.600+0000 7f719ab91640 1 -- 172.21.15.86:0/111103261 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71940c6b00 con 0x7f7194073120 2024-09-19T06:46:01.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.601+0000 7f71917fa640 1 -- 172.21.15.86:0/111103261 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7188044070 con 0x7f7194073120 2024-09-19T06:46:01.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.601+0000 7f71917fa640 1 --2- 172.21.15.86:0/111103261 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f717806c2b0 0x7f717806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.601+0000 7f7193fff640 1 --2- 172.21.15.86:0/111103261 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f717806c2b0 0x7f717806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.601+0000 7f71917fa640 1 -- 172.21.15.86:0/111103261 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7f71880ac120 con 0x7f7194073120 2024-09-19T06:46:01.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.602+0000 7f7193fff640 1 --2- 172.21.15.86:0/111103261 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f717806c2b0 0x7f717806e770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f71941e4280 tx=0x7f7180008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:01.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.609+0000 7f71917fa640 1 -- 172.21.15.86:0/111103261 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7188044e40 con 0x7f7194073120 2024-09-19T06:46:01.820 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.819+0000 7f719ab91640 1 -- 172.21.15.86:0/111103261 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71940776b0 con 0x7f7194073120 2024-09-19T06:46:01.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.820+0000 7f71917fa640 1 -- 172.21.15.86:0/111103261 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+6047 (secure 0 0 0) 0x7f718807a170 con 0x7f7194073120 2024-09-19T06:46:01.821 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:46:01.821 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":35,"btime":"2024-09-19T06:46:00:558535+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:46:00.558532+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5092},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5092":{"gid":5092,"name":"d","rank":0,"incarnation":35,"state":"up:replay","state_seq":1,"addr":"172.21.15.169:6837/1148622307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1148622307},{"type":"v1","addr":"172.21.15.169:6837","nonce":1148622307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:46:01.822 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 35 2024-09-19T06:46:01.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.822+0000 7f719ab91640 1 -- 172.21.15.86:0/111103261 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f717806c2b0 msgr2=0x7f717806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:01.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.822+0000 7f719ab91640 1 --2- 172.21.15.86:0/111103261 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f717806c2b0 0x7f717806e770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f71941e4280 tx=0x7f7180008040 comp rx=0 tx=0).stop 2024-09-19T06:46:01.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.822+0000 7f719ab91640 1 -- 172.21.15.86:0/111103261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7194073120 msgr2=0x7f71941f2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:01.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.822+0000 7f719ab91640 1 --2- 172.21.15.86:0/111103261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7194073120 0x7f71941f2cb0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f71880098f0 tx=0x7f71880046c0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.822+0000 7f719ab91640 1 -- 172.21.15.86:0/111103261 shutdown_connections 2024-09-19T06:46:01.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.822+0000 7f719ab91640 1 --2- 172.21.15.86:0/111103261 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f717806c2b0 0x7f717806e770 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.822+0000 7f719ab91640 1 --2- 172.21.15.86:0/111103261 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71940c9e40 0x7f7194153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.822+0000 7f719ab91640 1 --2- 172.21.15.86:0/111103261 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f71940c9a60 0x7f71941e5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.822+0000 7f719ab91640 1 --2- 172.21.15.86:0/111103261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7194073120 0x7f71941f2cb0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.822+0000 7f719ab91640 1 -- 172.21.15.86:0/111103261 >> 172.21.15.86:0/111103261 conn(0x7f7194070c30 msgr2=0x7f71940cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:01.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.822+0000 7f719ab91640 1 -- 172.21.15.86:0/111103261 shutdown_connections 2024-09-19T06:46:01.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:01.822+0000 7f719ab91640 1 -- 172.21.15.86:0/111103261 wait complete. 2024-09-19T06:46:01.835 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "btime": "2024-09-19T06:46:00:558535+0000", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 35, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-19T06:37:08.763572+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 35, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_5092": { "addr": "172.21.15.169:6837/1148622307", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6836", "nonce": 1148622307, "type": "v2" }, { "addr": "172.21.15.169:6837", "nonce": 1148622307, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5092, "incarnation": 35, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 34, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-09-19T06:46:00.558532+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5092 } } } ], "standbys": [ { "addr": "172.21.15.86:6837/728803297", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6835", "nonce": 728803297, "type": "v2" }, { "addr": "172.21.15.86:6837", "nonce": 728803297, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4247, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.169:6835/2537509253", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6833", "nonce": 2537509253, "type": "v2" }, { "addr": "172.21.15.169:6835", "nonce": 2537509253, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4262, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.169:6834/1723647527", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6832", "nonce": 1723647527, "type": "v2" }, { "addr": "172.21.15.169:6834", "nonce": 1723647527, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4265, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.86:6836/4135959816", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6834", "nonce": 4135959816, "type": "v2" }, { "addr": "172.21.15.86:6836", "nonce": 4135959816, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4270, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-09-19T06:46:03.836 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:46:03.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.936+0000 7fc3c413b640 1 Processor -- start 2024-09-19T06:46:03.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.937+0000 7fc3c413b640 1 -- start start 2024-09-19T06:46:03.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.937+0000 7fc3c413b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3bc155200 0x7fc3bc15afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.937+0000 7fc3c413b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc3bc0ca020 0x7fc3bc15e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.937+0000 7fc3c413b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3bc15ec10 con 0x7fc3bc154e20 2024-09-19T06:46:03.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.937+0000 7fc3c413b640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fc3bc15eed0 con 0x7fc3bc0ca020 2024-09-19T06:46:03.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.937+0000 7fc3c413b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc3bc15f1b0 con 0x7fc3bc155200 2024-09-19T06:46:03.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.937+0000 7fc3c26d8640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc3bc0ca020 0x7fc3bc15e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.938+0000 7fc3c26d8640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc3bc0ca020 0x7fc3bc15e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36932/0 (socket says 172.21.15.86:36932) 2024-09-19T06:46:03.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.938+0000 7fc3c26d8640 1 -- 172.21.15.86:0/4277387390 learned_addr learned my addr 172.21.15.86:0/4277387390 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:03.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.938+0000 7fc3c16d6640 1 --2- 172.21.15.86:0/4277387390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3bc155200 0x7fc3bc15afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.938+0000 7fc3c26d8640 1 -- 172.21.15.86:0/4277387390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3bc155200 msgr2=0x7fc3bc15afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:03.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.938+0000 7fc3c26d8640 1 --2- 172.21.15.86:0/4277387390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3bc155200 0x7fc3bc15afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.938+0000 7fc3c26d8640 1 -- 172.21.15.86:0/4277387390 >> v1:172.21.15.169:6789/0 conn(0x7fc3bc154e20 legacy=0x7fc3bc073840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:03.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.938+0000 7fc3c26d8640 1 -- 172.21.15.86:0/4277387390 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3bc15f490 con 0x7fc3bc0ca020 2024-09-19T06:46:03.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.939+0000 7fc3c26d8640 1 --2- 172.21.15.86:0/4277387390 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3bc0ca020 0x7fc3bc15e5b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009e50 tx=0x7fc3b402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90430e8e03d73e91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:03.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.939+0000 7fc3c0ed5640 1 -- 172.21.15.86:0/4277387390 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4036070 con 0x7fc3bc0ca020 2024-09-19T06:46:03.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.939+0000 7fc3c0ed5640 1 -- 172.21.15.86:0/4277387390 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b4031600 con 0x7fc3bc0ca020 2024-09-19T06:46:03.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.939+0000 7fc3c0ed5640 1 -- 172.21.15.86:0/4277387390 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b40319d0 con 0x7fc3bc0ca020 2024-09-19T06:46:03.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.940+0000 7fc3c413b640 1 -- 172.21.15.86:0/4277387390 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3bc0ca020 msgr2=0x7fc3bc15e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:03.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.940+0000 7fc3c413b640 1 --2- 172.21.15.86:0/4277387390 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3bc0ca020 0x7fc3bc15e5b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009e50 tx=0x7fc3b402a7a0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.940+0000 7fc3c413b640 1 -- 172.21.15.86:0/4277387390 shutdown_connections 2024-09-19T06:46:03.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.940+0000 7fc3c413b640 1 --2- 172.21.15.86:0/4277387390 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3bc0ca020 0x7fc3bc15e5b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.940+0000 7fc3c413b640 1 --2- 172.21.15.86:0/4277387390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3bc155200 0x7fc3bc15afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.940+0000 7fc3c413b640 1 -- 172.21.15.86:0/4277387390 >> 172.21.15.86:0/4277387390 conn(0x7fc3bc067890 msgr2=0x7fc3bc067c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:03.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.940+0000 7fc3c413b640 1 -- 172.21.15.86:0/4277387390 shutdown_connections 2024-09-19T06:46:03.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.940+0000 7fc3c413b640 1 -- 172.21.15.86:0/4277387390 wait complete. 2024-09-19T06:46:03.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.941+0000 7fc3c413b640 1 Processor -- start 2024-09-19T06:46:03.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.941+0000 7fc3c413b640 1 -- start start 2024-09-19T06:46:03.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.942+0000 7fc3c413b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3bc0ca020 0x7fc3bc155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.942+0000 7fc3c413b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3bc154e20 0x7fc3bc0c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.942+0000 7fc3c413b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3bc155200 0x7fc3bc14f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.942+0000 7fc3c413b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc070f10 con 0x7fc3bc155200 2024-09-19T06:46:03.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.942+0000 7fc3c413b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc070c30 con 0x7fc3bc0ca020 2024-09-19T06:46:03.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.942+0000 7fc3c413b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc3bc0c9460 con 0x7fc3bc154e20 2024-09-19T06:46:03.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.942+0000 7fc3c26d8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3bc155200 0x7fc3bc14f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.942+0000 7fc3c26d8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3bc155200 0x7fc3bc14f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36936/0 (socket says 172.21.15.86:36936) 2024-09-19T06:46:03.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.942+0000 7fc3c26d8640 1 -- 172.21.15.86:0/4190816406 learned_addr learned my addr 172.21.15.86:0/4190816406 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:03.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.942+0000 7fc3c16d6640 1 --2- 172.21.15.86:0/4190816406 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3bc154e20 0x7fc3bc0c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.942+0000 7fc3c1ed7640 1 --2- 172.21.15.86:0/4190816406 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3bc0ca020 0x7fc3bc155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.942+0000 7fc3c26d8640 1 -- 172.21.15.86:0/4190816406 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3bc154e20 msgr2=0x7fc3bc0c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:03.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.942+0000 7fc3c26d8640 1 --2- 172.21.15.86:0/4190816406 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3bc154e20 0x7fc3bc0c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.942+0000 7fc3c26d8640 1 -- 172.21.15.86:0/4190816406 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3bc0ca020 msgr2=0x7fc3bc155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:03.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.942+0000 7fc3c26d8640 1 --2- 172.21.15.86:0/4190816406 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3bc0ca020 0x7fc3bc155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.942+0000 7fc3c26d8640 1 -- 172.21.15.86:0/4190816406 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3bc0c70b0 con 0x7fc3bc155200 2024-09-19T06:46:03.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.942+0000 7fc3c26d8640 1 --2- 172.21.15.86:0/4190816406 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3bc155200 0x7fc3bc14f540 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4034040 tx=0x7fc3b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:03.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.942+0000 7fc3b27fc640 1 -- 172.21.15.86:0/4190816406 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4036050 con 0x7fc3bc155200 2024-09-19T06:46:03.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.942+0000 7fc3b27fc640 1 -- 172.21.15.86:0/4190816406 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b4042070 con 0x7fc3bc155200 2024-09-19T06:46:03.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.942+0000 7fc3c413b640 1 -- 172.21.15.86:0/4190816406 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3bc15ab70 con 0x7fc3bc155200 2024-09-19T06:46:03.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.942+0000 7fc3b27fc640 1 -- 172.21.15.86:0/4190816406 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4009510 con 0x7fc3bc155200 2024-09-19T06:46:03.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.943+0000 7fc3c413b640 1 -- 172.21.15.86:0/4190816406 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3bc15a890 con 0x7fc3bc155200 2024-09-19T06:46:03.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.944+0000 7fc3c413b640 1 -- 172.21.15.86:0/4190816406 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3bc15e5b0 con 0x7fc3bc155200 2024-09-19T06:46:03.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.944+0000 7fc3b27fc640 1 -- 172.21.15.86:0/4190816406 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc3b4007bf0 con 0x7fc3bc155200 2024-09-19T06:46:03.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.945+0000 7fc3b27fc640 1 --2- 172.21.15.86:0/4190816406 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc3a006c2b0 0x7fc3a006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.945+0000 7fc3b27fc640 1 -- 172.21.15.86:0/4190816406 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7fc3b40ac600 con 0x7fc3bc155200 2024-09-19T06:46:03.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.945+0000 7fc3c1ed7640 1 --2- 172.21.15.86:0/4190816406 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc3a006c2b0 0x7fc3a006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.945+0000 7fc3c1ed7640 1 --2- 172.21.15.86:0/4190816406 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc3a006c2b0 0x7fc3a006e770 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8001780 tx=0x7fc3b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:03.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:03.949+0000 7fc3b27fc640 1 -- 172.21.15.86:0/4190816406 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc3b407a2c0 con 0x7fc3bc155200 2024-09-19T06:46:04.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:04.159+0000 7fc3c413b640 1 -- 172.21.15.86:0/4190816406 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3bc06e3d0 con 0x7fc3bc155200 2024-09-19T06:46:04.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:04.160+0000 7fc3b27fc640 1 -- 172.21.15.86:0/4190816406 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+6047 (secure 0 0 0) 0x7fc3b407e5c0 con 0x7fc3bc155200 2024-09-19T06:46:04.161 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:46:04.162 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":35,"btime":"2024-09-19T06:46:00:558535+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:46:00.558532+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5092},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5092":{"gid":5092,"name":"d","rank":0,"incarnation":35,"state":"up:replay","state_seq":1,"addr":"172.21.15.169:6837/1148622307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1148622307},{"type":"v1","addr":"172.21.15.169:6837","nonce":1148622307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:46:04.162 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 35 2024-09-19T06:46:04.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:04.162+0000 7fc3c413b640 1 -- 172.21.15.86:0/4190816406 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc3a006c2b0 msgr2=0x7fc3a006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:04.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:04.162+0000 7fc3c413b640 1 --2- 172.21.15.86:0/4190816406 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc3a006c2b0 0x7fc3a006e770 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8001780 tx=0x7fc3b8009040 comp rx=0 tx=0).stop 2024-09-19T06:46:04.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:04.162+0000 7fc3c413b640 1 -- 172.21.15.86:0/4190816406 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3bc155200 msgr2=0x7fc3bc14f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:04.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:04.162+0000 7fc3c413b640 1 --2- 172.21.15.86:0/4190816406 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3bc155200 0x7fc3bc14f540 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4034040 tx=0x7fc3b4004a40 comp rx=0 tx=0).stop 2024-09-19T06:46:04.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:04.162+0000 7fc3c413b640 1 -- 172.21.15.86:0/4190816406 shutdown_connections 2024-09-19T06:46:04.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:04.162+0000 7fc3c413b640 1 --2- 172.21.15.86:0/4190816406 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc3a006c2b0 0x7fc3a006e770 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:04.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:04.162+0000 7fc3c413b640 1 --2- 172.21.15.86:0/4190816406 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3bc155200 0x7fc3bc14f540 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:04.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:04.162+0000 7fc3c413b640 1 --2- 172.21.15.86:0/4190816406 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3bc154e20 0x7fc3bc0c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:04.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:04.162+0000 7fc3c413b640 1 --2- 172.21.15.86:0/4190816406 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3bc0ca020 0x7fc3bc155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:04.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:04.162+0000 7fc3c413b640 1 -- 172.21.15.86:0/4190816406 >> 172.21.15.86:0/4190816406 conn(0x7fc3bc067890 msgr2=0x7fc3bc0cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:04.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:04.162+0000 7fc3c413b640 1 -- 172.21.15.86:0/4190816406 shutdown_connections 2024-09-19T06:46:04.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:04.162+0000 7fc3c413b640 1 -- 172.21.15.86:0/4190816406 wait complete. 2024-09-19T06:46:04.174 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:46:06.175 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:46:06.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.274+0000 7fc504f7f640 1 Processor -- start 2024-09-19T06:46:06.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.274+0000 7fc504f7f640 1 -- start start 2024-09-19T06:46:06.277 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.275+0000 7fc504f7f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5000d0d40 0x7fc5000ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:06.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.275+0000 7fc504f7f640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc5000d1120 0x7fc5000cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:06.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.275+0000 7fc504f7f640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc50015da60 0x7fc50015df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:06.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.275+0000 7fc504f7f640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fc50015c770 con 0x7fc5000d1120 2024-09-19T06:46:06.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.275+0000 7fc504f7f640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fc50015e450 con 0x7fc50015da60 2024-09-19T06:46:06.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.275+0000 7fc504f7f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc5000b3f20 con 0x7fc5000d0d40 2024-09-19T06:46:06.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.275+0000 7fc4fdd9b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc5000d1120 0x7fc5000cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:06.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.275+0000 7fc4fdd9b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc5000d1120 0x7fc5000cac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36952/0 (socket says 172.21.15.86:36952) 2024-09-19T06:46:06.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.275+0000 7fc4fdd9b640 1 -- 172.21.15.86:0/4232824966 learned_addr learned my addr 172.21.15.86:0/4232824966 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:06.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.276+0000 7fc4fed9d640 1 --2- 172.21.15.86:0/4232824966 >> v2:172.21.15.169:3300/0 conn(0x7fc50015da60 0x7fc50015df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:06.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.276+0000 7fc4fe59c640 1 --2- 172.21.15.86:0/4232824966 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5000d0d40 0x7fc5000ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:06.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.276+0000 7fc4fdd9b640 1 -- 172.21.15.86:0/4232824966 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5000d0d40 msgr2=0x7fc5000ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:06.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.276+0000 7fc4fdd9b640 1 --2- 172.21.15.86:0/4232824966 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5000d0d40 0x7fc5000ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.276+0000 7fc4fdd9b640 1 -- 172.21.15.86:0/4232824966 >> v2:172.21.15.169:3300/0 conn(0x7fc50015da60 msgr2=0x7fc50015df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:06.279 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.276+0000 7fc4fdd9b640 1 --2- 172.21.15.86:0/4232824966 >> v2:172.21.15.169:3300/0 conn(0x7fc50015da60 0x7fc50015df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.279 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.276+0000 7fc4fdd9b640 1 -- 172.21.15.86:0/4232824966 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50015c9c0 con 0x7fc5000d1120 2024-09-19T06:46:06.279 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.276+0000 7fc4fdd9b640 1 --2- 172.21.15.86:0/4232824966 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5000d1120 0x7fc5000cac00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc5000d1a20 tx=0x7fc4e802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ffd5e24e69d904 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:06.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.277+0000 7fc4fd59a640 1 -- 172.21.15.86:0/4232824966 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8037070 con 0x7fc5000d1120 2024-09-19T06:46:06.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.277+0000 7fc4fd59a640 1 -- 172.21.15.86:0/4232824966 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e8032440 con 0x7fc5000d1120 2024-09-19T06:46:06.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.277+0000 7fc4fd59a640 1 -- 172.21.15.86:0/4232824966 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8032810 con 0x7fc5000d1120 2024-09-19T06:46:06.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.277+0000 7fc504f7f640 1 -- 172.21.15.86:0/4232824966 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5000d1120 msgr2=0x7fc5000cac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:06.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.277+0000 7fc504f7f640 1 --2- 172.21.15.86:0/4232824966 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5000d1120 0x7fc5000cac00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc5000d1a20 tx=0x7fc4e802a1e0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.277+0000 7fc504f7f640 1 -- 172.21.15.86:0/4232824966 shutdown_connections 2024-09-19T06:46:06.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.277+0000 7fc504f7f640 1 --2- 172.21.15.86:0/4232824966 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5000d1120 0x7fc5000cac00 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.277+0000 7fc504f7f640 1 --2- 172.21.15.86:0/4232824966 >> v2:172.21.15.169:3300/0 conn(0x7fc50015da60 0x7fc50015df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.277+0000 7fc504f7f640 1 --2- 172.21.15.86:0/4232824966 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5000d0d40 0x7fc5000ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.277+0000 7fc504f7f640 1 -- 172.21.15.86:0/4232824966 >> 172.21.15.86:0/4232824966 conn(0x7fc50006d910 msgr2=0x7fc50006dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:06.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.277+0000 7fc504f7f640 1 -- 172.21.15.86:0/4232824966 shutdown_connections 2024-09-19T06:46:06.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.277+0000 7fc504f7f640 1 -- 172.21.15.86:0/4232824966 wait complete. 2024-09-19T06:46:06.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.279+0000 7fc504f7f640 1 Processor -- start 2024-09-19T06:46:06.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.279+0000 7fc504f7f640 1 -- start start 2024-09-19T06:46:06.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.279+0000 7fc504f7f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5000d0d40 0x7fc5001f4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:06.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.279+0000 7fc504f7f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5000d1120 0x7fc50015be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:06.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.279+0000 7fc504f7f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc50015da60 0x7fc5000c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:06.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.279+0000 7fc504f7f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc50015d260 con 0x7fc5000d0d40 2024-09-19T06:46:06.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.279+0000 7fc504f7f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc50015cf80 con 0x7fc50015da60 2024-09-19T06:46:06.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.279+0000 7fc504f7f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc5000b4b60 con 0x7fc5000d1120 2024-09-19T06:46:06.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.279+0000 7fc4fe59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5000d0d40 0x7fc5001f4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:06.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.279+0000 7fc4fe59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5000d0d40 0x7fc5001f4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36958/0 (socket says 172.21.15.86:36958) 2024-09-19T06:46:06.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.279+0000 7fc4fe59c640 1 -- 172.21.15.86:0/2592419237 learned_addr learned my addr 172.21.15.86:0/2592419237 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:06.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.279+0000 7fc4fdd9b640 1 --2- 172.21.15.86:0/2592419237 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5000d1120 0x7fc50015be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:06.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.280+0000 7fc4fed9d640 1 --2- 172.21.15.86:0/2592419237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc50015da60 0x7fc5000c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:06.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.280+0000 7fc4fe59c640 1 -- 172.21.15.86:0/2592419237 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5000d1120 msgr2=0x7fc50015be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:06.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.280+0000 7fc4fe59c640 1 --2- 172.21.15.86:0/2592419237 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5000d1120 0x7fc50015be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.280+0000 7fc4fe59c640 1 -- 172.21.15.86:0/2592419237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc50015da60 msgr2=0x7fc5000c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:06.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.280+0000 7fc4fe59c640 1 --2- 172.21.15.86:0/2592419237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc50015da60 0x7fc5000c70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.280+0000 7fc4fe59c640 1 -- 172.21.15.86:0/2592419237 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5001f0be0 con 0x7fc5000d0d40 2024-09-19T06:46:06.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.280+0000 7fc4fe59c640 1 --2- 172.21.15.86:0/2592419237 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5000d0d40 0x7fc5001f4a50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000e890 tx=0x7fc4f000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:06.285 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.280+0000 7fc4f6ffd640 1 -- 172.21.15.86:0/2592419237 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0017070 con 0x7fc5000d0d40 2024-09-19T06:46:06.285 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.280+0000 7fc4f6ffd640 1 -- 172.21.15.86:0/2592419237 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f000c940 con 0x7fc5000d0d40 2024-09-19T06:46:06.285 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.280+0000 7fc4f6ffd640 1 -- 172.21.15.86:0/2592419237 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f000cd10 con 0x7fc5000d0d40 2024-09-19T06:46:06.285 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.280+0000 7fc504f7f640 1 -- 172.21.15.86:0/2592419237 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc500158240 con 0x7fc5000d0d40 2024-09-19T06:46:06.285 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.280+0000 7fc504f7f640 1 -- 172.21.15.86:0/2592419237 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc500158800 con 0x7fc5000d0d40 2024-09-19T06:46:06.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.281+0000 7fc504f7f640 1 -- 172.21.15.86:0/2592419237 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc50015df10 con 0x7fc5000d0d40 2024-09-19T06:46:06.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.282+0000 7fc4f6ffd640 1 -- 172.21.15.86:0/2592419237 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc4f001a070 con 0x7fc5000d0d40 2024-09-19T06:46:06.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.282+0000 7fc4f6ffd640 1 --2- 172.21.15.86:0/2592419237 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc4e006c2b0 0x7fc4e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:06.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.282+0000 7fc4fdd9b640 1 --2- 172.21.15.86:0/2592419237 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc4e006c2b0 0x7fc4e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:06.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.282+0000 7fc4f6ffd640 1 -- 172.21.15.86:0/2592419237 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7fc4f008bab0 con 0x7fc5000d0d40 2024-09-19T06:46:06.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.283+0000 7fc4fdd9b640 1 --2- 172.21.15.86:0/2592419237 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc4e006c2b0 0x7fc4e006e770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8034000 tx=0x7fc4e802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:06.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.287+0000 7fc4f6ffd640 1 -- 172.21.15.86:0/2592419237 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc4f00594b0 con 0x7fc5000d0d40 2024-09-19T06:46:06.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.493+0000 7fc504f7f640 1 -- 172.21.15.86:0/2592419237 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5000cda00 con 0x7fc5000d0d40 2024-09-19T06:46:06.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.494+0000 7fc4f6ffd640 1 -- 172.21.15.86:0/2592419237 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+6047 (secure 0 0 0) 0x7fc4f005d7b0 con 0x7fc5000d0d40 2024-09-19T06:46:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:46:06.495 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":35,"btime":"2024-09-19T06:46:00:558535+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:46:00.558532+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5092},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5092":{"gid":5092,"name":"d","rank":0,"incarnation":35,"state":"up:replay","state_seq":1,"addr":"172.21.15.169:6837/1148622307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1148622307},{"type":"v1","addr":"172.21.15.169:6837","nonce":1148622307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:46:06.495 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 35 2024-09-19T06:46:06.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.496+0000 7fc504f7f640 1 -- 172.21.15.86:0/2592419237 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc4e006c2b0 msgr2=0x7fc4e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:06.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.496+0000 7fc504f7f640 1 --2- 172.21.15.86:0/2592419237 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc4e006c2b0 0x7fc4e006e770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8034000 tx=0x7fc4e802e000 comp rx=0 tx=0).stop 2024-09-19T06:46:06.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.496+0000 7fc504f7f640 1 -- 172.21.15.86:0/2592419237 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5000d0d40 msgr2=0x7fc5001f4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:06.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.496+0000 7fc504f7f640 1 --2- 172.21.15.86:0/2592419237 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5000d0d40 0x7fc5001f4a50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000e890 tx=0x7fc4f000ed50 comp rx=0 tx=0).stop 2024-09-19T06:46:06.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.496+0000 7fc504f7f640 1 -- 172.21.15.86:0/2592419237 shutdown_connections 2024-09-19T06:46:06.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.496+0000 7fc504f7f640 1 --2- 172.21.15.86:0/2592419237 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc4e006c2b0 0x7fc4e006e770 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.496+0000 7fc504f7f640 1 --2- 172.21.15.86:0/2592419237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc50015da60 0x7fc5000c70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.496+0000 7fc504f7f640 1 --2- 172.21.15.86:0/2592419237 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5000d1120 0x7fc50015be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.496+0000 7fc504f7f640 1 --2- 172.21.15.86:0/2592419237 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5000d0d40 0x7fc5001f4a50 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.496+0000 7fc504f7f640 1 -- 172.21.15.86:0/2592419237 >> 172.21.15.86:0/2592419237 conn(0x7fc50006d910 msgr2=0x7fc5000ca490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:06.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.496+0000 7fc504f7f640 1 -- 172.21.15.86:0/2592419237 shutdown_connections 2024-09-19T06:46:06.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:06.496+0000 7fc504f7f640 1 -- 172.21.15.86:0/2592419237 wait complete. 2024-09-19T06:46:06.508 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:46:08.509 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:46:08.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.608+0000 7fe25ae23640 1 Processor -- start 2024-09-19T06:46:08.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.608+0000 7fe25ae23640 1 -- start start 2024-09-19T06:46:08.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.608+0000 7fe25ae23640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe254153000 0x7fe254159080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:08.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.609+0000 7fe25ae23640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2540c76a0 0x7fe254163640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:08.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.609+0000 7fe25ae23640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2541533e0 con 0x7fe2541595c0 2024-09-19T06:46:08.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.609+0000 7fe25ae23640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe25406c600 con 0x7fe254153000 2024-09-19T06:46:08.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.609+0000 7fe25ae23640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe2540c57d0 con 0x7fe2540c76a0 2024-09-19T06:46:08.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.609+0000 7fe2593c0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2540c76a0 0x7fe254163640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:08.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.609+0000 7fe258bbf640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe254153000 0x7fe254159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:08.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.609+0000 7fe258bbf640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe254153000 0x7fe254159080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:38362/0 (socket says 172.21.15.86:38362) 2024-09-19T06:46:08.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.609+0000 7fe258bbf640 1 -- 172.21.15.86:0/2713345457 learned_addr learned my addr 172.21.15.86:0/2713345457 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:08.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.609+0000 7fe2593c0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2540c76a0 0x7fe254163640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:60158/0 (socket says 172.21.15.86:60158) 2024-09-19T06:46:08.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.609+0000 7fe253fff640 1 --1- 172.21.15.86:0/2713345457 >> v1:172.21.15.169:6789/0 conn(0x7fe2541595c0 0x7fe2540c6f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:44322/0 (socket says 172.21.15.86:44322) 2024-09-19T06:46:08.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.609+0000 7fe2593c0640 1 -- 172.21.15.86:0/2713345457 >> v2:172.21.15.169:3300/0 conn(0x7fe254153000 msgr2=0x7fe254159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:08.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.609+0000 7fe2593c0640 1 --2- 172.21.15.86:0/2713345457 >> v2:172.21.15.169:3300/0 conn(0x7fe254153000 0x7fe254159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.609+0000 7fe2593c0640 1 -- 172.21.15.86:0/2713345457 >> v1:172.21.15.169:6789/0 conn(0x7fe2541595c0 legacy=0x7fe2540c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:08.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.609+0000 7fe2593c0640 1 -- 172.21.15.86:0/2713345457 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe25406c850 con 0x7fe2540c76a0 2024-09-19T06:46:08.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.609+0000 7fe258bbf640 1 --2- 172.21.15.86:0/2713345457 >> v2:172.21.15.169:3300/0 conn(0x7fe254153000 0x7fe254159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:08.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.610+0000 7fe2593c0640 1 --2- 172.21.15.86:0/2713345457 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2540c76a0 0x7fe254163640 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe24c009d90 tx=0x7fe24c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b9566524c8cddd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:08.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.610+0000 7fe2537fe640 1 -- 172.21.15.86:0/2713345457 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24c007740 con 0x7fe2540c76a0 2024-09-19T06:46:08.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.610+0000 7fe2537fe640 1 -- 172.21.15.86:0/2713345457 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe24c0078e0 con 0x7fe2540c76a0 2024-09-19T06:46:08.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.610+0000 7fe2537fe640 1 -- 172.21.15.86:0/2713345457 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24c007cb0 con 0x7fe2540c76a0 2024-09-19T06:46:08.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.611+0000 7fe25ae23640 1 -- 172.21.15.86:0/2713345457 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2540c76a0 msgr2=0x7fe254163640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:08.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.611+0000 7fe25ae23640 1 --2- 172.21.15.86:0/2713345457 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2540c76a0 0x7fe254163640 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe24c009d90 tx=0x7fe24c02a660 comp rx=0 tx=0).stop 2024-09-19T06:46:08.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.611+0000 7fe25ae23640 1 -- 172.21.15.86:0/2713345457 shutdown_connections 2024-09-19T06:46:08.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.611+0000 7fe25ae23640 1 --2- 172.21.15.86:0/2713345457 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2540c76a0 0x7fe254163640 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.611+0000 7fe25ae23640 1 --2- 172.21.15.86:0/2713345457 >> v2:172.21.15.169:3300/0 conn(0x7fe254153000 0x7fe254159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.611+0000 7fe25ae23640 1 -- 172.21.15.86:0/2713345457 >> 172.21.15.86:0/2713345457 conn(0x7fe2540cdd80 msgr2=0x7fe2540ca220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:08.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.611+0000 7fe25ae23640 1 -- 172.21.15.86:0/2713345457 shutdown_connections 2024-09-19T06:46:08.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.611+0000 7fe25ae23640 1 -- 172.21.15.86:0/2713345457 wait complete. 2024-09-19T06:46:08.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.612+0000 7fe25ae23640 1 Processor -- start 2024-09-19T06:46:08.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.612+0000 7fe25ae23640 1 -- start start 2024-09-19T06:46:08.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.613+0000 7fe25ae23640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2540c76a0 0x7fe2541444c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:08.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.613+0000 7fe25ae23640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe254153000 0x7fe2541e3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:08.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.613+0000 7fe25ae23640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2541595c0 0x7fe2541eee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:08.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.613+0000 7fe25ae23640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe2540c4890 con 0x7fe254153000 2024-09-19T06:46:08.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.613+0000 7fe25ae23640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe2541599e0 con 0x7fe2540c76a0 2024-09-19T06:46:08.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.613+0000 7fe25ae23640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe2540c7b30 con 0x7fe2541595c0 2024-09-19T06:46:08.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.613+0000 7fe253fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe254153000 0x7fe2541e3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:08.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.613+0000 7fe253fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe254153000 0x7fe2541e3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36968/0 (socket says 172.21.15.86:36968) 2024-09-19T06:46:08.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.613+0000 7fe253fff640 1 -- 172.21.15.86:0/4190290639 learned_addr learned my addr 172.21.15.86:0/4190290639 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:08.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.613+0000 7fe2593c0640 1 --2- 172.21.15.86:0/4190290639 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2541595c0 0x7fe2541eee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:08.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.613+0000 7fe258bbf640 1 --2- 172.21.15.86:0/4190290639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2540c76a0 0x7fe2541444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:08.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.613+0000 7fe253fff640 1 -- 172.21.15.86:0/4190290639 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2541595c0 msgr2=0x7fe2541eee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:08.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.613+0000 7fe253fff640 1 --2- 172.21.15.86:0/4190290639 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2541595c0 0x7fe2541eee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.613+0000 7fe253fff640 1 -- 172.21.15.86:0/4190290639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2540c76a0 msgr2=0x7fe2541444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:08.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.613+0000 7fe253fff640 1 --2- 172.21.15.86:0/4190290639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2540c76a0 0x7fe2541444c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.613+0000 7fe253fff640 1 -- 172.21.15.86:0/4190290639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2541f2b00 con 0x7fe254153000 2024-09-19T06:46:08.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.613+0000 7fe253fff640 1 --2- 172.21.15.86:0/4190290639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe254153000 0x7fe2541e3c90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe24000c430 tx=0x7fe24000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:08.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.614+0000 7fe2517fa640 1 -- 172.21.15.86:0/4190290639 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2400074e0 con 0x7fe254153000 2024-09-19T06:46:08.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.614+0000 7fe2517fa640 1 -- 172.21.15.86:0/4190290639 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe240007680 con 0x7fe254153000 2024-09-19T06:46:08.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.614+0000 7fe25ae23640 1 -- 172.21.15.86:0/4190290639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2541516a0 con 0x7fe254153000 2024-09-19T06:46:08.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.614+0000 7fe2517fa640 1 -- 172.21.15.86:0/4190290639 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe240004a00 con 0x7fe254153000 2024-09-19T06:46:08.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.614+0000 7fe25ae23640 1 -- 172.21.15.86:0/4190290639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2541e4ea0 con 0x7fe254153000 2024-09-19T06:46:08.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.615+0000 7fe25ae23640 1 -- 172.21.15.86:0/4190290639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2540cafa0 con 0x7fe254153000 2024-09-19T06:46:08.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.615+0000 7fe2517fa640 1 -- 172.21.15.86:0/4190290639 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe24001a020 con 0x7fe254153000 2024-09-19T06:46:08.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.615+0000 7fe2517fa640 1 --2- 172.21.15.86:0/4190290639 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe23806c2b0 0x7fe23806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:08.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.616+0000 7fe2517fa640 1 -- 172.21.15.86:0/4190290639 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7fe24008b1c0 con 0x7fe254153000 2024-09-19T06:46:08.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.616+0000 7fe258bbf640 1 --2- 172.21.15.86:0/4190290639 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe23806c2b0 0x7fe23806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:08.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.616+0000 7fe258bbf640 1 --2- 172.21.15.86:0/4190290639 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe23806c2b0 0x7fe23806e770 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe248009a90 tx=0x7fe248008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:08.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.620+0000 7fe2517fa640 1 -- 172.21.15.86:0/4190290639 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe2400593b0 con 0x7fe254153000 2024-09-19T06:46:08.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.857+0000 7fe25ae23640 1 -- 172.21.15.86:0/4190290639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2540c6490 con 0x7fe254153000 2024-09-19T06:46:08.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.858+0000 7fe2517fa640 1 -- 172.21.15.86:0/4190290639 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+6051 (secure 0 0 0) 0x7fe240058cb0 con 0x7fe254153000 2024-09-19T06:46:08.859 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:46:08.860 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":36,"btime":"2024-09-19T06:46:08:027293+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:46:07.238786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5092},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5092":{"gid":5092,"name":"d","rank":0,"incarnation":35,"state":"up:reconnect","state_seq":15,"addr":"172.21.15.169:6837/1148622307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1148622307},{"type":"v1","addr":"172.21.15.169:6837","nonce":1148622307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:46:08.860 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 36 2024-09-19T06:46:08.861 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.860+0000 7fe25ae23640 1 -- 172.21.15.86:0/4190290639 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe23806c2b0 msgr2=0x7fe23806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:08.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.860+0000 7fe25ae23640 1 --2- 172.21.15.86:0/4190290639 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe23806c2b0 0x7fe23806e770 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe248009a90 tx=0x7fe248008040 comp rx=0 tx=0).stop 2024-09-19T06:46:08.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.860+0000 7fe25ae23640 1 -- 172.21.15.86:0/4190290639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe254153000 msgr2=0x7fe2541e3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:08.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.860+0000 7fe25ae23640 1 --2- 172.21.15.86:0/4190290639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe254153000 0x7fe2541e3c90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe24000c430 tx=0x7fe24000c8f0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.860+0000 7fe25ae23640 1 -- 172.21.15.86:0/4190290639 shutdown_connections 2024-09-19T06:46:08.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.860+0000 7fe25ae23640 1 --2- 172.21.15.86:0/4190290639 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fe23806c2b0 0x7fe23806e770 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.860+0000 7fe25ae23640 1 --2- 172.21.15.86:0/4190290639 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2541595c0 0x7fe2541eee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.860+0000 7fe25ae23640 1 --2- 172.21.15.86:0/4190290639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe254153000 0x7fe2541e3c90 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.860+0000 7fe25ae23640 1 --2- 172.21.15.86:0/4190290639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2540c76a0 0x7fe2541444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.860+0000 7fe25ae23640 1 -- 172.21.15.86:0/4190290639 >> 172.21.15.86:0/4190290639 conn(0x7fe2540cdd80 msgr2=0x7fe2540c7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:08.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.860+0000 7fe25ae23640 1 -- 172.21.15.86:0/4190290639 shutdown_connections 2024-09-19T06:46:08.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:08.860+0000 7fe25ae23640 1 -- 172.21.15.86:0/4190290639 wait complete. 2024-09-19T06:46:08.872 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:46:10.873 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:46:10.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.973+0000 7f81b9e45640 1 Processor -- start 2024-09-19T06:46:10.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.973+0000 7f81b9e45640 1 -- start start 2024-09-19T06:46:10.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.973+0000 7f81b9e45640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81b40d1120 0x7f81b415da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:10.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.973+0000 7f81b9e45640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81b415c9c0 con 0x7f81b415dfa0 2024-09-19T06:46:10.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.973+0000 7f81b9e45640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81b415cca0 con 0x7f81b40d0d40 2024-09-19T06:46:10.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.973+0000 7f81b9e45640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f81b415c770 con 0x7f81b40d1120 2024-09-19T06:46:10.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.974+0000 7f81b3fff640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f81b415dfa0 0x7f81b40b4b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33636/0 (socket says 172.21.15.86:33636) 2024-09-19T06:46:10.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.974+0000 7f81b3fff640 1 -- 172.21.15.86:0/2507890847 learned_addr learned my addr 172.21.15.86:0/2507890847 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:46:10.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.974+0000 7f81b2ffd640 1 --2- 172.21.15.86:0/2507890847 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81b40d1120 0x7f81b415da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:10.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.974+0000 7f81b27fc640 1 -- 172.21.15.86:0/2507890847 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3278127468 0 0) 0x7f81b415c9c0 con 0x7f81b415dfa0 2024-09-19T06:46:10.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.974+0000 7f81b27fc640 1 -- 172.21.15.86:0/2507890847 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f819c003520 con 0x7f81b415dfa0 2024-09-19T06:46:10.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.974+0000 7f81b27fc640 1 -- 172.21.15.86:0/2507890847 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2996273246 0 0) 0x7f81b415cca0 con 0x7f81b40d0d40 2024-09-19T06:46:10.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.974+0000 7f81b27fc640 1 -- 172.21.15.86:0/2507890847 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81b415c9c0 con 0x7f81b40d0d40 2024-09-19T06:46:10.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.974+0000 7f81b27fc640 1 -- 172.21.15.86:0/2507890847 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 739241041 0 0) 0x7f819c003520 con 0x7f81b415dfa0 2024-09-19T06:46:10.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.974+0000 7f81b2ffd640 1 -- 172.21.15.86:0/2507890847 >> v1:172.21.15.169:6789/0 conn(0x7f81b40d0d40 legacy=0x7f81b40ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:10.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.974+0000 7f81b2ffd640 1 -- 172.21.15.86:0/2507890847 >> v1:172.21.15.86:6789/0 conn(0x7f81b415dfa0 legacy=0x7f81b40b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:10.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.974+0000 7f81b2ffd640 1 -- 172.21.15.86:0/2507890847 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b415cf80 con 0x7f81b40d1120 2024-09-19T06:46:10.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.975+0000 7f81b2ffd640 1 --2- 172.21.15.86:0/2507890847 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81b40d1120 0x7f81b415da60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f81a80097d0 tx=0x7f81a802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=194ca0b18661a369 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:10.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.975+0000 7f81b27fc640 1 -- 172.21.15.86:0/2507890847 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a8037070 con 0x7f81b40d1120 2024-09-19T06:46:10.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.975+0000 7f81b27fc640 1 -- 172.21.15.86:0/2507890847 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a802ac30 con 0x7f81b40d1120 2024-09-19T06:46:10.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.975+0000 7f81b27fc640 1 -- 172.21.15.86:0/2507890847 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac001970 con 0x7f81b40d1120 2024-09-19T06:46:10.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.976+0000 7f81b9e45640 1 -- 172.21.15.86:0/2507890847 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81b40d1120 msgr2=0x7f81b415da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:10.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.976+0000 7f81b9e45640 1 --2- 172.21.15.86:0/2507890847 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81b40d1120 0x7f81b415da60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f81a80097d0 tx=0x7f81a802a1a0 comp rx=0 tx=0).stop 2024-09-19T06:46:10.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.976+0000 7f81b9e45640 1 -- 172.21.15.86:0/2507890847 shutdown_connections 2024-09-19T06:46:10.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.976+0000 7f81b9e45640 1 --2- 172.21.15.86:0/2507890847 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81b40d1120 0x7f81b415da60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:10.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.976+0000 7f81b9e45640 1 -- 172.21.15.86:0/2507890847 >> 172.21.15.86:0/2507890847 conn(0x7f81b406d910 msgr2=0x7f81b406dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:10.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.976+0000 7f81b9e45640 1 -- 172.21.15.86:0/2507890847 shutdown_connections 2024-09-19T06:46:10.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.976+0000 7f81b9e45640 1 -- 172.21.15.86:0/2507890847 wait complete. 2024-09-19T06:46:10.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.977+0000 7f81b9e45640 1 Processor -- start 2024-09-19T06:46:10.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.977+0000 7f81b9e45640 1 -- start start 2024-09-19T06:46:10.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.978+0000 7f81b9e45640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81b40d0d40 0x7f81b4150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:10.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.978+0000 7f81b9e45640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81b40d1120 0x7f81b4155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:10.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.978+0000 7f81b9e45640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81b415dfa0 0x7f81b41547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:10.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.978+0000 7f81b9e45640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f81b40b3f20 con 0x7f81b40d0d40 2024-09-19T06:46:10.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.978+0000 7f81b9e45640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f81b415e450 con 0x7f81b415dfa0 2024-09-19T06:46:10.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.978+0000 7f81b9e45640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f81b40cadd0 con 0x7f81b40d1120 2024-09-19T06:46:10.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.978+0000 7f81b37fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81b40d0d40 0x7f81b4150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:10.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.978+0000 7f81b37fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81b40d0d40 0x7f81b4150440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36974/0 (socket says 172.21.15.86:36974) 2024-09-19T06:46:10.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.978+0000 7f81b37fe640 1 -- 172.21.15.86:0/1930448791 learned_addr learned my addr 172.21.15.86:0/1930448791 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:10.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.978+0000 7f81b3fff640 1 --2- 172.21.15.86:0/1930448791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81b415dfa0 0x7f81b41547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:10.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.978+0000 7f81b2ffd640 1 --2- 172.21.15.86:0/1930448791 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81b40d1120 0x7f81b4155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:10.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.978+0000 7f81b37fe640 1 -- 172.21.15.86:0/1930448791 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81b40d1120 msgr2=0x7f81b4155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:10.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.978+0000 7f81b37fe640 1 --2- 172.21.15.86:0/1930448791 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81b40d1120 0x7f81b4155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:10.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.978+0000 7f81b37fe640 1 -- 172.21.15.86:0/1930448791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81b415dfa0 msgr2=0x7f81b41547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:10.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.978+0000 7f81b37fe640 1 --2- 172.21.15.86:0/1930448791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81b415dfa0 0x7f81b41547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:10.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.978+0000 7f81b37fe640 1 -- 172.21.15.86:0/1930448791 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b4152df0 con 0x7f81b40d0d40 2024-09-19T06:46:10.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.978+0000 7f81b2ffd640 1 --2- 172.21.15.86:0/1930448791 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81b40d1120 0x7f81b4155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:46:10.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.978+0000 7f81b37fe640 1 --2- 172.21.15.86:0/1930448791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81b40d0d40 0x7f81b4150440 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f81a40010e0 tx=0x7f81a400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:10.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.978+0000 7f819bfff640 1 -- 172.21.15.86:0/1930448791 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a40052d0 con 0x7f81b40d0d40 2024-09-19T06:46:10.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.978+0000 7f819bfff640 1 -- 172.21.15.86:0/1930448791 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a4005490 con 0x7f81b40d0d40 2024-09-19T06:46:10.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.979+0000 7f81b9e45640 1 -- 172.21.15.86:0/1930448791 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81b41f3cc0 con 0x7f81b40d0d40 2024-09-19T06:46:10.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.979+0000 7f819bfff640 1 -- 172.21.15.86:0/1930448791 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a4012870 con 0x7f81b40d0d40 2024-09-19T06:46:10.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.979+0000 7f81b9e45640 1 -- 172.21.15.86:0/1930448791 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81b41f4280 con 0x7f81b40d0d40 2024-09-19T06:46:10.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.979+0000 7f81b9e45640 1 -- 172.21.15.86:0/1930448791 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81b415da60 con 0x7f81b40d0d40 2024-09-19T06:46:10.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.980+0000 7f819bfff640 1 -- 172.21.15.86:0/1930448791 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f81a4012a10 con 0x7f81b40d0d40 2024-09-19T06:46:10.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.980+0000 7f819bfff640 1 --2- 172.21.15.86:0/1930448791 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f81a006c2b0 0x7f81a006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:10.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.981+0000 7f819bfff640 1 -- 172.21.15.86:0/1930448791 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7f81a408b6a0 con 0x7f81b40d0d40 2024-09-19T06:46:10.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.981+0000 7f81b2ffd640 1 --2- 172.21.15.86:0/1930448791 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f81a006c2b0 0x7f81a006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:10.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.981+0000 7f81b2ffd640 1 --2- 172.21.15.86:0/1930448791 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f81a006c2b0 0x7f81a006e770 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f81a8034000 tx=0x7f81a802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:10.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:10.989+0000 7f819bfff640 1 -- 172.21.15.86:0/1930448791 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f81a4059890 con 0x7f81b40d0d40 2024-09-19T06:46:11.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:11.196+0000 7f81b9e45640 1 -- 172.21.15.86:0/1930448791 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81b40c9270 con 0x7f81b40d0d40 2024-09-19T06:46:11.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:11.197+0000 7f819bfff640 1 -- 172.21.15.86:0/1930448791 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+6051 (secure 0 0 0) 0x7f81a4059190 con 0x7f81b40d0d40 2024-09-19T06:46:11.198 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:46:11.198 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":36,"btime":"2024-09-19T06:46:08:027293+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:46:07.238786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5092},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5092":{"gid":5092,"name":"d","rank":0,"incarnation":35,"state":"up:reconnect","state_seq":15,"addr":"172.21.15.169:6837/1148622307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1148622307},{"type":"v1","addr":"172.21.15.169:6837","nonce":1148622307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:46:11.199 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 36 2024-09-19T06:46:11.200 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:11.199+0000 7f81b9e45640 1 -- 172.21.15.86:0/1930448791 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f81a006c2b0 msgr2=0x7f81a006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:11.200 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:11.199+0000 7f81b9e45640 1 --2- 172.21.15.86:0/1930448791 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f81a006c2b0 0x7f81a006e770 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f81a8034000 tx=0x7f81a802e000 comp rx=0 tx=0).stop 2024-09-19T06:46:11.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:11.199+0000 7f81b9e45640 1 -- 172.21.15.86:0/1930448791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81b40d0d40 msgr2=0x7f81b4150440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:11.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:11.199+0000 7f81b9e45640 1 --2- 172.21.15.86:0/1930448791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81b40d0d40 0x7f81b4150440 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f81a40010e0 tx=0x7f81a400c980 comp rx=0 tx=0).stop 2024-09-19T06:46:11.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:11.199+0000 7f81b9e45640 1 -- 172.21.15.86:0/1930448791 shutdown_connections 2024-09-19T06:46:11.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:11.199+0000 7f81b9e45640 1 --2- 172.21.15.86:0/1930448791 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f81a006c2b0 0x7f81a006e770 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:11.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:11.199+0000 7f81b9e45640 1 --2- 172.21.15.86:0/1930448791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81b415dfa0 0x7f81b41547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:11.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:11.199+0000 7f81b9e45640 1 --2- 172.21.15.86:0/1930448791 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81b40d1120 0x7f81b4155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:11.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:11.199+0000 7f81b9e45640 1 --2- 172.21.15.86:0/1930448791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81b40d0d40 0x7f81b4150440 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:11.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:11.199+0000 7f81b9e45640 1 -- 172.21.15.86:0/1930448791 >> 172.21.15.86:0/1930448791 conn(0x7f81b406d910 msgr2=0x7f81b40c86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:11.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:11.199+0000 7f81b9e45640 1 -- 172.21.15.86:0/1930448791 shutdown_connections 2024-09-19T06:46:11.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:11.199+0000 7f81b9e45640 1 -- 172.21.15.86:0/1930448791 wait complete. 2024-09-19T06:46:11.212 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:46:13.212 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:46:13.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.312+0000 7efcd5d18640 1 Processor -- start 2024-09-19T06:46:13.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.312+0000 7efcd5d18640 1 -- start start 2024-09-19T06:46:13.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.313+0000 7efcd5d18640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efcd015b000 0x7efcd00ca020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:13.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.313+0000 7efcd5d18640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7efcd0071430 0x7efcd0073840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:13.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.313+0000 7efcd5d18640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcd015ef10 con 0x7efcd0155090 2024-09-19T06:46:13.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.313+0000 7efcd5d18640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7efcd00718a0 con 0x7efcd0071430 2024-09-19T06:46:13.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.313+0000 7efcd5d18640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7efcd015f1f0 con 0x7efcd015b000 2024-09-19T06:46:13.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.313+0000 7efccf7fe640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7efcd0155090 0x7efcd015e5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58712/0 (socket says 172.21.15.86:58712) 2024-09-19T06:46:13.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.313+0000 7efccf7fe640 1 -- 172.21.15.86:0/3907916194 learned_addr learned my addr 172.21.15.86:0/3907916194 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:46:13.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.313+0000 7efcce7fc640 1 -- 172.21.15.86:0/3907916194 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4149942643 0 0) 0x7efcd015ef10 con 0x7efcd0155090 2024-09-19T06:46:13.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.313+0000 7efccffff640 1 --2- 172.21.15.86:0/3907916194 >> v2:172.21.15.169:3300/0 conn(0x7efcd0071430 0x7efcd0073840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:13.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.313+0000 7efcceffd640 1 --2- 172.21.15.86:0/3907916194 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efcd015b000 0x7efcd00ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:13.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.313+0000 7efcce7fc640 1 -- 172.21.15.86:0/3907916194 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcb8003520 con 0x7efcd0155090 2024-09-19T06:46:13.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.313+0000 7efcce7fc640 1 -- 172.21.15.86:0/3907916194 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2722142621 0 0) 0x7efcb8003520 con 0x7efcd0155090 2024-09-19T06:46:13.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.313+0000 7efcce7fc640 1 -- 172.21.15.86:0/3907916194 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efcd015b000 msgr2=0x7efcd00ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:13.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.313+0000 7efcce7fc640 1 --2- 172.21.15.86:0/3907916194 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efcd015b000 0x7efcd00ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:13.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.313+0000 7efcce7fc640 1 -- 172.21.15.86:0/3907916194 >> v2:172.21.15.169:3300/0 conn(0x7efcd0071430 msgr2=0x7efcd0073840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:13.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.313+0000 7efcce7fc640 1 --2- 172.21.15.86:0/3907916194 >> v2:172.21.15.169:3300/0 conn(0x7efcd0071430 0x7efcd0073840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:13.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.313+0000 7efcce7fc640 1 -- 172.21.15.86:0/3907916194 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd015f4d0 con 0x7efcd0155090 2024-09-19T06:46:13.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.313+0000 7efcce7fc640 1 -- 172.21.15.86:0/3907916194 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7efcc0001670 con 0x7efcd0155090 2024-09-19T06:46:13.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.313+0000 7efcce7fc640 1 -- 172.21.15.86:0/3907916194 >> v1:172.21.15.86:6789/0 conn(0x7efcd0155090 legacy=0x7efcd015e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:13.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.313+0000 7efcce7fc640 1 --2- 172.21.15.86:0/3907916194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcb80039b0 0x7efcb8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:13.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.313+0000 7efcce7fc640 1 --2- 172.21.15.86:0/3907916194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efcb8004800 0x7efcb8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:13.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.313+0000 7efcce7fc640 1 --2- 172.21.15.86:0/3907916194 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efcd015b000 0x7efcb80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:13.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.313+0000 7efcce7fc640 1 -- 172.21.15.86:0/3907916194 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efcd00718a0 con 0x7efcb80039b0 2024-09-19T06:46:13.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.313+0000 7efcce7fc640 1 -- 172.21.15.86:0/3907916194 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efcd015f1f0 con 0x7efcb8004800 2024-09-19T06:46:13.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.313+0000 7efcce7fc640 1 -- 172.21.15.86:0/3907916194 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7efcb800b9f0 con 0x7efcd015b000 2024-09-19T06:46:13.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.314+0000 7efccf7fe640 1 --2- 172.21.15.86:0/3907916194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcb80039b0 0x7efcb8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:13.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.314+0000 7efcceffd640 1 --2- 172.21.15.86:0/3907916194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efcb8004800 0x7efcb8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:13.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.314+0000 7efccf7fe640 1 -- 172.21.15.86:0/3907916194 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efcd015b000 msgr2=0x7efcb80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:13.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.314+0000 7efccf7fe640 1 --2- 172.21.15.86:0/3907916194 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efcd015b000 0x7efcb80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:13.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.314+0000 7efccf7fe640 1 -- 172.21.15.86:0/3907916194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efcb8004800 msgr2=0x7efcb8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:13.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.314+0000 7efccf7fe640 1 --2- 172.21.15.86:0/3907916194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efcb8004800 0x7efcb8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:13.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.314+0000 7efccf7fe640 1 -- 172.21.15.86:0/3907916194 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb8003520 con 0x7efcb80039b0 2024-09-19T06:46:13.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.314+0000 7efccf7fe640 1 --2- 172.21.15.86:0/3907916194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcb80039b0 0x7efcb8003dd0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7efcc000c210 tx=0x7efcb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1b9ef9a0585104 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:13.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.315+0000 7efcce7fc640 1 -- 172.21.15.86:0/3907916194 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc0007d50 con 0x7efcb80039b0 2024-09-19T06:46:13.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.315+0000 7efcce7fc640 1 -- 172.21.15.86:0/3907916194 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc0005af0 con 0x7efcb80039b0 2024-09-19T06:46:13.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.315+0000 7efcce7fc640 1 -- 172.21.15.86:0/3907916194 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc0007070 con 0x7efcb80039b0 2024-09-19T06:46:13.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.315+0000 7efcd5d18640 1 -- 172.21.15.86:0/3907916194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcb80039b0 msgr2=0x7efcb8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:13.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.315+0000 7efcd5d18640 1 --2- 172.21.15.86:0/3907916194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcb80039b0 0x7efcb8003dd0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7efcc000c210 tx=0x7efcb8005830 comp rx=0 tx=0).stop 2024-09-19T06:46:13.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.315+0000 7efccffff640 1 -- 172.21.15.86:0/3907916194 reap_dead start 2024-09-19T06:46:13.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.315+0000 7efcd5d18640 1 -- 172.21.15.86:0/3907916194 shutdown_connections 2024-09-19T06:46:13.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.315+0000 7efcd5d18640 1 -- 172.21.15.86:0/3907916194 >> 172.21.15.86:0/3907916194 conn(0x7efcd0067890 msgr2=0x7efcd0067c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:13.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.315+0000 7efcd5d18640 1 -- 172.21.15.86:0/3907916194 shutdown_connections 2024-09-19T06:46:13.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.315+0000 7efcd5d18640 1 -- 172.21.15.86:0/3907916194 wait complete. 2024-09-19T06:46:13.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.316+0000 7efcd5d18640 1 Processor -- start 2024-09-19T06:46:13.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.317+0000 7efcd5d18640 1 -- start start 2024-09-19T06:46:13.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.317+0000 7efcd5d18640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcb80039b0 0x7efcd00cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:13.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.317+0000 7efcd5d18640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efcd014fa30 0x7efcd014fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:13.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.317+0000 7efcd5d18640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efcd014e3a0 0x7efcd014e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:13.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.317+0000 7efcd5d18640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efcd0070f10 con 0x7efcb80039b0 2024-09-19T06:46:13.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.317+0000 7efcd5d18640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efcd0070c30 con 0x7efcd014fa30 2024-09-19T06:46:13.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.317+0000 7efcd5d18640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7efcd0155470 con 0x7efcd014e3a0 2024-09-19T06:46:13.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.317+0000 7efccf7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcb80039b0 0x7efcd00cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:13.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.318+0000 7efccf7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcb80039b0 0x7efcd00cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46830/0 (socket says 172.21.15.86:46830) 2024-09-19T06:46:13.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.318+0000 7efccf7fe640 1 -- 172.21.15.86:0/2936356047 learned_addr learned my addr 172.21.15.86:0/2936356047 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:13.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.318+0000 7efcceffd640 1 --2- 172.21.15.86:0/2936356047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efcd014fa30 0x7efcd014fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:13.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.318+0000 7efccffff640 1 --2- 172.21.15.86:0/2936356047 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efcd014e3a0 0x7efcd014e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:13.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.318+0000 7efccf7fe640 1 -- 172.21.15.86:0/2936356047 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efcd014e3a0 msgr2=0x7efcd014e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:13.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.318+0000 7efccf7fe640 1 --2- 172.21.15.86:0/2936356047 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efcd014e3a0 0x7efcd014e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:13.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.318+0000 7efccf7fe640 1 -- 172.21.15.86:0/2936356047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efcd014fa30 msgr2=0x7efcd014fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:13.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.318+0000 7efccf7fe640 1 --2- 172.21.15.86:0/2936356047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efcd014fa30 0x7efcd014fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:13.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.318+0000 7efccf7fe640 1 -- 172.21.15.86:0/2936356047 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd00cea60 con 0x7efcb80039b0 2024-09-19T06:46:13.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.318+0000 7efccf7fe640 1 --2- 172.21.15.86:0/2936356047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcb80039b0 0x7efcd00cc890 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7efcc000c210 tx=0x7efcc0001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:13.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.318+0000 7efcb7fff640 1 -- 172.21.15.86:0/2936356047 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc0042070 con 0x7efcb80039b0 2024-09-19T06:46:13.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.318+0000 7efcb7fff640 1 -- 172.21.15.86:0/2936356047 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc0007480 con 0x7efcb80039b0 2024-09-19T06:46:13.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.318+0000 7efcd5d18640 1 -- 172.21.15.86:0/2936356047 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcd0150860 con 0x7efcb80039b0 2024-09-19T06:46:13.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.318+0000 7efcb7fff640 1 -- 172.21.15.86:0/2936356047 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc0001c90 con 0x7efcb80039b0 2024-09-19T06:46:13.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.318+0000 7efcd5d18640 1 -- 172.21.15.86:0/2936356047 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcd0150e20 con 0x7efcb80039b0 2024-09-19T06:46:13.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.320+0000 7efcd5d18640 1 -- 172.21.15.86:0/2936356047 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcd00681a0 con 0x7efcb80039b0 2024-09-19T06:46:13.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.320+0000 7efcb7fff640 1 -- 172.21.15.86:0/2936356047 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efcc0045070 con 0x7efcb80039b0 2024-09-19T06:46:13.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.321+0000 7efcb7fff640 1 --2- 172.21.15.86:0/2936356047 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7efcbc06c2b0 0x7efcbc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:13.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.321+0000 7efcb7fff640 1 -- 172.21.15.86:0/2936356047 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7efcc00ac490 con 0x7efcb80039b0 2024-09-19T06:46:13.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.321+0000 7efcceffd640 1 --2- 172.21.15.86:0/2936356047 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7efcbc06c2b0 0x7efcbc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:13.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.321+0000 7efcceffd640 1 --2- 172.21.15.86:0/2936356047 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7efcbc06c2b0 0x7efcbc06e770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efcd015e930 tx=0x7efcc4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:13.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.329+0000 7efcb7fff640 1 -- 172.21.15.86:0/2936356047 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7efcd00681a0 con 0x7efcb80039b0 2024-09-19T06:46:13.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.538+0000 7efcd5d18640 1 -- 172.21.15.86:0/2936356047 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efcd015ef10 con 0x7efcb80039b0 2024-09-19T06:46:13.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.539+0000 7efcb7fff640 1 -- 172.21.15.86:0/2936356047 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+6048 (secure 0 0 0) 0x7efcc007a070 con 0x7efcb80039b0 2024-09-19T06:46:13.540 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:46:13.541 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":37,"btime":"2024-09-19T06:46:13:043458+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:46:13.036622+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5092},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5092":{"gid":5092,"name":"d","rank":0,"incarnation":35,"state":"up:rejoin","state_seq":17,"addr":"172.21.15.169:6837/1148622307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1148622307},{"type":"v1","addr":"172.21.15.169:6837","nonce":1148622307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:46:13.541 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 37 2024-09-19T06:46:13.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.541+0000 7efcd5d18640 1 -- 172.21.15.86:0/2936356047 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7efcbc06c2b0 msgr2=0x7efcbc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:13.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.541+0000 7efcd5d18640 1 --2- 172.21.15.86:0/2936356047 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7efcbc06c2b0 0x7efcbc06e770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efcd015e930 tx=0x7efcc4009190 comp rx=0 tx=0).stop 2024-09-19T06:46:13.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.541+0000 7efcd5d18640 1 -- 172.21.15.86:0/2936356047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcb80039b0 msgr2=0x7efcd00cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:13.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.541+0000 7efcd5d18640 1 --2- 172.21.15.86:0/2936356047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcb80039b0 0x7efcd00cc890 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7efcc000c210 tx=0x7efcc0001a40 comp rx=0 tx=0).stop 2024-09-19T06:46:13.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.541+0000 7efcd5d18640 1 -- 172.21.15.86:0/2936356047 shutdown_connections 2024-09-19T06:46:13.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.541+0000 7efcd5d18640 1 --2- 172.21.15.86:0/2936356047 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7efcbc06c2b0 0x7efcbc06e770 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:13.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.541+0000 7efcd5d18640 1 --2- 172.21.15.86:0/2936356047 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efcd014e3a0 0x7efcd014e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:13.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.541+0000 7efcd5d18640 1 --2- 172.21.15.86:0/2936356047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efcd014fa30 0x7efcd014fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:13.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.541+0000 7efcd5d18640 1 --2- 172.21.15.86:0/2936356047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcb80039b0 0x7efcd00cc890 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:13.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.541+0000 7efcd5d18640 1 -- 172.21.15.86:0/2936356047 >> 172.21.15.86:0/2936356047 conn(0x7efcd0067890 msgr2=0x7efcd006de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:13.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.541+0000 7efcd5d18640 1 -- 172.21.15.86:0/2936356047 shutdown_connections 2024-09-19T06:46:13.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:13.541+0000 7efcd5d18640 1 -- 172.21.15.86:0/2936356047 wait complete. 2024-09-19T06:46:13.554 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "btime": "2024-09-19T06:46:13:043458+0000", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 37, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-19T06:37:08.763572+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 37, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_5092": { "addr": "172.21.15.169:6837/1148622307", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6836", "nonce": 1148622307, "type": "v2" }, { "addr": "172.21.15.169:6837", "nonce": 1148622307, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5092, "incarnation": 35, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:rejoin", "state_seq": 17 } }, "last_failure": 0, "last_failure_osd_epoch": 34, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-09-19T06:46:13.036622+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5092 } } } ], "standbys": [ { "addr": "172.21.15.86:6837/728803297", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6835", "nonce": 728803297, "type": "v2" }, { "addr": "172.21.15.86:6837", "nonce": 728803297, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4247, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.169:6835/2537509253", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6833", "nonce": 2537509253, "type": "v2" }, { "addr": "172.21.15.169:6835", "nonce": 2537509253, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4262, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.169:6834/1723647527", "addrs": { "addrvec": [ { "addr": "172.21.15.169:6832", "nonce": 1723647527, "type": "v2" }, { "addr": "172.21.15.169:6834", "nonce": 1723647527, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4265, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.86:6836/4135959816", "addrs": { "addrvec": [ { "addr": "172.21.15.86:6834", "nonce": 4135959816, "type": "v2" }, { "addr": "172.21.15.86:6836", "nonce": 4135959816, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4270, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-09-19T06:46:15.555 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:46:15.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.655+0000 7f9935da6640 1 Processor -- start 2024-09-19T06:46:15.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.655+0000 7f9935da6640 1 -- start start 2024-09-19T06:46:15.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.656+0000 7f9935da6640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f993006cc40 0x7f99301590b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:15.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.656+0000 7f9935da6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f99301595f0 0x7f9930152b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:15.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.656+0000 7f9935da6640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f993006bf00 con 0x7f99300c7220 2024-09-19T06:46:15.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.656+0000 7f9935da6640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f99300c4d50 con 0x7f993006cc40 2024-09-19T06:46:15.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.656+0000 7f9935da6640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f99300c6890 con 0x7f99301595f0 2024-09-19T06:46:15.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.656+0000 7f9926ffd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f993006cc40 0x7f99301590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:15.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.656+0000 7f992f7fe640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f99300c7220 0x7f99300c7600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58720/0 (socket says 172.21.15.86:58720) 2024-09-19T06:46:15.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.656+0000 7f9926ffd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f993006cc40 0x7f99301590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46844/0 (socket says 172.21.15.86:46844) 2024-09-19T06:46:15.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.656+0000 7f992f7fe640 1 -- 172.21.15.86:0/2154199959 learned_addr learned my addr 172.21.15.86:0/2154199959 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:46:15.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.656+0000 7f992ffff640 1 --2- 172.21.15.86:0/2154199959 >> v2:172.21.15.169:3300/0 conn(0x7f99301595f0 0x7f9930152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:15.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.657+0000 7f9926ffd640 1 -- 172.21.15.86:0/2154199959 >> v2:172.21.15.169:3300/0 conn(0x7f99301595f0 msgr2=0x7f9930152b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:15.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.657+0000 7f9926ffd640 1 --2- 172.21.15.86:0/2154199959 >> v2:172.21.15.169:3300/0 conn(0x7f99301595f0 0x7f9930152b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:15.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.657+0000 7f9926ffd640 1 -- 172.21.15.86:0/2154199959 >> v1:172.21.15.86:6789/0 conn(0x7f99300c7220 legacy=0x7f99300c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:15.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.657+0000 7f9926ffd640 1 -- 172.21.15.86:0/2154199959 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99300c4ff0 con 0x7f993006cc40 2024-09-19T06:46:15.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.657+0000 7f9926ffd640 1 --2- 172.21.15.86:0/2154199959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f993006cc40 0x7f99301590b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f993006d070 tx=0x7f991802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=202ebd60386b820f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:15.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.657+0000 7f992effd640 1 -- 172.21.15.86:0/2154199959 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9918037070 con 0x7f993006cc40 2024-09-19T06:46:15.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.658+0000 7f992effd640 1 -- 172.21.15.86:0/2154199959 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9918032440 con 0x7f993006cc40 2024-09-19T06:46:15.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.658+0000 7f992effd640 1 -- 172.21.15.86:0/2154199959 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9918032810 con 0x7f993006cc40 2024-09-19T06:46:15.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.658+0000 7f9935da6640 1 -- 172.21.15.86:0/2154199959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f993006cc40 msgr2=0x7f99301590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:15.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.658+0000 7f9935da6640 1 --2- 172.21.15.86:0/2154199959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f993006cc40 0x7f99301590b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f993006d070 tx=0x7f991802a1a0 comp rx=0 tx=0).stop 2024-09-19T06:46:15.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.658+0000 7f9935da6640 1 -- 172.21.15.86:0/2154199959 shutdown_connections 2024-09-19T06:46:15.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.658+0000 7f9935da6640 1 --2- 172.21.15.86:0/2154199959 >> v2:172.21.15.169:3300/0 conn(0x7f99301595f0 0x7f9930152b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:15.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.658+0000 7f9935da6640 1 --2- 172.21.15.86:0/2154199959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f993006cc40 0x7f99301590b0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:15.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.658+0000 7f9935da6640 1 -- 172.21.15.86:0/2154199959 >> 172.21.15.86:0/2154199959 conn(0x7f99300cdd80 msgr2=0x7f99300ca220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:15.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.658+0000 7f9935da6640 1 -- 172.21.15.86:0/2154199959 shutdown_connections 2024-09-19T06:46:15.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.658+0000 7f9935da6640 1 -- 172.21.15.86:0/2154199959 wait complete. 2024-09-19T06:46:15.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.659+0000 7f9935da6640 1 Processor -- start 2024-09-19T06:46:15.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.659+0000 7f9935da6640 1 -- start start 2024-09-19T06:46:15.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.660+0000 7f9935da6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f993006cc40 0x7f9930151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:15.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.660+0000 7f9935da6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99300c7220 0x7f9930147db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:15.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.660+0000 7f9935da6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99301595f0 0x7f99301f24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:15.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.660+0000 7f9935da6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f99300c5890 con 0x7f993006cc40 2024-09-19T06:46:15.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.660+0000 7f9935da6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f99300c55b0 con 0x7f99301595f0 2024-09-19T06:46:15.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.660+0000 7f9935da6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9930159a00 con 0x7f99300c7220 2024-09-19T06:46:15.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.660+0000 7f992f7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f993006cc40 0x7f9930151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:15.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.660+0000 7f992f7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f993006cc40 0x7f9930151e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46846/0 (socket says 172.21.15.86:46846) 2024-09-19T06:46:15.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.660+0000 7f992f7fe640 1 -- 172.21.15.86:0/1248786919 learned_addr learned my addr 172.21.15.86:0/1248786919 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:15.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.660+0000 7f9926ffd640 1 --2- 172.21.15.86:0/1248786919 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99300c7220 0x7f9930147db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:15.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.660+0000 7f992ffff640 1 --2- 172.21.15.86:0/1248786919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99301595f0 0x7f99301f24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:15.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.661+0000 7f992f7fe640 1 -- 172.21.15.86:0/1248786919 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99300c7220 msgr2=0x7f9930147db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:15.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.661+0000 7f992f7fe640 1 --2- 172.21.15.86:0/1248786919 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99300c7220 0x7f9930147db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:15.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.661+0000 7f992f7fe640 1 -- 172.21.15.86:0/1248786919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99301595f0 msgr2=0x7f99301f24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:15.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.661+0000 7f992f7fe640 1 --2- 172.21.15.86:0/1248786919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99301595f0 0x7f99301f24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:15.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.661+0000 7f992f7fe640 1 -- 172.21.15.86:0/1248786919 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9930144990 con 0x7f993006cc40 2024-09-19T06:46:15.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.661+0000 7f992ffff640 1 --2- 172.21.15.86:0/1248786919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99301595f0 0x7f99301f24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:15.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.661+0000 7f9926ffd640 1 --2- 172.21.15.86:0/1248786919 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99300c7220 0x7f9930147db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:15.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.661+0000 7f992f7fe640 1 --2- 172.21.15.86:0/1248786919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f993006cc40 0x7f9930151e00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f992000c430 tx=0x7f992000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:15.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.661+0000 7f992cff9640 1 -- 172.21.15.86:0/1248786919 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9920017070 con 0x7f993006cc40 2024-09-19T06:46:15.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.661+0000 7f992cff9640 1 -- 172.21.15.86:0/1248786919 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9920005ce0 con 0x7f993006cc40 2024-09-19T06:46:15.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.661+0000 7f9935da6640 1 -- 172.21.15.86:0/1248786919 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9930152440 con 0x7f993006cc40 2024-09-19T06:46:15.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.661+0000 7f992cff9640 1 -- 172.21.15.86:0/1248786919 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99200072f0 con 0x7f993006cc40 2024-09-19T06:46:15.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.661+0000 7f9935da6640 1 -- 172.21.15.86:0/1248786919 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9930143400 con 0x7f993006cc40 2024-09-19T06:46:15.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.662+0000 7f9935da6640 1 -- 172.21.15.86:0/1248786919 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99300cb690 con 0x7f993006cc40 2024-09-19T06:46:15.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.662+0000 7f992cff9640 1 -- 172.21.15.86:0/1248786919 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f992001a070 con 0x7f993006cc40 2024-09-19T06:46:15.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.663+0000 7f992cff9640 1 --2- 172.21.15.86:0/1248786919 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f991006c2b0 0x7f991006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:15.668 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.663+0000 7f9926ffd640 1 --2- 172.21.15.86:0/1248786919 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f991006c2b0 0x7f991006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:15.668 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.663+0000 7f992cff9640 1 -- 172.21.15.86:0/1248786919 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7f992008ae20 con 0x7f993006cc40 2024-09-19T06:46:15.668 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.664+0000 7f9926ffd640 1 --2- 172.21.15.86:0/1248786919 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f991006c2b0 0x7f991006e770 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9918034000 tx=0x7f991802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:15.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.668+0000 7f992cff9640 1 -- 172.21.15.86:0/1248786919 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f99300cb690 con 0x7f993006cc40 2024-09-19T06:46:15.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.877+0000 7f9935da6640 1 -- 172.21.15.86:0/1248786919 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f993006bbc0 con 0x7f993006cc40 2024-09-19T06:46:15.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.878+0000 7f992cff9640 1 -- 172.21.15.86:0/1248786919 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+6048 (secure 0 0 0) 0x7f9920058f80 con 0x7f993006cc40 2024-09-19T06:46:15.880 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:46:15.880 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":37,"btime":"2024-09-19T06:46:13:043458+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:46:13.036622+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5092},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5092":{"gid":5092,"name":"d","rank":0,"incarnation":35,"state":"up:rejoin","state_seq":17,"addr":"172.21.15.169:6837/1148622307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1148622307},{"type":"v1","addr":"172.21.15.169:6837","nonce":1148622307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:46:15.880 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 37 2024-09-19T06:46:15.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.880+0000 7f9935da6640 1 -- 172.21.15.86:0/1248786919 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f991006c2b0 msgr2=0x7f991006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:15.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.880+0000 7f9935da6640 1 --2- 172.21.15.86:0/1248786919 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f991006c2b0 0x7f991006e770 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9918034000 tx=0x7f991802e000 comp rx=0 tx=0).stop 2024-09-19T06:46:15.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.880+0000 7f9935da6640 1 -- 172.21.15.86:0/1248786919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f993006cc40 msgr2=0x7f9930151e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:15.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.880+0000 7f9935da6640 1 --2- 172.21.15.86:0/1248786919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f993006cc40 0x7f9930151e00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f992000c430 tx=0x7f992000c8f0 comp rx=0 tx=0).stop 2024-09-19T06:46:15.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.880+0000 7f9935da6640 1 -- 172.21.15.86:0/1248786919 shutdown_connections 2024-09-19T06:46:15.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.880+0000 7f9935da6640 1 --2- 172.21.15.86:0/1248786919 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f991006c2b0 0x7f991006e770 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:15.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.880+0000 7f9935da6640 1 --2- 172.21.15.86:0/1248786919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99301595f0 0x7f99301f24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:15.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.880+0000 7f9935da6640 1 --2- 172.21.15.86:0/1248786919 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99300c7220 0x7f9930147db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:15.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.880+0000 7f9935da6640 1 --2- 172.21.15.86:0/1248786919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f993006cc40 0x7f9930151e00 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:15.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.880+0000 7f9935da6640 1 -- 172.21.15.86:0/1248786919 >> 172.21.15.86:0/1248786919 conn(0x7f99300cdd80 msgr2=0x7f9930152930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:15.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.880+0000 7f9935da6640 1 -- 172.21.15.86:0/1248786919 shutdown_connections 2024-09-19T06:46:15.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:15.880+0000 7f9935da6640 1 -- 172.21.15.86:0/1248786919 wait complete. 2024-09-19T06:46:15.893 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:46:17.894 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:46:17.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.995+0000 7f9caf650640 1 Processor -- start 2024-09-19T06:46:17.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.996+0000 7f9caf650640 1 -- start start 2024-09-19T06:46:17.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.996+0000 7f9caf650640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9ca8154e20 0x7f9ca815afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:17.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.996+0000 7f9caf650640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9ca80ca020 0x7f9ca815e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:17.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.996+0000 7f9caf650640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ca815ec10 con 0x7f9ca8155200 2024-09-19T06:46:17.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.996+0000 7f9caf650640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f9ca815eed0 con 0x7f9ca8154e20 2024-09-19T06:46:17.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.996+0000 7f9caf650640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9ca815f1b0 con 0x7f9ca80ca020 2024-09-19T06:46:17.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.997+0000 7f9cadbed640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9ca80ca020 0x7f9ca815e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:17.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.997+0000 7f9cad3ec640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9ca8154e20 0x7f9ca815afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:17.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.997+0000 7f9cadbed640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9ca80ca020 0x7f9ca815e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:56722/0 (socket says 172.21.15.86:56722) 2024-09-19T06:46:17.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.997+0000 7f9cacbeb640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f9ca8155200 0x7f9ca8073840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:47102/0 (socket says 172.21.15.86:47102) 2024-09-19T06:46:17.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.997+0000 7f9cadbed640 1 -- 172.21.15.86:0/180285670 learned_addr learned my addr 172.21.15.86:0/180285670 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:17.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.997+0000 7f9cad3ec640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9ca8154e20 0x7f9ca815afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:41216/0 (socket says 172.21.15.86:41216) 2024-09-19T06:46:17.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.997+0000 7f9cadbed640 1 -- 172.21.15.86:0/180285670 >> v2:172.21.15.169:3300/0 conn(0x7f9ca8154e20 msgr2=0x7f9ca815afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:17.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.997+0000 7f9cadbed640 1 --2- 172.21.15.86:0/180285670 >> v2:172.21.15.169:3300/0 conn(0x7f9ca8154e20 0x7f9ca815afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:17.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.997+0000 7f9cadbed640 1 -- 172.21.15.86:0/180285670 >> v1:172.21.15.169:6789/0 conn(0x7f9ca8155200 legacy=0x7f9ca8073840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:18.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.997+0000 7f9cadbed640 1 -- 172.21.15.86:0/180285670 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca815f490 con 0x7f9ca80ca020 2024-09-19T06:46:18.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.997+0000 7f9cad3ec640 1 --2- 172.21.15.86:0/180285670 >> v2:172.21.15.169:3300/0 conn(0x7f9ca8154e20 0x7f9ca815afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:18.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.998+0000 7f9cadbed640 1 --2- 172.21.15.86:0/180285670 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9ca80ca020 0x7f9ca815e5b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9c98009870 tx=0x7f9c9802a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5eef6ac9f4dba45e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:18.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.998+0000 7f9c9ffff640 1 -- 172.21.15.86:0/180285670 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c98037070 con 0x7f9ca80ca020 2024-09-19T06:46:18.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.998+0000 7f9c9ffff640 1 -- 172.21.15.86:0/180285670 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c9802ae50 con 0x7f9ca80ca020 2024-09-19T06:46:18.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.998+0000 7f9c9ffff640 1 -- 172.21.15.86:0/180285670 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c98032860 con 0x7f9ca80ca020 2024-09-19T06:46:18.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.998+0000 7f9caf650640 1 -- 172.21.15.86:0/180285670 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9ca80ca020 msgr2=0x7f9ca815e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:18.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.998+0000 7f9caf650640 1 --2- 172.21.15.86:0/180285670 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9ca80ca020 0x7f9ca815e5b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9c98009870 tx=0x7f9c9802a300 comp rx=0 tx=0).stop 2024-09-19T06:46:18.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.999+0000 7f9caf650640 1 -- 172.21.15.86:0/180285670 shutdown_connections 2024-09-19T06:46:18.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.999+0000 7f9caf650640 1 --2- 172.21.15.86:0/180285670 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9ca80ca020 0x7f9ca815e5b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:18.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.999+0000 7f9caf650640 1 --2- 172.21.15.86:0/180285670 >> v2:172.21.15.169:3300/0 conn(0x7f9ca8154e20 0x7f9ca815afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:18.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.999+0000 7f9caf650640 1 -- 172.21.15.86:0/180285670 >> 172.21.15.86:0/180285670 conn(0x7f9ca8067890 msgr2=0x7f9ca8067c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:18.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.999+0000 7f9caf650640 1 -- 172.21.15.86:0/180285670 shutdown_connections 2024-09-19T06:46:18.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:17.999+0000 7f9caf650640 1 -- 172.21.15.86:0/180285670 wait complete. 2024-09-19T06:46:18.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.000+0000 7f9caf650640 1 Processor -- start 2024-09-19T06:46:18.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.000+0000 7f9caf650640 1 -- start start 2024-09-19T06:46:18.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.000+0000 7f9caf650640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9ca80ca020 0x7f9ca8150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:18.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.000+0000 7f9caf650640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ca8154e20 0x7f9ca81f1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:18.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.000+0000 7f9caf650640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ca8155200 0x7f9ca8158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:18.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.000+0000 7f9caf650640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca8070f10 con 0x7f9ca8154e20 2024-09-19T06:46:18.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.000+0000 7f9caf650640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca8070c30 con 0x7f9ca8155200 2024-09-19T06:46:18.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.000+0000 7f9caf650640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9ca80c9460 con 0x7f9ca80ca020 2024-09-19T06:46:18.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.001+0000 7f9cacbeb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ca8154e20 0x7f9ca81f1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:18.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.001+0000 7f9cacbeb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ca8154e20 0x7f9ca81f1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46860/0 (socket says 172.21.15.86:46860) 2024-09-19T06:46:18.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.001+0000 7f9cacbeb640 1 -- 172.21.15.86:0/4224206724 learned_addr learned my addr 172.21.15.86:0/4224206724 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:18.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.001+0000 7f9cad3ec640 1 --2- 172.21.15.86:0/4224206724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9ca80ca020 0x7f9ca8150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:18.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.001+0000 7f9cadbed640 1 --2- 172.21.15.86:0/4224206724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ca8155200 0x7f9ca8158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:18.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.001+0000 7f9cacbeb640 1 -- 172.21.15.86:0/4224206724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9ca80ca020 msgr2=0x7f9ca8150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:18.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.001+0000 7f9cacbeb640 1 --2- 172.21.15.86:0/4224206724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9ca80ca020 0x7f9ca8150d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:18.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.001+0000 7f9cacbeb640 1 -- 172.21.15.86:0/4224206724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ca8155200 msgr2=0x7f9ca8158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:18.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.001+0000 7f9cacbeb640 1 --2- 172.21.15.86:0/4224206724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ca8155200 0x7f9ca8158e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:18.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.001+0000 7f9cacbeb640 1 -- 172.21.15.86:0/4224206724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca815ade0 con 0x7f9ca8154e20 2024-09-19T06:46:18.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.001+0000 7f9cacbeb640 1 --2- 172.21.15.86:0/4224206724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ca8154e20 0x7f9ca81f1c80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9ca400c470 tx=0x7f9ca4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:18.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.001+0000 7f9c9dffb640 1 -- 172.21.15.86:0/4224206724 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca40074e0 con 0x7f9ca8154e20 2024-09-19T06:46:18.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.001+0000 7f9c9dffb640 1 -- 172.21.15.86:0/4224206724 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ca4007680 con 0x7f9ca8154e20 2024-09-19T06:46:18.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.001+0000 7f9caf650640 1 -- 172.21.15.86:0/4224206724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca81f4760 con 0x7f9ca8154e20 2024-09-19T06:46:18.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.001+0000 7f9c9dffb640 1 -- 172.21.15.86:0/4224206724 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4004a20 con 0x7f9ca8154e20 2024-09-19T06:46:18.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.002+0000 7f9caf650640 1 -- 172.21.15.86:0/4224206724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca815a300 con 0x7f9ca8154e20 2024-09-19T06:46:18.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.002+0000 7f9caf650640 1 -- 172.21.15.86:0/4224206724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ca815e5b0 con 0x7f9ca8154e20 2024-09-19T06:46:18.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.003+0000 7f9c9dffb640 1 -- 172.21.15.86:0/4224206724 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9ca401a020 con 0x7f9ca8154e20 2024-09-19T06:46:18.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.003+0000 7f9c9dffb640 1 --2- 172.21.15.86:0/4224206724 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9c9406c2e0 0x7f9c9406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:18.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.003+0000 7f9c9dffb640 1 -- 172.21.15.86:0/4224206724 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7f9ca408b060 con 0x7f9ca8154e20 2024-09-19T06:46:18.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.003+0000 7f9cad3ec640 1 --2- 172.21.15.86:0/4224206724 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9c9406c2e0 0x7f9c9406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:18.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.004+0000 7f9cad3ec640 1 --2- 172.21.15.86:0/4224206724 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9c9406c2e0 0x7f9c9406e7a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0009bd0 tx=0x7f9ca000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:18.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.008+0000 7f9c9dffb640 1 -- 172.21.15.86:0/4224206724 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9ca81f4760 con 0x7f9ca8154e20 2024-09-19T06:46:18.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.211+0000 7f9caf650640 1 -- 172.21.15.86:0/4224206724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ca8068080 con 0x7f9ca8154e20 2024-09-19T06:46:18.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.212+0000 7f9c9dffb640 1 -- 172.21.15.86:0/4224206724 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+6054 (secure 0 0 0) 0x7f9ca815ade0 con 0x7f9ca8154e20 2024-09-19T06:46:18.214 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:46:18.214 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":38,"btime":"2024-09-19T06:46:18:068869+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:46:18.053166+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5092},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5092":{"gid":5092,"name":"d","rank":0,"incarnation":35,"state":"up:clientreplay","state_seq":19,"addr":"172.21.15.169:6837/1148622307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1148622307},{"type":"v1","addr":"172.21.15.169:6837","nonce":1148622307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:46:18.214 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 38 2024-09-19T06:46:18.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.214+0000 7f9caf650640 1 -- 172.21.15.86:0/4224206724 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9c9406c2e0 msgr2=0x7f9c9406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:18.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.214+0000 7f9caf650640 1 --2- 172.21.15.86:0/4224206724 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9c9406c2e0 0x7f9c9406e7a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0009bd0 tx=0x7f9ca000b040 comp rx=0 tx=0).stop 2024-09-19T06:46:18.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.214+0000 7f9caf650640 1 -- 172.21.15.86:0/4224206724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ca8154e20 msgr2=0x7f9ca81f1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:18.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.214+0000 7f9caf650640 1 --2- 172.21.15.86:0/4224206724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ca8154e20 0x7f9ca81f1c80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9ca400c470 tx=0x7f9ca4001e70 comp rx=0 tx=0).stop 2024-09-19T06:46:18.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.214+0000 7f9caf650640 1 -- 172.21.15.86:0/4224206724 shutdown_connections 2024-09-19T06:46:18.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.214+0000 7f9caf650640 1 --2- 172.21.15.86:0/4224206724 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9c9406c2e0 0x7f9c9406e7a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:18.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.214+0000 7f9caf650640 1 --2- 172.21.15.86:0/4224206724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ca8155200 0x7f9ca8158e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:18.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.214+0000 7f9caf650640 1 --2- 172.21.15.86:0/4224206724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ca8154e20 0x7f9ca81f1c80 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:18.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.214+0000 7f9caf650640 1 --2- 172.21.15.86:0/4224206724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9ca80ca020 0x7f9ca8150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:18.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.214+0000 7f9caf650640 1 -- 172.21.15.86:0/4224206724 >> 172.21.15.86:0/4224206724 conn(0x7f9ca8067890 msgr2=0x7f9ca80cb310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:18.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.214+0000 7f9caf650640 1 -- 172.21.15.86:0/4224206724 shutdown_connections 2024-09-19T06:46:18.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:18.214+0000 7f9caf650640 1 -- 172.21.15.86:0/4224206724 wait complete. 2024-09-19T06:46:18.227 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:46:20.227 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:46:20.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.325+0000 7f01fbce4640 1 Processor -- start 2024-09-19T06:46:20.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.326+0000 7f01fbce4640 1 -- start start 2024-09-19T06:46:20.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.326+0000 7f01fbce4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01f40d0d40 0x7f01f40ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:20.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.326+0000 7f01fbce4640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f01f40d1120 0x7f01f40cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:20.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.326+0000 7f01fbce4640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01f415c9c0 con 0x7f01f415da60 2024-09-19T06:46:20.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.326+0000 7f01fbce4640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f01f415c770 con 0x7f01f40d1120 2024-09-19T06:46:20.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.326+0000 7f01fbce4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f01f40b3f20 con 0x7f01f40d0d40 2024-09-19T06:46:20.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.326+0000 7f01f927f640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f01f40d1120 0x7f01f40cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:20.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.326+0000 7f01fa281640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f01f415da60 0x7f01f40b4b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58730/0 (socket says 172.21.15.86:58730) 2024-09-19T06:46:20.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.326+0000 7f01fa281640 1 -- 172.21.15.86:0/3619812254 learned_addr learned my addr 172.21.15.86:0/3619812254 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:46:20.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.327+0000 7f01f9a80640 1 --2- 172.21.15.86:0/3619812254 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01f40d0d40 0x7f01f40ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:20.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.327+0000 7f01f927f640 1 -- 172.21.15.86:0/3619812254 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01f40d0d40 msgr2=0x7f01f40ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:20.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.327+0000 7f01f927f640 1 --2- 172.21.15.86:0/3619812254 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01f40d0d40 0x7f01f40ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:20.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.327+0000 7f01f927f640 1 -- 172.21.15.86:0/3619812254 >> v1:172.21.15.86:6789/0 conn(0x7f01f415da60 legacy=0x7f01f40b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:20.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.327+0000 7f01f8a7e640 1 -- 172.21.15.86:0/3619812254 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1639863888 0 0) 0x7f01f415c9c0 con 0x7f01f415da60 2024-09-19T06:46:20.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.327+0000 7f01f927f640 1 -- 172.21.15.86:0/3619812254 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f415cca0 con 0x7f01f40d1120 2024-09-19T06:46:20.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.327+0000 7f01f9a80640 1 --2- 172.21.15.86:0/3619812254 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01f40d0d40 0x7f01f40ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:20.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.328+0000 7f01f927f640 1 --2- 172.21.15.86:0/3619812254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f40d1120 0x7f01f40cac00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f01f00097a0 tx=0x7f01f002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef96189b1024eea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:20.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.328+0000 7f01f8a7e640 1 -- 172.21.15.86:0/3619812254 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f0037070 con 0x7f01f40d1120 2024-09-19T06:46:20.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.328+0000 7f01f8a7e640 1 -- 172.21.15.86:0/3619812254 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f0032440 con 0x7f01f40d1120 2024-09-19T06:46:20.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.328+0000 7f01f8a7e640 1 -- 172.21.15.86:0/3619812254 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f0032810 con 0x7f01f40d1120 2024-09-19T06:46:20.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.328+0000 7f01fbce4640 1 -- 172.21.15.86:0/3619812254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f40d1120 msgr2=0x7f01f40cac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:20.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.328+0000 7f01fbce4640 1 --2- 172.21.15.86:0/3619812254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f40d1120 0x7f01f40cac00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f01f00097a0 tx=0x7f01f002a180 comp rx=0 tx=0).stop 2024-09-19T06:46:20.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.329+0000 7f01fbce4640 1 -- 172.21.15.86:0/3619812254 shutdown_connections 2024-09-19T06:46:20.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.329+0000 7f01fbce4640 1 --2- 172.21.15.86:0/3619812254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f40d1120 0x7f01f40cac00 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:20.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.329+0000 7f01fbce4640 1 --2- 172.21.15.86:0/3619812254 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01f40d0d40 0x7f01f40ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:20.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.329+0000 7f01fbce4640 1 -- 172.21.15.86:0/3619812254 >> 172.21.15.86:0/3619812254 conn(0x7f01f406d910 msgr2=0x7f01f406dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:20.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.329+0000 7f01fbce4640 1 -- 172.21.15.86:0/3619812254 shutdown_connections 2024-09-19T06:46:20.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.329+0000 7f01fbce4640 1 -- 172.21.15.86:0/3619812254 wait complete. 2024-09-19T06:46:20.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.330+0000 7f01fbce4640 1 Processor -- start 2024-09-19T06:46:20.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.330+0000 7f01fbce4640 1 -- start start 2024-09-19T06:46:20.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.331+0000 7f01fbce4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01f40d0d40 0x7f01f41582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:20.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.331+0000 7f01fbce4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f40d1120 0x7f01f415ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:20.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.331+0000 7f01fbce4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01f415da60 0x7f01f415b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:20.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.331+0000 7f01fbce4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f01f415df10 con 0x7f01f40d1120 2024-09-19T06:46:20.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.331+0000 7f01fbce4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f01f415d260 con 0x7f01f415da60 2024-09-19T06:46:20.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.331+0000 7f01fbce4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f01f415e090 con 0x7f01f40d0d40 2024-09-19T06:46:20.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.331+0000 7f01f927f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f40d1120 0x7f01f415ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:20.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.331+0000 7f01f927f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f40d1120 0x7f01f415ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46880/0 (socket says 172.21.15.86:46880) 2024-09-19T06:46:20.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.331+0000 7f01f927f640 1 -- 172.21.15.86:0/959448804 learned_addr learned my addr 172.21.15.86:0/959448804 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:20.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.331+0000 7f01fa281640 1 --2- 172.21.15.86:0/959448804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01f415da60 0x7f01f415b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:20.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.331+0000 7f01f9a80640 1 --2- 172.21.15.86:0/959448804 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01f40d0d40 0x7f01f41582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:20.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.331+0000 7f01f927f640 1 -- 172.21.15.86:0/959448804 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01f40d0d40 msgr2=0x7f01f41582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:20.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.331+0000 7f01f927f640 1 --2- 172.21.15.86:0/959448804 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01f40d0d40 0x7f01f41582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:20.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.331+0000 7f01f927f640 1 -- 172.21.15.86:0/959448804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01f415da60 msgr2=0x7f01f415b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:20.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.331+0000 7f01f927f640 1 --2- 172.21.15.86:0/959448804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01f415da60 0x7f01f415b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:20.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.331+0000 7f01f927f640 1 -- 172.21.15.86:0/959448804 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f41f1bc0 con 0x7f01f40d1120 2024-09-19T06:46:20.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.331+0000 7f01f927f640 1 --2- 172.21.15.86:0/959448804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f40d1120 0x7f01f415ae00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f01f00097a0 tx=0x7f01f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:20.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.331+0000 7f01ea7fc640 1 -- 172.21.15.86:0/959448804 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f0037050 con 0x7f01f40d1120 2024-09-19T06:46:20.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.331+0000 7f01ea7fc640 1 -- 172.21.15.86:0/959448804 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f0038040 con 0x7f01f40d1120 2024-09-19T06:46:20.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.331+0000 7f01fbce4640 1 -- 172.21.15.86:0/959448804 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f41f1040 con 0x7f01f40d1120 2024-09-19T06:46:20.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.331+0000 7f01ea7fc640 1 -- 172.21.15.86:0/959448804 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f0004470 con 0x7f01f40d1120 2024-09-19T06:46:20.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.331+0000 7f01fbce4640 1 -- 172.21.15.86:0/959448804 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f41f1600 con 0x7f01f40d1120 2024-09-19T06:46:20.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.333+0000 7f01fbce4640 1 -- 172.21.15.86:0/959448804 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01f40ca6c0 con 0x7f01f40d1120 2024-09-19T06:46:20.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.333+0000 7f01ea7fc640 1 -- 172.21.15.86:0/959448804 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f01f0030900 con 0x7f01f40d1120 2024-09-19T06:46:20.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.333+0000 7f01ea7fc640 1 --2- 172.21.15.86:0/959448804 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f01d806c2b0 0x7f01d806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:20.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.333+0000 7f01ea7fc640 1 -- 172.21.15.86:0/959448804 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7f01f00ac600 con 0x7f01f40d1120 2024-09-19T06:46:20.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.333+0000 7f01f9a80640 1 --2- 172.21.15.86:0/959448804 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f01d806c2b0 0x7f01d806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:20.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.334+0000 7f01f9a80640 1 --2- 172.21.15.86:0/959448804 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f01d806c2b0 0x7f01d806e770 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f01e4006fd0 tx=0x7f01e4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:20.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.337+0000 7f01ea7fc640 1 -- 172.21.15.86:0/959448804 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f01f007a7f0 con 0x7f01f40d1120 2024-09-19T06:46:20.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.570+0000 7f01fbce4640 1 -- 172.21.15.86:0/959448804 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01f40d1590 con 0x7f01f40d1120 2024-09-19T06:46:20.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.570+0000 7f01ea7fc640 1 -- 172.21.15.86:0/959448804 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+6054 (secure 0 0 0) 0x7f01f007a0f0 con 0x7f01f40d1120 2024-09-19T06:46:20.572 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:46:20.572 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":38,"btime":"2024-09-19T06:46:18:068869+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:46:18.053166+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5092},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5092":{"gid":5092,"name":"d","rank":0,"incarnation":35,"state":"up:clientreplay","state_seq":19,"addr":"172.21.15.169:6837/1148622307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1148622307},{"type":"v1","addr":"172.21.15.169:6837","nonce":1148622307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:46:20.572 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 38 2024-09-19T06:46:20.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.572+0000 7f01fbce4640 1 -- 172.21.15.86:0/959448804 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f01d806c2b0 msgr2=0x7f01d806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:20.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.572+0000 7f01fbce4640 1 --2- 172.21.15.86:0/959448804 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f01d806c2b0 0x7f01d806e770 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f01e4006fd0 tx=0x7f01e4008040 comp rx=0 tx=0).stop 2024-09-19T06:46:20.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.572+0000 7f01fbce4640 1 -- 172.21.15.86:0/959448804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f40d1120 msgr2=0x7f01f415ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:20.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.572+0000 7f01fbce4640 1 --2- 172.21.15.86:0/959448804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f40d1120 0x7f01f415ae00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f01f00097a0 tx=0x7f01f00046c0 comp rx=0 tx=0).stop 2024-09-19T06:46:20.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.573+0000 7f01fbce4640 1 -- 172.21.15.86:0/959448804 shutdown_connections 2024-09-19T06:46:20.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.573+0000 7f01fbce4640 1 --2- 172.21.15.86:0/959448804 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f01d806c2b0 0x7f01d806e770 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:20.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.573+0000 7f01fbce4640 1 --2- 172.21.15.86:0/959448804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01f415da60 0x7f01f415b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:20.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.573+0000 7f01fbce4640 1 --2- 172.21.15.86:0/959448804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f40d1120 0x7f01f415ae00 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:20.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.573+0000 7f01fbce4640 1 --2- 172.21.15.86:0/959448804 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01f40d0d40 0x7f01f41582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:20.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.573+0000 7f01fbce4640 1 -- 172.21.15.86:0/959448804 >> 172.21.15.86:0/959448804 conn(0x7f01f406d910 msgr2=0x7f01f40cda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:20.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.573+0000 7f01fbce4640 1 -- 172.21.15.86:0/959448804 shutdown_connections 2024-09-19T06:46:20.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:20.573+0000 7f01fbce4640 1 -- 172.21.15.86:0/959448804 wait complete. 2024-09-19T06:46:20.585 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:46:22.586 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:46:22.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.684+0000 7f9f6ce53640 1 Processor -- start 2024-09-19T06:46:22.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.684+0000 7f9f6ce53640 1 -- start start 2024-09-19T06:46:22.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.685+0000 7f9f6ce53640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9f680c7220 0x7f9f680c7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:22.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.685+0000 7f9f6ce53640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9f6806cc40 0x7f9f681590b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:22.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.685+0000 7f9f6ce53640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f6806bf00 con 0x7f9f681595f0 2024-09-19T06:46:22.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.685+0000 7f9f6ce53640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f9f680c4d50 con 0x7f9f6806cc40 2024-09-19T06:46:22.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.685+0000 7f9f6ce53640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f9f680c6890 con 0x7f9f680c7220 2024-09-19T06:46:22.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.685+0000 7f9f66d9d640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f9f681595f0 0x7f9f68152b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60480/0 (socket says 172.21.15.86:60480) 2024-09-19T06:46:22.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.685+0000 7f9f66d9d640 1 -- 172.21.15.86:0/2439228590 learned_addr learned my addr 172.21.15.86:0/2439228590 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:46:22.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.685+0000 7f9f5ffff640 1 --2- 172.21.15.86:0/2439228590 >> v2:172.21.15.86:3300/0 conn(0x7f9f6806cc40 0x7f9f681590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:22.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.685+0000 7f9f65d9b640 1 -- 172.21.15.86:0/2439228590 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1094720113 0 0) 0x7f9f6806bf00 con 0x7f9f681595f0 2024-09-19T06:46:22.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.686+0000 7f9f65d9b640 1 -- 172.21.15.86:0/2439228590 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f54003520 con 0x7f9f681595f0 2024-09-19T06:46:22.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.686+0000 7f9f6659c640 1 --2- 172.21.15.86:0/2439228590 >> v2:172.21.15.169:3300/0 conn(0x7f9f680c7220 0x7f9f680c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:22.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.686+0000 7f9f5ffff640 1 -- 172.21.15.86:0/2439228590 >> v2:172.21.15.169:3300/0 conn(0x7f9f680c7220 msgr2=0x7f9f680c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:22.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.686+0000 7f9f5ffff640 1 --2- 172.21.15.86:0/2439228590 >> v2:172.21.15.169:3300/0 conn(0x7f9f680c7220 0x7f9f680c7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:22.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.686+0000 7f9f5ffff640 1 -- 172.21.15.86:0/2439228590 >> v1:172.21.15.86:6789/0 conn(0x7f9f681595f0 legacy=0x7f9f68152b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:22.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.686+0000 7f9f5ffff640 1 -- 172.21.15.86:0/2439228590 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f680c4ff0 con 0x7f9f6806cc40 2024-09-19T06:46:22.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.686+0000 7f9f5ffff640 1 --2- 172.21.15.86:0/2439228590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f6806cc40 0x7f9f681590b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9f680ce300 tx=0x7f9f5002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=877f62155a056f99 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:22.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.686+0000 7f9f65d9b640 1 -- 172.21.15.86:0/2439228590 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f50037070 con 0x7f9f6806cc40 2024-09-19T06:46:22.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.686+0000 7f9f65d9b640 1 -- 172.21.15.86:0/2439228590 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f50032440 con 0x7f9f6806cc40 2024-09-19T06:46:22.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.686+0000 7f9f65d9b640 1 -- 172.21.15.86:0/2439228590 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f50032810 con 0x7f9f6806cc40 2024-09-19T06:46:22.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.687+0000 7f9f6ce53640 1 -- 172.21.15.86:0/2439228590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f6806cc40 msgr2=0x7f9f681590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:22.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.687+0000 7f9f6ce53640 1 --2- 172.21.15.86:0/2439228590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f6806cc40 0x7f9f681590b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9f680ce300 tx=0x7f9f5002a1a0 comp rx=0 tx=0).stop 2024-09-19T06:46:22.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.687+0000 7f9f6ce53640 1 -- 172.21.15.86:0/2439228590 shutdown_connections 2024-09-19T06:46:22.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.687+0000 7f9f6ce53640 1 --2- 172.21.15.86:0/2439228590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f6806cc40 0x7f9f681590b0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:22.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.687+0000 7f9f6ce53640 1 --2- 172.21.15.86:0/2439228590 >> v2:172.21.15.169:3300/0 conn(0x7f9f680c7220 0x7f9f680c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:22.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.687+0000 7f9f6ce53640 1 -- 172.21.15.86:0/2439228590 >> 172.21.15.86:0/2439228590 conn(0x7f9f680cdd80 msgr2=0x7f9f680ca220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:22.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.687+0000 7f9f6ce53640 1 -- 172.21.15.86:0/2439228590 shutdown_connections 2024-09-19T06:46:22.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.687+0000 7f9f6ce53640 1 -- 172.21.15.86:0/2439228590 wait complete. 2024-09-19T06:46:22.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.688+0000 7f9f6ce53640 1 Processor -- start 2024-09-19T06:46:22.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.688+0000 7f9f6ce53640 1 -- start start 2024-09-19T06:46:22.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.689+0000 7f9f6ce53640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f6806cc40 0x7f9f68151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:22.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.689+0000 7f9f6ce53640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f680c7220 0x7f9f68142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:22.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.689+0000 7f9f6ce53640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f681595f0 0x7f9f681ef2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:22.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.689+0000 7f9f6ce53640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9f680c5890 con 0x7f9f681595f0 2024-09-19T06:46:22.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.689+0000 7f9f6ce53640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9f680c55b0 con 0x7f9f680c7220 2024-09-19T06:46:22.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.689+0000 7f9f6ce53640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9f681599f0 con 0x7f9f6806cc40 2024-09-19T06:46:22.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.689+0000 7f9f66d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f681595f0 0x7f9f681ef2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:22.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.689+0000 7f9f66d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f681595f0 0x7f9f681ef2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44958/0 (socket says 172.21.15.86:44958) 2024-09-19T06:46:22.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.689+0000 7f9f66d9d640 1 -- 172.21.15.86:0/2883271809 learned_addr learned my addr 172.21.15.86:0/2883271809 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:22.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.689+0000 7f9f5ffff640 1 --2- 172.21.15.86:0/2883271809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f680c7220 0x7f9f68142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:22.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.689+0000 7f9f6659c640 1 --2- 172.21.15.86:0/2883271809 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f6806cc40 0x7f9f68151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:22.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.689+0000 7f9f66d9d640 1 -- 172.21.15.86:0/2883271809 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f6806cc40 msgr2=0x7f9f68151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:22.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.690+0000 7f9f66d9d640 1 --2- 172.21.15.86:0/2883271809 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f6806cc40 0x7f9f68151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:22.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.690+0000 7f9f66d9d640 1 -- 172.21.15.86:0/2883271809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f680c7220 msgr2=0x7f9f68142cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:22.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.690+0000 7f9f66d9d640 1 --2- 172.21.15.86:0/2883271809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f680c7220 0x7f9f68142cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:22.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.690+0000 7f9f66d9d640 1 -- 172.21.15.86:0/2883271809 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f681f24f0 con 0x7f9f681595f0 2024-09-19T06:46:22.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.690+0000 7f9f5ffff640 1 --2- 172.21.15.86:0/2883271809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f680c7220 0x7f9f68142cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:46:22.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.690+0000 7f9f6659c640 1 --2- 172.21.15.86:0/2883271809 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f6806cc40 0x7f9f68151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:46:22.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.690+0000 7f9f66d9d640 1 --2- 172.21.15.86:0/2883271809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f681595f0 0x7f9f681ef2e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9f6000cad0 tx=0x7f9f6000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:22.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.690+0000 7f9f5effd640 1 -- 172.21.15.86:0/2883271809 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f60017070 con 0x7f9f681595f0 2024-09-19T06:46:22.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.690+0000 7f9f5effd640 1 -- 172.21.15.86:0/2883271809 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f6000abd0 con 0x7f9f681595f0 2024-09-19T06:46:22.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.690+0000 7f9f6ce53640 1 -- 172.21.15.86:0/2883271809 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f681f27d0 con 0x7f9f681595f0 2024-09-19T06:46:22.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.690+0000 7f9f5effd640 1 -- 172.21.15.86:0/2883271809 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f60012400 con 0x7f9f681595f0 2024-09-19T06:46:22.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.690+0000 7f9f6ce53640 1 -- 172.21.15.86:0/2883271809 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f681f2d90 con 0x7f9f681595f0 2024-09-19T06:46:22.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.691+0000 7f9f6ce53640 1 -- 172.21.15.86:0/2883271809 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f6806bbc0 con 0x7f9f681595f0 2024-09-19T06:46:22.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.691+0000 7f9f5effd640 1 -- 172.21.15.86:0/2883271809 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9f6001a070 con 0x7f9f681595f0 2024-09-19T06:46:22.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.692+0000 7f9f5effd640 1 --2- 172.21.15.86:0/2883271809 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9f4806c2b0 0x7f9f4806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:22.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.692+0000 7f9f5effd640 1 -- 172.21.15.86:0/2883271809 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7f9f6008b7c0 con 0x7f9f681595f0 2024-09-19T06:46:22.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.692+0000 7f9f6659c640 1 --2- 172.21.15.86:0/2883271809 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9f4806c2b0 0x7f9f4806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:22.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.692+0000 7f9f6659c640 1 --2- 172.21.15.86:0/2883271809 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9f4806c2b0 0x7f9f4806e770 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9f58006fd0 tx=0x7f9f58008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:22.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.696+0000 7f9f5effd640 1 -- 172.21.15.86:0/2883271809 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9f60059920 con 0x7f9f681595f0 2024-09-19T06:46:22.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.903+0000 7f9f6ce53640 1 -- 172.21.15.86:0/2883271809 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f68159350 con 0x7f9f681595f0 2024-09-19T06:46:22.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.904+0000 7f9f5effd640 1 -- 172.21.15.86:0/2883271809 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+6054 (secure 0 0 0) 0x7f9f60059220 con 0x7f9f681595f0 2024-09-19T06:46:22.906 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:46:22.906 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":38,"btime":"2024-09-19T06:46:18:068869+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:46:18.053166+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5092},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5092":{"gid":5092,"name":"d","rank":0,"incarnation":35,"state":"up:clientreplay","state_seq":19,"addr":"172.21.15.169:6837/1148622307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1148622307},{"type":"v1","addr":"172.21.15.169:6837","nonce":1148622307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T06:46:22.906 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 38 2024-09-19T06:46:22.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.906+0000 7f9f6ce53640 1 -- 172.21.15.86:0/2883271809 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9f4806c2b0 msgr2=0x7f9f4806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:22.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.906+0000 7f9f6ce53640 1 --2- 172.21.15.86:0/2883271809 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9f4806c2b0 0x7f9f4806e770 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9f58006fd0 tx=0x7f9f58008040 comp rx=0 tx=0).stop 2024-09-19T06:46:22.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.906+0000 7f9f6ce53640 1 -- 172.21.15.86:0/2883271809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f681595f0 msgr2=0x7f9f681ef2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:22.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.906+0000 7f9f6ce53640 1 --2- 172.21.15.86:0/2883271809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f681595f0 0x7f9f681ef2e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9f6000cad0 tx=0x7f9f6000cf90 comp rx=0 tx=0).stop 2024-09-19T06:46:22.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.906+0000 7f9f6ce53640 1 -- 172.21.15.86:0/2883271809 shutdown_connections 2024-09-19T06:46:22.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.906+0000 7f9f6ce53640 1 --2- 172.21.15.86:0/2883271809 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9f4806c2b0 0x7f9f4806e770 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:22.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.906+0000 7f9f6ce53640 1 --2- 172.21.15.86:0/2883271809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f681595f0 0x7f9f681ef2e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:22.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.906+0000 7f9f6ce53640 1 --2- 172.21.15.86:0/2883271809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f680c7220 0x7f9f68142cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:22.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.906+0000 7f9f6ce53640 1 --2- 172.21.15.86:0/2883271809 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f6806cc40 0x7f9f68151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:22.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.906+0000 7f9f6ce53640 1 -- 172.21.15.86:0/2883271809 >> 172.21.15.86:0/2883271809 conn(0x7f9f680cdd80 msgr2=0x7f9f680c7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:22.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.906+0000 7f9f6ce53640 1 -- 172.21.15.86:0/2883271809 shutdown_connections 2024-09-19T06:46:22.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:22.906+0000 7f9f6ce53640 1 -- 172.21.15.86:0/2883271809 wait complete. 2024-09-19T06:46:22.922 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-19T06:46:24.923 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:46:25.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.029+0000 7f5a4b3cf640 1 Processor -- start 2024-09-19T06:46:25.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.029+0000 7f5a4b3cf640 1 -- start start 2024-09-19T06:46:25.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.030+0000 7f5a4b3cf640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5a44152060 0x7f5a44072d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:25.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.030+0000 7f5a4b3cf640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5a4406bd10 0x7f5a440732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:25.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.030+0000 7f5a4b3cf640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a44158710 con 0x7f5a440c3680 2024-09-19T06:46:25.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.030+0000 7f5a4b3cf640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f5a440716c0 con 0x7f5a44152060 2024-09-19T06:46:25.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.030+0000 7f5a4b3cf640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f5a44152440 con 0x7f5a4406bd10 2024-09-19T06:46:25.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.030+0000 7f5a4916b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5a44152060 0x7f5a44072d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:25.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.030+0000 7f5a4916b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5a44152060 0x7f5a44072d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44964/0 (socket says 172.21.15.86:44964) 2024-09-19T06:46:25.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.030+0000 7f5a4916b640 1 -- 172.21.15.86:0/72810060 learned_addr learned my addr 172.21.15.86:0/72810060 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:25.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.030+0000 7f5a4896a640 1 --2- 172.21.15.86:0/72810060 >> v2:172.21.15.169:3300/0 conn(0x7f5a4406bd10 0x7f5a440732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:25.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.030+0000 7f5a4916b640 1 -- 172.21.15.86:0/72810060 >> v2:172.21.15.169:3300/0 conn(0x7f5a4406bd10 msgr2=0x7f5a440732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:25.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.030+0000 7f5a4916b640 1 --2- 172.21.15.86:0/72810060 >> v2:172.21.15.169:3300/0 conn(0x7f5a4406bd10 0x7f5a440732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:25.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.030+0000 7f5a4916b640 1 -- 172.21.15.86:0/72810060 >> v1:172.21.15.86:6789/0 conn(0x7f5a440c3680 legacy=0x7f5a440719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:25.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.030+0000 7f5a4916b640 1 -- 172.21.15.86:0/72810060 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a441589b0 con 0x7f5a44152060 2024-09-19T06:46:25.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.030+0000 7f5a43fff640 1 -- 172.21.15.86:0/72810060 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1885001965 0 0) 0x7f5a44158710 con 0x7f5a440c3680 2024-09-19T06:46:25.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.031+0000 7f5a4916b640 1 --2- 172.21.15.86:0/72810060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a44152060 0x7f5a44072d90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5a440c4850 tx=0x7f5a3402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c7b7dda6d42975 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:25.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.031+0000 7f5a43fff640 1 -- 172.21.15.86:0/72810060 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a34037070 con 0x7f5a44152060 2024-09-19T06:46:25.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.031+0000 7f5a43fff640 1 -- 172.21.15.86:0/72810060 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a3402ae50 con 0x7f5a44152060 2024-09-19T06:46:25.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.031+0000 7f5a43fff640 1 -- 172.21.15.86:0/72810060 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a34032860 con 0x7f5a44152060 2024-09-19T06:46:25.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.031+0000 7f5a4b3cf640 1 -- 172.21.15.86:0/72810060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a44152060 msgr2=0x7f5a44072d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:25.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.031+0000 7f5a4b3cf640 1 --2- 172.21.15.86:0/72810060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a44152060 0x7f5a44072d90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5a440c4850 tx=0x7f5a3402a300 comp rx=0 tx=0).stop 2024-09-19T06:46:25.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.031+0000 7f5a4b3cf640 1 -- 172.21.15.86:0/72810060 shutdown_connections 2024-09-19T06:46:25.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.031+0000 7f5a4b3cf640 1 --2- 172.21.15.86:0/72810060 >> v2:172.21.15.169:3300/0 conn(0x7f5a4406bd10 0x7f5a440732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:25.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.031+0000 7f5a4b3cf640 1 --2- 172.21.15.86:0/72810060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a44152060 0x7f5a44072d90 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:25.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.031+0000 7f5a4b3cf640 1 -- 172.21.15.86:0/72810060 >> 172.21.15.86:0/72810060 conn(0x7f5a440c9280 msgr2=0x7f5a440c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:25.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.032+0000 7f5a4b3cf640 1 -- 172.21.15.86:0/72810060 shutdown_connections 2024-09-19T06:46:25.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.032+0000 7f5a4b3cf640 1 -- 172.21.15.86:0/72810060 wait complete. 2024-09-19T06:46:25.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.033+0000 7f5a4b3cf640 1 Processor -- start 2024-09-19T06:46:25.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.033+0000 7f5a4b3cf640 1 -- start start 2024-09-19T06:46:25.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.033+0000 7f5a4b3cf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a4406bd10 0x7f5a44157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:25.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.033+0000 7f5a4b3cf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a440c3680 0x7f5a4414a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:25.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.033+0000 7f5a4b3cf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a44152060 0x7f5a4414aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:25.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.033+0000 7f5a4b3cf640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5a440c9e10 con 0x7f5a4406bd10 2024-09-19T06:46:25.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.033+0000 7f5a4b3cf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5a44071350 con 0x7f5a440c3680 2024-09-19T06:46:25.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.033+0000 7f5a4b3cf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5a440720d0 con 0x7f5a44152060 2024-09-19T06:46:25.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.033+0000 7f5a4916b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a4406bd10 0x7f5a44157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:25.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.034+0000 7f5a4916b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a4406bd10 0x7f5a44157150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44968/0 (socket says 172.21.15.86:44968) 2024-09-19T06:46:25.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.034+0000 7f5a4916b640 1 -- 172.21.15.86:0/96404415 learned_addr learned my addr 172.21.15.86:0/96404415 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:25.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.034+0000 7f5a4896a640 1 --2- 172.21.15.86:0/96404415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a440c3680 0x7f5a4414a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:25.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.034+0000 7f5a4996c640 1 --2- 172.21.15.86:0/96404415 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a44152060 0x7f5a4414aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:25.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.034+0000 7f5a4916b640 1 -- 172.21.15.86:0/96404415 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a44152060 msgr2=0x7f5a4414aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:25.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.034+0000 7f5a4916b640 1 --2- 172.21.15.86:0/96404415 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a44152060 0x7f5a4414aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:25.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.034+0000 7f5a4916b640 1 -- 172.21.15.86:0/96404415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a440c3680 msgr2=0x7f5a4414a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:25.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.034+0000 7f5a4916b640 1 --2- 172.21.15.86:0/96404415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a440c3680 0x7f5a4414a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:25.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.034+0000 7f5a4916b640 1 -- 172.21.15.86:0/96404415 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a44154170 con 0x7f5a4406bd10 2024-09-19T06:46:25.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.034+0000 7f5a4916b640 1 --2- 172.21.15.86:0/96404415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a4406bd10 0x7f5a44157150 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5a34000c00 tx=0x7f5a340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:25.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.034+0000 7f5a41ffb640 1 -- 172.21.15.86:0/96404415 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a34042070 con 0x7f5a4406bd10 2024-09-19T06:46:25.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.034+0000 7f5a41ffb640 1 -- 172.21.15.86:0/96404415 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a3403e670 con 0x7f5a4406bd10 2024-09-19T06:46:25.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.034+0000 7f5a4b3cf640 1 -- 172.21.15.86:0/96404415 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a441553d0 con 0x7f5a4406bd10 2024-09-19T06:46:25.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.034+0000 7f5a41ffb640 1 -- 172.21.15.86:0/96404415 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a34037040 con 0x7f5a4406bd10 2024-09-19T06:46:25.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.035+0000 7f5a4b3cf640 1 -- 172.21.15.86:0/96404415 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a44157690 con 0x7f5a4406bd10 2024-09-19T06:46:25.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.035+0000 7f5a4b3cf640 1 -- 172.21.15.86:0/96404415 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a44072490 con 0x7f5a4406bd10 2024-09-19T06:46:25.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.036+0000 7f5a41ffb640 1 -- 172.21.15.86:0/96404415 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5a34045070 con 0x7f5a4406bd10 2024-09-19T06:46:25.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.036+0000 7f5a41ffb640 1 --2- 172.21.15.86:0/96404415 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5a3006c2b0 0x7f5a3006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:25.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.036+0000 7f5a41ffb640 1 -- 172.21.15.86:0/96404415 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7f5a340ac130 con 0x7f5a4406bd10 2024-09-19T06:46:25.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.036+0000 7f5a4896a640 1 --2- 172.21.15.86:0/96404415 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5a3006c2b0 0x7f5a3006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:25.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.037+0000 7f5a4896a640 1 --2- 172.21.15.86:0/96404415 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5a3006c2b0 0x7f5a3006e770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5a4414a210 tx=0x7f5a38008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:25.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.041+0000 7f5a41ffb640 1 -- 172.21.15.86:0/96404415 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5a34079cd0 con 0x7f5a4406bd10 2024-09-19T06:46:25.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.240+0000 7f5a4b3cf640 1 -- 172.21.15.86:0/96404415 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a440c9060 con 0x7f5a4406bd10 2024-09-19T06:46:25.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.240+0000 7f5a41ffb640 1 -- 172.21.15.86:0/96404415 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+6055 (secure 0 0 0) 0x7f5a3407dfd0 con 0x7f5a4406bd10 2024-09-19T06:46:25.242 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:46:25.242 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":39,"btime":"2024-09-19T06:46:24:081910+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:46:24.081904+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5092},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5092":{"gid":5092,"name":"d","rank":0,"incarnation":35,"state":"up:active","state_seq":21,"addr":"172.21.15.169:6837/1148622307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1148622307},{"type":"v1","addr":"172.21.15.169:6837","nonce":1148622307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5092,"qdb_cluster":[5092]},"id":1}]} 2024-09-19T06:46:25.242 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 39 2024-09-19T06:46:25.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.242+0000 7f5a4b3cf640 1 -- 172.21.15.86:0/96404415 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5a3006c2b0 msgr2=0x7f5a3006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:25.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.242+0000 7f5a4b3cf640 1 --2- 172.21.15.86:0/96404415 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5a3006c2b0 0x7f5a3006e770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5a4414a210 tx=0x7f5a38008040 comp rx=0 tx=0).stop 2024-09-19T06:46:25.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.242+0000 7f5a4b3cf640 1 -- 172.21.15.86:0/96404415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a4406bd10 msgr2=0x7f5a44157150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:25.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.242+0000 7f5a4b3cf640 1 --2- 172.21.15.86:0/96404415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a4406bd10 0x7f5a44157150 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5a34000c00 tx=0x7f5a340046c0 comp rx=0 tx=0).stop 2024-09-19T06:46:25.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.242+0000 7f5a4b3cf640 1 -- 172.21.15.86:0/96404415 shutdown_connections 2024-09-19T06:46:25.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.242+0000 7f5a4b3cf640 1 --2- 172.21.15.86:0/96404415 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5a3006c2b0 0x7f5a3006e770 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:25.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.242+0000 7f5a4b3cf640 1 --2- 172.21.15.86:0/96404415 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a44152060 0x7f5a4414aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:25.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.242+0000 7f5a4b3cf640 1 --2- 172.21.15.86:0/96404415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a440c3680 0x7f5a4414a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:25.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.242+0000 7f5a4b3cf640 1 --2- 172.21.15.86:0/96404415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a4406bd10 0x7f5a44157150 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:25.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.242+0000 7f5a4b3cf640 1 -- 172.21.15.86:0/96404415 >> 172.21.15.86:0/96404415 conn(0x7f5a440c9280 msgr2=0x7f5a44073870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:25.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.242+0000 7f5a4b3cf640 1 -- 172.21.15.86:0/96404415 shutdown_connections 2024-09-19T06:46:25.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:25.242+0000 7f5a4b3cf640 1 -- 172.21.15.86:0/96404415 wait complete. 2024-09-19T06:46:25.254 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d has gained rank=0, replacing gid=5211 2024-09-19T06:46:25.254 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 4 secs before reviving mds.e 2024-09-19T06:46:29.154 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T06:46:29.154 DEBUG:teuthology.run_tasks:Unwinding manager mds_thrash 2024-09-19T06:46:29.164 INFO:tasks.mds_thrash:joining mds_thrasher 2024-09-19T06:46:29.164 ERROR:tasks.mds_thrash.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/mds_thrash.py", line 121, in _run self.do_thrash() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/mds_thrash.py", line 314, in do_thrash self.sleep_unless_stopped(delay) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-19T06:46:29.165 INFO:tasks.mds_thrash:done joining 2024-09-19T06:46:29.165 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-19T06:46:29.188 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-19T06:46:29.189 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:46:29.189 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T06:46:29.247 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T06:46:29.247 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T06:46:29.331 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T06:46:29.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.539+0000 7f73a4ca1640 1 Processor -- start 2024-09-19T06:46:29.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.539+0000 7f73a4ca1640 1 -- start start 2024-09-19T06:46:29.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.541+0000 7f73a4ca1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73a0159230 0x7f73a0159670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:29.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.541+0000 7f73a4ca1640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73a00c7970 con 0x7f73a0151f20 2024-09-19T06:46:29.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.541+0000 7f73a4ca1640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73a0159bb0 con 0x7f73a015b130 2024-09-19T06:46:29.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.541+0000 7f73a4ca1640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f73a0152300 con 0x7f73a0159230 2024-09-19T06:46:29.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.541+0000 7f739f7fe640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f73a0151f20 0x7f73a00c9880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60492/0 (socket says 172.21.15.86:60492) 2024-09-19T06:46:29.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.541+0000 7f739f7fe640 1 -- 172.21.15.86:0/553568594 learned_addr learned my addr 172.21.15.86:0/553568594 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:46:29.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.542+0000 7f739effd640 1 --2- 172.21.15.86:0/553568594 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73a0159230 0x7f73a0159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:29.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.546+0000 7f739e7fc640 1 -- 172.21.15.86:0/553568594 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3915929545 0 0) 0x7f73a00c7970 con 0x7f73a0151f20 2024-09-19T06:46:29.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.546+0000 7f739effd640 1 -- 172.21.15.86:0/553568594 >> v1:172.21.15.169:6789/0 conn(0x7f73a015b130 legacy=0x7f73a015b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:29.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.546+0000 7f739effd640 1 -- 172.21.15.86:0/553568594 >> v1:172.21.15.86:6789/0 conn(0x7f73a0151f20 legacy=0x7f73a00c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:29.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.546+0000 7f739effd640 1 -- 172.21.15.86:0/553568594 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a00c7c10 con 0x7f73a0159230 2024-09-19T06:46:29.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.548+0000 7f739effd640 1 --2- 172.21.15.86:0/553568594 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73a0159230 0x7f73a0159670 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f739400b9f0 tx=0x7f739402c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b2b5cda8b0f115e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:29.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.550+0000 7f739e7fc640 1 -- 172.21.15.86:0/553568594 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394031710 con 0x7f73a0159230 2024-09-19T06:46:29.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.550+0000 7f739e7fc640 1 -- 172.21.15.86:0/553568594 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73940318b0 con 0x7f73a0159230 2024-09-19T06:46:29.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.550+0000 7f739e7fc640 1 -- 172.21.15.86:0/553568594 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394031ca0 con 0x7f73a0159230 2024-09-19T06:46:29.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.551+0000 7f73a4ca1640 1 -- 172.21.15.86:0/553568594 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73a0159230 msgr2=0x7f73a0159670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:29.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.551+0000 7f73a4ca1640 1 --2- 172.21.15.86:0/553568594 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73a0159230 0x7f73a0159670 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f739400b9f0 tx=0x7f739402c800 comp rx=0 tx=0).stop 2024-09-19T06:46:29.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.551+0000 7f73a4ca1640 1 -- 172.21.15.86:0/553568594 shutdown_connections 2024-09-19T06:46:29.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.551+0000 7f73a4ca1640 1 --2- 172.21.15.86:0/553568594 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73a0159230 0x7f73a0159670 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:29.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.551+0000 7f73a4ca1640 1 -- 172.21.15.86:0/553568594 >> 172.21.15.86:0/553568594 conn(0x7f73a006bda0 msgr2=0x7f73a006c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:29.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.553+0000 7f73a4ca1640 1 -- 172.21.15.86:0/553568594 shutdown_connections 2024-09-19T06:46:29.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.553+0000 7f73a4ca1640 1 -- 172.21.15.86:0/553568594 wait complete. 2024-09-19T06:46:29.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.555+0000 7f73a4ca1640 1 Processor -- start 2024-09-19T06:46:29.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.555+0000 7f73a4ca1640 1 -- start start 2024-09-19T06:46:29.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.556+0000 7f73a4ca1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73a0151f20 0x7f73a01478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:29.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.557+0000 7f73a4ca1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73a0159230 0x7f73a01f01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:29.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.557+0000 7f73a4ca1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73a015b130 0x7f73a00c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:29.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.557+0000 7f73a4ca1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f73a00c84b0 con 0x7f73a0159230 2024-09-19T06:46:29.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.557+0000 7f73a4ca1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f73a00c81d0 con 0x7f73a015b130 2024-09-19T06:46:29.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.557+0000 7f73a4ca1640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f73a00c8790 con 0x7f73a0151f20 2024-09-19T06:46:29.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.557+0000 7f739effd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73a0159230 0x7f73a01f01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:29.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.557+0000 7f739effd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73a0159230 0x7f73a01f01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44972/0 (socket says 172.21.15.86:44972) 2024-09-19T06:46:29.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.557+0000 7f739effd640 1 -- 172.21.15.86:0/744994917 learned_addr learned my addr 172.21.15.86:0/744994917 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:29.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.557+0000 7f739f7fe640 1 --2- 172.21.15.86:0/744994917 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73a0151f20 0x7f73a01478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:29.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.558+0000 7f739f7fe640 1 -- 172.21.15.86:0/744994917 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73a015b130 msgr2=0x7f73a00c5b20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:46:29.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.558+0000 7f739f7fe640 1 --2- 172.21.15.86:0/744994917 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73a015b130 0x7f73a00c5b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:29.560 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.558+0000 7f739f7fe640 1 -- 172.21.15.86:0/744994917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73a0159230 msgr2=0x7f73a01f01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:29.560 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.558+0000 7f739f7fe640 1 --2- 172.21.15.86:0/744994917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73a0159230 0x7f73a01f01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:29.560 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.558+0000 7f739f7fe640 1 -- 172.21.15.86:0/744994917 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a01ec5b0 con 0x7f73a0151f20 2024-09-19T06:46:29.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.562+0000 7f739f7fe640 1 --2- 172.21.15.86:0/744994917 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73a0151f20 0x7f73a01478e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f739800c7f0 tx=0x7f739800ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:29.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.565+0000 7f7387fff640 1 -- 172.21.15.86:0/744994917 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7398018070 con 0x7f73a0151f20 2024-09-19T06:46:29.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.565+0000 7f7387fff640 1 -- 172.21.15.86:0/744994917 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f739800a640 con 0x7f73a0151f20 2024-09-19T06:46:29.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.566+0000 7f7387fff640 1 -- 172.21.15.86:0/744994917 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739800aa30 con 0x7f73a0151f20 2024-09-19T06:46:29.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.566+0000 7f73a4ca1640 1 -- 172.21.15.86:0/744994917 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73a014e550 con 0x7f73a0151f20 2024-09-19T06:46:29.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.567+0000 7f73a4ca1640 1 -- 172.21.15.86:0/744994917 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f73a014eb10 con 0x7f73a0151f20 2024-09-19T06:46:29.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.571+0000 7f7385ffb640 1 -- 172.21.15.86:0/744994917 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73a00690a0 con 0x7f73a0151f20 2024-09-19T06:46:29.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.573+0000 7f7387fff640 1 -- 172.21.15.86:0/744994917 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f739801b070 con 0x7f73a0151f20 2024-09-19T06:46:29.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.574+0000 7f7387fff640 1 --2- 172.21.15.86:0/744994917 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f738c06c3b0 0x7f738c06e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:29.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.574+0000 7f7387fff640 1 -- 172.21.15.86:0/744994917 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7f739808b130 con 0x7f73a0151f20 2024-09-19T06:46:29.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.576+0000 7f739effd640 1 --2- 172.21.15.86:0/744994917 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f738c06c3b0 0x7f738c06e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:29.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.577+0000 7f739effd640 1 --2- 172.21.15.86:0/744994917 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f738c06c3b0 0x7f738c06e870 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f739400b800 tx=0x7f7394031000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:29.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.589+0000 7f7387fff640 1 -- 172.21.15.86:0/744994917 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7398058b90 con 0x7f73a0151f20 2024-09-19T06:46:29.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.973+0000 7f7385ffb640 1 -- 172.21.15.86:0/744994917 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f73a01efb20 con 0x7f73a0151f20 2024-09-19T06:46:29.978 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.977+0000 7f7387fff640 1 -- 172.21.15.86:0/744994917 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 12 entries v34) ==== 81+0+732 (secure 0 0 0) 0x7f739805ce90 con 0x7f73a0151f20 2024-09-19T06:46:29.982 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:6839/22518982 2024-09-20T06:46:00.558337+0000 2024-09-19T06:46:29.982 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:6838/22518982 2024-09-20T06:46:00.558337+0000 2024-09-19T06:46:29.982 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.169:6837/3116130916 2024-09-20T06:44:35.535883+0000 2024-09-19T06:46:29.983 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.169:6837/2213887583 2024-09-20T06:42:05.505758+0000 2024-09-19T06:46:29.983 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.169:6836/3116130916 2024-09-20T06:44:35.535883+0000 2024-09-19T06:46:29.983 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:6839/1006149510 2024-09-20T06:43:55.528921+0000 2024-09-19T06:46:29.983 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:6838/1006149510 2024-09-20T06:43:55.528921+0000 2024-09-19T06:46:29.983 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.169:6836/2213887583 2024-09-20T06:42:05.505758+0000 2024-09-19T06:46:29.983 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:6838/1060607293 2024-09-20T06:40:55.493588+0000 2024-09-19T06:46:29.983 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:6839/1060607293 2024-09-20T06:40:55.493588+0000 2024-09-19T06:46:29.983 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.169:6837/201961024 2024-09-20T06:39:15.476134+0000 2024-09-19T06:46:29.983 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.169:6836/201961024 2024-09-20T06:39:15.476134+0000 2024-09-19T06:46:29.983 INFO:teuthology.orchestra.run.smithi086.stderr:listed 12 entries 2024-09-19T06:46:29.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.984+0000 7f7385ffb640 1 -- 172.21.15.86:0/744994917 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f738c06c3b0 msgr2=0x7f738c06e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:29.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.984+0000 7f7385ffb640 1 --2- 172.21.15.86:0/744994917 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f738c06c3b0 0x7f738c06e870 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f739400b800 tx=0x7f7394031000 comp rx=0 tx=0).stop 2024-09-19T06:46:29.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.984+0000 7f7385ffb640 1 -- 172.21.15.86:0/744994917 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73a0151f20 msgr2=0x7f73a01478e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:29.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.984+0000 7f7385ffb640 1 --2- 172.21.15.86:0/744994917 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73a0151f20 0x7f73a01478e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f739800c7f0 tx=0x7f739800ccb0 comp rx=0 tx=0).stop 2024-09-19T06:46:29.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.985+0000 7f7385ffb640 1 -- 172.21.15.86:0/744994917 shutdown_connections 2024-09-19T06:46:29.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.985+0000 7f7385ffb640 1 --2- 172.21.15.86:0/744994917 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f738c06c3b0 0x7f738c06e870 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:29.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.985+0000 7f7385ffb640 1 --2- 172.21.15.86:0/744994917 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73a015b130 0x7f73a00c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:29.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.985+0000 7f7385ffb640 1 --2- 172.21.15.86:0/744994917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73a0159230 0x7f73a01f01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:29.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.985+0000 7f7385ffb640 1 --2- 172.21.15.86:0/744994917 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73a0151f20 0x7f73a01478e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:29.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.985+0000 7f7385ffb640 1 -- 172.21.15.86:0/744994917 >> 172.21.15.86:0/744994917 conn(0x7f73a006bda0 msgr2=0x7f73a00cad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:29.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.985+0000 7f7385ffb640 1 -- 172.21.15.86:0/744994917 shutdown_connections 2024-09-19T06:46:29.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:29.985+0000 7f7385ffb640 1 -- 172.21.15.86:0/744994917 wait complete. 2024-09-19T06:46:30.003 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T06:46:30.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:46:30.004 DEBUG:teuthology.orchestra.run.smithi086:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T06:46:30.169 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi086.front.sepia.ceph.com 2024-09-19T06:46:30.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:46:30.169 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T06:46:30.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:46:30.221 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2024-09-19T06:46:30.275 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T06:46:30.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:46:30.275 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:46:30.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:46:30.336 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link delete ceph-brx 2024-09-19T06:46:30.446 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-19T06:46:30.455 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T06:46:30.456 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:46:30.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.638+0000 7f4f35619640 1 Processor -- start 2024-09-19T06:46:30.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.638+0000 7f4f35619640 1 -- start start 2024-09-19T06:46:30.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.640+0000 7f4f35619640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4f280d4940 0x7f4f28005a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:30.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.640+0000 7f4f35619640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4f280450f0 0x7f4f280ddc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:30.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.640+0000 7f4f35619640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f2804c090 0x7f4f280de190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:30.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.640+0000 7f4f35619640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f4f28044c60 con 0x7f4f280450f0 2024-09-19T06:46:30.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.640+0000 7f4f2ffff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4f280d4940 0x7f4f28005a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:30.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.640+0000 7f4f2ffff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4f280d4940 0x7f4f28005a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:49574/0 (socket says 172.21.15.86:49574) 2024-09-19T06:46:30.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.640+0000 7f4f2ffff640 1 -- 172.21.15.86:0/1062566296 learned_addr learned my addr 172.21.15.86:0/1062566296 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:30.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.640+0000 7f4f34e18640 1 --2- 172.21.15.86:0/1062566296 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f2804c090 0x7f4f280de190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:30.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.640+0000 7f4f35619640 1 -- 172.21.15.86:0/1062566296 --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f4f2804aa40 con 0x7f4f280d4940 2024-09-19T06:46:30.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.640+0000 7f4f35619640 1 -- 172.21.15.86:0/1062566296 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4f2804ace0 con 0x7f4f2804c090 2024-09-19T06:46:30.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.641+0000 7f4f2ffff640 1 -- 172.21.15.86:0/1062566296 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f2804c090 msgr2=0x7f4f280de190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:30.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.641+0000 7f4f2ffff640 1 --2- 172.21.15.86:0/1062566296 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f2804c090 0x7f4f280de190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:30.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.641+0000 7f4f2ffff640 1 -- 172.21.15.86:0/1062566296 >> v2:172.21.15.86:3300/0 conn(0x7f4f280450f0 msgr2=0x7f4f280ddc50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:46:30.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.641+0000 7f4f2ffff640 1 --2- 172.21.15.86:0/1062566296 >> v2:172.21.15.86:3300/0 conn(0x7f4f280450f0 0x7f4f280ddc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:30.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.641+0000 7f4f2ffff640 1 -- 172.21.15.86:0/1062566296 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2804afa0 con 0x7f4f280d4940 2024-09-19T06:46:30.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.643+0000 7f4f2ffff640 1 --2- 172.21.15.86:0/1062566296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4f280d4940 0x7f4f28005a00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4f28007500 tx=0x7f4f2402e5e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a38b46e98ba583b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:30.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.643+0000 7f4f2effd640 1 -- 172.21.15.86:0/1062566296 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2403a070 con 0x7f4f280d4940 2024-09-19T06:46:30.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.643+0000 7f4f2effd640 1 -- 172.21.15.86:0/1062566296 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f24008df0 con 0x7f4f280d4940 2024-09-19T06:46:30.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.643+0000 7f4f2effd640 1 -- 172.21.15.86:0/1062566296 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2400a2f0 con 0x7f4f280d4940 2024-09-19T06:46:30.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.644+0000 7f4f35619640 1 -- 172.21.15.86:0/1062566296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4f280d4940 msgr2=0x7f4f28005a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:30.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.644+0000 7f4f35619640 1 --2- 172.21.15.86:0/1062566296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4f280d4940 0x7f4f28005a00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4f28007500 tx=0x7f4f2402e5e0 comp rx=0 tx=0).stop 2024-09-19T06:46:30.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.648+0000 7f4f35619640 1 -- 172.21.15.86:0/1062566296 shutdown_connections 2024-09-19T06:46:30.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.648+0000 7f4f35619640 1 --2- 172.21.15.86:0/1062566296 >> v2:172.21.15.86:3300/0 conn(0x7f4f280450f0 0x7f4f280ddc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:30.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.648+0000 7f4f35619640 1 --2- 172.21.15.86:0/1062566296 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f2804c090 0x7f4f280de190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:30.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.648+0000 7f4f35619640 1 --2- 172.21.15.86:0/1062566296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4f280d4940 0x7f4f28005a00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:30.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.648+0000 7f4f35619640 1 -- 172.21.15.86:0/1062566296 >> 172.21.15.86:0/1062566296 conn(0x7f4f2804fc50 msgr2=0x7f4f28050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:30.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.648+0000 7f4f35619640 1 -- 172.21.15.86:0/1062566296 shutdown_connections 2024-09-19T06:46:30.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.648+0000 7f4f35619640 1 -- 172.21.15.86:0/1062566296 wait complete. 2024-09-19T06:46:30.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.650+0000 7f4f35619640 1 Processor -- start 2024-09-19T06:46:30.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.651+0000 7f4f35619640 1 -- start start 2024-09-19T06:46:30.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.652+0000 7f4f35619640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f280450f0 0x7f4f280d6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:30.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.652+0000 7f4f35619640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4f2804c090 0x7f4f280de550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:30.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.652+0000 7f4f35619640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f280d4940 0x7f4f28170070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:30.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.652+0000 7f4f2ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f280450f0 0x7f4f280d6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:30.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.652+0000 7f4f2ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f280450f0 0x7f4f280d6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44988/0 (socket says 172.21.15.86:44988) 2024-09-19T06:46:30.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.653+0000 7f4f2ffff640 1 -- 172.21.15.86:0/1330997183 learned_addr learned my addr 172.21.15.86:0/1330997183 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:30.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.653+0000 7f4f35619640 1 -- 172.21.15.86:0/1330997183 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4f28046770 con 0x7f4f280450f0 2024-09-19T06:46:30.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.660+0000 7f4f34e18640 1 --2- 172.21.15.86:0/1330997183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f280d4940 0x7f4f28170070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:30.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.660+0000 7f4f35619640 1 -- 172.21.15.86:0/1330997183 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4f28046490 con 0x7f4f2804c090 2024-09-19T06:46:30.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.660+0000 7f4f35619640 1 -- 172.21.15.86:0/1330997183 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4f28005f40 con 0x7f4f280d4940 2024-09-19T06:46:30.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.661+0000 7f4f2ffff640 1 -- 172.21.15.86:0/1330997183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f280d4940 msgr2=0x7f4f28170070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:30.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.661+0000 7f4f2ffff640 1 --2- 172.21.15.86:0/1330997183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f280d4940 0x7f4f28170070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:30.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.661+0000 7f4f2ffff640 1 -- 172.21.15.86:0/1330997183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4f2804c090 msgr2=0x7f4f280de550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:46:30.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.661+0000 7f4f2ffff640 1 --2- 172.21.15.86:0/1330997183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4f2804c090 0x7f4f280de550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:30.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.661+0000 7f4f2ffff640 1 -- 172.21.15.86:0/1330997183 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f280d6ed0 con 0x7f4f280450f0 2024-09-19T06:46:30.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.661+0000 7f4f2ffff640 1 --2- 172.21.15.86:0/1330997183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f280450f0 0x7f4f280d6990 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4f24009fd0 tx=0x7f4f240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:30.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.662+0000 7f4f2cff9640 1 -- 172.21.15.86:0/1330997183 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f24045070 con 0x7f4f280450f0 2024-09-19T06:46:30.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.662+0000 7f4f2cff9640 1 -- 172.21.15.86:0/1330997183 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f24013430 con 0x7f4f280450f0 2024-09-19T06:46:30.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.662+0000 7f4f2cff9640 1 -- 172.21.15.86:0/1330997183 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2403a070 con 0x7f4f280450f0 2024-09-19T06:46:30.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.662+0000 7f4f35619640 1 -- 172.21.15.86:0/1330997183 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f280d5260 con 0x7f4f280450f0 2024-09-19T06:46:30.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.664+0000 7f4f2cff9640 1 -- 172.21.15.86:0/1330997183 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4f2403e070 con 0x7f4f280450f0 2024-09-19T06:46:30.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.665+0000 7f4f2cff9640 1 --2- 172.21.15.86:0/1330997183 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f4f1406c300 0x7f4f1406e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:30.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.667+0000 7f4f35619640 1 -- 172.21.15.86:0/1330997183 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f280d5820 con 0x7f4f280450f0 2024-09-19T06:46:30.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.668+0000 7f4f2f7fe640 1 --2- 172.21.15.86:0/1330997183 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f4f1406c300 0x7f4f1406e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:30.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.669+0000 7f4f35619640 1 -- 172.21.15.86:0/1330997183 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f281709f0 con 0x7f4f280450f0 2024-09-19T06:46:30.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.671+0000 7f4f2f7fe640 1 --2- 172.21.15.86:0/1330997183 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f4f1406c300 0x7f4f1406e7c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c006fd0 tx=0x7f4f1c006b40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:30.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.677+0000 7f4f2cff9640 1 -- 172.21.15.86:0/1330997183 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7f4f24077e30 con 0x7f4f280450f0 2024-09-19T06:46:30.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:30.678+0000 7f4f2cff9640 1 -- 172.21.15.86:0/1330997183 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4f2407a490 con 0x7f4f280450f0 2024-09-19T06:46:31.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.045+0000 7f4f35619640 1 -- 172.21.15.86:0/1330997183 --> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4f2804b2e0 con 0x7f4f1406c300 2024-09-19T06:46:31.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.060+0000 7f4f2cff9640 1 -- 172.21.15.86:0/1330997183 <== mgr.4105 v2:172.21.15.86:6816/4165134248 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335400 (secure 0 0 0) 0x7f4f2804b2e0 con 0x7f4f1406c300 2024-09-19T06:46:31.062 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:46:31.069 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-09-19T06:46:31.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.070+0000 7f4f35619640 1 -- 172.21.15.86:0/1330997183 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f4f1406c300 msgr2=0x7f4f1406e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:31.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.070+0000 7f4f35619640 1 --2- 172.21.15.86:0/1330997183 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f4f1406c300 0x7f4f1406e7c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c006fd0 tx=0x7f4f1c006b40 comp rx=0 tx=0).stop 2024-09-19T06:46:31.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.070+0000 7f4f35619640 1 -- 172.21.15.86:0/1330997183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f280450f0 msgr2=0x7f4f280d6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:31.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.070+0000 7f4f35619640 1 --2- 172.21.15.86:0/1330997183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f280450f0 0x7f4f280d6990 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4f24009fd0 tx=0x7f4f240046c0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.070+0000 7f4f35619640 1 -- 172.21.15.86:0/1330997183 shutdown_connections 2024-09-19T06:46:31.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.070+0000 7f4f35619640 1 --2- 172.21.15.86:0/1330997183 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f4f1406c300 0x7f4f1406e7c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.070+0000 7f4f35619640 1 --2- 172.21.15.86:0/1330997183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f280d4940 0x7f4f28170070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.070+0000 7f4f35619640 1 --2- 172.21.15.86:0/1330997183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4f2804c090 0x7f4f280de550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.070+0000 7f4f35619640 1 --2- 172.21.15.86:0/1330997183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f280450f0 0x7f4f280d6990 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.070+0000 7f4f35619640 1 -- 172.21.15.86:0/1330997183 >> 172.21.15.86:0/1330997183 conn(0x7f4f2804fc50 msgr2=0x7f4f2804e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:31.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.071+0000 7f4f35619640 1 -- 172.21.15.86:0/1330997183 shutdown_connections 2024-09-19T06:46:31.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.071+0000 7f4f35619640 1 -- 172.21.15.86:0/1330997183 wait complete. 2024-09-19T06:46:31.099 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2024-09-19T06:46:29.917281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":12336787590,"num_objects":3165,"num_object_clones":0,"num_object_copies":12562,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3165,"num_whiteouts":0,"num_read":1823,"num_read_kb":289582,"num_write":2248681,"num_write_kb":28380693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158052,"ondisk_log_size":158052,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":21579176,"kb_used_data":14098472,"kb_used_omap":12,"kb_used_meta":7480563,"kb_avail":733395544,"statfs":{"total":773094113280,"available":750997037056,"internally_reserved":0,"allocated":14436835328,"data_stored":24676916813,"data_compressed":1359086508,"data_compressed_allocated":5368832000,"data_compressed_original":15610601472,"omap_allocated":12752,"internal_metadata":7660097072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,5,0,1,6,7,1,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":66,"apply_latency_ms":66,"commit_latency_ns":66000000,"apply_latency_ns":66000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-838792068,"num_objects":-200,"num_object_clones":0,"num_object_copies":-800,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-200,"num_whiteouts":0,"num_read":59,"num_read_kb":104,"num_write":227,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003174"},"pg_stats":[{"pgid":"2.1f","version":"29'12","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.585975+0000","last_change":"2024-09-19T06:37:08.446272+0000","last_active":"2024-09-19T06:46:05.585975+0000","last_peered":"2024-09-19T06:46:05.585975+0000","last_clean":"2024-09-19T06:46:05.585975+0000","last_became_active":"2024-09-19T06:37:08.446044+0000","last_became_peered":"2024-09-19T06:37:08.446044+0000","last_unstale":"2024-09-19T06:46:05.585975+0000","last_undegraded":"2024-09-19T06:46:05.585975+0000","last_fullsized":"2024-09-19T06:46:05.585975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:37.623543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":20504,"num_write":9,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562503+0000","last_change":"2024-09-19T06:37:09.441539+0000","last_active":"2024-09-19T06:46:00.562503+0000","last_peered":"2024-09-19T06:46:00.562503+0000","last_clean":"2024-09-19T06:46:00.562503+0000","last_became_active":"2024-09-19T06:37:09.440839+0000","last_became_peered":"2024-09-19T06:37:09.440839+0000","last_unstale":"2024-09-19T06:46:00.562503+0000","last_undegraded":"2024-09-19T06:46:00.562503+0000","last_fullsized":"2024-09-19T06:46:00.562503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:49.222252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'5097","reported_seq":5170,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.177956+0000","last_change":"2024-09-19T06:37:13.461355+0000","last_active":"2024-09-19T06:46:24.177956+0000","last_peered":"2024-09-19T06:46:24.177956+0000","last_clean":"2024-09-19T06:46:24.177956+0000","last_became_active":"2024-09-19T06:37:13.460936+0000","last_became_peered":"2024-09-19T06:37:13.460936+0000","last_unstale":"2024-09-19T06:46:24.177956+0000","last_undegraded":"2024-09-19T06:46:24.177956+0000","last_fullsized":"2024-09-19T06:46:24.177956+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5097,"log_dups_size":0,"ondisk_log_size":5097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:59.860583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394383373,"num_objects":104,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":74676,"num_write_kb":941501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'23","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562733+0000","last_change":"2024-09-19T06:37:08.438583+0000","last_active":"2024-09-19T06:46:00.562733+0000","last_peered":"2024-09-19T06:46:00.562733+0000","last_clean":"2024-09-19T06:46:00.562733+0000","last_became_active":"2024-09-19T06:37:08.437921+0000","last_became_peered":"2024-09-19T06:37:08.437921+0000","last_unstale":"2024-09-19T06:46:00.562733+0000","last_undegraded":"2024-09-19T06:46:00.562733+0000","last_fullsized":"2024-09-19T06:46:00.562733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:58:23.269120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":24576,"num_write":22,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950609+0000","last_change":"2024-09-19T06:37:09.450731+0000","last_active":"2024-09-19T06:46:01.950609+0000","last_peered":"2024-09-19T06:46:01.950609+0000","last_clean":"2024-09-19T06:46:01.950609+0000","last_became_active":"2024-09-19T06:37:09.450430+0000","last_became_peered":"2024-09-19T06:37:09.450430+0000","last_unstale":"2024-09-19T06:46:01.950609+0000","last_undegraded":"2024-09-19T06:46:01.950609+0000","last_fullsized":"2024-09-19T06:46:01.950609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:21.701872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"34'4804","reported_seq":4883,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.302731+0000","last_change":"2024-09-19T06:37:13.459445+0000","last_active":"2024-09-19T06:46:24.302731+0000","last_peered":"2024-09-19T06:46:24.302731+0000","last_clean":"2024-09-19T06:46:24.302731+0000","last_became_active":"2024-09-19T06:37:13.459040+0000","last_became_peered":"2024-09-19T06:37:13.459040+0000","last_unstale":"2024-09-19T06:46:24.302731+0000","last_undegraded":"2024-09-19T06:46:24.302731+0000","last_fullsized":"2024-09-19T06:46:24.302731+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4804,"log_dups_size":0,"ondisk_log_size":4804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:37.676097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381707433,"num_objects":95,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":70584,"num_write_kb":897029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"34'333","reported_seq":394,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.208685+0000","last_change":"2024-09-19T06:37:08.448303+0000","last_active":"2024-09-19T06:46:23.208685+0000","last_peered":"2024-09-19T06:46:23.208685+0000","last_clean":"2024-09-19T06:46:23.208685+0000","last_became_active":"2024-09-19T06:37:08.447559+0000","last_became_peered":"2024-09-19T06:37:08.447559+0000","last_unstale":"2024-09-19T06:46:23.208685+0000","last_undegraded":"2024-09-19T06:46:23.208685+0000","last_fullsized":"2024-09-19T06:46:23.208685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:43.093216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":35254,"num_write":321,"num_write_kb":8395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'7","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565135+0000","last_change":"2024-09-19T06:37:09.445971+0000","last_active":"2024-09-19T06:46:00.565135+0000","last_peered":"2024-09-19T06:46:00.565135+0000","last_clean":"2024-09-19T06:46:00.565135+0000","last_became_active":"2024-09-19T06:37:09.444806+0000","last_became_peered":"2024-09-19T06:37:09.444806+0000","last_unstale":"2024-09-19T06:46:00.565135+0000","last_undegraded":"2024-09-19T06:46:00.565135+0000","last_fullsized":"2024-09-19T06:46:00.565135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:15.765835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4729","reported_seq":4809,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.336466+0000","last_change":"2024-09-19T06:37:13.459035+0000","last_active":"2024-09-19T06:46:24.336466+0000","last_peered":"2024-09-19T06:46:24.336466+0000","last_clean":"2024-09-19T06:46:24.336466+0000","last_became_active":"2024-09-19T06:37:13.458588+0000","last_became_peered":"2024-09-19T06:37:13.458588+0000","last_unstale":"2024-09-19T06:46:24.336466+0000","last_undegraded":"2024-09-19T06:46:24.336466+0000","last_fullsized":"2024-09-19T06:46:24.336466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4729,"log_dups_size":0,"ondisk_log_size":4729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:27.900054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373310089,"num_objects":99,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":47,"num_read_kb":0,"num_write":68497,"num_write_kb":860659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.184523+0000","last_change":"2024-09-19T06:37:08.446363+0000","last_active":"2024-09-19T06:46:23.184523+0000","last_peered":"2024-09-19T06:46:23.184523+0000","last_clean":"2024-09-19T06:46:23.184523+0000","last_became_active":"2024-09-19T06:37:08.446053+0000","last_became_peered":"2024-09-19T06:37:08.446053+0000","last_unstale":"2024-09-19T06:46:23.184523+0000","last_undegraded":"2024-09-19T06:46:23.184523+0000","last_fullsized":"2024-09-19T06:46:23.184523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:22.488347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"34'7","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.403973+0000","last_change":"2024-09-19T06:37:09.445124+0000","last_active":"2024-09-19T06:46:23.403973+0000","last_peered":"2024-09-19T06:46:23.403973+0000","last_clean":"2024-09-19T06:46:23.403973+0000","last_became_active":"2024-09-19T06:37:09.444824+0000","last_became_peered":"2024-09-19T06:37:09.444824+0000","last_unstale":"2024-09-19T06:46:23.403973+0000","last_undegraded":"2024-09-19T06:46:23.403973+0000","last_fullsized":"2024-09-19T06:46:23.403973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:40:05.642055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'4073","reported_seq":4133,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.075830+0000","last_change":"2024-09-19T06:37:13.459720+0000","last_active":"2024-09-19T06:46:24.075830+0000","last_peered":"2024-09-19T06:46:24.075830+0000","last_clean":"2024-09-19T06:46:24.075830+0000","last_became_active":"2024-09-19T06:37:13.459350+0000","last_became_peered":"2024-09-19T06:37:13.459350+0000","last_unstale":"2024-09-19T06:46:24.075830+0000","last_undegraded":"2024-09-19T06:46:24.075830+0000","last_fullsized":"2024-09-19T06:46:24.075830+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4073,"log_dups_size":0,"ondisk_log_size":4073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:29.546976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327179682,"num_objects":82,"num_object_clones":0,"num_object_copies":328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":59441,"num_write_kb":744923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.941540+0000","last_change":"2024-09-19T06:37:09.447795+0000","last_active":"2024-09-19T06:46:01.941540+0000","last_peered":"2024-09-19T06:46:01.941540+0000","last_clean":"2024-09-19T06:46:01.941540+0000","last_became_active":"2024-09-19T06:37:09.447502+0000","last_became_peered":"2024-09-19T06:37:09.447502+0000","last_unstale":"2024-09-19T06:46:01.941540+0000","last_undegraded":"2024-09-19T06:46:01.941540+0000","last_fullsized":"2024-09-19T06:46:01.941540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:51.384743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"34'578","reported_seq":631,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:12.370895+0000","last_change":"2024-09-19T06:37:08.446179+0000","last_active":"2024-09-19T06:46:12.370895+0000","last_peered":"2024-09-19T06:46:12.370895+0000","last_clean":"2024-09-19T06:46:12.370895+0000","last_became_active":"2024-09-19T06:37:08.445834+0000","last_became_peered":"2024-09-19T06:37:08.445834+0000","last_unstale":"2024-09-19T06:46:12.370895+0000","last_undegraded":"2024-09-19T06:46:12.370895+0000","last_fullsized":"2024-09-19T06:46:12.370895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:03.783414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":20492,"num_write":569,"num_write_kb":4620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"34'4836","reported_seq":4898,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.897304+0000","last_change":"2024-09-19T06:37:13.460344+0000","last_active":"2024-09-19T06:46:23.897304+0000","last_peered":"2024-09-19T06:46:23.897304+0000","last_clean":"2024-09-19T06:46:23.897304+0000","last_became_active":"2024-09-19T06:37:13.459967+0000","last_became_peered":"2024-09-19T06:37:13.459967+0000","last_unstale":"2024-09-19T06:46:23.897304+0000","last_undegraded":"2024-09-19T06:46:23.897304+0000","last_fullsized":"2024-09-19T06:46:23.897304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4836,"log_dups_size":0,"ondisk_log_size":4836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:59.096218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390215220,"num_objects":100,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":70072,"num_write_kb":882801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'5","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.563104+0000","last_change":"2024-09-19T06:37:09.449884+0000","last_active":"2024-09-19T06:46:00.563104+0000","last_peered":"2024-09-19T06:46:00.563104+0000","last_clean":"2024-09-19T06:46:00.563104+0000","last_became_active":"2024-09-19T06:37:09.449645+0000","last_became_peered":"2024-09-19T06:37:09.449645+0000","last_unstale":"2024-09-19T06:46:00.563104+0000","last_undegraded":"2024-09-19T06:46:00.563104+0000","last_fullsized":"2024-09-19T06:46:00.563104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:07.353098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.408189+0000","last_change":"2024-09-19T06:37:08.437022+0000","last_active":"2024-09-19T06:46:01.408189+0000","last_peered":"2024-09-19T06:46:01.408189+0000","last_clean":"2024-09-19T06:46:01.408189+0000","last_became_active":"2024-09-19T06:37:08.436761+0000","last_became_peered":"2024-09-19T06:37:08.436761+0000","last_unstale":"2024-09-19T06:46:01.408189+0000","last_undegraded":"2024-09-19T06:46:01.408189+0000","last_fullsized":"2024-09-19T06:46:01.408189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:04.985581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'5008","reported_seq":5093,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.367571+0000","last_change":"2024-09-19T06:37:51.782710+0000","last_active":"2024-09-19T06:46:24.367571+0000","last_peered":"2024-09-19T06:46:24.367571+0000","last_clean":"2024-09-19T06:46:24.367571+0000","last_became_active":"2024-09-19T06:37:51.782257+0000","last_became_peered":"2024-09-19T06:37:51.782257+0000","last_unstale":"2024-09-19T06:46:24.367571+0000","last_undegraded":"2024-09-19T06:46:24.367571+0000","last_fullsized":"2024-09-19T06:46:24.367571+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5008,"log_dups_size":0,"ondisk_log_size":5008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:17:15.241783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385899096,"num_objects":101,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":44,"num_read_kb":0,"num_write":72255,"num_write_kb":909964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562671+0000","last_change":"2024-09-19T06:37:09.433042+0000","last_active":"2024-09-19T06:46:00.562671+0000","last_peered":"2024-09-19T06:46:00.562671+0000","last_clean":"2024-09-19T06:46:00.562671+0000","last_became_active":"2024-09-19T06:37:09.432589+0000","last_became_peered":"2024-09-19T06:37:09.432589+0000","last_unstale":"2024-09-19T06:46:00.562671+0000","last_undegraded":"2024-09-19T06:46:00.562671+0000","last_fullsized":"2024-09-19T06:46:00.562671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:18.661071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.407761+0000","last_change":"2024-09-19T06:37:08.444408+0000","last_active":"2024-09-19T06:46:01.407761+0000","last_peered":"2024-09-19T06:46:01.407761+0000","last_clean":"2024-09-19T06:46:01.407761+0000","last_became_active":"2024-09-19T06:37:08.444160+0000","last_became_peered":"2024-09-19T06:37:08.444160+0000","last_unstale":"2024-09-19T06:46:01.407761+0000","last_undegraded":"2024-09-19T06:46:01.407761+0000","last_fullsized":"2024-09-19T06:46:01.407761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:54.304153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"34'5580","reported_seq":5655,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.161310+0000","last_change":"2024-09-19T06:37:13.466175+0000","last_active":"2024-09-19T06:46:24.161310+0000","last_peered":"2024-09-19T06:46:24.161310+0000","last_clean":"2024-09-19T06:46:24.161310+0000","last_became_active":"2024-09-19T06:37:13.465731+0000","last_became_peered":"2024-09-19T06:37:13.465731+0000","last_unstale":"2024-09-19T06:46:24.161310+0000","last_undegraded":"2024-09-19T06:46:24.161310+0000","last_fullsized":"2024-09-19T06:46:24.161310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5580,"log_dups_size":0,"ondisk_log_size":5580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:01.100164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432110707,"num_objects":108,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":81171,"num_write_kb":1030279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.951476+0000","last_change":"2024-09-19T06:37:09.437254+0000","last_active":"2024-09-19T06:46:01.951476+0000","last_peered":"2024-09-19T06:46:01.951476+0000","last_clean":"2024-09-19T06:46:01.951476+0000","last_became_active":"2024-09-19T06:37:09.436512+0000","last_became_peered":"2024-09-19T06:37:09.436512+0000","last_unstale":"2024-09-19T06:46:01.951476+0000","last_undegraded":"2024-09-19T06:46:01.951476+0000","last_fullsized":"2024-09-19T06:46:01.951476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:21.893793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"33'797","reported_seq":844,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564196+0000","last_change":"2024-09-19T06:37:08.446216+0000","last_active":"2024-09-19T06:46:00.564196+0000","last_peered":"2024-09-19T06:46:00.564196+0000","last_clean":"2024-09-19T06:46:00.564196+0000","last_became_active":"2024-09-19T06:37:08.445845+0000","last_became_peered":"2024-09-19T06:37:08.445845+0000","last_unstale":"2024-09-19T06:46:00.564196+0000","last_undegraded":"2024-09-19T06:46:00.564196+0000","last_fullsized":"2024-09-19T06:46:00.564196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:04.033283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":8706,"num_write":792,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"34'4170","reported_seq":4237,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.823142+0000","last_change":"2024-09-19T06:37:13.462192+0000","last_active":"2024-09-19T06:46:23.823142+0000","last_peered":"2024-09-19T06:46:23.823142+0000","last_clean":"2024-09-19T06:46:23.823142+0000","last_became_active":"2024-09-19T06:37:13.460955+0000","last_became_peered":"2024-09-19T06:37:13.460955+0000","last_unstale":"2024-09-19T06:46:23.823142+0000","last_undegraded":"2024-09-19T06:46:23.823142+0000","last_fullsized":"2024-09-19T06:46:23.823142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4170,"log_dups_size":0,"ondisk_log_size":4170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:53.583488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352537253,"num_objects":94,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":60526,"num_write_kb":751027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'14","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950811+0000","last_change":"2024-09-19T06:37:09.445989+0000","last_active":"2024-09-19T06:46:01.950811+0000","last_peered":"2024-09-19T06:46:01.950811+0000","last_clean":"2024-09-19T06:46:01.950811+0000","last_became_active":"2024-09-19T06:37:09.445705+0000","last_became_peered":"2024-09-19T06:37:09.445705+0000","last_unstale":"2024-09-19T06:46:01.950811+0000","last_undegraded":"2024-09-19T06:46:01.950811+0000","last_fullsized":"2024-09-19T06:46:01.950811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:24.592460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.189422+0000","last_change":"2024-09-19T06:37:08.446226+0000","last_active":"2024-09-19T06:46:23.189422+0000","last_peered":"2024-09-19T06:46:23.189422+0000","last_clean":"2024-09-19T06:46:23.189422+0000","last_became_active":"2024-09-19T06:37:08.445929+0000","last_became_peered":"2024-09-19T06:37:08.445929+0000","last_unstale":"2024-09-19T06:46:23.189422+0000","last_undegraded":"2024-09-19T06:46:23.189422+0000","last_fullsized":"2024-09-19T06:46:23.189422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:32.233033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"34'4917","reported_seq":4992,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.329970+0000","last_change":"2024-09-19T06:37:13.462598+0000","last_active":"2024-09-19T06:46:24.329970+0000","last_peered":"2024-09-19T06:46:24.329970+0000","last_clean":"2024-09-19T06:46:24.329970+0000","last_became_active":"2024-09-19T06:37:13.462217+0000","last_became_peered":"2024-09-19T06:37:13.462217+0000","last_unstale":"2024-09-19T06:46:24.329970+0000","last_undegraded":"2024-09-19T06:46:24.329970+0000","last_fullsized":"2024-09-19T06:46:24.329970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4917,"log_dups_size":0,"ondisk_log_size":4917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:04.109419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390081596,"num_objects":96,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":71632,"num_write_kb":902613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'10","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.563792+0000","last_change":"2024-09-19T06:37:09.434309+0000","last_active":"2024-09-19T06:46:00.563792+0000","last_peered":"2024-09-19T06:46:00.563792+0000","last_clean":"2024-09-19T06:46:00.563792+0000","last_became_active":"2024-09-19T06:37:09.433897+0000","last_became_peered":"2024-09-19T06:37:09.433897+0000","last_unstale":"2024-09-19T06:46:00.563792+0000","last_undegraded":"2024-09-19T06:46:00.563792+0000","last_fullsized":"2024-09-19T06:46:00.563792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:59.054484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"34'164","reported_seq":212,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.577973+0000","last_change":"2024-09-19T06:37:08.441525+0000","last_active":"2024-09-19T06:46:05.577973+0000","last_peered":"2024-09-19T06:46:05.577973+0000","last_clean":"2024-09-19T06:46:05.577973+0000","last_became_active":"2024-09-19T06:37:08.441245+0000","last_became_peered":"2024-09-19T06:37:08.441245+0000","last_unstale":"2024-09-19T06:46:05.577973+0000","last_undegraded":"2024-09-19T06:46:05.577973+0000","last_fullsized":"2024-09-19T06:46:05.577973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:19.820705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":67,"num_write":354,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"34'5320","reported_seq":5397,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.235454+0000","last_change":"2024-09-19T06:37:13.468486+0000","last_active":"2024-09-19T06:46:24.235454+0000","last_peered":"2024-09-19T06:46:24.235454+0000","last_clean":"2024-09-19T06:46:24.235454+0000","last_became_active":"2024-09-19T06:37:13.468074+0000","last_became_peered":"2024-09-19T06:37:13.468074+0000","last_unstale":"2024-09-19T06:46:24.235454+0000","last_undegraded":"2024-09-19T06:46:24.235454+0000","last_fullsized":"2024-09-19T06:46:24.235454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5320,"log_dups_size":0,"ondisk_log_size":5320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:36.783781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411056495,"num_objects":104,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":78187,"num_write_kb":979369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.408530+0000","last_change":"2024-09-19T06:37:09.435864+0000","last_active":"2024-09-19T06:46:01.408530+0000","last_peered":"2024-09-19T06:46:01.408530+0000","last_clean":"2024-09-19T06:46:01.408530+0000","last_became_active":"2024-09-19T06:37:09.435597+0000","last_became_peered":"2024-09-19T06:37:09.435597+0000","last_unstale":"2024-09-19T06:46:01.408530+0000","last_undegraded":"2024-09-19T06:46:01.408530+0000","last_fullsized":"2024-09-19T06:46:01.408530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:20.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.566013+0000","last_change":"2024-09-19T06:37:08.447931+0000","last_active":"2024-09-19T06:46:00.566013+0000","last_peered":"2024-09-19T06:46:00.566013+0000","last_clean":"2024-09-19T06:46:00.566013+0000","last_became_active":"2024-09-19T06:37:08.447630+0000","last_became_peered":"2024-09-19T06:37:08.447630+0000","last_unstale":"2024-09-19T06:46:00.566013+0000","last_undegraded":"2024-09-19T06:46:00.566013+0000","last_fullsized":"2024-09-19T06:46:00.566013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:17.375740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"34'4451","reported_seq":4525,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.189015+0000","last_change":"2024-09-19T06:37:13.468360+0000","last_active":"2024-09-19T06:46:24.189015+0000","last_peered":"2024-09-19T06:46:24.189015+0000","last_clean":"2024-09-19T06:46:24.189015+0000","last_became_active":"2024-09-19T06:37:13.467926+0000","last_became_peered":"2024-09-19T06:37:13.467926+0000","last_unstale":"2024-09-19T06:46:24.189015+0000","last_undegraded":"2024-09-19T06:46:24.189015+0000","last_fullsized":"2024-09-19T06:46:24.189015+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4451,"log_dups_size":0,"ondisk_log_size":4451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:55.089630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343942003,"num_objects":86,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":64740,"num_write_kb":802716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"34'9","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565285+0000","last_change":"2024-09-19T06:37:09.441678+0000","last_active":"2024-09-19T06:46:00.565285+0000","last_peered":"2024-09-19T06:46:00.565285+0000","last_clean":"2024-09-19T06:46:00.565285+0000","last_became_active":"2024-09-19T06:37:09.441406+0000","last_became_peered":"2024-09-19T06:37:09.441406+0000","last_unstale":"2024-09-19T06:46:00.565285+0000","last_undegraded":"2024-09-19T06:46:00.565285+0000","last_fullsized":"2024-09-19T06:46:00.565285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:14.638004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"29'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.408645+0000","last_change":"2024-09-19T06:37:08.438805+0000","last_active":"2024-09-19T06:46:01.408645+0000","last_peered":"2024-09-19T06:46:01.408645+0000","last_clean":"2024-09-19T06:46:01.408645+0000","last_became_active":"2024-09-19T06:37:08.438528+0000","last_became_peered":"2024-09-19T06:37:08.438528+0000","last_unstale":"2024-09-19T06:46:01.408645+0000","last_undegraded":"2024-09-19T06:46:01.408645+0000","last_fullsized":"2024-09-19T06:46:01.408645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:55.500347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'5386","reported_seq":5451,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.372613+0000","last_change":"2024-09-19T06:37:13.459697+0000","last_active":"2024-09-19T06:46:23.372613+0000","last_peered":"2024-09-19T06:46:23.372613+0000","last_clean":"2024-09-19T06:46:23.372613+0000","last_became_active":"2024-09-19T06:37:13.459303+0000","last_became_peered":"2024-09-19T06:37:13.459303+0000","last_unstale":"2024-09-19T06:46:23.372613+0000","last_undegraded":"2024-09-19T06:46:23.372613+0000","last_fullsized":"2024-09-19T06:46:23.372613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5386,"log_dups_size":0,"ondisk_log_size":5386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:01.695905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":453003691,"num_objects":111,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":78968,"num_write_kb":992273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.951577+0000","last_change":"2024-09-19T06:37:09.449701+0000","last_active":"2024-09-19T06:46:01.951577+0000","last_peered":"2024-09-19T06:46:01.951577+0000","last_clean":"2024-09-19T06:46:01.951577+0000","last_became_active":"2024-09-19T06:37:09.448899+0000","last_became_peered":"2024-09-19T06:37:09.448899+0000","last_unstale":"2024-09-19T06:46:01.951577+0000","last_undegraded":"2024-09-19T06:46:01.951577+0000","last_fullsized":"2024-09-19T06:46:01.951577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:17.448251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"34'198","reported_seq":243,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.603626+0000","last_change":"2024-09-19T06:37:08.434263+0000","last_active":"2024-09-19T06:46:05.603626+0000","last_peered":"2024-09-19T06:46:05.603626+0000","last_clean":"2024-09-19T06:46:05.603626+0000","last_became_active":"2024-09-19T06:37:08.433984+0000","last_became_peered":"2024-09-19T06:37:08.433984+0000","last_unstale":"2024-09-19T06:46:05.603626+0000","last_undegraded":"2024-09-19T06:46:05.603626+0000","last_fullsized":"2024-09-19T06:46:05.603626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:05.599054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":190,"num_write_kb":4204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"34'4452","reported_seq":4525,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.151962+0000","last_change":"2024-09-19T06:37:13.464527+0000","last_active":"2024-09-19T06:46:24.151962+0000","last_peered":"2024-09-19T06:46:24.151962+0000","last_clean":"2024-09-19T06:46:24.151962+0000","last_became_active":"2024-09-19T06:37:13.461685+0000","last_became_peered":"2024-09-19T06:37:13.461685+0000","last_unstale":"2024-09-19T06:46:24.151962+0000","last_undegraded":"2024-09-19T06:46:24.151962+0000","last_fullsized":"2024-09-19T06:46:24.151962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4452,"log_dups_size":0,"ondisk_log_size":4452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:57.229892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356592787,"num_objects":91,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":65349,"num_write_kb":836807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'11","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.408137+0000","last_change":"2024-09-19T06:37:09.434421+0000","last_active":"2024-09-19T06:46:01.408137+0000","last_peered":"2024-09-19T06:46:01.408137+0000","last_clean":"2024-09-19T06:46:01.408137+0000","last_became_active":"2024-09-19T06:37:09.434119+0000","last_became_peered":"2024-09-19T06:37:09.434119+0000","last_unstale":"2024-09-19T06:46:01.408137+0000","last_undegraded":"2024-09-19T06:46:01.408137+0000","last_fullsized":"2024-09-19T06:46:01.408137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:56.984336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"34'26","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.253625+0000","last_change":"2024-09-19T06:37:08.436856+0000","last_active":"2024-09-19T06:46:23.253625+0000","last_peered":"2024-09-19T06:46:23.253625+0000","last_clean":"2024-09-19T06:46:23.253625+0000","last_became_active":"2024-09-19T06:37:08.435718+0000","last_became_peered":"2024-09-19T06:37:08.435718+0000","last_unstale":"2024-09-19T06:46:23.253625+0000","last_undegraded":"2024-09-19T06:46:23.253625+0000","last_fullsized":"2024-09-19T06:46:23.253625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:58.650430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94168,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":144,"num_write":22,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'5155","reported_seq":5231,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.003595+0000","last_change":"2024-09-19T06:37:13.466081+0000","last_active":"2024-09-19T06:46:24.003595+0000","last_peered":"2024-09-19T06:46:24.003595+0000","last_clean":"2024-09-19T06:46:24.003595+0000","last_became_active":"2024-09-19T06:37:13.465348+0000","last_became_peered":"2024-09-19T06:37:13.465348+0000","last_unstale":"2024-09-19T06:46:24.003595+0000","last_undegraded":"2024-09-19T06:46:24.003595+0000","last_fullsized":"2024-09-19T06:46:24.003595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5155,"log_dups_size":0,"ondisk_log_size":5155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:11.592737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432066503,"num_objects":110,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":75839,"num_write_kb":952671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950025+0000","last_change":"2024-09-19T06:37:09.444888+0000","last_active":"2024-09-19T06:46:01.950025+0000","last_peered":"2024-09-19T06:46:01.950025+0000","last_clean":"2024-09-19T06:46:01.950025+0000","last_became_active":"2024-09-19T06:37:09.444605+0000","last_became_peered":"2024-09-19T06:37:09.444605+0000","last_unstale":"2024-09-19T06:46:01.950025+0000","last_undegraded":"2024-09-19T06:46:01.950025+0000","last_fullsized":"2024-09-19T06:46:01.950025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:53.868356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'43","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.589711+0000","last_change":"2024-09-19T06:37:08.446760+0000","last_active":"2024-09-19T06:46:05.589711+0000","last_peered":"2024-09-19T06:46:05.589711+0000","last_clean":"2024-09-19T06:46:05.589711+0000","last_became_active":"2024-09-19T06:37:08.446474+0000","last_became_peered":"2024-09-19T06:37:08.446474+0000","last_unstale":"2024-09-19T06:46:05.589711+0000","last_undegraded":"2024-09-19T06:46:05.589711+0000","last_fullsized":"2024-09-19T06:46:05.589711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:12.597952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":38,"num_write_kb":8207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"34'4304","reported_seq":4380,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.890073+0000","last_change":"2024-09-19T06:37:13.471220+0000","last_active":"2024-09-19T06:46:23.890073+0000","last_peered":"2024-09-19T06:46:23.890073+0000","last_clean":"2024-09-19T06:46:23.890073+0000","last_became_active":"2024-09-19T06:37:13.470860+0000","last_became_peered":"2024-09-19T06:37:13.470860+0000","last_unstale":"2024-09-19T06:46:23.890073+0000","last_undegraded":"2024-09-19T06:46:23.890073+0000","last_fullsized":"2024-09-19T06:46:23.890073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4304,"log_dups_size":0,"ondisk_log_size":4304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:07.659583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356948802,"num_objects":91,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":62615,"num_write_kb":794606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562847+0000","last_change":"2024-09-19T06:37:09.440366+0000","last_active":"2024-09-19T06:46:00.562847+0000","last_peered":"2024-09-19T06:46:00.562847+0000","last_clean":"2024-09-19T06:46:00.562847+0000","last_became_active":"2024-09-19T06:37:09.439478+0000","last_became_peered":"2024-09-19T06:37:09.439478+0000","last_unstale":"2024-09-19T06:46:00.562847+0000","last_undegraded":"2024-09-19T06:46:00.562847+0000","last_fullsized":"2024-09-19T06:46:00.562847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:21.837351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564567+0000","last_change":"2024-09-19T06:37:08.435473+0000","last_active":"2024-09-19T06:46:00.564567+0000","last_peered":"2024-09-19T06:46:00.564567+0000","last_clean":"2024-09-19T06:46:00.564567+0000","last_became_active":"2024-09-19T06:37:08.435183+0000","last_became_peered":"2024-09-19T06:37:08.435183+0000","last_unstale":"2024-09-19T06:46:00.564567+0000","last_undegraded":"2024-09-19T06:46:00.564567+0000","last_fullsized":"2024-09-19T06:46:00.564567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:53.115010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":198,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564274+0000","last_change":"2024-09-19T06:36:58.829099+0000","last_active":"2024-09-19T06:46:00.564274+0000","last_peered":"2024-09-19T06:46:00.564274+0000","last_clean":"2024-09-19T06:46:00.564274+0000","last_became_active":"2024-09-19T06:36:58.828079+0000","last_became_peered":"2024-09-19T06:36:58.828079+0000","last_unstale":"2024-09-19T06:46:00.564274+0000","last_undegraded":"2024-09-19T06:46:00.564274+0000","last_fullsized":"2024-09-19T06:46:00.564274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:36:57.771085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:36:57.771085+0000","last_clean_scrub_stamp":"2024-09-19T06:36:57.771085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:14.663925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"34'4731","reported_seq":4793,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.127010+0000","last_change":"2024-09-19T06:37:13.464435+0000","last_active":"2024-09-19T06:46:24.127010+0000","last_peered":"2024-09-19T06:46:24.127010+0000","last_clean":"2024-09-19T06:46:24.127010+0000","last_became_active":"2024-09-19T06:37:13.464101+0000","last_became_peered":"2024-09-19T06:37:13.464101+0000","last_unstale":"2024-09-19T06:46:24.127010+0000","last_undegraded":"2024-09-19T06:46:24.127010+0000","last_fullsized":"2024-09-19T06:46:24.127010+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4731,"log_dups_size":0,"ondisk_log_size":4731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:30.073937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":377497092,"num_objects":95,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":68921,"num_write_kb":870393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565768+0000","last_change":"2024-09-19T06:37:09.442774+0000","last_active":"2024-09-19T06:46:00.565768+0000","last_peered":"2024-09-19T06:46:00.565768+0000","last_clean":"2024-09-19T06:46:00.565768+0000","last_became_active":"2024-09-19T06:37:09.442515+0000","last_became_peered":"2024-09-19T06:37:09.442515+0000","last_unstale":"2024-09-19T06:46:00.565768+0000","last_undegraded":"2024-09-19T06:46:00.565768+0000","last_fullsized":"2024-09-19T06:46:00.565768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:57.376059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.877516+0000","last_change":"2024-09-19T06:37:08.438038+0000","last_active":"2024-09-19T06:46:01.877516+0000","last_peered":"2024-09-19T06:46:01.877516+0000","last_clean":"2024-09-19T06:46:01.877516+0000","last_became_active":"2024-09-19T06:37:08.437771+0000","last_became_peered":"2024-09-19T06:37:08.437771+0000","last_unstale":"2024-09-19T06:46:01.877516+0000","last_undegraded":"2024-09-19T06:46:01.877516+0000","last_fullsized":"2024-09-19T06:46:01.877516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:07.210382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"34'4781","reported_seq":4856,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.140073+0000","last_change":"2024-09-19T06:37:51.782418+0000","last_active":"2024-09-19T06:46:24.140073+0000","last_peered":"2024-09-19T06:46:24.140073+0000","last_clean":"2024-09-19T06:46:24.140073+0000","last_became_active":"2024-09-19T06:37:51.781963+0000","last_became_peered":"2024-09-19T06:37:51.781963+0000","last_unstale":"2024-09-19T06:46:24.140073+0000","last_undegraded":"2024-09-19T06:46:24.140073+0000","last_fullsized":"2024-09-19T06:46:24.140073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4781,"log_dups_size":0,"ondisk_log_size":4781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:12:05.227644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360712105,"num_objects":88,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":69474,"num_write_kb":883742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565121+0000","last_change":"2024-09-19T06:37:09.442213+0000","last_active":"2024-09-19T06:46:00.565121+0000","last_peered":"2024-09-19T06:46:00.565121+0000","last_clean":"2024-09-19T06:46:00.565121+0000","last_became_active":"2024-09-19T06:37:09.441850+0000","last_became_peered":"2024-09-19T06:37:09.441850+0000","last_unstale":"2024-09-19T06:46:00.565121+0000","last_undegraded":"2024-09-19T06:46:00.565121+0000","last_fullsized":"2024-09-19T06:46:00.565121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:43.728914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"34'158","reported_seq":208,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.217854+0000","last_change":"2024-09-19T06:37:08.431703+0000","last_active":"2024-09-19T06:46:23.217854+0000","last_peered":"2024-09-19T06:46:23.217854+0000","last_clean":"2024-09-19T06:46:23.217854+0000","last_became_active":"2024-09-19T06:37:08.431443+0000","last_became_peered":"2024-09-19T06:37:08.431443+0000","last_unstale":"2024-09-19T06:46:23.217854+0000","last_undegraded":"2024-09-19T06:46:23.217854+0000","last_fullsized":"2024-09-19T06:46:23.217854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:02.007521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2390477,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":2297,"num_write":153,"num_write_kb":2408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'4474","reported_seq":4550,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.957819+0000","last_change":"2024-09-19T06:37:13.469295+0000","last_active":"2024-09-19T06:46:23.957819+0000","last_peered":"2024-09-19T06:46:23.957819+0000","last_clean":"2024-09-19T06:46:23.957819+0000","last_became_active":"2024-09-19T06:37:13.468879+0000","last_became_peered":"2024-09-19T06:37:13.468879+0000","last_unstale":"2024-09-19T06:46:23.957819+0000","last_undegraded":"2024-09-19T06:46:23.957819+0000","last_fullsized":"2024-09-19T06:46:23.957819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4474,"log_dups_size":0,"ondisk_log_size":4474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:34.380034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364930356,"num_objects":96,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":65527,"num_write_kb":822050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.566185+0000","last_change":"2024-09-19T06:37:09.439264+0000","last_active":"2024-09-19T06:46:00.566185+0000","last_peered":"2024-09-19T06:46:00.566185+0000","last_clean":"2024-09-19T06:46:00.566185+0000","last_became_active":"2024-09-19T06:37:09.438954+0000","last_became_peered":"2024-09-19T06:37:09.438954+0000","last_unstale":"2024-09-19T06:46:00.566185+0000","last_undegraded":"2024-09-19T06:46:00.566185+0000","last_fullsized":"2024-09-19T06:46:00.566185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:55.094093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"34'7","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.185155+0000","last_change":"2024-09-19T06:37:08.437406+0000","last_active":"2024-09-19T06:46:23.185155+0000","last_peered":"2024-09-19T06:46:23.185155+0000","last_clean":"2024-09-19T06:46:23.185155+0000","last_became_active":"2024-09-19T06:37:08.437093+0000","last_became_peered":"2024-09-19T06:37:08.437093+0000","last_unstale":"2024-09-19T06:46:23.185155+0000","last_undegraded":"2024-09-19T06:46:23.185155+0000","last_fullsized":"2024-09-19T06:46:23.185155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:25.158027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"34'4661","reported_seq":4733,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.314617+0000","last_change":"2024-09-19T06:37:13.460116+0000","last_active":"2024-09-19T06:46:23.314617+0000","last_peered":"2024-09-19T06:46:23.314617+0000","last_clean":"2024-09-19T06:46:23.314617+0000","last_became_active":"2024-09-19T06:37:13.459707+0000","last_became_peered":"2024-09-19T06:37:13.459707+0000","last_unstale":"2024-09-19T06:46:23.314617+0000","last_undegraded":"2024-09-19T06:46:23.314617+0000","last_fullsized":"2024-09-19T06:46:23.314617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4661,"log_dups_size":0,"ondisk_log_size":4661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:02.657115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381701754,"num_objects":95,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":38,"num_read_kb":0,"num_write":68452,"num_write_kb":859940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565428+0000","last_change":"2024-09-19T06:37:09.442670+0000","last_active":"2024-09-19T06:46:00.565428+0000","last_peered":"2024-09-19T06:46:00.565428+0000","last_clean":"2024-09-19T06:46:00.565428+0000","last_became_active":"2024-09-19T06:37:09.442390+0000","last_became_peered":"2024-09-19T06:37:09.442390+0000","last_unstale":"2024-09-19T06:46:00.565428+0000","last_undegraded":"2024-09-19T06:46:00.565428+0000","last_fullsized":"2024-09-19T06:46:00.565428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:02:26.726663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.577499+0000","last_change":"2024-09-19T06:37:08.437263+0000","last_active":"2024-09-19T06:46:05.577499+0000","last_peered":"2024-09-19T06:46:05.577499+0000","last_clean":"2024-09-19T06:46:05.577499+0000","last_became_active":"2024-09-19T06:37:08.436982+0000","last_became_peered":"2024-09-19T06:37:08.436982+0000","last_unstale":"2024-09-19T06:46:05.577499+0000","last_undegraded":"2024-09-19T06:46:05.577499+0000","last_fullsized":"2024-09-19T06:46:05.577499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:14.895925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"34'4713","reported_seq":4793,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.957548+0000","last_change":"2024-09-19T06:37:51.782712+0000","last_active":"2024-09-19T06:46:23.957548+0000","last_peered":"2024-09-19T06:46:23.957548+0000","last_clean":"2024-09-19T06:46:23.957548+0000","last_became_active":"2024-09-19T06:37:51.781602+0000","last_became_peered":"2024-09-19T06:37:51.781602+0000","last_unstale":"2024-09-19T06:46:23.957548+0000","last_undegraded":"2024-09-19T06:46:23.957548+0000","last_fullsized":"2024-09-19T06:46:23.957548+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4713,"log_dups_size":0,"ondisk_log_size":4713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:24.142942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385955277,"num_objects":96,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":68431,"num_write_kb":854704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3,6],"acting":[4,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'10","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565596+0000","last_change":"2024-09-19T06:37:09.439142+0000","last_active":"2024-09-19T06:46:00.565596+0000","last_peered":"2024-09-19T06:46:00.565596+0000","last_clean":"2024-09-19T06:46:00.565596+0000","last_became_active":"2024-09-19T06:37:09.437717+0000","last_became_peered":"2024-09-19T06:37:09.437717+0000","last_unstale":"2024-09-19T06:46:00.565596+0000","last_undegraded":"2024-09-19T06:46:00.565596+0000","last_fullsized":"2024-09-19T06:46:00.565596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:32.934290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.186451+0000","last_change":"2024-09-19T06:37:08.430649+0000","last_active":"2024-09-19T06:46:23.186451+0000","last_peered":"2024-09-19T06:46:23.186451+0000","last_clean":"2024-09-19T06:46:23.186451+0000","last_became_active":"2024-09-19T06:37:08.430324+0000","last_became_peered":"2024-09-19T06:37:08.430324+0000","last_unstale":"2024-09-19T06:46:23.186451+0000","last_undegraded":"2024-09-19T06:46:23.186451+0000","last_fullsized":"2024-09-19T06:46:23.186451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:56.656357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"34'5160","reported_seq":5230,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.301836+0000","last_change":"2024-09-19T06:37:13.463695+0000","last_active":"2024-09-19T06:46:24.301836+0000","last_peered":"2024-09-19T06:46:24.301836+0000","last_clean":"2024-09-19T06:46:24.301836+0000","last_became_active":"2024-09-19T06:37:13.463334+0000","last_became_peered":"2024-09-19T06:37:13.463334+0000","last_unstale":"2024-09-19T06:46:24.301836+0000","last_undegraded":"2024-09-19T06:46:24.301836+0000","last_fullsized":"2024-09-19T06:46:24.301836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5160,"log_dups_size":0,"ondisk_log_size":5160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:46.991800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402906913,"num_objects":107,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":75164,"num_write_kb":939459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.379327+0000","last_change":"2024-09-19T06:37:09.450168+0000","last_active":"2024-09-19T06:46:23.379327+0000","last_peered":"2024-09-19T06:46:23.379327+0000","last_clean":"2024-09-19T06:46:23.379327+0000","last_became_active":"2024-09-19T06:37:09.449872+0000","last_became_peered":"2024-09-19T06:37:09.449872+0000","last_unstale":"2024-09-19T06:46:23.379327+0000","last_undegraded":"2024-09-19T06:46:23.379327+0000","last_fullsized":"2024-09-19T06:46:23.379327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:02:28.282840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.941730+0000","last_change":"2024-09-19T06:37:08.442428+0000","last_active":"2024-09-19T06:46:01.941730+0000","last_peered":"2024-09-19T06:46:01.941730+0000","last_clean":"2024-09-19T06:46:01.941730+0000","last_became_active":"2024-09-19T06:37:08.442120+0000","last_became_peered":"2024-09-19T06:37:08.442120+0000","last_unstale":"2024-09-19T06:46:01.941730+0000","last_undegraded":"2024-09-19T06:46:01.941730+0000","last_fullsized":"2024-09-19T06:46:01.941730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:48.816822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"34'4856","reported_seq":4937,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.673291+0000","last_change":"2024-09-19T06:37:13.471319+0000","last_active":"2024-09-19T06:46:23.673291+0000","last_peered":"2024-09-19T06:46:23.673291+0000","last_clean":"2024-09-19T06:46:23.673291+0000","last_became_active":"2024-09-19T06:37:13.470887+0000","last_became_peered":"2024-09-19T06:37:13.470887+0000","last_unstale":"2024-09-19T06:46:23.673291+0000","last_undegraded":"2024-09-19T06:46:23.673291+0000","last_fullsized":"2024-09-19T06:46:23.673291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4856,"log_dups_size":0,"ondisk_log_size":4856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:21.884985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394324198,"num_objects":100,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":70481,"num_write_kb":907517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'10","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565922+0000","last_change":"2024-09-19T06:37:09.439142+0000","last_active":"2024-09-19T06:46:00.565922+0000","last_peered":"2024-09-19T06:46:00.565922+0000","last_clean":"2024-09-19T06:46:00.565922+0000","last_became_active":"2024-09-19T06:37:09.437635+0000","last_became_peered":"2024-09-19T06:37:09.437635+0000","last_unstale":"2024-09-19T06:46:00.565922+0000","last_undegraded":"2024-09-19T06:46:00.565922+0000","last_fullsized":"2024-09-19T06:46:00.565922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:46.773889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'1","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564672+0000","last_change":"2024-09-19T06:37:08.438932+0000","last_active":"2024-09-19T06:46:00.564672+0000","last_peered":"2024-09-19T06:46:00.564672+0000","last_clean":"2024-09-19T06:46:00.564672+0000","last_became_active":"2024-09-19T06:37:08.438405+0000","last_became_peered":"2024-09-19T06:37:08.438405+0000","last_unstale":"2024-09-19T06:46:00.564672+0000","last_undegraded":"2024-09-19T06:46:00.564672+0000","last_fullsized":"2024-09-19T06:46:00.564672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:59.606628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'5152","reported_seq":5232,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.339377+0000","last_change":"2024-09-19T06:37:13.459370+0000","last_active":"2024-09-19T06:46:24.339377+0000","last_peered":"2024-09-19T06:46:24.339377+0000","last_clean":"2024-09-19T06:46:24.339377+0000","last_became_active":"2024-09-19T06:37:13.458928+0000","last_became_peered":"2024-09-19T06:37:13.458928+0000","last_unstale":"2024-09-19T06:46:24.339377+0000","last_undegraded":"2024-09-19T06:46:24.339377+0000","last_fullsized":"2024-09-19T06:46:24.339377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5152,"log_dups_size":0,"ondisk_log_size":5152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:00.179404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402885323,"num_objects":102,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":47,"num_read_kb":0,"num_write":75196,"num_write_kb":949879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'10","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950479+0000","last_change":"2024-09-19T06:37:09.448958+0000","last_active":"2024-09-19T06:46:01.950479+0000","last_peered":"2024-09-19T06:46:01.950479+0000","last_clean":"2024-09-19T06:46:01.950479+0000","last_became_active":"2024-09-19T06:37:09.448697+0000","last_became_peered":"2024-09-19T06:37:09.448697+0000","last_unstale":"2024-09-19T06:46:01.950479+0000","last_undegraded":"2024-09-19T06:46:01.950479+0000","last_fullsized":"2024-09-19T06:46:01.950479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:16.306915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'62","reported_seq":123,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.855090+0000","last_change":"2024-09-19T06:37:08.442685+0000","last_active":"2024-09-19T06:46:05.855090+0000","last_peered":"2024-09-19T06:46:05.855090+0000","last_clean":"2024-09-19T06:46:05.855090+0000","last_became_active":"2024-09-19T06:37:08.442436+0000","last_became_peered":"2024-09-19T06:37:08.442436+0000","last_unstale":"2024-09-19T06:46:05.855090+0000","last_undegraded":"2024-09-19T06:46:05.855090+0000","last_fullsized":"2024-09-19T06:46:05.855090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:09.952733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":32451,"num_write":58,"num_write_kb":8225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"34'4531","reported_seq":4592,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.249194+0000","last_change":"2024-09-19T06:37:13.457651+0000","last_active":"2024-09-19T06:46:24.249194+0000","last_peered":"2024-09-19T06:46:24.249194+0000","last_clean":"2024-09-19T06:46:24.249194+0000","last_became_active":"2024-09-19T06:37:13.457246+0000","last_became_peered":"2024-09-19T06:37:13.457246+0000","last_unstale":"2024-09-19T06:46:24.249194+0000","last_undegraded":"2024-09-19T06:46:24.249194+0000","last_fullsized":"2024-09-19T06:46:24.249194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4531,"log_dups_size":0,"ondisk_log_size":4531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:18.553158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369098752,"num_objects":88,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":65998,"num_write_kb":826143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565529+0000","last_change":"2024-09-19T06:37:09.441212+0000","last_active":"2024-09-19T06:46:00.565529+0000","last_peered":"2024-09-19T06:46:00.565529+0000","last_clean":"2024-09-19T06:46:00.565529+0000","last_became_active":"2024-09-19T06:37:09.440209+0000","last_became_peered":"2024-09-19T06:37:09.440209+0000","last_unstale":"2024-09-19T06:46:00.565529+0000","last_undegraded":"2024-09-19T06:46:00.565529+0000","last_fullsized":"2024-09-19T06:46:00.565529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:52.173784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"34'219","reported_seq":289,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.212226+0000","last_change":"2024-09-19T06:37:08.442615+0000","last_active":"2024-09-19T06:46:23.212226+0000","last_peered":"2024-09-19T06:46:23.212226+0000","last_clean":"2024-09-19T06:46:23.212226+0000","last_became_active":"2024-09-19T06:37:08.442242+0000","last_became_peered":"2024-09-19T06:37:08.442242+0000","last_unstale":"2024-09-19T06:46:23.212226+0000","last_undegraded":"2024-09-19T06:46:23.212226+0000","last_fullsized":"2024-09-19T06:46:23.212226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:23.813400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":49,"num_read_kb":24618,"num_write":215,"num_write_kb":4203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"34'4646","reported_seq":4720,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.330511+0000","last_change":"2024-09-19T06:37:13.464688+0000","last_active":"2024-09-19T06:46:24.330511+0000","last_peered":"2024-09-19T06:46:24.330511+0000","last_clean":"2024-09-19T06:46:24.330511+0000","last_became_active":"2024-09-19T06:37:13.461620+0000","last_became_peered":"2024-09-19T06:37:13.461620+0000","last_unstale":"2024-09-19T06:46:24.330511+0000","last_undegraded":"2024-09-19T06:46:24.330511+0000","last_fullsized":"2024-09-19T06:46:24.330511+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4646,"log_dups_size":0,"ondisk_log_size":4646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:02.928332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369181538,"num_objects":93,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":67687,"num_write_kb":859195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.951250+0000","last_change":"2024-09-19T06:37:09.440021+0000","last_active":"2024-09-19T06:46:01.951250+0000","last_peered":"2024-09-19T06:46:01.951250+0000","last_clean":"2024-09-19T06:46:01.951250+0000","last_became_active":"2024-09-19T06:37:09.437800+0000","last_became_peered":"2024-09-19T06:37:09.437800+0000","last_unstale":"2024-09-19T06:46:01.951250+0000","last_undegraded":"2024-09-19T06:46:01.951250+0000","last_fullsized":"2024-09-19T06:46:01.951250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:51.963097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"34'16","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.204186+0000","last_change":"2024-09-19T06:37:08.434422+0000","last_active":"2024-09-19T06:46:23.204186+0000","last_peered":"2024-09-19T06:46:23.204186+0000","last_clean":"2024-09-19T06:46:23.204186+0000","last_became_active":"2024-09-19T06:37:08.434151+0000","last_became_peered":"2024-09-19T06:37:08.434151+0000","last_unstale":"2024-09-19T06:46:23.204186+0000","last_undegraded":"2024-09-19T06:46:23.204186+0000","last_fullsized":"2024-09-19T06:46:23.204186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:49.540748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":17,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'4787","reported_seq":4869,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.914919+0000","last_change":"2024-09-19T06:37:13.459321+0000","last_active":"2024-09-19T06:46:23.914919+0000","last_peered":"2024-09-19T06:46:23.914919+0000","last_clean":"2024-09-19T06:46:23.914919+0000","last_became_active":"2024-09-19T06:37:13.458924+0000","last_became_peered":"2024-09-19T06:37:13.458924+0000","last_unstale":"2024-09-19T06:46:23.914919+0000","last_undegraded":"2024-09-19T06:46:23.914919+0000","last_fullsized":"2024-09-19T06:46:23.914919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4787,"log_dups_size":0,"ondisk_log_size":4787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:11.428574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":377594865,"num_objects":100,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":49,"num_read_kb":0,"num_write":69701,"num_write_kb":881574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950806+0000","last_change":"2024-09-19T06:37:09.448450+0000","last_active":"2024-09-19T06:46:01.950806+0000","last_peered":"2024-09-19T06:46:01.950806+0000","last_clean":"2024-09-19T06:46:01.950806+0000","last_became_active":"2024-09-19T06:37:09.448173+0000","last_became_peered":"2024-09-19T06:37:09.448173+0000","last_unstale":"2024-09-19T06:46:01.950806+0000","last_undegraded":"2024-09-19T06:46:01.950806+0000","last_fullsized":"2024-09-19T06:46:01.950806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:22.442374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564938+0000","last_change":"2024-09-19T06:37:08.442796+0000","last_active":"2024-09-19T06:46:00.564938+0000","last_peered":"2024-09-19T06:46:00.564938+0000","last_clean":"2024-09-19T06:46:00.564938+0000","last_became_active":"2024-09-19T06:37:08.442126+0000","last_became_peered":"2024-09-19T06:37:08.442126+0000","last_unstale":"2024-09-19T06:46:00.564938+0000","last_undegraded":"2024-09-19T06:46:00.564938+0000","last_fullsized":"2024-09-19T06:46:00.564938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:27.716141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"34'4735","reported_seq":4795,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.879399+0000","last_change":"2024-09-19T06:37:13.464100+0000","last_active":"2024-09-19T06:46:23.879399+0000","last_peered":"2024-09-19T06:46:23.879399+0000","last_clean":"2024-09-19T06:46:23.879399+0000","last_became_active":"2024-09-19T06:37:13.462750+0000","last_became_peered":"2024-09-19T06:37:13.462750+0000","last_unstale":"2024-09-19T06:46:23.879399+0000","last_undegraded":"2024-09-19T06:46:23.879399+0000","last_fullsized":"2024-09-19T06:46:23.879399+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4735,"log_dups_size":0,"ondisk_log_size":4735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:49.139841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364972928,"num_objects":94,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":69379,"num_write_kb":873579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'5","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.877347+0000","last_change":"2024-09-19T06:37:51.593841+0000","last_active":"2024-09-19T06:46:01.877347+0000","last_peered":"2024-09-19T06:46:01.877347+0000","last_clean":"2024-09-19T06:46:01.877347+0000","last_became_active":"2024-09-19T06:37:51.593513+0000","last_became_peered":"2024-09-19T06:37:51.593513+0000","last_unstale":"2024-09-19T06:46:01.877347+0000","last_undegraded":"2024-09-19T06:46:01.877347+0000","last_fullsized":"2024-09-19T06:46:01.877347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:08.337914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.942374+0000","last_change":"2024-09-19T06:37:08.439543+0000","last_active":"2024-09-19T06:46:01.942374+0000","last_peered":"2024-09-19T06:46:01.942374+0000","last_clean":"2024-09-19T06:46:01.942374+0000","last_became_active":"2024-09-19T06:37:08.438785+0000","last_became_peered":"2024-09-19T06:37:08.438785+0000","last_unstale":"2024-09-19T06:46:01.942374+0000","last_undegraded":"2024-09-19T06:46:01.942374+0000","last_fullsized":"2024-09-19T06:46:01.942374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:51.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"34'4801","reported_seq":4888,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.306391+0000","last_change":"2024-09-19T06:37:13.462327+0000","last_active":"2024-09-19T06:46:23.306391+0000","last_peered":"2024-09-19T06:46:23.306391+0000","last_clean":"2024-09-19T06:46:23.306391+0000","last_became_active":"2024-09-19T06:37:13.461762+0000","last_became_peered":"2024-09-19T06:37:13.461762+0000","last_unstale":"2024-09-19T06:46:23.306391+0000","last_undegraded":"2024-09-19T06:46:23.306391+0000","last_fullsized":"2024-09-19T06:46:23.306391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4801,"log_dups_size":0,"ondisk_log_size":4801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:26.931537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411072145,"num_objects":104,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":71041,"num_write_kb":900045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'5595","reported_seq":5671,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.233489+0000","last_change":"2024-09-19T06:37:13.471309+0000","last_active":"2024-09-19T06:46:24.233489+0000","last_peered":"2024-09-19T06:46:24.233489+0000","last_clean":"2024-09-19T06:46:24.233489+0000","last_became_active":"2024-09-19T06:37:13.470969+0000","last_became_peered":"2024-09-19T06:37:13.470969+0000","last_unstale":"2024-09-19T06:46:24.233489+0000","last_undegraded":"2024-09-19T06:46:24.233489+0000","last_fullsized":"2024-09-19T06:46:24.233489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5595,"log_dups_size":0,"ondisk_log_size":5595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:30.990159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436219018,"num_objects":107,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":81876,"num_write_kb":1028288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.407620+0000","last_change":"2024-09-19T06:37:09.443308+0000","last_active":"2024-09-19T06:46:01.407620+0000","last_peered":"2024-09-19T06:46:01.407620+0000","last_clean":"2024-09-19T06:46:01.407620+0000","last_became_active":"2024-09-19T06:37:09.443069+0000","last_became_peered":"2024-09-19T06:37:09.443069+0000","last_unstale":"2024-09-19T06:46:01.407620+0000","last_undegraded":"2024-09-19T06:46:01.407620+0000","last_fullsized":"2024-09-19T06:46:01.407620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:31:33.708578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"34'28","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.952755+0000","last_change":"2024-09-19T06:37:08.441967+0000","last_active":"2024-09-19T06:46:05.952755+0000","last_peered":"2024-09-19T06:46:05.952755+0000","last_clean":"2024-09-19T06:46:05.952755+0000","last_became_active":"2024-09-19T06:37:08.441698+0000","last_became_peered":"2024-09-19T06:37:08.441698+0000","last_unstale":"2024-09-19T06:46:05.952755+0000","last_undegraded":"2024-09-19T06:46:05.952755+0000","last_fullsized":"2024-09-19T06:46:05.952755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:56.933775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":23,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4728","reported_seq":4801,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.343079+0000","last_change":"2024-09-19T06:37:13.470903+0000","last_active":"2024-09-19T06:46:24.343079+0000","last_peered":"2024-09-19T06:46:24.343079+0000","last_clean":"2024-09-19T06:46:24.343079+0000","last_became_active":"2024-09-19T06:37:13.470528+0000","last_became_peered":"2024-09-19T06:37:13.470528+0000","last_unstale":"2024-09-19T06:46:24.343079+0000","last_undegraded":"2024-09-19T06:46:24.343079+0000","last_fullsized":"2024-09-19T06:46:24.343079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4728,"log_dups_size":0,"ondisk_log_size":4728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:45.999436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381764812,"num_objects":102,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":69139,"num_write_kb":882580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'14","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562486+0000","last_change":"2024-09-19T06:37:09.448953+0000","last_active":"2024-09-19T06:46:00.562486+0000","last_peered":"2024-09-19T06:46:00.562486+0000","last_clean":"2024-09-19T06:46:00.562486+0000","last_became_active":"2024-09-19T06:37:09.448658+0000","last_became_peered":"2024-09-19T06:37:09.448658+0000","last_unstale":"2024-09-19T06:46:00.562486+0000","last_undegraded":"2024-09-19T06:46:00.562486+0000","last_fullsized":"2024-09-19T06:46:00.562486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:07.333392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562651+0000","last_change":"2024-09-19T06:37:08.440800+0000","last_active":"2024-09-19T06:46:00.562651+0000","last_peered":"2024-09-19T06:46:00.562651+0000","last_clean":"2024-09-19T06:46:00.562651+0000","last_became_active":"2024-09-19T06:37:08.440591+0000","last_became_peered":"2024-09-19T06:37:08.440591+0000","last_unstale":"2024-09-19T06:46:00.562651+0000","last_undegraded":"2024-09-19T06:46:00.562651+0000","last_fullsized":"2024-09-19T06:46:00.562651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:05.540261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'20","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.942090+0000","last_change":"2024-09-19T06:37:08.441268+0000","last_active":"2024-09-19T06:46:01.942090+0000","last_peered":"2024-09-19T06:46:01.942090+0000","last_clean":"2024-09-19T06:46:01.942090+0000","last_became_active":"2024-09-19T06:37:08.440969+0000","last_became_peered":"2024-09-19T06:37:08.440969+0000","last_unstale":"2024-09-19T06:46:01.942090+0000","last_undegraded":"2024-09-19T06:46:01.942090+0000","last_fullsized":"2024-09-19T06:46:01.942090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:59.426336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":18,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950785+0000","last_change":"2024-09-19T06:37:09.444857+0000","last_active":"2024-09-19T06:46:01.950785+0000","last_peered":"2024-09-19T06:46:01.950785+0000","last_clean":"2024-09-19T06:46:01.950785+0000","last_became_active":"2024-09-19T06:37:09.444562+0000","last_became_peered":"2024-09-19T06:37:09.444562+0000","last_unstale":"2024-09-19T06:46:01.950785+0000","last_undegraded":"2024-09-19T06:46:01.950785+0000","last_fullsized":"2024-09-19T06:46:01.950785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:02.470787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"34'3831","reported_seq":3893,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.370400+0000","last_change":"2024-09-19T06:37:13.467183+0000","last_active":"2024-09-19T06:46:24.370400+0000","last_peered":"2024-09-19T06:46:24.370400+0000","last_clean":"2024-09-19T06:46:24.370400+0000","last_became_active":"2024-09-19T06:37:13.466765+0000","last_became_peered":"2024-09-19T06:37:13.466765+0000","last_unstale":"2024-09-19T06:46:24.370400+0000","last_undegraded":"2024-09-19T06:46:24.370400+0000","last_fullsized":"2024-09-19T06:46:24.370400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":3831,"log_dups_size":0,"ondisk_log_size":3831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:35.184815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285214399,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":56416,"num_write_kb":718624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'987","reported_seq":1040,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.590330+0000","last_change":"2024-09-19T06:37:08.443993+0000","last_active":"2024-09-19T06:46:05.590330+0000","last_peered":"2024-09-19T06:46:05.590330+0000","last_clean":"2024-09-19T06:46:05.590330+0000","last_became_active":"2024-09-19T06:37:08.443774+0000","last_became_peered":"2024-09-19T06:37:08.443774+0000","last_unstale":"2024-09-19T06:46:05.590330+0000","last_undegraded":"2024-09-19T06:46:05.590330+0000","last_fullsized":"2024-09-19T06:46:05.590330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":987,"log_dups_size":0,"ondisk_log_size":987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:16.005073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":42342,"num_write":985,"num_write_kb":4941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.951295+0000","last_change":"2024-09-19T06:37:09.440258+0000","last_active":"2024-09-19T06:46:01.951295+0000","last_peered":"2024-09-19T06:46:01.951295+0000","last_clean":"2024-09-19T06:46:01.951295+0000","last_became_active":"2024-09-19T06:37:09.438457+0000","last_became_peered":"2024-09-19T06:37:09.438457+0000","last_unstale":"2024-09-19T06:46:01.951295+0000","last_undegraded":"2024-09-19T06:46:01.951295+0000","last_fullsized":"2024-09-19T06:46:01.951295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:24.636340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'5301","reported_seq":5370,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.322864+0000","last_change":"2024-09-19T06:37:13.462800+0000","last_active":"2024-09-19T06:46:24.322864+0000","last_peered":"2024-09-19T06:46:24.322864+0000","last_clean":"2024-09-19T06:46:24.322864+0000","last_became_active":"2024-09-19T06:37:13.462393+0000","last_became_peered":"2024-09-19T06:37:13.462393+0000","last_unstale":"2024-09-19T06:46:24.322864+0000","last_undegraded":"2024-09-19T06:46:24.322864+0000","last_fullsized":"2024-09-19T06:46:24.322864+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5301,"log_dups_size":0,"ondisk_log_size":5301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:35.901637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423730412,"num_objects":108,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":77269,"num_write_kb":974522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.941457+0000","last_change":"2024-09-19T06:37:09.450421+0000","last_active":"2024-09-19T06:46:01.941457+0000","last_peered":"2024-09-19T06:46:01.941457+0000","last_clean":"2024-09-19T06:46:01.941457+0000","last_became_active":"2024-09-19T06:37:09.450147+0000","last_became_peered":"2024-09-19T06:37:09.450147+0000","last_unstale":"2024-09-19T06:46:01.941457+0000","last_undegraded":"2024-09-19T06:46:01.941457+0000","last_fullsized":"2024-09-19T06:46:01.941457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:42.949759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'11","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.877114+0000","last_change":"2024-09-19T06:37:09.435131+0000","last_active":"2024-09-19T06:46:01.877114+0000","last_peered":"2024-09-19T06:46:01.877114+0000","last_clean":"2024-09-19T06:46:01.877114+0000","last_became_active":"2024-09-19T06:37:09.434840+0000","last_became_peered":"2024-09-19T06:37:09.434840+0000","last_unstale":"2024-09-19T06:46:01.877114+0000","last_undegraded":"2024-09-19T06:46:01.877114+0000","last_fullsized":"2024-09-19T06:46:01.877114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:20.484554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564591+0000","last_change":"2024-09-19T06:37:09.445196+0000","last_active":"2024-09-19T06:46:00.564591+0000","last_peered":"2024-09-19T06:46:00.564591+0000","last_clean":"2024-09-19T06:46:00.564591+0000","last_became_active":"2024-09-19T06:37:09.444907+0000","last_became_peered":"2024-09-19T06:37:09.444907+0000","last_unstale":"2024-09-19T06:46:00.564591+0000","last_undegraded":"2024-09-19T06:46:00.564591+0000","last_fullsized":"2024-09-19T06:46:00.564591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:17.605675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950638+0000","last_change":"2024-09-19T06:37:09.447966+0000","last_active":"2024-09-19T06:46:01.950638+0000","last_peered":"2024-09-19T06:46:01.950638+0000","last_clean":"2024-09-19T06:46:01.950638+0000","last_became_active":"2024-09-19T06:37:09.447692+0000","last_became_peered":"2024-09-19T06:37:09.447692+0000","last_unstale":"2024-09-19T06:46:01.950638+0000","last_undegraded":"2024-09-19T06:46:01.950638+0000","last_fullsized":"2024-09-19T06:46:01.950638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:01.517824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'7","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.408272+0000","last_change":"2024-09-19T06:37:51.596144+0000","last_active":"2024-09-19T06:46:01.408272+0000","last_peered":"2024-09-19T06:46:01.408272+0000","last_clean":"2024-09-19T06:46:01.408272+0000","last_became_active":"2024-09-19T06:37:51.595875+0000","last_became_peered":"2024-09-19T06:37:51.595875+0000","last_unstale":"2024-09-19T06:46:01.408272+0000","last_undegraded":"2024-09-19T06:46:01.408272+0000","last_fullsized":"2024-09-19T06:46:01.408272+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:30.846248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"28'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.408530+0000","last_change":"2024-09-19T06:37:09.441782+0000","last_active":"2024-09-19T06:46:01.408530+0000","last_peered":"2024-09-19T06:46:01.408530+0000","last_clean":"2024-09-19T06:46:01.408530+0000","last_became_active":"2024-09-19T06:37:09.441456+0000","last_became_peered":"2024-09-19T06:37:09.441456+0000","last_unstale":"2024-09-19T06:46:01.408530+0000","last_undegraded":"2024-09-19T06:46:01.408530+0000","last_fullsized":"2024-09-19T06:46:01.408530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:04:28.458974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.942133+0000","last_change":"2024-09-19T06:37:09.449856+0000","last_active":"2024-09-19T06:46:01.942133+0000","last_peered":"2024-09-19T06:46:01.942133+0000","last_clean":"2024-09-19T06:46:01.942133+0000","last_became_active":"2024-09-19T06:37:09.449562+0000","last_became_peered":"2024-09-19T06:37:09.449562+0000","last_unstale":"2024-09-19T06:46:01.942133+0000","last_undegraded":"2024-09-19T06:46:01.942133+0000","last_fullsized":"2024-09-19T06:46:01.942133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:49.182126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'9","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.563653+0000","last_change":"2024-09-19T06:37:09.438551+0000","last_active":"2024-09-19T06:46:00.563653+0000","last_peered":"2024-09-19T06:46:00.563653+0000","last_clean":"2024-09-19T06:46:00.563653+0000","last_became_active":"2024-09-19T06:37:09.437624+0000","last_became_peered":"2024-09-19T06:37:09.437624+0000","last_unstale":"2024-09-19T06:46:00.563653+0000","last_undegraded":"2024-09-19T06:46:00.563653+0000","last_fullsized":"2024-09-19T06:46:00.563653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:46.565780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564849+0000","last_change":"2024-09-19T06:37:09.438737+0000","last_active":"2024-09-19T06:46:00.564849+0000","last_peered":"2024-09-19T06:46:00.564849+0000","last_clean":"2024-09-19T06:46:00.564849+0000","last_became_active":"2024-09-19T06:37:09.438453+0000","last_became_peered":"2024-09-19T06:37:09.438453+0000","last_unstale":"2024-09-19T06:46:00.564849+0000","last_undegraded":"2024-09-19T06:46:00.564849+0000","last_fullsized":"2024-09-19T06:46:00.564849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.982275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"34'11","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.628456+0000","last_change":"2024-09-19T06:37:09.442093+0000","last_active":"2024-09-19T06:46:05.628456+0000","last_peered":"2024-09-19T06:46:05.628456+0000","last_clean":"2024-09-19T06:46:05.628456+0000","last_became_active":"2024-09-19T06:37:09.439710+0000","last_became_peered":"2024-09-19T06:37:09.439710+0000","last_unstale":"2024-09-19T06:46:05.628456+0000","last_undegraded":"2024-09-19T06:46:05.628456+0000","last_fullsized":"2024-09-19T06:46:05.628456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:02.626854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'9","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.877132+0000","last_change":"2024-09-19T06:37:51.593282+0000","last_active":"2024-09-19T06:46:01.877132+0000","last_peered":"2024-09-19T06:46:01.877132+0000","last_clean":"2024-09-19T06:46:01.877132+0000","last_became_active":"2024-09-19T06:37:51.592846+0000","last_became_peered":"2024-09-19T06:37:51.592846+0000","last_unstale":"2024-09-19T06:46:01.877132+0000","last_undegraded":"2024-09-19T06:46:01.877132+0000","last_fullsized":"2024-09-19T06:46:01.877132+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:03:58.694299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"29'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950505+0000","last_change":"2024-09-19T06:37:09.449633+0000","last_active":"2024-09-19T06:46:01.950505+0000","last_peered":"2024-09-19T06:46:01.950505+0000","last_clean":"2024-09-19T06:46:01.950505+0000","last_became_active":"2024-09-19T06:37:09.449379+0000","last_became_peered":"2024-09-19T06:37:09.449379+0000","last_unstale":"2024-09-19T06:46:01.950505+0000","last_undegraded":"2024-09-19T06:46:01.950505+0000","last_fullsized":"2024-09-19T06:46:01.950505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:29.565038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.942221+0000","last_change":"2024-09-19T06:37:09.447808+0000","last_active":"2024-09-19T06:46:01.942221+0000","last_peered":"2024-09-19T06:46:01.942221+0000","last_clean":"2024-09-19T06:46:01.942221+0000","last_became_active":"2024-09-19T06:37:09.447514+0000","last_became_peered":"2024-09-19T06:37:09.447514+0000","last_unstale":"2024-09-19T06:46:01.942221+0000","last_undegraded":"2024-09-19T06:46:01.942221+0000","last_fullsized":"2024-09-19T06:46:01.942221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:04.653997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'10","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565955+0000","last_change":"2024-09-19T06:37:09.439605+0000","last_active":"2024-09-19T06:46:00.565955+0000","last_peered":"2024-09-19T06:46:00.565955+0000","last_clean":"2024-09-19T06:46:00.565955+0000","last_became_active":"2024-09-19T06:37:09.432601+0000","last_became_peered":"2024-09-19T06:37:09.432601+0000","last_unstale":"2024-09-19T06:46:00.565955+0000","last_undegraded":"2024-09-19T06:46:00.565955+0000","last_fullsized":"2024-09-19T06:46:00.565955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:50.640062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"34'10","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.877546+0000","last_change":"2024-09-19T06:37:09.440268+0000","last_active":"2024-09-19T06:46:01.877546+0000","last_peered":"2024-09-19T06:46:01.877546+0000","last_clean":"2024-09-19T06:46:01.877546+0000","last_became_active":"2024-09-19T06:37:09.439937+0000","last_became_peered":"2024-09-19T06:37:09.439937+0000","last_unstale":"2024-09-19T06:46:01.877546+0000","last_undegraded":"2024-09-19T06:46:01.877546+0000","last_fullsized":"2024-09-19T06:46:01.877546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:32:46.182979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565483+0000","last_change":"2024-09-19T06:37:09.437080+0000","last_active":"2024-09-19T06:46:00.565483+0000","last_peered":"2024-09-19T06:46:00.565483+0000","last_clean":"2024-09-19T06:46:00.565483+0000","last_became_active":"2024-09-19T06:37:09.436752+0000","last_became_peered":"2024-09-19T06:37:09.436752+0000","last_unstale":"2024-09-19T06:46:00.565483+0000","last_undegraded":"2024-09-19T06:46:00.565483+0000","last_fullsized":"2024-09-19T06:46:00.565483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:31.423640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"34'11","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.196400+0000","last_change":"2024-09-19T06:37:09.448942+0000","last_active":"2024-09-19T06:46:23.196400+0000","last_peered":"2024-09-19T06:46:23.196400+0000","last_clean":"2024-09-19T06:46:23.196400+0000","last_became_active":"2024-09-19T06:37:09.448647+0000","last_became_peered":"2024-09-19T06:37:09.448647+0000","last_unstale":"2024-09-19T06:46:23.196400+0000","last_undegraded":"2024-09-19T06:46:23.196400+0000","last_fullsized":"2024-09-19T06:46:23.196400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:49.027909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'10","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.407626+0000","last_change":"2024-09-19T06:37:09.445015+0000","last_active":"2024-09-19T06:46:01.407626+0000","last_peered":"2024-09-19T06:46:01.407626+0000","last_clean":"2024-09-19T06:46:01.407626+0000","last_became_active":"2024-09-19T06:37:09.444737+0000","last_became_peered":"2024-09-19T06:37:09.444737+0000","last_unstale":"2024-09-19T06:46:01.407626+0000","last_undegraded":"2024-09-19T06:46:01.407626+0000","last_fullsized":"2024-09-19T06:46:01.407626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:16.194580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'10","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950483+0000","last_change":"2024-09-19T06:37:09.446025+0000","last_active":"2024-09-19T06:46:01.950483+0000","last_peered":"2024-09-19T06:46:01.950483+0000","last_clean":"2024-09-19T06:46:01.950483+0000","last_became_active":"2024-09-19T06:37:09.445503+0000","last_became_peered":"2024-09-19T06:37:09.445503+0000","last_unstale":"2024-09-19T06:46:01.950483+0000","last_undegraded":"2024-09-19T06:46:01.950483+0000","last_fullsized":"2024-09-19T06:46:01.950483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:30.469995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.563043+0000","last_change":"2024-09-19T06:37:09.441302+0000","last_active":"2024-09-19T06:46:00.563043+0000","last_peered":"2024-09-19T06:46:00.563043+0000","last_clean":"2024-09-19T06:46:00.563043+0000","last_became_active":"2024-09-19T06:37:09.439767+0000","last_became_peered":"2024-09-19T06:37:09.439767+0000","last_unstale":"2024-09-19T06:46:00.563043+0000","last_undegraded":"2024-09-19T06:46:00.563043+0000","last_fullsized":"2024-09-19T06:46:00.563043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:01.038823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.951163+0000","last_change":"2024-09-19T06:37:09.440976+0000","last_active":"2024-09-19T06:46:01.951163+0000","last_peered":"2024-09-19T06:46:01.951163+0000","last_clean":"2024-09-19T06:46:01.951163+0000","last_became_active":"2024-09-19T06:37:09.440702+0000","last_became_peered":"2024-09-19T06:37:09.440702+0000","last_unstale":"2024-09-19T06:46:01.951163+0000","last_undegraded":"2024-09-19T06:46:01.951163+0000","last_fullsized":"2024-09-19T06:46:01.951163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:21.281400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'11","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.942156+0000","last_change":"2024-09-19T06:37:09.442301+0000","last_active":"2024-09-19T06:46:01.942156+0000","last_peered":"2024-09-19T06:46:01.942156+0000","last_clean":"2024-09-19T06:46:01.942156+0000","last_became_active":"2024-09-19T06:37:09.442053+0000","last_became_peered":"2024-09-19T06:37:09.442053+0000","last_unstale":"2024-09-19T06:46:01.942156+0000","last_undegraded":"2024-09-19T06:46:01.942156+0000","last_fullsized":"2024-09-19T06:46:01.942156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:26.189384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'9","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.942136+0000","last_change":"2024-09-19T06:37:09.441525+0000","last_active":"2024-09-19T06:46:01.942136+0000","last_peered":"2024-09-19T06:46:01.942136+0000","last_clean":"2024-09-19T06:46:01.942136+0000","last_became_active":"2024-09-19T06:37:09.441179+0000","last_became_peered":"2024-09-19T06:37:09.441179+0000","last_unstale":"2024-09-19T06:46:01.942136+0000","last_undegraded":"2024-09-19T06:46:01.942136+0000","last_fullsized":"2024-09-19T06:46:01.942136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:47.235113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'10","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.566138+0000","last_change":"2024-09-19T06:37:09.437163+0000","last_active":"2024-09-19T06:46:00.566138+0000","last_peered":"2024-09-19T06:46:00.566138+0000","last_clean":"2024-09-19T06:46:00.566138+0000","last_became_active":"2024-09-19T06:37:09.436892+0000","last_became_peered":"2024-09-19T06:37:09.436892+0000","last_unstale":"2024-09-19T06:46:00.566138+0000","last_undegraded":"2024-09-19T06:46:00.566138+0000","last_fullsized":"2024-09-19T06:46:00.566138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:47:58.347385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562140+0000","last_change":"2024-09-19T06:37:09.437524+0000","last_active":"2024-09-19T06:46:00.562140+0000","last_peered":"2024-09-19T06:46:00.562140+0000","last_clean":"2024-09-19T06:46:00.562140+0000","last_became_active":"2024-09-19T06:37:09.437023+0000","last_became_peered":"2024-09-19T06:37:09.437023+0000","last_unstale":"2024-09-19T06:46:00.562140+0000","last_undegraded":"2024-09-19T06:46:00.562140+0000","last_fullsized":"2024-09-19T06:46:00.562140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:31.398914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565598+0000","last_change":"2024-09-19T06:37:09.448814+0000","last_active":"2024-09-19T06:46:00.565598+0000","last_peered":"2024-09-19T06:46:00.565598+0000","last_clean":"2024-09-19T06:46:00.565598+0000","last_became_active":"2024-09-19T06:37:09.448547+0000","last_became_peered":"2024-09-19T06:37:09.448547+0000","last_unstale":"2024-09-19T06:46:00.565598+0000","last_undegraded":"2024-09-19T06:46:00.565598+0000","last_fullsized":"2024-09-19T06:46:00.565598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:13.526300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'7","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564426+0000","last_change":"2024-09-19T06:37:09.446910+0000","last_active":"2024-09-19T06:46:00.564426+0000","last_peered":"2024-09-19T06:46:00.564426+0000","last_clean":"2024-09-19T06:46:00.564426+0000","last_became_active":"2024-09-19T06:37:09.446603+0000","last_became_peered":"2024-09-19T06:37:09.446603+0000","last_unstale":"2024-09-19T06:46:00.564426+0000","last_undegraded":"2024-09-19T06:46:00.564426+0000","last_fullsized":"2024-09-19T06:46:00.564426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:47.006354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565756+0000","last_change":"2024-09-19T06:37:09.430160+0000","last_active":"2024-09-19T06:46:00.565756+0000","last_peered":"2024-09-19T06:46:00.565756+0000","last_clean":"2024-09-19T06:46:00.565756+0000","last_became_active":"2024-09-19T06:37:09.429813+0000","last_became_peered":"2024-09-19T06:37:09.429813+0000","last_unstale":"2024-09-19T06:46:00.565756+0000","last_undegraded":"2024-09-19T06:46:00.565756+0000","last_fullsized":"2024-09-19T06:46:00.565756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:10.353834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'5","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.877259+0000","last_change":"2024-09-19T06:37:51.782148+0000","last_active":"2024-09-19T06:46:01.877259+0000","last_peered":"2024-09-19T06:46:01.877259+0000","last_clean":"2024-09-19T06:46:01.877259+0000","last_became_active":"2024-09-19T06:37:51.781695+0000","last_became_peered":"2024-09-19T06:37:51.781695+0000","last_unstale":"2024-09-19T06:46:01.877259+0000","last_undegraded":"2024-09-19T06:46:01.877259+0000","last_fullsized":"2024-09-19T06:46:01.877259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:13.160550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950209+0000","last_change":"2024-09-19T06:37:09.446789+0000","last_active":"2024-09-19T06:46:01.950209+0000","last_peered":"2024-09-19T06:46:01.950209+0000","last_clean":"2024-09-19T06:46:01.950209+0000","last_became_active":"2024-09-19T06:37:09.446557+0000","last_became_peered":"2024-09-19T06:37:09.446557+0000","last_unstale":"2024-09-19T06:46:01.950209+0000","last_undegraded":"2024-09-19T06:46:01.950209+0000","last_fullsized":"2024-09-19T06:46:01.950209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:18.119474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.408917+0000","last_change":"2024-09-19T06:37:09.448093+0000","last_active":"2024-09-19T06:46:01.408917+0000","last_peered":"2024-09-19T06:46:01.408917+0000","last_clean":"2024-09-19T06:46:01.408917+0000","last_became_active":"2024-09-19T06:37:09.447753+0000","last_became_peered":"2024-09-19T06:37:09.447753+0000","last_unstale":"2024-09-19T06:46:01.408917+0000","last_undegraded":"2024-09-19T06:46:01.408917+0000","last_fullsized":"2024-09-19T06:46:01.408917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:11.944092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.566032+0000","last_change":"2024-09-19T06:37:09.442798+0000","last_active":"2024-09-19T06:46:00.566032+0000","last_peered":"2024-09-19T06:46:00.566032+0000","last_clean":"2024-09-19T06:46:00.566032+0000","last_became_active":"2024-09-19T06:37:09.442047+0000","last_became_peered":"2024-09-19T06:37:09.442047+0000","last_unstale":"2024-09-19T06:46:00.566032+0000","last_undegraded":"2024-09-19T06:46:00.566032+0000","last_fullsized":"2024-09-19T06:46:00.566032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:33.193185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":12270796617,"num_objects":3116,"num_object_clones":0,"num_object_copies":12464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3116,"num_whiteouts":0,"num_read":1242,"num_read_kb":0,"num_write":2244704,"num_write_kb":28311472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":14400413696,"data_stored":24543608832,"data_compressed":1344871924,"data_compressed_allocated":5351727104,"data_compressed_original":15494922240,"omap_allocated":0,"internal_metadata":0},"log_size":153765,"ondisk_log_size":153765,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":467,"ondisk_log_size":467,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65400605,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":465,"num_read_kb":289482,"num_write":3818,"num_write_kb":66805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33341440,"data_stored":130801210,"data_compressed":14149544,"data_compressed_allocated":17014784,"data_compressed_original":114532352,"omap_allocated":0,"internal_metadata":0},"log_size":3703,"ondisk_log_size":3703,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65040,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509557,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1978644,"kb_used_data":1294212,"kb_used_omap":1,"kb_used_meta":684414,"kb_avail":92393196,"statfs":{"total":96636764160,"available":94610632704,"internally_reserved":0,"allocated":1325273088,"data_stored":2267551713,"data_compressed":124553786,"data_compressed_allocated":494407680,"data_compressed_original":1436893184,"omap_allocated":1595,"internal_metadata":700840389},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509557,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2741744,"kb_used_data":1776864,"kb_used_omap":1,"kb_used_meta":964862,"kb_avail":91630096,"statfs":{"total":96636764160,"available":93829218304,"internally_reserved":0,"allocated":1819508736,"data_stored":3105010060,"data_compressed":171329329,"data_compressed_allocated":674234368,"data_compressed_original":1959952384,"omap_allocated":1595,"internal_metadata":988019141},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509556,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2404484,"kb_used_data":1556916,"kb_used_omap":1,"kb_used_meta":847550,"kb_avail":91967356,"statfs":{"total":96636764160,"available":94174572544,"internally_reserved":0,"allocated":1594281984,"data_stored":2734205989,"data_compressed":150705539,"data_compressed_allocated":594751488,"data_compressed_original":1734893568,"omap_allocated":1595,"internal_metadata":867891653},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542261,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2449536,"kb_used_data":1575536,"kb_used_omap":1,"kb_used_meta":873982,"kb_avail":91922304,"statfs":{"total":96636764160,"available":94128439296,"internally_reserved":0,"allocated":1613348864,"data_stored":2765507565,"data_compressed":152489907,"data_compressed_allocated":598831104,"data_compressed_original":1751199744,"omap_allocated":1590,"internal_metadata":894958026},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542259,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2804680,"kb_used_data":1849272,"kb_used_omap":1,"kb_used_meta":955390,"kb_avail":91567160,"statfs":{"total":96636764160,"available":93764771840,"internally_reserved":0,"allocated":1893654528,"data_stored":3241159207,"data_compressed":179048312,"data_compressed_allocated":705675264,"data_compressed_original":2053390336,"omap_allocated":1594,"internal_metadata":978319814},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542258,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3487684,"kb_used_data":2326964,"kb_used_omap":1,"kb_used_meta":1160702,"kb_avail":90884156,"statfs":{"total":96636764160,"available":93065375744,"internally_reserved":0,"allocated":2382811136,"data_stored":4063537562,"data_compressed":223516304,"data_compressed_allocated":885309440,"data_compressed_original":2566246400,"omap_allocated":1593,"internal_metadata":1188559303},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,5,0,1,5,7,1,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542258,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3548688,"kb_used_data":2320384,"kb_used_omap":1,"kb_used_meta":1228286,"kb_avail":90823152,"statfs":{"total":96636764160,"available":93002907648,"internally_reserved":0,"allocated":2376073216,"data_stored":4057641390,"data_compressed":223574906,"data_compressed_allocated":883261440,"data_compressed_original":2565042176,"omap_allocated":1595,"internal_metadata":1257765317},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574966,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2163716,"kb_used_data":1398324,"kb_used_omap":1,"kb_used_meta":765374,"kb_avail":92208124,"statfs":{"total":96636764160,"available":94421118976,"internally_reserved":0,"allocated":1431883776,"data_stored":2442303327,"data_compressed":133868425,"data_compressed_allocated":532361216,"data_compressed_original":1542983680,"omap_allocated":1595,"internal_metadata":783743429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4018176,"data_stored":20972158,"data_compressed":2327138,"data_compressed_allocated":2707456,"data_compressed_original":19673088,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3305472,"data_stored":14973479,"data_compressed":1661240,"data_compressed_allocated":2039808,"data_compressed_original":13717504,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":94168,"data_compressed":5056,"data_compressed_allocated":8192,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5226496,"data_stored":12677752,"data_compressed":1395672,"data_compressed_allocated":1748992,"data_compressed_original":9207808,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5414912,"data_stored":23362053,"data_compressed":2560869,"data_compressed_allocated":2981888,"data_compressed_original":20942848,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1662976,"data_stored":8388698,"data_compressed":865550,"data_compressed_allocated":1097728,"data_compressed_original":7827456,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3923968,"data_stored":16777888,"data_compressed":1995942,"data_compressed_allocated":2461696,"data_compressed_original":15323136,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9711616,"data_stored":33555014,"data_compressed":3338077,"data_compressed_allocated":3969024,"data_compressed_original":27815936,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1589829632,"data_stored":2712477696,"data_compressed":148345881,"data_compressed_allocated":591998976,"data_compressed_original":1714647040,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2372399104,"data_stored":4042502144,"data_compressed":221913666,"data_compressed_allocated":881221632,"data_compressed_original":2551324672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1431437312,"data_stored":2442043392,"data_compressed":133863369,"data_compressed_allocated":532353024,"data_compressed_original":1542959104,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2377216000,"data_stored":4050694144,"data_compressed":222120632,"data_compressed_allocated":883560448,"data_compressed_original":2557038592,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1813725184,"data_stored":3081482240,"data_compressed":168768460,"data_compressed_allocated":671252480,"data_compressed_original":1939009536,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1323241472,"data_stored":2258997248,"data_compressed":123688236,"data_compressed_allocated":493309952,"data_compressed_original":1429065728,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1889361920,"data_stored":3224215552,"data_compressed":177052370,"data_compressed_allocated":703213568,"data_compressed_original":2038067200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1603203072,"data_stored":2731196416,"data_compressed":149119310,"data_compressed_allocated":594817024,"data_compressed_original":1722810368,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:46:31.105 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:46:31.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.344+0000 7fb833311640 1 Processor -- start 2024-09-19T06:46:31.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.344+0000 7fb833311640 1 -- start start 2024-09-19T06:46:31.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.346+0000 7fb833311640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb82c0c8430 0x7fb82c151460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:31.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.346+0000 7fb833311640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb82c158560 con 0x7fb82c0c8050 2024-09-19T06:46:31.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.346+0000 7fb833311640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb82c06ce10 con 0x7fb82c0c2760 2024-09-19T06:46:31.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.346+0000 7fb833311640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb82c06d0f0 con 0x7fb82c0c8430 2024-09-19T06:46:31.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.346+0000 7fb8318ae640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fb82c0c2760 0x7fb82c161f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:45212/0 (socket says 172.21.15.86:45212) 2024-09-19T06:46:31.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.346+0000 7fb8318ae640 1 -- 172.21.15.86:0/951012802 learned_addr learned my addr 172.21.15.86:0/951012802 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:46:31.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.347+0000 7fb823fff640 1 -- 172.21.15.86:0/951012802 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3011882888 0 0) 0x7fb82c06ce10 con 0x7fb82c0c2760 2024-09-19T06:46:31.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.347+0000 7fb823fff640 1 -- 172.21.15.86:0/951012802 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb818003520 con 0x7fb82c0c2760 2024-09-19T06:46:31.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.347+0000 7fb823fff640 1 -- 172.21.15.86:0/951012802 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2397416693 0 0) 0x7fb82c158560 con 0x7fb82c0c8050 2024-09-19T06:46:31.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.347+0000 7fb823fff640 1 -- 172.21.15.86:0/951012802 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb82c06ce10 con 0x7fb82c0c8050 2024-09-19T06:46:31.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.348+0000 7fb823fff640 1 -- 172.21.15.86:0/951012802 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 7190893 0 0) 0x7fb82c06ce10 con 0x7fb82c0c8050 2024-09-19T06:46:31.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.348+0000 7fb823fff640 1 -- 172.21.15.86:0/951012802 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb82c0c8430 msgr2=0x7fb82c151460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:46:31.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.348+0000 7fb823fff640 1 --2- 172.21.15.86:0/951012802 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb82c0c8430 0x7fb82c151460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.348+0000 7fb823fff640 1 -- 172.21.15.86:0/951012802 >> v1:172.21.15.169:6789/0 conn(0x7fb82c0c2760 legacy=0x7fb82c161f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:31.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.348+0000 7fb823fff640 1 -- 172.21.15.86:0/951012802 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82c06d3d0 con 0x7fb82c0c8050 2024-09-19T06:46:31.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.348+0000 7fb823fff640 1 -- 172.21.15.86:0/951012802 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7fb81c0015f0 con 0x7fb82c0c8050 2024-09-19T06:46:31.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.348+0000 7fb823fff640 1 -- 172.21.15.86:0/951012802 >> v1:172.21.15.86:6789/0 conn(0x7fb82c0c8050 legacy=0x7fb82c0c2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:31.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.348+0000 7fb823fff640 1 --2- 172.21.15.86:0/951012802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb818004bd0 0x7fb818004fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:31.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.348+0000 7fb823fff640 1 --2- 172.21.15.86:0/951012802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8180037a0 0x7fb818003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:31.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.348+0000 7fb823fff640 1 --2- 172.21.15.86:0/951012802 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb82c0c8430 0x7fb81802da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:31.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.348+0000 7fb823fff640 1 -- 172.21.15.86:0/951012802 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c06d0f0 con 0x7fb8180037a0 2024-09-19T06:46:31.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.348+0000 7fb823fff640 1 -- 172.21.15.86:0/951012802 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb818004500 con 0x7fb818004bd0 2024-09-19T06:46:31.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.348+0000 7fb823fff640 1 -- 172.21.15.86:0/951012802 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb81802df90 con 0x7fb82c0c8430 2024-09-19T06:46:31.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.348+0000 7fb8310ad640 1 --2- 172.21.15.86:0/951012802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb818004bd0 0x7fb818004fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:31.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.349+0000 7fb8318ae640 1 --2- 172.21.15.86:0/951012802 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb82c0c8430 0x7fb81802da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:31.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.349+0000 7fb8310ad640 1 -- 172.21.15.86:0/951012802 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb82c0c8430 msgr2=0x7fb81802da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:31.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.349+0000 7fb8310ad640 1 --2- 172.21.15.86:0/951012802 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb82c0c8430 0x7fb81802da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.349+0000 7fb8310ad640 1 -- 172.21.15.86:0/951012802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8180037a0 msgr2=0x7fb818003c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:46:31.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.349+0000 7fb8310ad640 1 --2- 172.21.15.86:0/951012802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8180037a0 0x7fb818003c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.349+0000 7fb8310ad640 1 -- 172.21.15.86:0/951012802 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82c06d3d0 con 0x7fb818004bd0 2024-09-19T06:46:31.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.350+0000 7fb8310ad640 1 --2- 172.21.15.86:0/951012802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb818004bd0 0x7fb818004fd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb81c007f70 tx=0x7fb818005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41ee14a96365be13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:31.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.352+0000 7fb823fff640 1 -- 172.21.15.86:0/951012802 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81c035070 con 0x7fb818004bd0 2024-09-19T06:46:31.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.352+0000 7fb823fff640 1 -- 172.21.15.86:0/951012802 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb81c02fa50 con 0x7fb818004bd0 2024-09-19T06:46:31.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.352+0000 7fb823fff640 1 -- 172.21.15.86:0/951012802 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81c007b40 con 0x7fb818004bd0 2024-09-19T06:46:31.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.353+0000 7fb833311640 1 -- 172.21.15.86:0/951012802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb818004bd0 msgr2=0x7fb818004fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:31.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.353+0000 7fb833311640 1 --2- 172.21.15.86:0/951012802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb818004bd0 0x7fb818004fd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb81c007f70 tx=0x7fb818005830 comp rx=0 tx=0).stop 2024-09-19T06:46:31.355 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.355+0000 7fb8318ae640 1 -- 172.21.15.86:0/951012802 reap_dead start 2024-09-19T06:46:31.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.356+0000 7fb833311640 1 -- 172.21.15.86:0/951012802 shutdown_connections 2024-09-19T06:46:31.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.356+0000 7fb833311640 1 -- 172.21.15.86:0/951012802 >> 172.21.15.86:0/951012802 conn(0x7fb82c0cd030 msgr2=0x7fb82c0cd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:31.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.362+0000 7fb833311640 1 -- 172.21.15.86:0/951012802 shutdown_connections 2024-09-19T06:46:31.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.362+0000 7fb833311640 1 -- 172.21.15.86:0/951012802 wait complete. 2024-09-19T06:46:31.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.364+0000 7fb833311640 1 Processor -- start 2024-09-19T06:46:31.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.364+0000 7fb833311640 1 -- start start 2024-09-19T06:46:31.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.365+0000 7fb833311640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb818004bd0 0x7fb82c154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:31.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.365+0000 7fb833311640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb82c0cb600 0x7fb82c0c5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:31.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.365+0000 7fb833311640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb82c0c5960 0x7fb82c0ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:31.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.366+0000 7fb833311640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c073f80 con 0x7fb82c0cb600 2024-09-19T06:46:31.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.366+0000 7fb833311640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c06d990 con 0x7fb818004bd0 2024-09-19T06:46:31.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.366+0000 7fb833311640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb82c074100 con 0x7fb82c0c5960 2024-09-19T06:46:31.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.366+0000 7fb8318ae640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb82c0c5960 0x7fb82c0ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:31.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.366+0000 7fb8318ae640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb82c0c5960 0x7fb82c0ca020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:40260/0 (socket says 172.21.15.86:40260) 2024-09-19T06:46:31.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.366+0000 7fb8318ae640 1 -- 172.21.15.86:0/714535480 learned_addr learned my addr 172.21.15.86:0/714535480 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:31.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.366+0000 7fb8310ad640 1 --2- 172.21.15.86:0/714535480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb818004bd0 0x7fb82c154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:31.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.367+0000 7fb8308ac640 1 --2- 172.21.15.86:0/714535480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb82c0cb600 0x7fb82c0c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:31.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.367+0000 7fb8310ad640 1 -- 172.21.15.86:0/714535480 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb82c0c5960 msgr2=0x7fb82c0ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:31.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.367+0000 7fb8310ad640 1 --2- 172.21.15.86:0/714535480 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb82c0c5960 0x7fb82c0ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.367+0000 7fb8310ad640 1 -- 172.21.15.86:0/714535480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb82c0cb600 msgr2=0x7fb82c0c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:31.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.367+0000 7fb8310ad640 1 --2- 172.21.15.86:0/714535480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb82c0cb600 0x7fb82c0c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.367+0000 7fb8310ad640 1 -- 172.21.15.86:0/714535480 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82c072c60 con 0x7fb818004bd0 2024-09-19T06:46:31.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.368+0000 7fb8310ad640 1 --2- 172.21.15.86:0/714535480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb818004bd0 0x7fb82c154710 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb81c037000 tx=0x7fb81c0018f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:31.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.369+0000 7fb821ffb640 1 -- 172.21.15.86:0/714535480 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81c007b40 con 0x7fb818004bd0 2024-09-19T06:46:31.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.369+0000 7fb821ffb640 1 -- 172.21.15.86:0/714535480 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb81c005070 con 0x7fb818004bd0 2024-09-19T06:46:31.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.369+0000 7fb833311640 1 -- 172.21.15.86:0/714535480 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb82c1ed020 con 0x7fb818004bd0 2024-09-19T06:46:31.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.370+0000 7fb833311640 1 -- 172.21.15.86:0/714535480 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb82c140ed0 con 0x7fb818004bd0 2024-09-19T06:46:31.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.371+0000 7fb821ffb640 1 -- 172.21.15.86:0/714535480 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81c0015f0 con 0x7fb818004bd0 2024-09-19T06:46:31.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.373+0000 7fb833311640 1 -- 172.21.15.86:0/714535480 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb80c005290 con 0x7fb818004bd0 2024-09-19T06:46:31.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.384+0000 7fb821ffb640 1 -- 172.21.15.86:0/714535480 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb81c040070 con 0x7fb818004bd0 2024-09-19T06:46:31.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.385+0000 7fb821ffb640 1 --2- 172.21.15.86:0/714535480 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb81808fd30 0x7fb8180921f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:31.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.385+0000 7fb821ffb640 1 -- 172.21.15.86:0/714535480 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7fb81c0ac8e0 con 0x7fb818004bd0 2024-09-19T06:46:31.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.385+0000 7fb8308ac640 1 --2- 172.21.15.86:0/714535480 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb81808fd30 0x7fb8180921f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:31.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.385+0000 7fb821ffb640 1 -- 172.21.15.86:0/714535480 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb82c1ed020 con 0x7fb818004bd0 2024-09-19T06:46:31.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.386+0000 7fb8308ac640 1 --2- 172.21.15.86:0/714535480 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb81808fd30 0x7fb8180921f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb82c1e6f10 tx=0x7fb82400d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:31.662 INFO:tasks.ceph.mds.d.smithi169.stderr:2024-09-19T06:46:31.661+0000 7fc487910640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T06:46:31.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.727+0000 7fb833311640 1 -- 172.21.15.86:0/714535480 --> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb80c000bc0 con 0x7fb81808fd30 2024-09-19T06:46:31.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.741+0000 7fb821ffb640 1 -- 172.21.15.86:0/714535480 <== mgr.4105 v2:172.21.15.86:6816/4165134248 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335400 (secure 0 0 0) 0x7fb80c000bc0 con 0x7fb81808fd30 2024-09-19T06:46:31.745 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:46:31.747 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-09-19T06:46:31.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.746+0000 7fb833311640 1 -- 172.21.15.86:0/714535480 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb81808fd30 msgr2=0x7fb8180921f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:31.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.746+0000 7fb833311640 1 --2- 172.21.15.86:0/714535480 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb81808fd30 0x7fb8180921f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb82c1e6f10 tx=0x7fb82400d040 comp rx=0 tx=0).stop 2024-09-19T06:46:31.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.746+0000 7fb833311640 1 -- 172.21.15.86:0/714535480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb818004bd0 msgr2=0x7fb82c154710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:31.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.746+0000 7fb833311640 1 --2- 172.21.15.86:0/714535480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb818004bd0 0x7fb82c154710 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb81c037000 tx=0x7fb81c0018f0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.746+0000 7fb833311640 1 -- 172.21.15.86:0/714535480 shutdown_connections 2024-09-19T06:46:31.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.746+0000 7fb833311640 1 --2- 172.21.15.86:0/714535480 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb81808fd30 0x7fb8180921f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.746+0000 7fb833311640 1 --2- 172.21.15.86:0/714535480 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb82c0c5960 0x7fb82c0ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.746+0000 7fb833311640 1 --2- 172.21.15.86:0/714535480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb82c0cb600 0x7fb82c0c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.746+0000 7fb833311640 1 --2- 172.21.15.86:0/714535480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb818004bd0 0x7fb82c154710 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.746+0000 7fb833311640 1 -- 172.21.15.86:0/714535480 >> 172.21.15.86:0/714535480 conn(0x7fb82c0cd030 msgr2=0x7fb82c13fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:31.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.746+0000 7fb833311640 1 -- 172.21.15.86:0/714535480 shutdown_connections 2024-09-19T06:46:31.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.746+0000 7fb833311640 1 -- 172.21.15.86:0/714535480 wait complete. 2024-09-19T06:46:31.770 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2024-09-19T06:46:29.917281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":12336787590,"num_objects":3165,"num_object_clones":0,"num_object_copies":12562,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3165,"num_whiteouts":0,"num_read":1823,"num_read_kb":289582,"num_write":2248681,"num_write_kb":28380693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158052,"ondisk_log_size":158052,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":21579176,"kb_used_data":14098472,"kb_used_omap":12,"kb_used_meta":7480563,"kb_avail":733395544,"statfs":{"total":773094113280,"available":750997037056,"internally_reserved":0,"allocated":14436835328,"data_stored":24676916813,"data_compressed":1359086508,"data_compressed_allocated":5368832000,"data_compressed_original":15610601472,"omap_allocated":12752,"internal_metadata":7660097072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,5,0,1,6,7,1,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":66,"apply_latency_ms":66,"commit_latency_ns":66000000,"apply_latency_ns":66000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-838792068,"num_objects":-200,"num_object_clones":0,"num_object_copies":-800,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-200,"num_whiteouts":0,"num_read":59,"num_read_kb":104,"num_write":227,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003174"},"pg_stats":[{"pgid":"2.1f","version":"29'12","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.585975+0000","last_change":"2024-09-19T06:37:08.446272+0000","last_active":"2024-09-19T06:46:05.585975+0000","last_peered":"2024-09-19T06:46:05.585975+0000","last_clean":"2024-09-19T06:46:05.585975+0000","last_became_active":"2024-09-19T06:37:08.446044+0000","last_became_peered":"2024-09-19T06:37:08.446044+0000","last_unstale":"2024-09-19T06:46:05.585975+0000","last_undegraded":"2024-09-19T06:46:05.585975+0000","last_fullsized":"2024-09-19T06:46:05.585975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:37.623543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":20504,"num_write":9,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562503+0000","last_change":"2024-09-19T06:37:09.441539+0000","last_active":"2024-09-19T06:46:00.562503+0000","last_peered":"2024-09-19T06:46:00.562503+0000","last_clean":"2024-09-19T06:46:00.562503+0000","last_became_active":"2024-09-19T06:37:09.440839+0000","last_became_peered":"2024-09-19T06:37:09.440839+0000","last_unstale":"2024-09-19T06:46:00.562503+0000","last_undegraded":"2024-09-19T06:46:00.562503+0000","last_fullsized":"2024-09-19T06:46:00.562503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:49.222252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'5097","reported_seq":5170,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.177956+0000","last_change":"2024-09-19T06:37:13.461355+0000","last_active":"2024-09-19T06:46:24.177956+0000","last_peered":"2024-09-19T06:46:24.177956+0000","last_clean":"2024-09-19T06:46:24.177956+0000","last_became_active":"2024-09-19T06:37:13.460936+0000","last_became_peered":"2024-09-19T06:37:13.460936+0000","last_unstale":"2024-09-19T06:46:24.177956+0000","last_undegraded":"2024-09-19T06:46:24.177956+0000","last_fullsized":"2024-09-19T06:46:24.177956+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5097,"log_dups_size":0,"ondisk_log_size":5097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:59.860583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394383373,"num_objects":104,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":74676,"num_write_kb":941501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'23","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562733+0000","last_change":"2024-09-19T06:37:08.438583+0000","last_active":"2024-09-19T06:46:00.562733+0000","last_peered":"2024-09-19T06:46:00.562733+0000","last_clean":"2024-09-19T06:46:00.562733+0000","last_became_active":"2024-09-19T06:37:08.437921+0000","last_became_peered":"2024-09-19T06:37:08.437921+0000","last_unstale":"2024-09-19T06:46:00.562733+0000","last_undegraded":"2024-09-19T06:46:00.562733+0000","last_fullsized":"2024-09-19T06:46:00.562733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:58:23.269120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":24576,"num_write":22,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950609+0000","last_change":"2024-09-19T06:37:09.450731+0000","last_active":"2024-09-19T06:46:01.950609+0000","last_peered":"2024-09-19T06:46:01.950609+0000","last_clean":"2024-09-19T06:46:01.950609+0000","last_became_active":"2024-09-19T06:37:09.450430+0000","last_became_peered":"2024-09-19T06:37:09.450430+0000","last_unstale":"2024-09-19T06:46:01.950609+0000","last_undegraded":"2024-09-19T06:46:01.950609+0000","last_fullsized":"2024-09-19T06:46:01.950609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:21.701872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"34'4804","reported_seq":4883,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.302731+0000","last_change":"2024-09-19T06:37:13.459445+0000","last_active":"2024-09-19T06:46:24.302731+0000","last_peered":"2024-09-19T06:46:24.302731+0000","last_clean":"2024-09-19T06:46:24.302731+0000","last_became_active":"2024-09-19T06:37:13.459040+0000","last_became_peered":"2024-09-19T06:37:13.459040+0000","last_unstale":"2024-09-19T06:46:24.302731+0000","last_undegraded":"2024-09-19T06:46:24.302731+0000","last_fullsized":"2024-09-19T06:46:24.302731+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4804,"log_dups_size":0,"ondisk_log_size":4804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:37.676097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381707433,"num_objects":95,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":70584,"num_write_kb":897029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"34'333","reported_seq":394,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.208685+0000","last_change":"2024-09-19T06:37:08.448303+0000","last_active":"2024-09-19T06:46:23.208685+0000","last_peered":"2024-09-19T06:46:23.208685+0000","last_clean":"2024-09-19T06:46:23.208685+0000","last_became_active":"2024-09-19T06:37:08.447559+0000","last_became_peered":"2024-09-19T06:37:08.447559+0000","last_unstale":"2024-09-19T06:46:23.208685+0000","last_undegraded":"2024-09-19T06:46:23.208685+0000","last_fullsized":"2024-09-19T06:46:23.208685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:43.093216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":35254,"num_write":321,"num_write_kb":8395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'7","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565135+0000","last_change":"2024-09-19T06:37:09.445971+0000","last_active":"2024-09-19T06:46:00.565135+0000","last_peered":"2024-09-19T06:46:00.565135+0000","last_clean":"2024-09-19T06:46:00.565135+0000","last_became_active":"2024-09-19T06:37:09.444806+0000","last_became_peered":"2024-09-19T06:37:09.444806+0000","last_unstale":"2024-09-19T06:46:00.565135+0000","last_undegraded":"2024-09-19T06:46:00.565135+0000","last_fullsized":"2024-09-19T06:46:00.565135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:15.765835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4729","reported_seq":4809,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.336466+0000","last_change":"2024-09-19T06:37:13.459035+0000","last_active":"2024-09-19T06:46:24.336466+0000","last_peered":"2024-09-19T06:46:24.336466+0000","last_clean":"2024-09-19T06:46:24.336466+0000","last_became_active":"2024-09-19T06:37:13.458588+0000","last_became_peered":"2024-09-19T06:37:13.458588+0000","last_unstale":"2024-09-19T06:46:24.336466+0000","last_undegraded":"2024-09-19T06:46:24.336466+0000","last_fullsized":"2024-09-19T06:46:24.336466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4729,"log_dups_size":0,"ondisk_log_size":4729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:27.900054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373310089,"num_objects":99,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":47,"num_read_kb":0,"num_write":68497,"num_write_kb":860659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.184523+0000","last_change":"2024-09-19T06:37:08.446363+0000","last_active":"2024-09-19T06:46:23.184523+0000","last_peered":"2024-09-19T06:46:23.184523+0000","last_clean":"2024-09-19T06:46:23.184523+0000","last_became_active":"2024-09-19T06:37:08.446053+0000","last_became_peered":"2024-09-19T06:37:08.446053+0000","last_unstale":"2024-09-19T06:46:23.184523+0000","last_undegraded":"2024-09-19T06:46:23.184523+0000","last_fullsized":"2024-09-19T06:46:23.184523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:22.488347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"34'7","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.403973+0000","last_change":"2024-09-19T06:37:09.445124+0000","last_active":"2024-09-19T06:46:23.403973+0000","last_peered":"2024-09-19T06:46:23.403973+0000","last_clean":"2024-09-19T06:46:23.403973+0000","last_became_active":"2024-09-19T06:37:09.444824+0000","last_became_peered":"2024-09-19T06:37:09.444824+0000","last_unstale":"2024-09-19T06:46:23.403973+0000","last_undegraded":"2024-09-19T06:46:23.403973+0000","last_fullsized":"2024-09-19T06:46:23.403973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:40:05.642055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'4073","reported_seq":4133,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.075830+0000","last_change":"2024-09-19T06:37:13.459720+0000","last_active":"2024-09-19T06:46:24.075830+0000","last_peered":"2024-09-19T06:46:24.075830+0000","last_clean":"2024-09-19T06:46:24.075830+0000","last_became_active":"2024-09-19T06:37:13.459350+0000","last_became_peered":"2024-09-19T06:37:13.459350+0000","last_unstale":"2024-09-19T06:46:24.075830+0000","last_undegraded":"2024-09-19T06:46:24.075830+0000","last_fullsized":"2024-09-19T06:46:24.075830+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4073,"log_dups_size":0,"ondisk_log_size":4073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:29.546976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327179682,"num_objects":82,"num_object_clones":0,"num_object_copies":328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":59441,"num_write_kb":744923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.941540+0000","last_change":"2024-09-19T06:37:09.447795+0000","last_active":"2024-09-19T06:46:01.941540+0000","last_peered":"2024-09-19T06:46:01.941540+0000","last_clean":"2024-09-19T06:46:01.941540+0000","last_became_active":"2024-09-19T06:37:09.447502+0000","last_became_peered":"2024-09-19T06:37:09.447502+0000","last_unstale":"2024-09-19T06:46:01.941540+0000","last_undegraded":"2024-09-19T06:46:01.941540+0000","last_fullsized":"2024-09-19T06:46:01.941540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:51.384743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"34'578","reported_seq":631,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:12.370895+0000","last_change":"2024-09-19T06:37:08.446179+0000","last_active":"2024-09-19T06:46:12.370895+0000","last_peered":"2024-09-19T06:46:12.370895+0000","last_clean":"2024-09-19T06:46:12.370895+0000","last_became_active":"2024-09-19T06:37:08.445834+0000","last_became_peered":"2024-09-19T06:37:08.445834+0000","last_unstale":"2024-09-19T06:46:12.370895+0000","last_undegraded":"2024-09-19T06:46:12.370895+0000","last_fullsized":"2024-09-19T06:46:12.370895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:03.783414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":20492,"num_write":569,"num_write_kb":4620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"34'4836","reported_seq":4898,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.897304+0000","last_change":"2024-09-19T06:37:13.460344+0000","last_active":"2024-09-19T06:46:23.897304+0000","last_peered":"2024-09-19T06:46:23.897304+0000","last_clean":"2024-09-19T06:46:23.897304+0000","last_became_active":"2024-09-19T06:37:13.459967+0000","last_became_peered":"2024-09-19T06:37:13.459967+0000","last_unstale":"2024-09-19T06:46:23.897304+0000","last_undegraded":"2024-09-19T06:46:23.897304+0000","last_fullsized":"2024-09-19T06:46:23.897304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4836,"log_dups_size":0,"ondisk_log_size":4836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:59.096218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390215220,"num_objects":100,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":70072,"num_write_kb":882801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'5","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.563104+0000","last_change":"2024-09-19T06:37:09.449884+0000","last_active":"2024-09-19T06:46:00.563104+0000","last_peered":"2024-09-19T06:46:00.563104+0000","last_clean":"2024-09-19T06:46:00.563104+0000","last_became_active":"2024-09-19T06:37:09.449645+0000","last_became_peered":"2024-09-19T06:37:09.449645+0000","last_unstale":"2024-09-19T06:46:00.563104+0000","last_undegraded":"2024-09-19T06:46:00.563104+0000","last_fullsized":"2024-09-19T06:46:00.563104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:07.353098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.408189+0000","last_change":"2024-09-19T06:37:08.437022+0000","last_active":"2024-09-19T06:46:01.408189+0000","last_peered":"2024-09-19T06:46:01.408189+0000","last_clean":"2024-09-19T06:46:01.408189+0000","last_became_active":"2024-09-19T06:37:08.436761+0000","last_became_peered":"2024-09-19T06:37:08.436761+0000","last_unstale":"2024-09-19T06:46:01.408189+0000","last_undegraded":"2024-09-19T06:46:01.408189+0000","last_fullsized":"2024-09-19T06:46:01.408189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:04.985581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'5008","reported_seq":5093,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.367571+0000","last_change":"2024-09-19T06:37:51.782710+0000","last_active":"2024-09-19T06:46:24.367571+0000","last_peered":"2024-09-19T06:46:24.367571+0000","last_clean":"2024-09-19T06:46:24.367571+0000","last_became_active":"2024-09-19T06:37:51.782257+0000","last_became_peered":"2024-09-19T06:37:51.782257+0000","last_unstale":"2024-09-19T06:46:24.367571+0000","last_undegraded":"2024-09-19T06:46:24.367571+0000","last_fullsized":"2024-09-19T06:46:24.367571+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5008,"log_dups_size":0,"ondisk_log_size":5008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:17:15.241783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385899096,"num_objects":101,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":44,"num_read_kb":0,"num_write":72255,"num_write_kb":909964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562671+0000","last_change":"2024-09-19T06:37:09.433042+0000","last_active":"2024-09-19T06:46:00.562671+0000","last_peered":"2024-09-19T06:46:00.562671+0000","last_clean":"2024-09-19T06:46:00.562671+0000","last_became_active":"2024-09-19T06:37:09.432589+0000","last_became_peered":"2024-09-19T06:37:09.432589+0000","last_unstale":"2024-09-19T06:46:00.562671+0000","last_undegraded":"2024-09-19T06:46:00.562671+0000","last_fullsized":"2024-09-19T06:46:00.562671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:18.661071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.407761+0000","last_change":"2024-09-19T06:37:08.444408+0000","last_active":"2024-09-19T06:46:01.407761+0000","last_peered":"2024-09-19T06:46:01.407761+0000","last_clean":"2024-09-19T06:46:01.407761+0000","last_became_active":"2024-09-19T06:37:08.444160+0000","last_became_peered":"2024-09-19T06:37:08.444160+0000","last_unstale":"2024-09-19T06:46:01.407761+0000","last_undegraded":"2024-09-19T06:46:01.407761+0000","last_fullsized":"2024-09-19T06:46:01.407761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:54.304153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"34'5580","reported_seq":5655,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.161310+0000","last_change":"2024-09-19T06:37:13.466175+0000","last_active":"2024-09-19T06:46:24.161310+0000","last_peered":"2024-09-19T06:46:24.161310+0000","last_clean":"2024-09-19T06:46:24.161310+0000","last_became_active":"2024-09-19T06:37:13.465731+0000","last_became_peered":"2024-09-19T06:37:13.465731+0000","last_unstale":"2024-09-19T06:46:24.161310+0000","last_undegraded":"2024-09-19T06:46:24.161310+0000","last_fullsized":"2024-09-19T06:46:24.161310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5580,"log_dups_size":0,"ondisk_log_size":5580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:01.100164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432110707,"num_objects":108,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":81171,"num_write_kb":1030279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.951476+0000","last_change":"2024-09-19T06:37:09.437254+0000","last_active":"2024-09-19T06:46:01.951476+0000","last_peered":"2024-09-19T06:46:01.951476+0000","last_clean":"2024-09-19T06:46:01.951476+0000","last_became_active":"2024-09-19T06:37:09.436512+0000","last_became_peered":"2024-09-19T06:37:09.436512+0000","last_unstale":"2024-09-19T06:46:01.951476+0000","last_undegraded":"2024-09-19T06:46:01.951476+0000","last_fullsized":"2024-09-19T06:46:01.951476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:21.893793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"33'797","reported_seq":844,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564196+0000","last_change":"2024-09-19T06:37:08.446216+0000","last_active":"2024-09-19T06:46:00.564196+0000","last_peered":"2024-09-19T06:46:00.564196+0000","last_clean":"2024-09-19T06:46:00.564196+0000","last_became_active":"2024-09-19T06:37:08.445845+0000","last_became_peered":"2024-09-19T06:37:08.445845+0000","last_unstale":"2024-09-19T06:46:00.564196+0000","last_undegraded":"2024-09-19T06:46:00.564196+0000","last_fullsized":"2024-09-19T06:46:00.564196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:04.033283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":8706,"num_write":792,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"34'4170","reported_seq":4237,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.823142+0000","last_change":"2024-09-19T06:37:13.462192+0000","last_active":"2024-09-19T06:46:23.823142+0000","last_peered":"2024-09-19T06:46:23.823142+0000","last_clean":"2024-09-19T06:46:23.823142+0000","last_became_active":"2024-09-19T06:37:13.460955+0000","last_became_peered":"2024-09-19T06:37:13.460955+0000","last_unstale":"2024-09-19T06:46:23.823142+0000","last_undegraded":"2024-09-19T06:46:23.823142+0000","last_fullsized":"2024-09-19T06:46:23.823142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4170,"log_dups_size":0,"ondisk_log_size":4170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:53.583488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352537253,"num_objects":94,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":60526,"num_write_kb":751027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'14","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950811+0000","last_change":"2024-09-19T06:37:09.445989+0000","last_active":"2024-09-19T06:46:01.950811+0000","last_peered":"2024-09-19T06:46:01.950811+0000","last_clean":"2024-09-19T06:46:01.950811+0000","last_became_active":"2024-09-19T06:37:09.445705+0000","last_became_peered":"2024-09-19T06:37:09.445705+0000","last_unstale":"2024-09-19T06:46:01.950811+0000","last_undegraded":"2024-09-19T06:46:01.950811+0000","last_fullsized":"2024-09-19T06:46:01.950811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:24.592460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.189422+0000","last_change":"2024-09-19T06:37:08.446226+0000","last_active":"2024-09-19T06:46:23.189422+0000","last_peered":"2024-09-19T06:46:23.189422+0000","last_clean":"2024-09-19T06:46:23.189422+0000","last_became_active":"2024-09-19T06:37:08.445929+0000","last_became_peered":"2024-09-19T06:37:08.445929+0000","last_unstale":"2024-09-19T06:46:23.189422+0000","last_undegraded":"2024-09-19T06:46:23.189422+0000","last_fullsized":"2024-09-19T06:46:23.189422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:32.233033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"34'4917","reported_seq":4992,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.329970+0000","last_change":"2024-09-19T06:37:13.462598+0000","last_active":"2024-09-19T06:46:24.329970+0000","last_peered":"2024-09-19T06:46:24.329970+0000","last_clean":"2024-09-19T06:46:24.329970+0000","last_became_active":"2024-09-19T06:37:13.462217+0000","last_became_peered":"2024-09-19T06:37:13.462217+0000","last_unstale":"2024-09-19T06:46:24.329970+0000","last_undegraded":"2024-09-19T06:46:24.329970+0000","last_fullsized":"2024-09-19T06:46:24.329970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4917,"log_dups_size":0,"ondisk_log_size":4917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:04.109419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390081596,"num_objects":96,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":71632,"num_write_kb":902613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'10","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.563792+0000","last_change":"2024-09-19T06:37:09.434309+0000","last_active":"2024-09-19T06:46:00.563792+0000","last_peered":"2024-09-19T06:46:00.563792+0000","last_clean":"2024-09-19T06:46:00.563792+0000","last_became_active":"2024-09-19T06:37:09.433897+0000","last_became_peered":"2024-09-19T06:37:09.433897+0000","last_unstale":"2024-09-19T06:46:00.563792+0000","last_undegraded":"2024-09-19T06:46:00.563792+0000","last_fullsized":"2024-09-19T06:46:00.563792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:59.054484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"34'164","reported_seq":212,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.577973+0000","last_change":"2024-09-19T06:37:08.441525+0000","last_active":"2024-09-19T06:46:05.577973+0000","last_peered":"2024-09-19T06:46:05.577973+0000","last_clean":"2024-09-19T06:46:05.577973+0000","last_became_active":"2024-09-19T06:37:08.441245+0000","last_became_peered":"2024-09-19T06:37:08.441245+0000","last_unstale":"2024-09-19T06:46:05.577973+0000","last_undegraded":"2024-09-19T06:46:05.577973+0000","last_fullsized":"2024-09-19T06:46:05.577973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:19.820705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":67,"num_write":354,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"34'5320","reported_seq":5397,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.235454+0000","last_change":"2024-09-19T06:37:13.468486+0000","last_active":"2024-09-19T06:46:24.235454+0000","last_peered":"2024-09-19T06:46:24.235454+0000","last_clean":"2024-09-19T06:46:24.235454+0000","last_became_active":"2024-09-19T06:37:13.468074+0000","last_became_peered":"2024-09-19T06:37:13.468074+0000","last_unstale":"2024-09-19T06:46:24.235454+0000","last_undegraded":"2024-09-19T06:46:24.235454+0000","last_fullsized":"2024-09-19T06:46:24.235454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5320,"log_dups_size":0,"ondisk_log_size":5320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:36.783781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411056495,"num_objects":104,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":78187,"num_write_kb":979369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.408530+0000","last_change":"2024-09-19T06:37:09.435864+0000","last_active":"2024-09-19T06:46:01.408530+0000","last_peered":"2024-09-19T06:46:01.408530+0000","last_clean":"2024-09-19T06:46:01.408530+0000","last_became_active":"2024-09-19T06:37:09.435597+0000","last_became_peered":"2024-09-19T06:37:09.435597+0000","last_unstale":"2024-09-19T06:46:01.408530+0000","last_undegraded":"2024-09-19T06:46:01.408530+0000","last_fullsized":"2024-09-19T06:46:01.408530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:20.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.566013+0000","last_change":"2024-09-19T06:37:08.447931+0000","last_active":"2024-09-19T06:46:00.566013+0000","last_peered":"2024-09-19T06:46:00.566013+0000","last_clean":"2024-09-19T06:46:00.566013+0000","last_became_active":"2024-09-19T06:37:08.447630+0000","last_became_peered":"2024-09-19T06:37:08.447630+0000","last_unstale":"2024-09-19T06:46:00.566013+0000","last_undegraded":"2024-09-19T06:46:00.566013+0000","last_fullsized":"2024-09-19T06:46:00.566013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:17.375740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"34'4451","reported_seq":4525,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.189015+0000","last_change":"2024-09-19T06:37:13.468360+0000","last_active":"2024-09-19T06:46:24.189015+0000","last_peered":"2024-09-19T06:46:24.189015+0000","last_clean":"2024-09-19T06:46:24.189015+0000","last_became_active":"2024-09-19T06:37:13.467926+0000","last_became_peered":"2024-09-19T06:37:13.467926+0000","last_unstale":"2024-09-19T06:46:24.189015+0000","last_undegraded":"2024-09-19T06:46:24.189015+0000","last_fullsized":"2024-09-19T06:46:24.189015+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4451,"log_dups_size":0,"ondisk_log_size":4451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:55.089630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343942003,"num_objects":86,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":64740,"num_write_kb":802716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"34'9","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565285+0000","last_change":"2024-09-19T06:37:09.441678+0000","last_active":"2024-09-19T06:46:00.565285+0000","last_peered":"2024-09-19T06:46:00.565285+0000","last_clean":"2024-09-19T06:46:00.565285+0000","last_became_active":"2024-09-19T06:37:09.441406+0000","last_became_peered":"2024-09-19T06:37:09.441406+0000","last_unstale":"2024-09-19T06:46:00.565285+0000","last_undegraded":"2024-09-19T06:46:00.565285+0000","last_fullsized":"2024-09-19T06:46:00.565285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:14.638004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"29'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.408645+0000","last_change":"2024-09-19T06:37:08.438805+0000","last_active":"2024-09-19T06:46:01.408645+0000","last_peered":"2024-09-19T06:46:01.408645+0000","last_clean":"2024-09-19T06:46:01.408645+0000","last_became_active":"2024-09-19T06:37:08.438528+0000","last_became_peered":"2024-09-19T06:37:08.438528+0000","last_unstale":"2024-09-19T06:46:01.408645+0000","last_undegraded":"2024-09-19T06:46:01.408645+0000","last_fullsized":"2024-09-19T06:46:01.408645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:55.500347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'5386","reported_seq":5451,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.372613+0000","last_change":"2024-09-19T06:37:13.459697+0000","last_active":"2024-09-19T06:46:23.372613+0000","last_peered":"2024-09-19T06:46:23.372613+0000","last_clean":"2024-09-19T06:46:23.372613+0000","last_became_active":"2024-09-19T06:37:13.459303+0000","last_became_peered":"2024-09-19T06:37:13.459303+0000","last_unstale":"2024-09-19T06:46:23.372613+0000","last_undegraded":"2024-09-19T06:46:23.372613+0000","last_fullsized":"2024-09-19T06:46:23.372613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5386,"log_dups_size":0,"ondisk_log_size":5386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:01.695905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":453003691,"num_objects":111,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":78968,"num_write_kb":992273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.951577+0000","last_change":"2024-09-19T06:37:09.449701+0000","last_active":"2024-09-19T06:46:01.951577+0000","last_peered":"2024-09-19T06:46:01.951577+0000","last_clean":"2024-09-19T06:46:01.951577+0000","last_became_active":"2024-09-19T06:37:09.448899+0000","last_became_peered":"2024-09-19T06:37:09.448899+0000","last_unstale":"2024-09-19T06:46:01.951577+0000","last_undegraded":"2024-09-19T06:46:01.951577+0000","last_fullsized":"2024-09-19T06:46:01.951577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:17.448251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"34'198","reported_seq":243,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.603626+0000","last_change":"2024-09-19T06:37:08.434263+0000","last_active":"2024-09-19T06:46:05.603626+0000","last_peered":"2024-09-19T06:46:05.603626+0000","last_clean":"2024-09-19T06:46:05.603626+0000","last_became_active":"2024-09-19T06:37:08.433984+0000","last_became_peered":"2024-09-19T06:37:08.433984+0000","last_unstale":"2024-09-19T06:46:05.603626+0000","last_undegraded":"2024-09-19T06:46:05.603626+0000","last_fullsized":"2024-09-19T06:46:05.603626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:05.599054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":190,"num_write_kb":4204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"34'4452","reported_seq":4525,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.151962+0000","last_change":"2024-09-19T06:37:13.464527+0000","last_active":"2024-09-19T06:46:24.151962+0000","last_peered":"2024-09-19T06:46:24.151962+0000","last_clean":"2024-09-19T06:46:24.151962+0000","last_became_active":"2024-09-19T06:37:13.461685+0000","last_became_peered":"2024-09-19T06:37:13.461685+0000","last_unstale":"2024-09-19T06:46:24.151962+0000","last_undegraded":"2024-09-19T06:46:24.151962+0000","last_fullsized":"2024-09-19T06:46:24.151962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4452,"log_dups_size":0,"ondisk_log_size":4452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:57.229892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356592787,"num_objects":91,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":65349,"num_write_kb":836807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'11","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.408137+0000","last_change":"2024-09-19T06:37:09.434421+0000","last_active":"2024-09-19T06:46:01.408137+0000","last_peered":"2024-09-19T06:46:01.408137+0000","last_clean":"2024-09-19T06:46:01.408137+0000","last_became_active":"2024-09-19T06:37:09.434119+0000","last_became_peered":"2024-09-19T06:37:09.434119+0000","last_unstale":"2024-09-19T06:46:01.408137+0000","last_undegraded":"2024-09-19T06:46:01.408137+0000","last_fullsized":"2024-09-19T06:46:01.408137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:56.984336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"34'26","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.253625+0000","last_change":"2024-09-19T06:37:08.436856+0000","last_active":"2024-09-19T06:46:23.253625+0000","last_peered":"2024-09-19T06:46:23.253625+0000","last_clean":"2024-09-19T06:46:23.253625+0000","last_became_active":"2024-09-19T06:37:08.435718+0000","last_became_peered":"2024-09-19T06:37:08.435718+0000","last_unstale":"2024-09-19T06:46:23.253625+0000","last_undegraded":"2024-09-19T06:46:23.253625+0000","last_fullsized":"2024-09-19T06:46:23.253625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:58.650430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94168,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":144,"num_write":22,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'5155","reported_seq":5231,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.003595+0000","last_change":"2024-09-19T06:37:13.466081+0000","last_active":"2024-09-19T06:46:24.003595+0000","last_peered":"2024-09-19T06:46:24.003595+0000","last_clean":"2024-09-19T06:46:24.003595+0000","last_became_active":"2024-09-19T06:37:13.465348+0000","last_became_peered":"2024-09-19T06:37:13.465348+0000","last_unstale":"2024-09-19T06:46:24.003595+0000","last_undegraded":"2024-09-19T06:46:24.003595+0000","last_fullsized":"2024-09-19T06:46:24.003595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5155,"log_dups_size":0,"ondisk_log_size":5155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:11.592737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432066503,"num_objects":110,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":75839,"num_write_kb":952671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950025+0000","last_change":"2024-09-19T06:37:09.444888+0000","last_active":"2024-09-19T06:46:01.950025+0000","last_peered":"2024-09-19T06:46:01.950025+0000","last_clean":"2024-09-19T06:46:01.950025+0000","last_became_active":"2024-09-19T06:37:09.444605+0000","last_became_peered":"2024-09-19T06:37:09.444605+0000","last_unstale":"2024-09-19T06:46:01.950025+0000","last_undegraded":"2024-09-19T06:46:01.950025+0000","last_fullsized":"2024-09-19T06:46:01.950025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:53.868356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'43","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.589711+0000","last_change":"2024-09-19T06:37:08.446760+0000","last_active":"2024-09-19T06:46:05.589711+0000","last_peered":"2024-09-19T06:46:05.589711+0000","last_clean":"2024-09-19T06:46:05.589711+0000","last_became_active":"2024-09-19T06:37:08.446474+0000","last_became_peered":"2024-09-19T06:37:08.446474+0000","last_unstale":"2024-09-19T06:46:05.589711+0000","last_undegraded":"2024-09-19T06:46:05.589711+0000","last_fullsized":"2024-09-19T06:46:05.589711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:12.597952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":38,"num_write_kb":8207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"34'4304","reported_seq":4380,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.890073+0000","last_change":"2024-09-19T06:37:13.471220+0000","last_active":"2024-09-19T06:46:23.890073+0000","last_peered":"2024-09-19T06:46:23.890073+0000","last_clean":"2024-09-19T06:46:23.890073+0000","last_became_active":"2024-09-19T06:37:13.470860+0000","last_became_peered":"2024-09-19T06:37:13.470860+0000","last_unstale":"2024-09-19T06:46:23.890073+0000","last_undegraded":"2024-09-19T06:46:23.890073+0000","last_fullsized":"2024-09-19T06:46:23.890073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4304,"log_dups_size":0,"ondisk_log_size":4304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:07.659583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356948802,"num_objects":91,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":62615,"num_write_kb":794606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562847+0000","last_change":"2024-09-19T06:37:09.440366+0000","last_active":"2024-09-19T06:46:00.562847+0000","last_peered":"2024-09-19T06:46:00.562847+0000","last_clean":"2024-09-19T06:46:00.562847+0000","last_became_active":"2024-09-19T06:37:09.439478+0000","last_became_peered":"2024-09-19T06:37:09.439478+0000","last_unstale":"2024-09-19T06:46:00.562847+0000","last_undegraded":"2024-09-19T06:46:00.562847+0000","last_fullsized":"2024-09-19T06:46:00.562847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:21.837351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564567+0000","last_change":"2024-09-19T06:37:08.435473+0000","last_active":"2024-09-19T06:46:00.564567+0000","last_peered":"2024-09-19T06:46:00.564567+0000","last_clean":"2024-09-19T06:46:00.564567+0000","last_became_active":"2024-09-19T06:37:08.435183+0000","last_became_peered":"2024-09-19T06:37:08.435183+0000","last_unstale":"2024-09-19T06:46:00.564567+0000","last_undegraded":"2024-09-19T06:46:00.564567+0000","last_fullsized":"2024-09-19T06:46:00.564567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:53.115010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":198,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564274+0000","last_change":"2024-09-19T06:36:58.829099+0000","last_active":"2024-09-19T06:46:00.564274+0000","last_peered":"2024-09-19T06:46:00.564274+0000","last_clean":"2024-09-19T06:46:00.564274+0000","last_became_active":"2024-09-19T06:36:58.828079+0000","last_became_peered":"2024-09-19T06:36:58.828079+0000","last_unstale":"2024-09-19T06:46:00.564274+0000","last_undegraded":"2024-09-19T06:46:00.564274+0000","last_fullsized":"2024-09-19T06:46:00.564274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:36:57.771085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:36:57.771085+0000","last_clean_scrub_stamp":"2024-09-19T06:36:57.771085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:14.663925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"34'4731","reported_seq":4793,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.127010+0000","last_change":"2024-09-19T06:37:13.464435+0000","last_active":"2024-09-19T06:46:24.127010+0000","last_peered":"2024-09-19T06:46:24.127010+0000","last_clean":"2024-09-19T06:46:24.127010+0000","last_became_active":"2024-09-19T06:37:13.464101+0000","last_became_peered":"2024-09-19T06:37:13.464101+0000","last_unstale":"2024-09-19T06:46:24.127010+0000","last_undegraded":"2024-09-19T06:46:24.127010+0000","last_fullsized":"2024-09-19T06:46:24.127010+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4731,"log_dups_size":0,"ondisk_log_size":4731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:30.073937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":377497092,"num_objects":95,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":68921,"num_write_kb":870393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565768+0000","last_change":"2024-09-19T06:37:09.442774+0000","last_active":"2024-09-19T06:46:00.565768+0000","last_peered":"2024-09-19T06:46:00.565768+0000","last_clean":"2024-09-19T06:46:00.565768+0000","last_became_active":"2024-09-19T06:37:09.442515+0000","last_became_peered":"2024-09-19T06:37:09.442515+0000","last_unstale":"2024-09-19T06:46:00.565768+0000","last_undegraded":"2024-09-19T06:46:00.565768+0000","last_fullsized":"2024-09-19T06:46:00.565768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:57.376059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.877516+0000","last_change":"2024-09-19T06:37:08.438038+0000","last_active":"2024-09-19T06:46:01.877516+0000","last_peered":"2024-09-19T06:46:01.877516+0000","last_clean":"2024-09-19T06:46:01.877516+0000","last_became_active":"2024-09-19T06:37:08.437771+0000","last_became_peered":"2024-09-19T06:37:08.437771+0000","last_unstale":"2024-09-19T06:46:01.877516+0000","last_undegraded":"2024-09-19T06:46:01.877516+0000","last_fullsized":"2024-09-19T06:46:01.877516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:07.210382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"34'4781","reported_seq":4856,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.140073+0000","last_change":"2024-09-19T06:37:51.782418+0000","last_active":"2024-09-19T06:46:24.140073+0000","last_peered":"2024-09-19T06:46:24.140073+0000","last_clean":"2024-09-19T06:46:24.140073+0000","last_became_active":"2024-09-19T06:37:51.781963+0000","last_became_peered":"2024-09-19T06:37:51.781963+0000","last_unstale":"2024-09-19T06:46:24.140073+0000","last_undegraded":"2024-09-19T06:46:24.140073+0000","last_fullsized":"2024-09-19T06:46:24.140073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4781,"log_dups_size":0,"ondisk_log_size":4781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:12:05.227644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360712105,"num_objects":88,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":69474,"num_write_kb":883742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565121+0000","last_change":"2024-09-19T06:37:09.442213+0000","last_active":"2024-09-19T06:46:00.565121+0000","last_peered":"2024-09-19T06:46:00.565121+0000","last_clean":"2024-09-19T06:46:00.565121+0000","last_became_active":"2024-09-19T06:37:09.441850+0000","last_became_peered":"2024-09-19T06:37:09.441850+0000","last_unstale":"2024-09-19T06:46:00.565121+0000","last_undegraded":"2024-09-19T06:46:00.565121+0000","last_fullsized":"2024-09-19T06:46:00.565121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:43.728914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"34'158","reported_seq":208,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.217854+0000","last_change":"2024-09-19T06:37:08.431703+0000","last_active":"2024-09-19T06:46:23.217854+0000","last_peered":"2024-09-19T06:46:23.217854+0000","last_clean":"2024-09-19T06:46:23.217854+0000","last_became_active":"2024-09-19T06:37:08.431443+0000","last_became_peered":"2024-09-19T06:37:08.431443+0000","last_unstale":"2024-09-19T06:46:23.217854+0000","last_undegraded":"2024-09-19T06:46:23.217854+0000","last_fullsized":"2024-09-19T06:46:23.217854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:02.007521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2390477,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":2297,"num_write":153,"num_write_kb":2408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'4474","reported_seq":4550,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.957819+0000","last_change":"2024-09-19T06:37:13.469295+0000","last_active":"2024-09-19T06:46:23.957819+0000","last_peered":"2024-09-19T06:46:23.957819+0000","last_clean":"2024-09-19T06:46:23.957819+0000","last_became_active":"2024-09-19T06:37:13.468879+0000","last_became_peered":"2024-09-19T06:37:13.468879+0000","last_unstale":"2024-09-19T06:46:23.957819+0000","last_undegraded":"2024-09-19T06:46:23.957819+0000","last_fullsized":"2024-09-19T06:46:23.957819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4474,"log_dups_size":0,"ondisk_log_size":4474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:34.380034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364930356,"num_objects":96,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":65527,"num_write_kb":822050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.566185+0000","last_change":"2024-09-19T06:37:09.439264+0000","last_active":"2024-09-19T06:46:00.566185+0000","last_peered":"2024-09-19T06:46:00.566185+0000","last_clean":"2024-09-19T06:46:00.566185+0000","last_became_active":"2024-09-19T06:37:09.438954+0000","last_became_peered":"2024-09-19T06:37:09.438954+0000","last_unstale":"2024-09-19T06:46:00.566185+0000","last_undegraded":"2024-09-19T06:46:00.566185+0000","last_fullsized":"2024-09-19T06:46:00.566185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:55.094093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"34'7","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.185155+0000","last_change":"2024-09-19T06:37:08.437406+0000","last_active":"2024-09-19T06:46:23.185155+0000","last_peered":"2024-09-19T06:46:23.185155+0000","last_clean":"2024-09-19T06:46:23.185155+0000","last_became_active":"2024-09-19T06:37:08.437093+0000","last_became_peered":"2024-09-19T06:37:08.437093+0000","last_unstale":"2024-09-19T06:46:23.185155+0000","last_undegraded":"2024-09-19T06:46:23.185155+0000","last_fullsized":"2024-09-19T06:46:23.185155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:25.158027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"34'4661","reported_seq":4733,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.314617+0000","last_change":"2024-09-19T06:37:13.460116+0000","last_active":"2024-09-19T06:46:23.314617+0000","last_peered":"2024-09-19T06:46:23.314617+0000","last_clean":"2024-09-19T06:46:23.314617+0000","last_became_active":"2024-09-19T06:37:13.459707+0000","last_became_peered":"2024-09-19T06:37:13.459707+0000","last_unstale":"2024-09-19T06:46:23.314617+0000","last_undegraded":"2024-09-19T06:46:23.314617+0000","last_fullsized":"2024-09-19T06:46:23.314617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4661,"log_dups_size":0,"ondisk_log_size":4661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:02.657115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381701754,"num_objects":95,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":38,"num_read_kb":0,"num_write":68452,"num_write_kb":859940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565428+0000","last_change":"2024-09-19T06:37:09.442670+0000","last_active":"2024-09-19T06:46:00.565428+0000","last_peered":"2024-09-19T06:46:00.565428+0000","last_clean":"2024-09-19T06:46:00.565428+0000","last_became_active":"2024-09-19T06:37:09.442390+0000","last_became_peered":"2024-09-19T06:37:09.442390+0000","last_unstale":"2024-09-19T06:46:00.565428+0000","last_undegraded":"2024-09-19T06:46:00.565428+0000","last_fullsized":"2024-09-19T06:46:00.565428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:02:26.726663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.577499+0000","last_change":"2024-09-19T06:37:08.437263+0000","last_active":"2024-09-19T06:46:05.577499+0000","last_peered":"2024-09-19T06:46:05.577499+0000","last_clean":"2024-09-19T06:46:05.577499+0000","last_became_active":"2024-09-19T06:37:08.436982+0000","last_became_peered":"2024-09-19T06:37:08.436982+0000","last_unstale":"2024-09-19T06:46:05.577499+0000","last_undegraded":"2024-09-19T06:46:05.577499+0000","last_fullsized":"2024-09-19T06:46:05.577499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:14.895925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"34'4713","reported_seq":4793,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.957548+0000","last_change":"2024-09-19T06:37:51.782712+0000","last_active":"2024-09-19T06:46:23.957548+0000","last_peered":"2024-09-19T06:46:23.957548+0000","last_clean":"2024-09-19T06:46:23.957548+0000","last_became_active":"2024-09-19T06:37:51.781602+0000","last_became_peered":"2024-09-19T06:37:51.781602+0000","last_unstale":"2024-09-19T06:46:23.957548+0000","last_undegraded":"2024-09-19T06:46:23.957548+0000","last_fullsized":"2024-09-19T06:46:23.957548+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4713,"log_dups_size":0,"ondisk_log_size":4713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:24.142942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385955277,"num_objects":96,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":68431,"num_write_kb":854704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3,6],"acting":[4,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'10","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565596+0000","last_change":"2024-09-19T06:37:09.439142+0000","last_active":"2024-09-19T06:46:00.565596+0000","last_peered":"2024-09-19T06:46:00.565596+0000","last_clean":"2024-09-19T06:46:00.565596+0000","last_became_active":"2024-09-19T06:37:09.437717+0000","last_became_peered":"2024-09-19T06:37:09.437717+0000","last_unstale":"2024-09-19T06:46:00.565596+0000","last_undegraded":"2024-09-19T06:46:00.565596+0000","last_fullsized":"2024-09-19T06:46:00.565596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:32.934290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.186451+0000","last_change":"2024-09-19T06:37:08.430649+0000","last_active":"2024-09-19T06:46:23.186451+0000","last_peered":"2024-09-19T06:46:23.186451+0000","last_clean":"2024-09-19T06:46:23.186451+0000","last_became_active":"2024-09-19T06:37:08.430324+0000","last_became_peered":"2024-09-19T06:37:08.430324+0000","last_unstale":"2024-09-19T06:46:23.186451+0000","last_undegraded":"2024-09-19T06:46:23.186451+0000","last_fullsized":"2024-09-19T06:46:23.186451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:56.656357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"34'5160","reported_seq":5230,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.301836+0000","last_change":"2024-09-19T06:37:13.463695+0000","last_active":"2024-09-19T06:46:24.301836+0000","last_peered":"2024-09-19T06:46:24.301836+0000","last_clean":"2024-09-19T06:46:24.301836+0000","last_became_active":"2024-09-19T06:37:13.463334+0000","last_became_peered":"2024-09-19T06:37:13.463334+0000","last_unstale":"2024-09-19T06:46:24.301836+0000","last_undegraded":"2024-09-19T06:46:24.301836+0000","last_fullsized":"2024-09-19T06:46:24.301836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5160,"log_dups_size":0,"ondisk_log_size":5160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:46.991800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402906913,"num_objects":107,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":75164,"num_write_kb":939459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.379327+0000","last_change":"2024-09-19T06:37:09.450168+0000","last_active":"2024-09-19T06:46:23.379327+0000","last_peered":"2024-09-19T06:46:23.379327+0000","last_clean":"2024-09-19T06:46:23.379327+0000","last_became_active":"2024-09-19T06:37:09.449872+0000","last_became_peered":"2024-09-19T06:37:09.449872+0000","last_unstale":"2024-09-19T06:46:23.379327+0000","last_undegraded":"2024-09-19T06:46:23.379327+0000","last_fullsized":"2024-09-19T06:46:23.379327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:02:28.282840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.941730+0000","last_change":"2024-09-19T06:37:08.442428+0000","last_active":"2024-09-19T06:46:01.941730+0000","last_peered":"2024-09-19T06:46:01.941730+0000","last_clean":"2024-09-19T06:46:01.941730+0000","last_became_active":"2024-09-19T06:37:08.442120+0000","last_became_peered":"2024-09-19T06:37:08.442120+0000","last_unstale":"2024-09-19T06:46:01.941730+0000","last_undegraded":"2024-09-19T06:46:01.941730+0000","last_fullsized":"2024-09-19T06:46:01.941730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:48.816822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"34'4856","reported_seq":4937,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.673291+0000","last_change":"2024-09-19T06:37:13.471319+0000","last_active":"2024-09-19T06:46:23.673291+0000","last_peered":"2024-09-19T06:46:23.673291+0000","last_clean":"2024-09-19T06:46:23.673291+0000","last_became_active":"2024-09-19T06:37:13.470887+0000","last_became_peered":"2024-09-19T06:37:13.470887+0000","last_unstale":"2024-09-19T06:46:23.673291+0000","last_undegraded":"2024-09-19T06:46:23.673291+0000","last_fullsized":"2024-09-19T06:46:23.673291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4856,"log_dups_size":0,"ondisk_log_size":4856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:21.884985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394324198,"num_objects":100,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":70481,"num_write_kb":907517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'10","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565922+0000","last_change":"2024-09-19T06:37:09.439142+0000","last_active":"2024-09-19T06:46:00.565922+0000","last_peered":"2024-09-19T06:46:00.565922+0000","last_clean":"2024-09-19T06:46:00.565922+0000","last_became_active":"2024-09-19T06:37:09.437635+0000","last_became_peered":"2024-09-19T06:37:09.437635+0000","last_unstale":"2024-09-19T06:46:00.565922+0000","last_undegraded":"2024-09-19T06:46:00.565922+0000","last_fullsized":"2024-09-19T06:46:00.565922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:46.773889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'1","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564672+0000","last_change":"2024-09-19T06:37:08.438932+0000","last_active":"2024-09-19T06:46:00.564672+0000","last_peered":"2024-09-19T06:46:00.564672+0000","last_clean":"2024-09-19T06:46:00.564672+0000","last_became_active":"2024-09-19T06:37:08.438405+0000","last_became_peered":"2024-09-19T06:37:08.438405+0000","last_unstale":"2024-09-19T06:46:00.564672+0000","last_undegraded":"2024-09-19T06:46:00.564672+0000","last_fullsized":"2024-09-19T06:46:00.564672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:59.606628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'5152","reported_seq":5232,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.339377+0000","last_change":"2024-09-19T06:37:13.459370+0000","last_active":"2024-09-19T06:46:24.339377+0000","last_peered":"2024-09-19T06:46:24.339377+0000","last_clean":"2024-09-19T06:46:24.339377+0000","last_became_active":"2024-09-19T06:37:13.458928+0000","last_became_peered":"2024-09-19T06:37:13.458928+0000","last_unstale":"2024-09-19T06:46:24.339377+0000","last_undegraded":"2024-09-19T06:46:24.339377+0000","last_fullsized":"2024-09-19T06:46:24.339377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5152,"log_dups_size":0,"ondisk_log_size":5152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:00.179404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402885323,"num_objects":102,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":47,"num_read_kb":0,"num_write":75196,"num_write_kb":949879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'10","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950479+0000","last_change":"2024-09-19T06:37:09.448958+0000","last_active":"2024-09-19T06:46:01.950479+0000","last_peered":"2024-09-19T06:46:01.950479+0000","last_clean":"2024-09-19T06:46:01.950479+0000","last_became_active":"2024-09-19T06:37:09.448697+0000","last_became_peered":"2024-09-19T06:37:09.448697+0000","last_unstale":"2024-09-19T06:46:01.950479+0000","last_undegraded":"2024-09-19T06:46:01.950479+0000","last_fullsized":"2024-09-19T06:46:01.950479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:16.306915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'62","reported_seq":123,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.855090+0000","last_change":"2024-09-19T06:37:08.442685+0000","last_active":"2024-09-19T06:46:05.855090+0000","last_peered":"2024-09-19T06:46:05.855090+0000","last_clean":"2024-09-19T06:46:05.855090+0000","last_became_active":"2024-09-19T06:37:08.442436+0000","last_became_peered":"2024-09-19T06:37:08.442436+0000","last_unstale":"2024-09-19T06:46:05.855090+0000","last_undegraded":"2024-09-19T06:46:05.855090+0000","last_fullsized":"2024-09-19T06:46:05.855090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:09.952733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":32451,"num_write":58,"num_write_kb":8225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"34'4531","reported_seq":4592,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.249194+0000","last_change":"2024-09-19T06:37:13.457651+0000","last_active":"2024-09-19T06:46:24.249194+0000","last_peered":"2024-09-19T06:46:24.249194+0000","last_clean":"2024-09-19T06:46:24.249194+0000","last_became_active":"2024-09-19T06:37:13.457246+0000","last_became_peered":"2024-09-19T06:37:13.457246+0000","last_unstale":"2024-09-19T06:46:24.249194+0000","last_undegraded":"2024-09-19T06:46:24.249194+0000","last_fullsized":"2024-09-19T06:46:24.249194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4531,"log_dups_size":0,"ondisk_log_size":4531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:18.553158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369098752,"num_objects":88,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":65998,"num_write_kb":826143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565529+0000","last_change":"2024-09-19T06:37:09.441212+0000","last_active":"2024-09-19T06:46:00.565529+0000","last_peered":"2024-09-19T06:46:00.565529+0000","last_clean":"2024-09-19T06:46:00.565529+0000","last_became_active":"2024-09-19T06:37:09.440209+0000","last_became_peered":"2024-09-19T06:37:09.440209+0000","last_unstale":"2024-09-19T06:46:00.565529+0000","last_undegraded":"2024-09-19T06:46:00.565529+0000","last_fullsized":"2024-09-19T06:46:00.565529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:52.173784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"34'219","reported_seq":289,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.212226+0000","last_change":"2024-09-19T06:37:08.442615+0000","last_active":"2024-09-19T06:46:23.212226+0000","last_peered":"2024-09-19T06:46:23.212226+0000","last_clean":"2024-09-19T06:46:23.212226+0000","last_became_active":"2024-09-19T06:37:08.442242+0000","last_became_peered":"2024-09-19T06:37:08.442242+0000","last_unstale":"2024-09-19T06:46:23.212226+0000","last_undegraded":"2024-09-19T06:46:23.212226+0000","last_fullsized":"2024-09-19T06:46:23.212226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:23.813400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":49,"num_read_kb":24618,"num_write":215,"num_write_kb":4203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"34'4646","reported_seq":4720,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.330511+0000","last_change":"2024-09-19T06:37:13.464688+0000","last_active":"2024-09-19T06:46:24.330511+0000","last_peered":"2024-09-19T06:46:24.330511+0000","last_clean":"2024-09-19T06:46:24.330511+0000","last_became_active":"2024-09-19T06:37:13.461620+0000","last_became_peered":"2024-09-19T06:37:13.461620+0000","last_unstale":"2024-09-19T06:46:24.330511+0000","last_undegraded":"2024-09-19T06:46:24.330511+0000","last_fullsized":"2024-09-19T06:46:24.330511+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4646,"log_dups_size":0,"ondisk_log_size":4646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:02.928332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369181538,"num_objects":93,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":67687,"num_write_kb":859195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.951250+0000","last_change":"2024-09-19T06:37:09.440021+0000","last_active":"2024-09-19T06:46:01.951250+0000","last_peered":"2024-09-19T06:46:01.951250+0000","last_clean":"2024-09-19T06:46:01.951250+0000","last_became_active":"2024-09-19T06:37:09.437800+0000","last_became_peered":"2024-09-19T06:37:09.437800+0000","last_unstale":"2024-09-19T06:46:01.951250+0000","last_undegraded":"2024-09-19T06:46:01.951250+0000","last_fullsized":"2024-09-19T06:46:01.951250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:51.963097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"34'16","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.204186+0000","last_change":"2024-09-19T06:37:08.434422+0000","last_active":"2024-09-19T06:46:23.204186+0000","last_peered":"2024-09-19T06:46:23.204186+0000","last_clean":"2024-09-19T06:46:23.204186+0000","last_became_active":"2024-09-19T06:37:08.434151+0000","last_became_peered":"2024-09-19T06:37:08.434151+0000","last_unstale":"2024-09-19T06:46:23.204186+0000","last_undegraded":"2024-09-19T06:46:23.204186+0000","last_fullsized":"2024-09-19T06:46:23.204186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:49.540748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":17,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'4787","reported_seq":4869,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.914919+0000","last_change":"2024-09-19T06:37:13.459321+0000","last_active":"2024-09-19T06:46:23.914919+0000","last_peered":"2024-09-19T06:46:23.914919+0000","last_clean":"2024-09-19T06:46:23.914919+0000","last_became_active":"2024-09-19T06:37:13.458924+0000","last_became_peered":"2024-09-19T06:37:13.458924+0000","last_unstale":"2024-09-19T06:46:23.914919+0000","last_undegraded":"2024-09-19T06:46:23.914919+0000","last_fullsized":"2024-09-19T06:46:23.914919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4787,"log_dups_size":0,"ondisk_log_size":4787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:11.428574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":377594865,"num_objects":100,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":49,"num_read_kb":0,"num_write":69701,"num_write_kb":881574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950806+0000","last_change":"2024-09-19T06:37:09.448450+0000","last_active":"2024-09-19T06:46:01.950806+0000","last_peered":"2024-09-19T06:46:01.950806+0000","last_clean":"2024-09-19T06:46:01.950806+0000","last_became_active":"2024-09-19T06:37:09.448173+0000","last_became_peered":"2024-09-19T06:37:09.448173+0000","last_unstale":"2024-09-19T06:46:01.950806+0000","last_undegraded":"2024-09-19T06:46:01.950806+0000","last_fullsized":"2024-09-19T06:46:01.950806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:22.442374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564938+0000","last_change":"2024-09-19T06:37:08.442796+0000","last_active":"2024-09-19T06:46:00.564938+0000","last_peered":"2024-09-19T06:46:00.564938+0000","last_clean":"2024-09-19T06:46:00.564938+0000","last_became_active":"2024-09-19T06:37:08.442126+0000","last_became_peered":"2024-09-19T06:37:08.442126+0000","last_unstale":"2024-09-19T06:46:00.564938+0000","last_undegraded":"2024-09-19T06:46:00.564938+0000","last_fullsized":"2024-09-19T06:46:00.564938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:27.716141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"34'4735","reported_seq":4795,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.879399+0000","last_change":"2024-09-19T06:37:13.464100+0000","last_active":"2024-09-19T06:46:23.879399+0000","last_peered":"2024-09-19T06:46:23.879399+0000","last_clean":"2024-09-19T06:46:23.879399+0000","last_became_active":"2024-09-19T06:37:13.462750+0000","last_became_peered":"2024-09-19T06:37:13.462750+0000","last_unstale":"2024-09-19T06:46:23.879399+0000","last_undegraded":"2024-09-19T06:46:23.879399+0000","last_fullsized":"2024-09-19T06:46:23.879399+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4735,"log_dups_size":0,"ondisk_log_size":4735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:49.139841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364972928,"num_objects":94,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":69379,"num_write_kb":873579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'5","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.877347+0000","last_change":"2024-09-19T06:37:51.593841+0000","last_active":"2024-09-19T06:46:01.877347+0000","last_peered":"2024-09-19T06:46:01.877347+0000","last_clean":"2024-09-19T06:46:01.877347+0000","last_became_active":"2024-09-19T06:37:51.593513+0000","last_became_peered":"2024-09-19T06:37:51.593513+0000","last_unstale":"2024-09-19T06:46:01.877347+0000","last_undegraded":"2024-09-19T06:46:01.877347+0000","last_fullsized":"2024-09-19T06:46:01.877347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:08.337914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.942374+0000","last_change":"2024-09-19T06:37:08.439543+0000","last_active":"2024-09-19T06:46:01.942374+0000","last_peered":"2024-09-19T06:46:01.942374+0000","last_clean":"2024-09-19T06:46:01.942374+0000","last_became_active":"2024-09-19T06:37:08.438785+0000","last_became_peered":"2024-09-19T06:37:08.438785+0000","last_unstale":"2024-09-19T06:46:01.942374+0000","last_undegraded":"2024-09-19T06:46:01.942374+0000","last_fullsized":"2024-09-19T06:46:01.942374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:51.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"34'4801","reported_seq":4888,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.306391+0000","last_change":"2024-09-19T06:37:13.462327+0000","last_active":"2024-09-19T06:46:23.306391+0000","last_peered":"2024-09-19T06:46:23.306391+0000","last_clean":"2024-09-19T06:46:23.306391+0000","last_became_active":"2024-09-19T06:37:13.461762+0000","last_became_peered":"2024-09-19T06:37:13.461762+0000","last_unstale":"2024-09-19T06:46:23.306391+0000","last_undegraded":"2024-09-19T06:46:23.306391+0000","last_fullsized":"2024-09-19T06:46:23.306391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4801,"log_dups_size":0,"ondisk_log_size":4801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:26.931537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411072145,"num_objects":104,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":71041,"num_write_kb":900045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'5595","reported_seq":5671,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.233489+0000","last_change":"2024-09-19T06:37:13.471309+0000","last_active":"2024-09-19T06:46:24.233489+0000","last_peered":"2024-09-19T06:46:24.233489+0000","last_clean":"2024-09-19T06:46:24.233489+0000","last_became_active":"2024-09-19T06:37:13.470969+0000","last_became_peered":"2024-09-19T06:37:13.470969+0000","last_unstale":"2024-09-19T06:46:24.233489+0000","last_undegraded":"2024-09-19T06:46:24.233489+0000","last_fullsized":"2024-09-19T06:46:24.233489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5595,"log_dups_size":0,"ondisk_log_size":5595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:30.990159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436219018,"num_objects":107,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":81876,"num_write_kb":1028288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.407620+0000","last_change":"2024-09-19T06:37:09.443308+0000","last_active":"2024-09-19T06:46:01.407620+0000","last_peered":"2024-09-19T06:46:01.407620+0000","last_clean":"2024-09-19T06:46:01.407620+0000","last_became_active":"2024-09-19T06:37:09.443069+0000","last_became_peered":"2024-09-19T06:37:09.443069+0000","last_unstale":"2024-09-19T06:46:01.407620+0000","last_undegraded":"2024-09-19T06:46:01.407620+0000","last_fullsized":"2024-09-19T06:46:01.407620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:31:33.708578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"34'28","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.952755+0000","last_change":"2024-09-19T06:37:08.441967+0000","last_active":"2024-09-19T06:46:05.952755+0000","last_peered":"2024-09-19T06:46:05.952755+0000","last_clean":"2024-09-19T06:46:05.952755+0000","last_became_active":"2024-09-19T06:37:08.441698+0000","last_became_peered":"2024-09-19T06:37:08.441698+0000","last_unstale":"2024-09-19T06:46:05.952755+0000","last_undegraded":"2024-09-19T06:46:05.952755+0000","last_fullsized":"2024-09-19T06:46:05.952755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:56.933775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":23,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4728","reported_seq":4801,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.343079+0000","last_change":"2024-09-19T06:37:13.470903+0000","last_active":"2024-09-19T06:46:24.343079+0000","last_peered":"2024-09-19T06:46:24.343079+0000","last_clean":"2024-09-19T06:46:24.343079+0000","last_became_active":"2024-09-19T06:37:13.470528+0000","last_became_peered":"2024-09-19T06:37:13.470528+0000","last_unstale":"2024-09-19T06:46:24.343079+0000","last_undegraded":"2024-09-19T06:46:24.343079+0000","last_fullsized":"2024-09-19T06:46:24.343079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4728,"log_dups_size":0,"ondisk_log_size":4728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:45.999436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381764812,"num_objects":102,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":69139,"num_write_kb":882580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'14","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562486+0000","last_change":"2024-09-19T06:37:09.448953+0000","last_active":"2024-09-19T06:46:00.562486+0000","last_peered":"2024-09-19T06:46:00.562486+0000","last_clean":"2024-09-19T06:46:00.562486+0000","last_became_active":"2024-09-19T06:37:09.448658+0000","last_became_peered":"2024-09-19T06:37:09.448658+0000","last_unstale":"2024-09-19T06:46:00.562486+0000","last_undegraded":"2024-09-19T06:46:00.562486+0000","last_fullsized":"2024-09-19T06:46:00.562486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:07.333392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562651+0000","last_change":"2024-09-19T06:37:08.440800+0000","last_active":"2024-09-19T06:46:00.562651+0000","last_peered":"2024-09-19T06:46:00.562651+0000","last_clean":"2024-09-19T06:46:00.562651+0000","last_became_active":"2024-09-19T06:37:08.440591+0000","last_became_peered":"2024-09-19T06:37:08.440591+0000","last_unstale":"2024-09-19T06:46:00.562651+0000","last_undegraded":"2024-09-19T06:46:00.562651+0000","last_fullsized":"2024-09-19T06:46:00.562651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:05.540261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'20","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.942090+0000","last_change":"2024-09-19T06:37:08.441268+0000","last_active":"2024-09-19T06:46:01.942090+0000","last_peered":"2024-09-19T06:46:01.942090+0000","last_clean":"2024-09-19T06:46:01.942090+0000","last_became_active":"2024-09-19T06:37:08.440969+0000","last_became_peered":"2024-09-19T06:37:08.440969+0000","last_unstale":"2024-09-19T06:46:01.942090+0000","last_undegraded":"2024-09-19T06:46:01.942090+0000","last_fullsized":"2024-09-19T06:46:01.942090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:59.426336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":18,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950785+0000","last_change":"2024-09-19T06:37:09.444857+0000","last_active":"2024-09-19T06:46:01.950785+0000","last_peered":"2024-09-19T06:46:01.950785+0000","last_clean":"2024-09-19T06:46:01.950785+0000","last_became_active":"2024-09-19T06:37:09.444562+0000","last_became_peered":"2024-09-19T06:37:09.444562+0000","last_unstale":"2024-09-19T06:46:01.950785+0000","last_undegraded":"2024-09-19T06:46:01.950785+0000","last_fullsized":"2024-09-19T06:46:01.950785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:02.470787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"34'3831","reported_seq":3893,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.370400+0000","last_change":"2024-09-19T06:37:13.467183+0000","last_active":"2024-09-19T06:46:24.370400+0000","last_peered":"2024-09-19T06:46:24.370400+0000","last_clean":"2024-09-19T06:46:24.370400+0000","last_became_active":"2024-09-19T06:37:13.466765+0000","last_became_peered":"2024-09-19T06:37:13.466765+0000","last_unstale":"2024-09-19T06:46:24.370400+0000","last_undegraded":"2024-09-19T06:46:24.370400+0000","last_fullsized":"2024-09-19T06:46:24.370400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":3831,"log_dups_size":0,"ondisk_log_size":3831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:35.184815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285214399,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":56416,"num_write_kb":718624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'987","reported_seq":1040,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.590330+0000","last_change":"2024-09-19T06:37:08.443993+0000","last_active":"2024-09-19T06:46:05.590330+0000","last_peered":"2024-09-19T06:46:05.590330+0000","last_clean":"2024-09-19T06:46:05.590330+0000","last_became_active":"2024-09-19T06:37:08.443774+0000","last_became_peered":"2024-09-19T06:37:08.443774+0000","last_unstale":"2024-09-19T06:46:05.590330+0000","last_undegraded":"2024-09-19T06:46:05.590330+0000","last_fullsized":"2024-09-19T06:46:05.590330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":987,"log_dups_size":0,"ondisk_log_size":987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:16.005073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":42342,"num_write":985,"num_write_kb":4941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.951295+0000","last_change":"2024-09-19T06:37:09.440258+0000","last_active":"2024-09-19T06:46:01.951295+0000","last_peered":"2024-09-19T06:46:01.951295+0000","last_clean":"2024-09-19T06:46:01.951295+0000","last_became_active":"2024-09-19T06:37:09.438457+0000","last_became_peered":"2024-09-19T06:37:09.438457+0000","last_unstale":"2024-09-19T06:46:01.951295+0000","last_undegraded":"2024-09-19T06:46:01.951295+0000","last_fullsized":"2024-09-19T06:46:01.951295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:24.636340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'5301","reported_seq":5370,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.322864+0000","last_change":"2024-09-19T06:37:13.462800+0000","last_active":"2024-09-19T06:46:24.322864+0000","last_peered":"2024-09-19T06:46:24.322864+0000","last_clean":"2024-09-19T06:46:24.322864+0000","last_became_active":"2024-09-19T06:37:13.462393+0000","last_became_peered":"2024-09-19T06:37:13.462393+0000","last_unstale":"2024-09-19T06:46:24.322864+0000","last_undegraded":"2024-09-19T06:46:24.322864+0000","last_fullsized":"2024-09-19T06:46:24.322864+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5301,"log_dups_size":0,"ondisk_log_size":5301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:35.901637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423730412,"num_objects":108,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":77269,"num_write_kb":974522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.941457+0000","last_change":"2024-09-19T06:37:09.450421+0000","last_active":"2024-09-19T06:46:01.941457+0000","last_peered":"2024-09-19T06:46:01.941457+0000","last_clean":"2024-09-19T06:46:01.941457+0000","last_became_active":"2024-09-19T06:37:09.450147+0000","last_became_peered":"2024-09-19T06:37:09.450147+0000","last_unstale":"2024-09-19T06:46:01.941457+0000","last_undegraded":"2024-09-19T06:46:01.941457+0000","last_fullsized":"2024-09-19T06:46:01.941457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:42.949759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'11","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.877114+0000","last_change":"2024-09-19T06:37:09.435131+0000","last_active":"2024-09-19T06:46:01.877114+0000","last_peered":"2024-09-19T06:46:01.877114+0000","last_clean":"2024-09-19T06:46:01.877114+0000","last_became_active":"2024-09-19T06:37:09.434840+0000","last_became_peered":"2024-09-19T06:37:09.434840+0000","last_unstale":"2024-09-19T06:46:01.877114+0000","last_undegraded":"2024-09-19T06:46:01.877114+0000","last_fullsized":"2024-09-19T06:46:01.877114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:20.484554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564591+0000","last_change":"2024-09-19T06:37:09.445196+0000","last_active":"2024-09-19T06:46:00.564591+0000","last_peered":"2024-09-19T06:46:00.564591+0000","last_clean":"2024-09-19T06:46:00.564591+0000","last_became_active":"2024-09-19T06:37:09.444907+0000","last_became_peered":"2024-09-19T06:37:09.444907+0000","last_unstale":"2024-09-19T06:46:00.564591+0000","last_undegraded":"2024-09-19T06:46:00.564591+0000","last_fullsized":"2024-09-19T06:46:00.564591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:17.605675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950638+0000","last_change":"2024-09-19T06:37:09.447966+0000","last_active":"2024-09-19T06:46:01.950638+0000","last_peered":"2024-09-19T06:46:01.950638+0000","last_clean":"2024-09-19T06:46:01.950638+0000","last_became_active":"2024-09-19T06:37:09.447692+0000","last_became_peered":"2024-09-19T06:37:09.447692+0000","last_unstale":"2024-09-19T06:46:01.950638+0000","last_undegraded":"2024-09-19T06:46:01.950638+0000","last_fullsized":"2024-09-19T06:46:01.950638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:01.517824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'7","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.408272+0000","last_change":"2024-09-19T06:37:51.596144+0000","last_active":"2024-09-19T06:46:01.408272+0000","last_peered":"2024-09-19T06:46:01.408272+0000","last_clean":"2024-09-19T06:46:01.408272+0000","last_became_active":"2024-09-19T06:37:51.595875+0000","last_became_peered":"2024-09-19T06:37:51.595875+0000","last_unstale":"2024-09-19T06:46:01.408272+0000","last_undegraded":"2024-09-19T06:46:01.408272+0000","last_fullsized":"2024-09-19T06:46:01.408272+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:30.846248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"28'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.408530+0000","last_change":"2024-09-19T06:37:09.441782+0000","last_active":"2024-09-19T06:46:01.408530+0000","last_peered":"2024-09-19T06:46:01.408530+0000","last_clean":"2024-09-19T06:46:01.408530+0000","last_became_active":"2024-09-19T06:37:09.441456+0000","last_became_peered":"2024-09-19T06:37:09.441456+0000","last_unstale":"2024-09-19T06:46:01.408530+0000","last_undegraded":"2024-09-19T06:46:01.408530+0000","last_fullsized":"2024-09-19T06:46:01.408530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:04:28.458974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.942133+0000","last_change":"2024-09-19T06:37:09.449856+0000","last_active":"2024-09-19T06:46:01.942133+0000","last_peered":"2024-09-19T06:46:01.942133+0000","last_clean":"2024-09-19T06:46:01.942133+0000","last_became_active":"2024-09-19T06:37:09.449562+0000","last_became_peered":"2024-09-19T06:37:09.449562+0000","last_unstale":"2024-09-19T06:46:01.942133+0000","last_undegraded":"2024-09-19T06:46:01.942133+0000","last_fullsized":"2024-09-19T06:46:01.942133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:49.182126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'9","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.563653+0000","last_change":"2024-09-19T06:37:09.438551+0000","last_active":"2024-09-19T06:46:00.563653+0000","last_peered":"2024-09-19T06:46:00.563653+0000","last_clean":"2024-09-19T06:46:00.563653+0000","last_became_active":"2024-09-19T06:37:09.437624+0000","last_became_peered":"2024-09-19T06:37:09.437624+0000","last_unstale":"2024-09-19T06:46:00.563653+0000","last_undegraded":"2024-09-19T06:46:00.563653+0000","last_fullsized":"2024-09-19T06:46:00.563653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:46.565780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564849+0000","last_change":"2024-09-19T06:37:09.438737+0000","last_active":"2024-09-19T06:46:00.564849+0000","last_peered":"2024-09-19T06:46:00.564849+0000","last_clean":"2024-09-19T06:46:00.564849+0000","last_became_active":"2024-09-19T06:37:09.438453+0000","last_became_peered":"2024-09-19T06:37:09.438453+0000","last_unstale":"2024-09-19T06:46:00.564849+0000","last_undegraded":"2024-09-19T06:46:00.564849+0000","last_fullsized":"2024-09-19T06:46:00.564849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.982275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"34'11","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.628456+0000","last_change":"2024-09-19T06:37:09.442093+0000","last_active":"2024-09-19T06:46:05.628456+0000","last_peered":"2024-09-19T06:46:05.628456+0000","last_clean":"2024-09-19T06:46:05.628456+0000","last_became_active":"2024-09-19T06:37:09.439710+0000","last_became_peered":"2024-09-19T06:37:09.439710+0000","last_unstale":"2024-09-19T06:46:05.628456+0000","last_undegraded":"2024-09-19T06:46:05.628456+0000","last_fullsized":"2024-09-19T06:46:05.628456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:02.626854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'9","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.877132+0000","last_change":"2024-09-19T06:37:51.593282+0000","last_active":"2024-09-19T06:46:01.877132+0000","last_peered":"2024-09-19T06:46:01.877132+0000","last_clean":"2024-09-19T06:46:01.877132+0000","last_became_active":"2024-09-19T06:37:51.592846+0000","last_became_peered":"2024-09-19T06:37:51.592846+0000","last_unstale":"2024-09-19T06:46:01.877132+0000","last_undegraded":"2024-09-19T06:46:01.877132+0000","last_fullsized":"2024-09-19T06:46:01.877132+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:03:58.694299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"29'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950505+0000","last_change":"2024-09-19T06:37:09.449633+0000","last_active":"2024-09-19T06:46:01.950505+0000","last_peered":"2024-09-19T06:46:01.950505+0000","last_clean":"2024-09-19T06:46:01.950505+0000","last_became_active":"2024-09-19T06:37:09.449379+0000","last_became_peered":"2024-09-19T06:37:09.449379+0000","last_unstale":"2024-09-19T06:46:01.950505+0000","last_undegraded":"2024-09-19T06:46:01.950505+0000","last_fullsized":"2024-09-19T06:46:01.950505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:29.565038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.942221+0000","last_change":"2024-09-19T06:37:09.447808+0000","last_active":"2024-09-19T06:46:01.942221+0000","last_peered":"2024-09-19T06:46:01.942221+0000","last_clean":"2024-09-19T06:46:01.942221+0000","last_became_active":"2024-09-19T06:37:09.447514+0000","last_became_peered":"2024-09-19T06:37:09.447514+0000","last_unstale":"2024-09-19T06:46:01.942221+0000","last_undegraded":"2024-09-19T06:46:01.942221+0000","last_fullsized":"2024-09-19T06:46:01.942221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:04.653997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'10","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565955+0000","last_change":"2024-09-19T06:37:09.439605+0000","last_active":"2024-09-19T06:46:00.565955+0000","last_peered":"2024-09-19T06:46:00.565955+0000","last_clean":"2024-09-19T06:46:00.565955+0000","last_became_active":"2024-09-19T06:37:09.432601+0000","last_became_peered":"2024-09-19T06:37:09.432601+0000","last_unstale":"2024-09-19T06:46:00.565955+0000","last_undegraded":"2024-09-19T06:46:00.565955+0000","last_fullsized":"2024-09-19T06:46:00.565955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:50.640062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"34'10","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.877546+0000","last_change":"2024-09-19T06:37:09.440268+0000","last_active":"2024-09-19T06:46:01.877546+0000","last_peered":"2024-09-19T06:46:01.877546+0000","last_clean":"2024-09-19T06:46:01.877546+0000","last_became_active":"2024-09-19T06:37:09.439937+0000","last_became_peered":"2024-09-19T06:37:09.439937+0000","last_unstale":"2024-09-19T06:46:01.877546+0000","last_undegraded":"2024-09-19T06:46:01.877546+0000","last_fullsized":"2024-09-19T06:46:01.877546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:32:46.182979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565483+0000","last_change":"2024-09-19T06:37:09.437080+0000","last_active":"2024-09-19T06:46:00.565483+0000","last_peered":"2024-09-19T06:46:00.565483+0000","last_clean":"2024-09-19T06:46:00.565483+0000","last_became_active":"2024-09-19T06:37:09.436752+0000","last_became_peered":"2024-09-19T06:37:09.436752+0000","last_unstale":"2024-09-19T06:46:00.565483+0000","last_undegraded":"2024-09-19T06:46:00.565483+0000","last_fullsized":"2024-09-19T06:46:00.565483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:31.423640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"34'11","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.196400+0000","last_change":"2024-09-19T06:37:09.448942+0000","last_active":"2024-09-19T06:46:23.196400+0000","last_peered":"2024-09-19T06:46:23.196400+0000","last_clean":"2024-09-19T06:46:23.196400+0000","last_became_active":"2024-09-19T06:37:09.448647+0000","last_became_peered":"2024-09-19T06:37:09.448647+0000","last_unstale":"2024-09-19T06:46:23.196400+0000","last_undegraded":"2024-09-19T06:46:23.196400+0000","last_fullsized":"2024-09-19T06:46:23.196400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:49.027909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'10","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.407626+0000","last_change":"2024-09-19T06:37:09.445015+0000","last_active":"2024-09-19T06:46:01.407626+0000","last_peered":"2024-09-19T06:46:01.407626+0000","last_clean":"2024-09-19T06:46:01.407626+0000","last_became_active":"2024-09-19T06:37:09.444737+0000","last_became_peered":"2024-09-19T06:37:09.444737+0000","last_unstale":"2024-09-19T06:46:01.407626+0000","last_undegraded":"2024-09-19T06:46:01.407626+0000","last_fullsized":"2024-09-19T06:46:01.407626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:16.194580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'10","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950483+0000","last_change":"2024-09-19T06:37:09.446025+0000","last_active":"2024-09-19T06:46:01.950483+0000","last_peered":"2024-09-19T06:46:01.950483+0000","last_clean":"2024-09-19T06:46:01.950483+0000","last_became_active":"2024-09-19T06:37:09.445503+0000","last_became_peered":"2024-09-19T06:37:09.445503+0000","last_unstale":"2024-09-19T06:46:01.950483+0000","last_undegraded":"2024-09-19T06:46:01.950483+0000","last_fullsized":"2024-09-19T06:46:01.950483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:30.469995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.563043+0000","last_change":"2024-09-19T06:37:09.441302+0000","last_active":"2024-09-19T06:46:00.563043+0000","last_peered":"2024-09-19T06:46:00.563043+0000","last_clean":"2024-09-19T06:46:00.563043+0000","last_became_active":"2024-09-19T06:37:09.439767+0000","last_became_peered":"2024-09-19T06:37:09.439767+0000","last_unstale":"2024-09-19T06:46:00.563043+0000","last_undegraded":"2024-09-19T06:46:00.563043+0000","last_fullsized":"2024-09-19T06:46:00.563043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:01.038823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.951163+0000","last_change":"2024-09-19T06:37:09.440976+0000","last_active":"2024-09-19T06:46:01.951163+0000","last_peered":"2024-09-19T06:46:01.951163+0000","last_clean":"2024-09-19T06:46:01.951163+0000","last_became_active":"2024-09-19T06:37:09.440702+0000","last_became_peered":"2024-09-19T06:37:09.440702+0000","last_unstale":"2024-09-19T06:46:01.951163+0000","last_undegraded":"2024-09-19T06:46:01.951163+0000","last_fullsized":"2024-09-19T06:46:01.951163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:21.281400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'11","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.942156+0000","last_change":"2024-09-19T06:37:09.442301+0000","last_active":"2024-09-19T06:46:01.942156+0000","last_peered":"2024-09-19T06:46:01.942156+0000","last_clean":"2024-09-19T06:46:01.942156+0000","last_became_active":"2024-09-19T06:37:09.442053+0000","last_became_peered":"2024-09-19T06:37:09.442053+0000","last_unstale":"2024-09-19T06:46:01.942156+0000","last_undegraded":"2024-09-19T06:46:01.942156+0000","last_fullsized":"2024-09-19T06:46:01.942156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:26.189384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'9","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.942136+0000","last_change":"2024-09-19T06:37:09.441525+0000","last_active":"2024-09-19T06:46:01.942136+0000","last_peered":"2024-09-19T06:46:01.942136+0000","last_clean":"2024-09-19T06:46:01.942136+0000","last_became_active":"2024-09-19T06:37:09.441179+0000","last_became_peered":"2024-09-19T06:37:09.441179+0000","last_unstale":"2024-09-19T06:46:01.942136+0000","last_undegraded":"2024-09-19T06:46:01.942136+0000","last_fullsized":"2024-09-19T06:46:01.942136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:47.235113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'10","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.566138+0000","last_change":"2024-09-19T06:37:09.437163+0000","last_active":"2024-09-19T06:46:00.566138+0000","last_peered":"2024-09-19T06:46:00.566138+0000","last_clean":"2024-09-19T06:46:00.566138+0000","last_became_active":"2024-09-19T06:37:09.436892+0000","last_became_peered":"2024-09-19T06:37:09.436892+0000","last_unstale":"2024-09-19T06:46:00.566138+0000","last_undegraded":"2024-09-19T06:46:00.566138+0000","last_fullsized":"2024-09-19T06:46:00.566138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:47:58.347385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562140+0000","last_change":"2024-09-19T06:37:09.437524+0000","last_active":"2024-09-19T06:46:00.562140+0000","last_peered":"2024-09-19T06:46:00.562140+0000","last_clean":"2024-09-19T06:46:00.562140+0000","last_became_active":"2024-09-19T06:37:09.437023+0000","last_became_peered":"2024-09-19T06:37:09.437023+0000","last_unstale":"2024-09-19T06:46:00.562140+0000","last_undegraded":"2024-09-19T06:46:00.562140+0000","last_fullsized":"2024-09-19T06:46:00.562140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:31.398914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565598+0000","last_change":"2024-09-19T06:37:09.448814+0000","last_active":"2024-09-19T06:46:00.565598+0000","last_peered":"2024-09-19T06:46:00.565598+0000","last_clean":"2024-09-19T06:46:00.565598+0000","last_became_active":"2024-09-19T06:37:09.448547+0000","last_became_peered":"2024-09-19T06:37:09.448547+0000","last_unstale":"2024-09-19T06:46:00.565598+0000","last_undegraded":"2024-09-19T06:46:00.565598+0000","last_fullsized":"2024-09-19T06:46:00.565598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:13.526300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'7","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564426+0000","last_change":"2024-09-19T06:37:09.446910+0000","last_active":"2024-09-19T06:46:00.564426+0000","last_peered":"2024-09-19T06:46:00.564426+0000","last_clean":"2024-09-19T06:46:00.564426+0000","last_became_active":"2024-09-19T06:37:09.446603+0000","last_became_peered":"2024-09-19T06:37:09.446603+0000","last_unstale":"2024-09-19T06:46:00.564426+0000","last_undegraded":"2024-09-19T06:46:00.564426+0000","last_fullsized":"2024-09-19T06:46:00.564426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:47.006354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565756+0000","last_change":"2024-09-19T06:37:09.430160+0000","last_active":"2024-09-19T06:46:00.565756+0000","last_peered":"2024-09-19T06:46:00.565756+0000","last_clean":"2024-09-19T06:46:00.565756+0000","last_became_active":"2024-09-19T06:37:09.429813+0000","last_became_peered":"2024-09-19T06:37:09.429813+0000","last_unstale":"2024-09-19T06:46:00.565756+0000","last_undegraded":"2024-09-19T06:46:00.565756+0000","last_fullsized":"2024-09-19T06:46:00.565756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:10.353834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'5","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.877259+0000","last_change":"2024-09-19T06:37:51.782148+0000","last_active":"2024-09-19T06:46:01.877259+0000","last_peered":"2024-09-19T06:46:01.877259+0000","last_clean":"2024-09-19T06:46:01.877259+0000","last_became_active":"2024-09-19T06:37:51.781695+0000","last_became_peered":"2024-09-19T06:37:51.781695+0000","last_unstale":"2024-09-19T06:46:01.877259+0000","last_undegraded":"2024-09-19T06:46:01.877259+0000","last_fullsized":"2024-09-19T06:46:01.877259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:13.160550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950209+0000","last_change":"2024-09-19T06:37:09.446789+0000","last_active":"2024-09-19T06:46:01.950209+0000","last_peered":"2024-09-19T06:46:01.950209+0000","last_clean":"2024-09-19T06:46:01.950209+0000","last_became_active":"2024-09-19T06:37:09.446557+0000","last_became_peered":"2024-09-19T06:37:09.446557+0000","last_unstale":"2024-09-19T06:46:01.950209+0000","last_undegraded":"2024-09-19T06:46:01.950209+0000","last_fullsized":"2024-09-19T06:46:01.950209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:18.119474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.408917+0000","last_change":"2024-09-19T06:37:09.448093+0000","last_active":"2024-09-19T06:46:01.408917+0000","last_peered":"2024-09-19T06:46:01.408917+0000","last_clean":"2024-09-19T06:46:01.408917+0000","last_became_active":"2024-09-19T06:37:09.447753+0000","last_became_peered":"2024-09-19T06:37:09.447753+0000","last_unstale":"2024-09-19T06:46:01.408917+0000","last_undegraded":"2024-09-19T06:46:01.408917+0000","last_fullsized":"2024-09-19T06:46:01.408917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:11.944092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.566032+0000","last_change":"2024-09-19T06:37:09.442798+0000","last_active":"2024-09-19T06:46:00.566032+0000","last_peered":"2024-09-19T06:46:00.566032+0000","last_clean":"2024-09-19T06:46:00.566032+0000","last_became_active":"2024-09-19T06:37:09.442047+0000","last_became_peered":"2024-09-19T06:37:09.442047+0000","last_unstale":"2024-09-19T06:46:00.566032+0000","last_undegraded":"2024-09-19T06:46:00.566032+0000","last_fullsized":"2024-09-19T06:46:00.566032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:33.193185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":12270796617,"num_objects":3116,"num_object_clones":0,"num_object_copies":12464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3116,"num_whiteouts":0,"num_read":1242,"num_read_kb":0,"num_write":2244704,"num_write_kb":28311472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":14400413696,"data_stored":24543608832,"data_compressed":1344871924,"data_compressed_allocated":5351727104,"data_compressed_original":15494922240,"omap_allocated":0,"internal_metadata":0},"log_size":153765,"ondisk_log_size":153765,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":467,"ondisk_log_size":467,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65400605,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":465,"num_read_kb":289482,"num_write":3818,"num_write_kb":66805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33341440,"data_stored":130801210,"data_compressed":14149544,"data_compressed_allocated":17014784,"data_compressed_original":114532352,"omap_allocated":0,"internal_metadata":0},"log_size":3703,"ondisk_log_size":3703,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65040,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509557,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1978644,"kb_used_data":1294212,"kb_used_omap":1,"kb_used_meta":684414,"kb_avail":92393196,"statfs":{"total":96636764160,"available":94610632704,"internally_reserved":0,"allocated":1325273088,"data_stored":2267551713,"data_compressed":124553786,"data_compressed_allocated":494407680,"data_compressed_original":1436893184,"omap_allocated":1595,"internal_metadata":700840389},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509557,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2741744,"kb_used_data":1776864,"kb_used_omap":1,"kb_used_meta":964862,"kb_avail":91630096,"statfs":{"total":96636764160,"available":93829218304,"internally_reserved":0,"allocated":1819508736,"data_stored":3105010060,"data_compressed":171329329,"data_compressed_allocated":674234368,"data_compressed_original":1959952384,"omap_allocated":1595,"internal_metadata":988019141},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509556,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2404484,"kb_used_data":1556916,"kb_used_omap":1,"kb_used_meta":847550,"kb_avail":91967356,"statfs":{"total":96636764160,"available":94174572544,"internally_reserved":0,"allocated":1594281984,"data_stored":2734205989,"data_compressed":150705539,"data_compressed_allocated":594751488,"data_compressed_original":1734893568,"omap_allocated":1595,"internal_metadata":867891653},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542261,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2449536,"kb_used_data":1575536,"kb_used_omap":1,"kb_used_meta":873982,"kb_avail":91922304,"statfs":{"total":96636764160,"available":94128439296,"internally_reserved":0,"allocated":1613348864,"data_stored":2765507565,"data_compressed":152489907,"data_compressed_allocated":598831104,"data_compressed_original":1751199744,"omap_allocated":1590,"internal_metadata":894958026},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542259,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2804680,"kb_used_data":1849272,"kb_used_omap":1,"kb_used_meta":955390,"kb_avail":91567160,"statfs":{"total":96636764160,"available":93764771840,"internally_reserved":0,"allocated":1893654528,"data_stored":3241159207,"data_compressed":179048312,"data_compressed_allocated":705675264,"data_compressed_original":2053390336,"omap_allocated":1594,"internal_metadata":978319814},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542258,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3487684,"kb_used_data":2326964,"kb_used_omap":1,"kb_used_meta":1160702,"kb_avail":90884156,"statfs":{"total":96636764160,"available":93065375744,"internally_reserved":0,"allocated":2382811136,"data_stored":4063537562,"data_compressed":223516304,"data_compressed_allocated":885309440,"data_compressed_original":2566246400,"omap_allocated":1593,"internal_metadata":1188559303},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,5,0,1,5,7,1,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542258,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3548688,"kb_used_data":2320384,"kb_used_omap":1,"kb_used_meta":1228286,"kb_avail":90823152,"statfs":{"total":96636764160,"available":93002907648,"internally_reserved":0,"allocated":2376073216,"data_stored":4057641390,"data_compressed":223574906,"data_compressed_allocated":883261440,"data_compressed_original":2565042176,"omap_allocated":1595,"internal_metadata":1257765317},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574966,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2163716,"kb_used_data":1398324,"kb_used_omap":1,"kb_used_meta":765374,"kb_avail":92208124,"statfs":{"total":96636764160,"available":94421118976,"internally_reserved":0,"allocated":1431883776,"data_stored":2442303327,"data_compressed":133868425,"data_compressed_allocated":532361216,"data_compressed_original":1542983680,"omap_allocated":1595,"internal_metadata":783743429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4018176,"data_stored":20972158,"data_compressed":2327138,"data_compressed_allocated":2707456,"data_compressed_original":19673088,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3305472,"data_stored":14973479,"data_compressed":1661240,"data_compressed_allocated":2039808,"data_compressed_original":13717504,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":94168,"data_compressed":5056,"data_compressed_allocated":8192,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5226496,"data_stored":12677752,"data_compressed":1395672,"data_compressed_allocated":1748992,"data_compressed_original":9207808,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5414912,"data_stored":23362053,"data_compressed":2560869,"data_compressed_allocated":2981888,"data_compressed_original":20942848,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1662976,"data_stored":8388698,"data_compressed":865550,"data_compressed_allocated":1097728,"data_compressed_original":7827456,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3923968,"data_stored":16777888,"data_compressed":1995942,"data_compressed_allocated":2461696,"data_compressed_original":15323136,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9711616,"data_stored":33555014,"data_compressed":3338077,"data_compressed_allocated":3969024,"data_compressed_original":27815936,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1589829632,"data_stored":2712477696,"data_compressed":148345881,"data_compressed_allocated":591998976,"data_compressed_original":1714647040,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2372399104,"data_stored":4042502144,"data_compressed":221913666,"data_compressed_allocated":881221632,"data_compressed_original":2551324672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1431437312,"data_stored":2442043392,"data_compressed":133863369,"data_compressed_allocated":532353024,"data_compressed_original":1542959104,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2377216000,"data_stored":4050694144,"data_compressed":222120632,"data_compressed_allocated":883560448,"data_compressed_original":2557038592,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1813725184,"data_stored":3081482240,"data_compressed":168768460,"data_compressed_allocated":671252480,"data_compressed_original":1939009536,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1323241472,"data_stored":2258997248,"data_compressed":123688236,"data_compressed_allocated":493309952,"data_compressed_original":1429065728,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1889361920,"data_stored":3224215552,"data_compressed":177052370,"data_compressed_allocated":703213568,"data_compressed_original":2038067200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1603203072,"data_stored":2731196416,"data_compressed":149119310,"data_compressed_allocated":594817024,"data_compressed_original":1722810368,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:46:31.776 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T06:46:31.776 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:46:31.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.986+0000 7fa27443c640 1 Processor -- start 2024-09-19T06:46:31.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.987+0000 7fa27443c640 1 -- start start 2024-09-19T06:46:31.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.988+0000 7fa27443c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa26c155320 0x7fa26c15e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:31.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.988+0000 7fa27443c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa26c0cc890 0x7fa26c0c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:31.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.988+0000 7fa27443c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa26c15ea10 con 0x7fa26c0cb900 2024-09-19T06:46:31.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.988+0000 7fa27443c640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fa26c15ecf0 con 0x7fa26c0cc890 2024-09-19T06:46:31.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.988+0000 7fa27443c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fa26c15efd0 con 0x7fa26c155320 2024-09-19T06:46:31.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.988+0000 7fa2721d8640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa26c155320 0x7fa26c15e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:31.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.989+0000 7fa2721d8640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa26c155320 0x7fa26c15e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:49596/0 (socket says 172.21.15.86:49596) 2024-09-19T06:46:31.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.989+0000 7fa2721d8640 1 -- 172.21.15.86:0/1159293701 learned_addr learned my addr 172.21.15.86:0/1159293701 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:31.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.989+0000 7fa2721d8640 1 -- 172.21.15.86:0/1159293701 >> v2:172.21.15.86:3300/0 conn(0x7fa26c0cc890 msgr2=0x7fa26c0c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:31.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.989+0000 7fa2719d7640 1 --2- 172.21.15.86:0/1159293701 >> v2:172.21.15.86:3300/0 conn(0x7fa26c0cc890 0x7fa26c0c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:31.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.989+0000 7fa2721d8640 1 --2- 172.21.15.86:0/1159293701 >> v2:172.21.15.86:3300/0 conn(0x7fa26c0cc890 0x7fa26c0c5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.989+0000 7fa2721d8640 1 -- 172.21.15.86:0/1159293701 >> v1:172.21.15.169:6789/0 conn(0x7fa26c0cb900 legacy=0x7fa26c0c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:31.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.989+0000 7fa2721d8640 1 -- 172.21.15.86:0/1159293701 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa26c0c62a0 con 0x7fa26c155320 2024-09-19T06:46:31.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.990+0000 7fa2719d7640 1 --2- 172.21.15.86:0/1159293701 >> v2:172.21.15.86:3300/0 conn(0x7fa26c0cc890 0x7fa26c0c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:46:31.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.990+0000 7fa2721d8640 1 --2- 172.21.15.86:0/1159293701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa26c155320 0x7fa26c15e3f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa26c0ce6a0 tx=0x7fa26402a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3e2ea711d93e75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:31.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.992+0000 7fa2711d6640 1 -- 172.21.15.86:0/1159293701 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa264037070 con 0x7fa26c155320 2024-09-19T06:46:31.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.992+0000 7fa2711d6640 1 -- 172.21.15.86:0/1159293701 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa264032440 con 0x7fa26c155320 2024-09-19T06:46:31.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.992+0000 7fa2711d6640 1 -- 172.21.15.86:0/1159293701 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2640327f0 con 0x7fa26c155320 2024-09-19T06:46:31.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.993+0000 7fa27443c640 1 -- 172.21.15.86:0/1159293701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa26c155320 msgr2=0x7fa26c15e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:31.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.993+0000 7fa27443c640 1 --2- 172.21.15.86:0/1159293701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa26c155320 0x7fa26c15e3f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa26c0ce6a0 tx=0x7fa26402a250 comp rx=0 tx=0).stop 2024-09-19T06:46:31.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.993+0000 7fa27443c640 1 -- 172.21.15.86:0/1159293701 shutdown_connections 2024-09-19T06:46:31.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.993+0000 7fa27443c640 1 --2- 172.21.15.86:0/1159293701 >> v2:172.21.15.86:3300/0 conn(0x7fa26c0cc890 0x7fa26c0c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.993+0000 7fa27443c640 1 --2- 172.21.15.86:0/1159293701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa26c155320 0x7fa26c15e3f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:31.993+0000 7fa27443c640 1 -- 172.21.15.86:0/1159293701 >> 172.21.15.86:0/1159293701 conn(0x7fa26c067890 msgr2=0x7fa26c067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:32.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.001+0000 7fa27443c640 1 -- 172.21.15.86:0/1159293701 shutdown_connections 2024-09-19T06:46:32.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.001+0000 7fa27443c640 1 -- 172.21.15.86:0/1159293701 wait complete. 2024-09-19T06:46:32.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.003+0000 7fa27443c640 1 Processor -- start 2024-09-19T06:46:32.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.007+0000 7fa27443c640 1 -- start start 2024-09-19T06:46:32.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.008+0000 7fa27443c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa26c0cb900 0x7fa26c15d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:32.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.008+0000 7fa27443c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa26c0cc890 0x7fa26c155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:32.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.008+0000 7fa27443c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa26c155320 0x7fa26c155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:32.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.008+0000 7fa27443c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa26c0c71b0 con 0x7fa26c0cb900 2024-09-19T06:46:32.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.008+0000 7fa27443c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa26c15f2b0 con 0x7fa26c155320 2024-09-19T06:46:32.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.008+0000 7fa27443c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa26c0c7330 con 0x7fa26c0cc890 2024-09-19T06:46:32.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.008+0000 7fa2721d8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa26c0cb900 0x7fa26c15d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:32.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.008+0000 7fa2721d8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa26c0cb900 0x7fa26c15d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45022/0 (socket says 172.21.15.86:45022) 2024-09-19T06:46:32.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.008+0000 7fa2721d8640 1 -- 172.21.15.86:0/1374192671 learned_addr learned my addr 172.21.15.86:0/1374192671 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:32.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.009+0000 7fa2721d8640 1 -- 172.21.15.86:0/1374192671 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa26c0cc890 msgr2=0x7fa26c155a70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:46:32.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.009+0000 7fa2721d8640 1 --2- 172.21.15.86:0/1374192671 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa26c0cc890 0x7fa26c155a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:32.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.009+0000 7fa2721d8640 1 -- 172.21.15.86:0/1374192671 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa26c155320 msgr2=0x7fa26c155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:32.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.009+0000 7fa2721d8640 1 --2- 172.21.15.86:0/1374192671 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa26c155320 0x7fa26c155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:32.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.009+0000 7fa2721d8640 1 -- 172.21.15.86:0/1374192671 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa26c1f8340 con 0x7fa26c0cb900 2024-09-19T06:46:32.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.009+0000 7fa2721d8640 1 --2- 172.21.15.86:0/1374192671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa26c0cb900 0x7fa26c15d280 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa264000c00 tx=0x7fa2640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:32.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.010+0000 7fa262ffd640 1 -- 172.21.15.86:0/1374192671 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa264037040 con 0x7fa26c0cb900 2024-09-19T06:46:32.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.010+0000 7fa262ffd640 1 -- 172.21.15.86:0/1374192671 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2640325f0 con 0x7fa26c0cb900 2024-09-19T06:46:32.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.010+0000 7fa262ffd640 1 -- 172.21.15.86:0/1374192671 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2640329c0 con 0x7fa26c0cb900 2024-09-19T06:46:32.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.010+0000 7fa27443c640 1 -- 172.21.15.86:0/1374192671 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa26c1f91c0 con 0x7fa26c0cb900 2024-09-19T06:46:32.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.010+0000 7fa27443c640 1 -- 172.21.15.86:0/1374192671 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa26c1f85b0 con 0x7fa26c0cb900 2024-09-19T06:46:32.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.012+0000 7fa260ff9640 1 -- 172.21.15.86:0/1374192671 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa248005290 con 0x7fa26c0cb900 2024-09-19T06:46:32.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.014+0000 7fa262ffd640 1 -- 172.21.15.86:0/1374192671 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa264032b60 con 0x7fa26c0cb900 2024-09-19T06:46:32.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.014+0000 7fa262ffd640 1 --2- 172.21.15.86:0/1374192671 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa25006c2e0 0x7fa25006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:32.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.015+0000 7fa262ffd640 1 -- 172.21.15.86:0/1374192671 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7fa2640ac3a0 con 0x7fa26c0cb900 2024-09-19T06:46:32.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.018+0000 7fa2719d7640 1 --2- 172.21.15.86:0/1374192671 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa25006c2e0 0x7fa25006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:32.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.018+0000 7fa2719d7640 1 --2- 172.21.15.86:0/1374192671 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa25006c2e0 0x7fa25006e7a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa26c1f5e60 tx=0x7fa25c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:32.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.024+0000 7fa262ffd640 1 -- 172.21.15.86:0/1374192671 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa26407a3d0 con 0x7fa26c0cb900 2024-09-19T06:46:32.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.343+0000 7fa260ff9640 1 -- 172.21.15.86:0/1374192671 --> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa248000bc0 con 0x7fa25006c2e0 2024-09-19T06:46:32.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.364+0000 7fa262ffd640 1 -- 172.21.15.86:0/1374192671 <== mgr.4105 v2:172.21.15.86:6816/4165134248 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335427 (secure 0 0 0) 0x7fa248000bc0 con 0x7fa25006c2e0 2024-09-19T06:46:32.371 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:46:32.374 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-09-19T06:46:32.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.372+0000 7fa260ff9640 1 -- 172.21.15.86:0/1374192671 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa25006c2e0 msgr2=0x7fa25006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:32.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.372+0000 7fa260ff9640 1 --2- 172.21.15.86:0/1374192671 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa25006c2e0 0x7fa25006e7a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa26c1f5e60 tx=0x7fa25c008040 comp rx=0 tx=0).stop 2024-09-19T06:46:32.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.373+0000 7fa260ff9640 1 -- 172.21.15.86:0/1374192671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa26c0cb900 msgr2=0x7fa26c15d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:32.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.373+0000 7fa260ff9640 1 --2- 172.21.15.86:0/1374192671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa26c0cb900 0x7fa26c15d280 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa264000c00 tx=0x7fa2640046c0 comp rx=0 tx=0).stop 2024-09-19T06:46:32.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.373+0000 7fa260ff9640 1 -- 172.21.15.86:0/1374192671 shutdown_connections 2024-09-19T06:46:32.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.373+0000 7fa260ff9640 1 --2- 172.21.15.86:0/1374192671 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa25006c2e0 0x7fa25006e7a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:32.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.373+0000 7fa260ff9640 1 --2- 172.21.15.86:0/1374192671 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa26c155320 0x7fa26c155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:32.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.373+0000 7fa260ff9640 1 --2- 172.21.15.86:0/1374192671 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa26c0cc890 0x7fa26c155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:32.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.373+0000 7fa260ff9640 1 --2- 172.21.15.86:0/1374192671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa26c0cb900 0x7fa26c15d280 secure :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa264000c00 tx=0x7fa2640046c0 comp rx=0 tx=0).stop 2024-09-19T06:46:32.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.373+0000 7fa260ff9640 1 -- 172.21.15.86:0/1374192671 >> 172.21.15.86:0/1374192671 conn(0x7fa26c067890 msgr2=0x7fa26c0cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:32.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.373+0000 7fa260ff9640 1 -- 172.21.15.86:0/1374192671 shutdown_connections 2024-09-19T06:46:32.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.373+0000 7fa260ff9640 1 -- 172.21.15.86:0/1374192671 wait complete. 2024-09-19T06:46:32.392 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2024-09-19T06:46:31.917731+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":11447595243,"num_objects":2953,"num_object_clones":0,"num_object_copies":11714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2953,"num_whiteouts":0,"num_read":1825,"num_read_kb":289584,"num_write":2248894,"num_write_kb":28380694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158302,"ondisk_log_size":158302,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":20772500,"kb_used_data":13304712,"kb_used_omap":12,"kb_used_meta":7463923,"kb_avail":734202220,"statfs":{"total":773094113280,"available":751823073280,"internally_reserved":0,"allocated":13624025088,"data_stored":23311670962,"data_compressed":1285743505,"data_compressed_allocated":5072150528,"data_compressed_original":14761484288,"omap_allocated":12752,"internal_metadata":7643057712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,1,4,8,8,7,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":83,"apply_latency_ms":83,"commit_latency_ns":83000000,"apply_latency_ns":83000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1727984415,"num_objects":-412,"num_object_clones":0,"num_object_copies":-1648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-412,"num_whiteouts":0,"num_read":61,"num_read_kb":106,"num_write":440,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003008"},"pg_stats":[{"pgid":"2.1f","version":"29'12","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.585975+0000","last_change":"2024-09-19T06:37:08.446272+0000","last_active":"2024-09-19T06:46:05.585975+0000","last_peered":"2024-09-19T06:46:05.585975+0000","last_clean":"2024-09-19T06:46:05.585975+0000","last_became_active":"2024-09-19T06:37:08.446044+0000","last_became_peered":"2024-09-19T06:37:08.446044+0000","last_unstale":"2024-09-19T06:46:05.585975+0000","last_undegraded":"2024-09-19T06:46:05.585975+0000","last_fullsized":"2024-09-19T06:46:05.585975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:37.623543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":20504,"num_write":9,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562503+0000","last_change":"2024-09-19T06:37:09.441539+0000","last_active":"2024-09-19T06:46:00.562503+0000","last_peered":"2024-09-19T06:46:00.562503+0000","last_clean":"2024-09-19T06:46:00.562503+0000","last_became_active":"2024-09-19T06:37:09.440839+0000","last_became_peered":"2024-09-19T06:37:09.440839+0000","last_unstale":"2024-09-19T06:46:00.562503+0000","last_undegraded":"2024-09-19T06:46:00.562503+0000","last_fullsized":"2024-09-19T06:46:00.562503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:49.222252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'5111","reported_seq":5184,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:30.663807+0000","last_change":"2024-09-19T06:37:13.461355+0000","last_active":"2024-09-19T06:46:30.663807+0000","last_peered":"2024-09-19T06:46:30.663807+0000","last_clean":"2024-09-19T06:46:30.663807+0000","last_became_active":"2024-09-19T06:37:13.460936+0000","last_became_peered":"2024-09-19T06:37:13.460936+0000","last_unstale":"2024-09-19T06:46:30.663807+0000","last_undegraded":"2024-09-19T06:46:30.663807+0000","last_fullsized":"2024-09-19T06:46:30.663807+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5111,"log_dups_size":0,"ondisk_log_size":5111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:59.860583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":348246029,"num_objects":93,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":74687,"num_write_kb":941501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'23","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562733+0000","last_change":"2024-09-19T06:37:08.438583+0000","last_active":"2024-09-19T06:46:00.562733+0000","last_peered":"2024-09-19T06:46:00.562733+0000","last_clean":"2024-09-19T06:46:00.562733+0000","last_became_active":"2024-09-19T06:37:08.437921+0000","last_became_peered":"2024-09-19T06:37:08.437921+0000","last_unstale":"2024-09-19T06:46:00.562733+0000","last_undegraded":"2024-09-19T06:46:00.562733+0000","last_fullsized":"2024-09-19T06:46:00.562733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:58:23.269120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":24576,"num_write":22,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950609+0000","last_change":"2024-09-19T06:37:09.450731+0000","last_active":"2024-09-19T06:46:01.950609+0000","last_peered":"2024-09-19T06:46:01.950609+0000","last_clean":"2024-09-19T06:46:01.950609+0000","last_became_active":"2024-09-19T06:37:09.450430+0000","last_became_peered":"2024-09-19T06:37:09.450430+0000","last_unstale":"2024-09-19T06:46:01.950609+0000","last_undegraded":"2024-09-19T06:46:01.950609+0000","last_fullsized":"2024-09-19T06:46:01.950609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:21.701872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"34'4804","reported_seq":4883,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.302731+0000","last_change":"2024-09-19T06:37:13.459445+0000","last_active":"2024-09-19T06:46:24.302731+0000","last_peered":"2024-09-19T06:46:24.302731+0000","last_clean":"2024-09-19T06:46:24.302731+0000","last_became_active":"2024-09-19T06:37:13.459040+0000","last_became_peered":"2024-09-19T06:37:13.459040+0000","last_unstale":"2024-09-19T06:46:24.302731+0000","last_undegraded":"2024-09-19T06:46:24.302731+0000","last_fullsized":"2024-09-19T06:46:24.302731+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4804,"log_dups_size":0,"ondisk_log_size":4804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:37.676097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381707433,"num_objects":95,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":70584,"num_write_kb":897029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"34'333","reported_seq":394,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.208685+0000","last_change":"2024-09-19T06:37:08.448303+0000","last_active":"2024-09-19T06:46:23.208685+0000","last_peered":"2024-09-19T06:46:23.208685+0000","last_clean":"2024-09-19T06:46:23.208685+0000","last_became_active":"2024-09-19T06:37:08.447559+0000","last_became_peered":"2024-09-19T06:37:08.447559+0000","last_unstale":"2024-09-19T06:46:23.208685+0000","last_undegraded":"2024-09-19T06:46:23.208685+0000","last_fullsized":"2024-09-19T06:46:23.208685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:43.093216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":35254,"num_write":321,"num_write_kb":8395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'7","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565135+0000","last_change":"2024-09-19T06:37:09.445971+0000","last_active":"2024-09-19T06:46:00.565135+0000","last_peered":"2024-09-19T06:46:00.565135+0000","last_clean":"2024-09-19T06:46:00.565135+0000","last_became_active":"2024-09-19T06:37:09.444806+0000","last_became_peered":"2024-09-19T06:37:09.444806+0000","last_unstale":"2024-09-19T06:46:00.565135+0000","last_undegraded":"2024-09-19T06:46:00.565135+0000","last_fullsized":"2024-09-19T06:46:00.565135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:15.765835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4729","reported_seq":4809,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.336466+0000","last_change":"2024-09-19T06:37:13.459035+0000","last_active":"2024-09-19T06:46:24.336466+0000","last_peered":"2024-09-19T06:46:24.336466+0000","last_clean":"2024-09-19T06:46:24.336466+0000","last_became_active":"2024-09-19T06:37:13.458588+0000","last_became_peered":"2024-09-19T06:37:13.458588+0000","last_unstale":"2024-09-19T06:46:24.336466+0000","last_undegraded":"2024-09-19T06:46:24.336466+0000","last_fullsized":"2024-09-19T06:46:24.336466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4729,"log_dups_size":0,"ondisk_log_size":4729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:27.900054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373310089,"num_objects":99,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":47,"num_read_kb":0,"num_write":68497,"num_write_kb":860659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.184523+0000","last_change":"2024-09-19T06:37:08.446363+0000","last_active":"2024-09-19T06:46:23.184523+0000","last_peered":"2024-09-19T06:46:23.184523+0000","last_clean":"2024-09-19T06:46:23.184523+0000","last_became_active":"2024-09-19T06:37:08.446053+0000","last_became_peered":"2024-09-19T06:37:08.446053+0000","last_unstale":"2024-09-19T06:46:23.184523+0000","last_undegraded":"2024-09-19T06:46:23.184523+0000","last_fullsized":"2024-09-19T06:46:23.184523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:22.488347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"34'7","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.403973+0000","last_change":"2024-09-19T06:37:09.445124+0000","last_active":"2024-09-19T06:46:23.403973+0000","last_peered":"2024-09-19T06:46:23.403973+0000","last_clean":"2024-09-19T06:46:23.403973+0000","last_became_active":"2024-09-19T06:37:09.444824+0000","last_became_peered":"2024-09-19T06:37:09.444824+0000","last_unstale":"2024-09-19T06:46:23.403973+0000","last_undegraded":"2024-09-19T06:46:23.403973+0000","last_fullsized":"2024-09-19T06:46:23.403973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:40:05.642055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'4073","reported_seq":4133,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.075830+0000","last_change":"2024-09-19T06:37:13.459720+0000","last_active":"2024-09-19T06:46:24.075830+0000","last_peered":"2024-09-19T06:46:24.075830+0000","last_clean":"2024-09-19T06:46:24.075830+0000","last_became_active":"2024-09-19T06:37:13.459350+0000","last_became_peered":"2024-09-19T06:37:13.459350+0000","last_unstale":"2024-09-19T06:46:24.075830+0000","last_undegraded":"2024-09-19T06:46:24.075830+0000","last_fullsized":"2024-09-19T06:46:24.075830+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4073,"log_dups_size":0,"ondisk_log_size":4073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:29.546976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327179682,"num_objects":82,"num_object_clones":0,"num_object_copies":328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":59441,"num_write_kb":744923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.941540+0000","last_change":"2024-09-19T06:37:09.447795+0000","last_active":"2024-09-19T06:46:01.941540+0000","last_peered":"2024-09-19T06:46:01.941540+0000","last_clean":"2024-09-19T06:46:01.941540+0000","last_became_active":"2024-09-19T06:37:09.447502+0000","last_became_peered":"2024-09-19T06:37:09.447502+0000","last_unstale":"2024-09-19T06:46:01.941540+0000","last_undegraded":"2024-09-19T06:46:01.941540+0000","last_fullsized":"2024-09-19T06:46:01.941540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:51.384743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"34'578","reported_seq":631,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:12.370895+0000","last_change":"2024-09-19T06:37:08.446179+0000","last_active":"2024-09-19T06:46:12.370895+0000","last_peered":"2024-09-19T06:46:12.370895+0000","last_clean":"2024-09-19T06:46:12.370895+0000","last_became_active":"2024-09-19T06:37:08.445834+0000","last_became_peered":"2024-09-19T06:37:08.445834+0000","last_unstale":"2024-09-19T06:46:12.370895+0000","last_undegraded":"2024-09-19T06:46:12.370895+0000","last_fullsized":"2024-09-19T06:46:12.370895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:03.783414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":20492,"num_write":569,"num_write_kb":4620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"34'4836","reported_seq":4898,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.897304+0000","last_change":"2024-09-19T06:37:13.460344+0000","last_active":"2024-09-19T06:46:23.897304+0000","last_peered":"2024-09-19T06:46:23.897304+0000","last_clean":"2024-09-19T06:46:23.897304+0000","last_became_active":"2024-09-19T06:37:13.459967+0000","last_became_peered":"2024-09-19T06:37:13.459967+0000","last_unstale":"2024-09-19T06:46:23.897304+0000","last_undegraded":"2024-09-19T06:46:23.897304+0000","last_fullsized":"2024-09-19T06:46:23.897304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4836,"log_dups_size":0,"ondisk_log_size":4836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:59.096218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390215220,"num_objects":100,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":70072,"num_write_kb":882801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.628489+0000","last_change":"2024-09-19T06:37:09.449884+0000","last_active":"2024-09-19T06:46:05.628489+0000","last_peered":"2024-09-19T06:46:05.628489+0000","last_clean":"2024-09-19T06:46:05.628489+0000","last_became_active":"2024-09-19T06:37:09.449645+0000","last_became_peered":"2024-09-19T06:37:09.449645+0000","last_unstale":"2024-09-19T06:46:05.628489+0000","last_undegraded":"2024-09-19T06:46:05.628489+0000","last_fullsized":"2024-09-19T06:46:05.628489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:07.353098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.408189+0000","last_change":"2024-09-19T06:37:08.437022+0000","last_active":"2024-09-19T06:46:01.408189+0000","last_peered":"2024-09-19T06:46:01.408189+0000","last_clean":"2024-09-19T06:46:01.408189+0000","last_became_active":"2024-09-19T06:37:08.436761+0000","last_became_peered":"2024-09-19T06:37:08.436761+0000","last_unstale":"2024-09-19T06:46:01.408189+0000","last_undegraded":"2024-09-19T06:46:01.408189+0000","last_fullsized":"2024-09-19T06:46:01.408189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:04.985581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'5008","reported_seq":5093,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.367571+0000","last_change":"2024-09-19T06:37:51.782710+0000","last_active":"2024-09-19T06:46:24.367571+0000","last_peered":"2024-09-19T06:46:24.367571+0000","last_clean":"2024-09-19T06:46:24.367571+0000","last_became_active":"2024-09-19T06:37:51.782257+0000","last_became_peered":"2024-09-19T06:37:51.782257+0000","last_unstale":"2024-09-19T06:46:24.367571+0000","last_undegraded":"2024-09-19T06:46:24.367571+0000","last_fullsized":"2024-09-19T06:46:24.367571+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5008,"log_dups_size":0,"ondisk_log_size":5008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:17:15.241783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385899096,"num_objects":101,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":44,"num_read_kb":0,"num_write":72255,"num_write_kb":909964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562671+0000","last_change":"2024-09-19T06:37:09.433042+0000","last_active":"2024-09-19T06:46:00.562671+0000","last_peered":"2024-09-19T06:46:00.562671+0000","last_clean":"2024-09-19T06:46:00.562671+0000","last_became_active":"2024-09-19T06:37:09.432589+0000","last_became_peered":"2024-09-19T06:37:09.432589+0000","last_unstale":"2024-09-19T06:46:00.562671+0000","last_undegraded":"2024-09-19T06:46:00.562671+0000","last_fullsized":"2024-09-19T06:46:00.562671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:18.661071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.407761+0000","last_change":"2024-09-19T06:37:08.444408+0000","last_active":"2024-09-19T06:46:01.407761+0000","last_peered":"2024-09-19T06:46:01.407761+0000","last_clean":"2024-09-19T06:46:01.407761+0000","last_became_active":"2024-09-19T06:37:08.444160+0000","last_became_peered":"2024-09-19T06:37:08.444160+0000","last_unstale":"2024-09-19T06:46:01.407761+0000","last_undegraded":"2024-09-19T06:46:01.407761+0000","last_fullsized":"2024-09-19T06:46:01.407761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:54.304153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"34'5580","reported_seq":5655,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.161310+0000","last_change":"2024-09-19T06:37:13.466175+0000","last_active":"2024-09-19T06:46:24.161310+0000","last_peered":"2024-09-19T06:46:24.161310+0000","last_clean":"2024-09-19T06:46:24.161310+0000","last_became_active":"2024-09-19T06:37:13.465731+0000","last_became_peered":"2024-09-19T06:37:13.465731+0000","last_unstale":"2024-09-19T06:46:24.161310+0000","last_undegraded":"2024-09-19T06:46:24.161310+0000","last_fullsized":"2024-09-19T06:46:24.161310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5580,"log_dups_size":0,"ondisk_log_size":5580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:01.100164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432110707,"num_objects":108,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":81171,"num_write_kb":1030279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.951476+0000","last_change":"2024-09-19T06:37:09.437254+0000","last_active":"2024-09-19T06:46:01.951476+0000","last_peered":"2024-09-19T06:46:01.951476+0000","last_clean":"2024-09-19T06:46:01.951476+0000","last_became_active":"2024-09-19T06:37:09.436512+0000","last_became_peered":"2024-09-19T06:37:09.436512+0000","last_unstale":"2024-09-19T06:46:01.951476+0000","last_undegraded":"2024-09-19T06:46:01.951476+0000","last_fullsized":"2024-09-19T06:46:01.951476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:21.893793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"33'797","reported_seq":844,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564196+0000","last_change":"2024-09-19T06:37:08.446216+0000","last_active":"2024-09-19T06:46:00.564196+0000","last_peered":"2024-09-19T06:46:00.564196+0000","last_clean":"2024-09-19T06:46:00.564196+0000","last_became_active":"2024-09-19T06:37:08.445845+0000","last_became_peered":"2024-09-19T06:37:08.445845+0000","last_unstale":"2024-09-19T06:46:00.564196+0000","last_undegraded":"2024-09-19T06:46:00.564196+0000","last_fullsized":"2024-09-19T06:46:00.564196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:04.033283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":8706,"num_write":792,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"34'4170","reported_seq":4237,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.823142+0000","last_change":"2024-09-19T06:37:13.462192+0000","last_active":"2024-09-19T06:46:23.823142+0000","last_peered":"2024-09-19T06:46:23.823142+0000","last_clean":"2024-09-19T06:46:23.823142+0000","last_became_active":"2024-09-19T06:37:13.460955+0000","last_became_peered":"2024-09-19T06:37:13.460955+0000","last_unstale":"2024-09-19T06:46:23.823142+0000","last_undegraded":"2024-09-19T06:46:23.823142+0000","last_fullsized":"2024-09-19T06:46:23.823142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4170,"log_dups_size":0,"ondisk_log_size":4170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:53.583488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352537253,"num_objects":94,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":60526,"num_write_kb":751027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950855+0000","last_change":"2024-09-19T06:37:09.445989+0000","last_active":"2024-09-19T06:46:01.950855+0000","last_peered":"2024-09-19T06:46:01.950855+0000","last_clean":"2024-09-19T06:46:01.950855+0000","last_became_active":"2024-09-19T06:37:09.445705+0000","last_became_peered":"2024-09-19T06:37:09.445705+0000","last_unstale":"2024-09-19T06:46:01.950855+0000","last_undegraded":"2024-09-19T06:46:01.950855+0000","last_fullsized":"2024-09-19T06:46:01.950855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:24.592460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.189422+0000","last_change":"2024-09-19T06:37:08.446226+0000","last_active":"2024-09-19T06:46:23.189422+0000","last_peered":"2024-09-19T06:46:23.189422+0000","last_clean":"2024-09-19T06:46:23.189422+0000","last_became_active":"2024-09-19T06:37:08.445929+0000","last_became_peered":"2024-09-19T06:37:08.445929+0000","last_unstale":"2024-09-19T06:46:23.189422+0000","last_undegraded":"2024-09-19T06:46:23.189422+0000","last_fullsized":"2024-09-19T06:46:23.189422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:32.233033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"34'4917","reported_seq":4992,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.329970+0000","last_change":"2024-09-19T06:37:13.462598+0000","last_active":"2024-09-19T06:46:24.329970+0000","last_peered":"2024-09-19T06:46:24.329970+0000","last_clean":"2024-09-19T06:46:24.329970+0000","last_became_active":"2024-09-19T06:37:13.462217+0000","last_became_peered":"2024-09-19T06:37:13.462217+0000","last_unstale":"2024-09-19T06:46:24.329970+0000","last_undegraded":"2024-09-19T06:46:24.329970+0000","last_fullsized":"2024-09-19T06:46:24.329970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4917,"log_dups_size":0,"ondisk_log_size":4917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:04.109419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390081596,"num_objects":96,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":71632,"num_write_kb":902613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'10","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.563792+0000","last_change":"2024-09-19T06:37:09.434309+0000","last_active":"2024-09-19T06:46:00.563792+0000","last_peered":"2024-09-19T06:46:00.563792+0000","last_clean":"2024-09-19T06:46:00.563792+0000","last_became_active":"2024-09-19T06:37:09.433897+0000","last_became_peered":"2024-09-19T06:37:09.433897+0000","last_unstale":"2024-09-19T06:46:00.563792+0000","last_undegraded":"2024-09-19T06:46:00.563792+0000","last_fullsized":"2024-09-19T06:46:00.563792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:59.054484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"34'164","reported_seq":212,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.577973+0000","last_change":"2024-09-19T06:37:08.441525+0000","last_active":"2024-09-19T06:46:05.577973+0000","last_peered":"2024-09-19T06:46:05.577973+0000","last_clean":"2024-09-19T06:46:05.577973+0000","last_became_active":"2024-09-19T06:37:08.441245+0000","last_became_peered":"2024-09-19T06:37:08.441245+0000","last_unstale":"2024-09-19T06:46:05.577973+0000","last_undegraded":"2024-09-19T06:46:05.577973+0000","last_fullsized":"2024-09-19T06:46:05.577973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:19.820705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":67,"num_write":354,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"34'5329","reported_seq":5406,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:30.401844+0000","last_change":"2024-09-19T06:37:13.468486+0000","last_active":"2024-09-19T06:46:30.401844+0000","last_peered":"2024-09-19T06:46:30.401844+0000","last_clean":"2024-09-19T06:46:30.401844+0000","last_became_active":"2024-09-19T06:37:13.468074+0000","last_became_peered":"2024-09-19T06:37:13.468074+0000","last_unstale":"2024-09-19T06:46:30.401844+0000","last_undegraded":"2024-09-19T06:46:30.401844+0000","last_fullsized":"2024-09-19T06:46:30.401844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5329,"log_dups_size":0,"ondisk_log_size":5329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:36.783781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373307759,"num_objects":95,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":78196,"num_write_kb":979369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.408530+0000","last_change":"2024-09-19T06:37:09.435864+0000","last_active":"2024-09-19T06:46:01.408530+0000","last_peered":"2024-09-19T06:46:01.408530+0000","last_clean":"2024-09-19T06:46:01.408530+0000","last_became_active":"2024-09-19T06:37:09.435597+0000","last_became_peered":"2024-09-19T06:37:09.435597+0000","last_unstale":"2024-09-19T06:46:01.408530+0000","last_undegraded":"2024-09-19T06:46:01.408530+0000","last_fullsized":"2024-09-19T06:46:01.408530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:20.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.566013+0000","last_change":"2024-09-19T06:37:08.447931+0000","last_active":"2024-09-19T06:46:00.566013+0000","last_peered":"2024-09-19T06:46:00.566013+0000","last_clean":"2024-09-19T06:46:00.566013+0000","last_became_active":"2024-09-19T06:37:08.447630+0000","last_became_peered":"2024-09-19T06:37:08.447630+0000","last_unstale":"2024-09-19T06:46:00.566013+0000","last_undegraded":"2024-09-19T06:46:00.566013+0000","last_fullsized":"2024-09-19T06:46:00.566013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:17.375740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"34'4467","reported_seq":4540,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:31.131115+0000","last_change":"2024-09-19T06:37:13.468360+0000","last_active":"2024-09-19T06:46:31.131115+0000","last_peered":"2024-09-19T06:46:31.131115+0000","last_clean":"2024-09-19T06:46:31.131115+0000","last_became_active":"2024-09-19T06:37:13.467926+0000","last_became_peered":"2024-09-19T06:37:13.467926+0000","last_unstale":"2024-09-19T06:46:31.131115+0000","last_undegraded":"2024-09-19T06:46:31.131115+0000","last_fullsized":"2024-09-19T06:46:31.131115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4467,"log_dups_size":0,"ondisk_log_size":4467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:55.089630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276833139,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":64756,"num_write_kb":802716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"34'10","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.190431+0000","last_change":"2024-09-19T06:37:09.441678+0000","last_active":"2024-09-19T06:46:23.190431+0000","last_peered":"2024-09-19T06:46:23.190431+0000","last_clean":"2024-09-19T06:46:23.190431+0000","last_became_active":"2024-09-19T06:37:09.441406+0000","last_became_peered":"2024-09-19T06:37:09.441406+0000","last_unstale":"2024-09-19T06:46:23.190431+0000","last_undegraded":"2024-09-19T06:46:23.190431+0000","last_fullsized":"2024-09-19T06:46:23.190431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:14.638004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"29'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.408645+0000","last_change":"2024-09-19T06:37:08.438805+0000","last_active":"2024-09-19T06:46:01.408645+0000","last_peered":"2024-09-19T06:46:01.408645+0000","last_clean":"2024-09-19T06:46:01.408645+0000","last_became_active":"2024-09-19T06:37:08.438528+0000","last_became_peered":"2024-09-19T06:37:08.438528+0000","last_unstale":"2024-09-19T06:46:01.408645+0000","last_undegraded":"2024-09-19T06:46:01.408645+0000","last_fullsized":"2024-09-19T06:46:01.408645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:55.500347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'5386","reported_seq":5451,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.372613+0000","last_change":"2024-09-19T06:37:13.459697+0000","last_active":"2024-09-19T06:46:23.372613+0000","last_peered":"2024-09-19T06:46:23.372613+0000","last_clean":"2024-09-19T06:46:23.372613+0000","last_became_active":"2024-09-19T06:37:13.459303+0000","last_became_peered":"2024-09-19T06:37:13.459303+0000","last_unstale":"2024-09-19T06:46:23.372613+0000","last_undegraded":"2024-09-19T06:46:23.372613+0000","last_fullsized":"2024-09-19T06:46:23.372613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5386,"log_dups_size":0,"ondisk_log_size":5386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:01.695905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":453003691,"num_objects":111,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":78968,"num_write_kb":992273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.951577+0000","last_change":"2024-09-19T06:37:09.449701+0000","last_active":"2024-09-19T06:46:01.951577+0000","last_peered":"2024-09-19T06:46:01.951577+0000","last_clean":"2024-09-19T06:46:01.951577+0000","last_became_active":"2024-09-19T06:37:09.448899+0000","last_became_peered":"2024-09-19T06:37:09.448899+0000","last_unstale":"2024-09-19T06:46:01.951577+0000","last_undegraded":"2024-09-19T06:46:01.951577+0000","last_fullsized":"2024-09-19T06:46:01.951577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:17.448251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"34'198","reported_seq":243,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.603626+0000","last_change":"2024-09-19T06:37:08.434263+0000","last_active":"2024-09-19T06:46:05.603626+0000","last_peered":"2024-09-19T06:46:05.603626+0000","last_clean":"2024-09-19T06:46:05.603626+0000","last_became_active":"2024-09-19T06:37:08.433984+0000","last_became_peered":"2024-09-19T06:37:08.433984+0000","last_unstale":"2024-09-19T06:46:05.603626+0000","last_undegraded":"2024-09-19T06:46:05.603626+0000","last_fullsized":"2024-09-19T06:46:05.603626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:05.599054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":190,"num_write_kb":4204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"34'4452","reported_seq":4525,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.151962+0000","last_change":"2024-09-19T06:37:13.464527+0000","last_active":"2024-09-19T06:46:24.151962+0000","last_peered":"2024-09-19T06:46:24.151962+0000","last_clean":"2024-09-19T06:46:24.151962+0000","last_became_active":"2024-09-19T06:37:13.461685+0000","last_became_peered":"2024-09-19T06:37:13.461685+0000","last_unstale":"2024-09-19T06:46:24.151962+0000","last_undegraded":"2024-09-19T06:46:24.151962+0000","last_fullsized":"2024-09-19T06:46:24.151962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4452,"log_dups_size":0,"ondisk_log_size":4452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:57.229892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356592787,"num_objects":91,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":65349,"num_write_kb":836807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'11","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.408137+0000","last_change":"2024-09-19T06:37:09.434421+0000","last_active":"2024-09-19T06:46:01.408137+0000","last_peered":"2024-09-19T06:46:01.408137+0000","last_clean":"2024-09-19T06:46:01.408137+0000","last_became_active":"2024-09-19T06:37:09.434119+0000","last_became_peered":"2024-09-19T06:37:09.434119+0000","last_unstale":"2024-09-19T06:46:01.408137+0000","last_undegraded":"2024-09-19T06:46:01.408137+0000","last_fullsized":"2024-09-19T06:46:01.408137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:56.984336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"34'27","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:31.167644+0000","last_change":"2024-09-19T06:37:08.436856+0000","last_active":"2024-09-19T06:46:31.167644+0000","last_peered":"2024-09-19T06:46:31.167644+0000","last_clean":"2024-09-19T06:46:31.167644+0000","last_became_active":"2024-09-19T06:37:08.435718+0000","last_became_peered":"2024-09-19T06:37:08.435718+0000","last_unstale":"2024-09-19T06:46:31.167644+0000","last_undegraded":"2024-09-19T06:46:31.167644+0000","last_fullsized":"2024-09-19T06:46:31.167644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:58.650430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94269,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":146,"num_write":23,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'5155","reported_seq":5231,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.003595+0000","last_change":"2024-09-19T06:37:13.466081+0000","last_active":"2024-09-19T06:46:24.003595+0000","last_peered":"2024-09-19T06:46:24.003595+0000","last_clean":"2024-09-19T06:46:24.003595+0000","last_became_active":"2024-09-19T06:37:13.465348+0000","last_became_peered":"2024-09-19T06:37:13.465348+0000","last_unstale":"2024-09-19T06:46:24.003595+0000","last_undegraded":"2024-09-19T06:46:24.003595+0000","last_fullsized":"2024-09-19T06:46:24.003595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5155,"log_dups_size":0,"ondisk_log_size":5155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:11.592737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432066503,"num_objects":110,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":75839,"num_write_kb":952671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950025+0000","last_change":"2024-09-19T06:37:09.444888+0000","last_active":"2024-09-19T06:46:01.950025+0000","last_peered":"2024-09-19T06:46:01.950025+0000","last_clean":"2024-09-19T06:46:01.950025+0000","last_became_active":"2024-09-19T06:37:09.444605+0000","last_became_peered":"2024-09-19T06:37:09.444605+0000","last_unstale":"2024-09-19T06:46:01.950025+0000","last_undegraded":"2024-09-19T06:46:01.950025+0000","last_fullsized":"2024-09-19T06:46:01.950025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:53.868356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'43","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.589711+0000","last_change":"2024-09-19T06:37:08.446760+0000","last_active":"2024-09-19T06:46:05.589711+0000","last_peered":"2024-09-19T06:46:05.589711+0000","last_clean":"2024-09-19T06:46:05.589711+0000","last_became_active":"2024-09-19T06:37:08.446474+0000","last_became_peered":"2024-09-19T06:37:08.446474+0000","last_unstale":"2024-09-19T06:46:05.589711+0000","last_undegraded":"2024-09-19T06:46:05.589711+0000","last_fullsized":"2024-09-19T06:46:05.589711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:12.597952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":38,"num_write_kb":8207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"34'4322","reported_seq":4398,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:31.359497+0000","last_change":"2024-09-19T06:37:13.471220+0000","last_active":"2024-09-19T06:46:31.359497+0000","last_peered":"2024-09-19T06:46:31.359497+0000","last_clean":"2024-09-19T06:46:31.359497+0000","last_became_active":"2024-09-19T06:37:13.470860+0000","last_became_peered":"2024-09-19T06:37:13.470860+0000","last_unstale":"2024-09-19T06:46:31.359497+0000","last_undegraded":"2024-09-19T06:46:31.359497+0000","last_fullsized":"2024-09-19T06:46:31.359497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4322,"log_dups_size":0,"ondisk_log_size":4322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:07.659583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":294034242,"num_objects":76,"num_object_clones":0,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":62630,"num_write_kb":794606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562847+0000","last_change":"2024-09-19T06:37:09.440366+0000","last_active":"2024-09-19T06:46:00.562847+0000","last_peered":"2024-09-19T06:46:00.562847+0000","last_clean":"2024-09-19T06:46:00.562847+0000","last_became_active":"2024-09-19T06:37:09.439478+0000","last_became_peered":"2024-09-19T06:37:09.439478+0000","last_unstale":"2024-09-19T06:46:00.562847+0000","last_undegraded":"2024-09-19T06:46:00.562847+0000","last_fullsized":"2024-09-19T06:46:00.562847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:21.837351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564567+0000","last_change":"2024-09-19T06:37:08.435473+0000","last_active":"2024-09-19T06:46:00.564567+0000","last_peered":"2024-09-19T06:46:00.564567+0000","last_clean":"2024-09-19T06:46:00.564567+0000","last_became_active":"2024-09-19T06:37:08.435183+0000","last_became_peered":"2024-09-19T06:37:08.435183+0000","last_unstale":"2024-09-19T06:46:00.564567+0000","last_undegraded":"2024-09-19T06:46:00.564567+0000","last_fullsized":"2024-09-19T06:46:00.564567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:53.115010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":198,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564274+0000","last_change":"2024-09-19T06:36:58.829099+0000","last_active":"2024-09-19T06:46:00.564274+0000","last_peered":"2024-09-19T06:46:00.564274+0000","last_clean":"2024-09-19T06:46:00.564274+0000","last_became_active":"2024-09-19T06:36:58.828079+0000","last_became_peered":"2024-09-19T06:36:58.828079+0000","last_unstale":"2024-09-19T06:46:00.564274+0000","last_undegraded":"2024-09-19T06:46:00.564274+0000","last_fullsized":"2024-09-19T06:46:00.564274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:36:57.771085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:36:57.771085+0000","last_clean_scrub_stamp":"2024-09-19T06:36:57.771085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:14.663925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"34'4740","reported_seq":4802,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:30.922251+0000","last_change":"2024-09-19T06:37:13.464435+0000","last_active":"2024-09-19T06:46:30.922251+0000","last_peered":"2024-09-19T06:46:30.922251+0000","last_clean":"2024-09-19T06:46:30.922251+0000","last_became_active":"2024-09-19T06:37:13.464101+0000","last_became_peered":"2024-09-19T06:37:13.464101+0000","last_unstale":"2024-09-19T06:46:30.922251+0000","last_undegraded":"2024-09-19T06:46:30.922251+0000","last_fullsized":"2024-09-19T06:46:30.922251+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4740,"log_dups_size":0,"ondisk_log_size":4740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:30.073937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339748356,"num_objects":86,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":68930,"num_write_kb":870393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565768+0000","last_change":"2024-09-19T06:37:09.442774+0000","last_active":"2024-09-19T06:46:00.565768+0000","last_peered":"2024-09-19T06:46:00.565768+0000","last_clean":"2024-09-19T06:46:00.565768+0000","last_became_active":"2024-09-19T06:37:09.442515+0000","last_became_peered":"2024-09-19T06:37:09.442515+0000","last_unstale":"2024-09-19T06:46:00.565768+0000","last_undegraded":"2024-09-19T06:46:00.565768+0000","last_fullsized":"2024-09-19T06:46:00.565768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:57.376059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.877516+0000","last_change":"2024-09-19T06:37:08.438038+0000","last_active":"2024-09-19T06:46:01.877516+0000","last_peered":"2024-09-19T06:46:01.877516+0000","last_clean":"2024-09-19T06:46:01.877516+0000","last_became_active":"2024-09-19T06:37:08.437771+0000","last_became_peered":"2024-09-19T06:37:08.437771+0000","last_unstale":"2024-09-19T06:46:01.877516+0000","last_undegraded":"2024-09-19T06:46:01.877516+0000","last_fullsized":"2024-09-19T06:46:01.877516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:07.210382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"34'4799","reported_seq":4874,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:30.687597+0000","last_change":"2024-09-19T06:37:51.782418+0000","last_active":"2024-09-19T06:46:30.687597+0000","last_peered":"2024-09-19T06:46:30.687597+0000","last_clean":"2024-09-19T06:46:30.687597+0000","last_became_active":"2024-09-19T06:37:51.781963+0000","last_became_peered":"2024-09-19T06:37:51.781963+0000","last_unstale":"2024-09-19T06:46:30.687597+0000","last_undegraded":"2024-09-19T06:46:30.687597+0000","last_fullsized":"2024-09-19T06:46:30.687597+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4799,"log_dups_size":0,"ondisk_log_size":4799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:12:05.227644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289408937,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":69491,"num_write_kb":883742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565121+0000","last_change":"2024-09-19T06:37:09.442213+0000","last_active":"2024-09-19T06:46:00.565121+0000","last_peered":"2024-09-19T06:46:00.565121+0000","last_clean":"2024-09-19T06:46:00.565121+0000","last_became_active":"2024-09-19T06:37:09.441850+0000","last_became_peered":"2024-09-19T06:37:09.441850+0000","last_unstale":"2024-09-19T06:46:00.565121+0000","last_undegraded":"2024-09-19T06:46:00.565121+0000","last_fullsized":"2024-09-19T06:46:00.565121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:43.728914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"34'158","reported_seq":208,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.217854+0000","last_change":"2024-09-19T06:37:08.431703+0000","last_active":"2024-09-19T06:46:23.217854+0000","last_peered":"2024-09-19T06:46:23.217854+0000","last_clean":"2024-09-19T06:46:23.217854+0000","last_became_active":"2024-09-19T06:37:08.431443+0000","last_became_peered":"2024-09-19T06:37:08.431443+0000","last_unstale":"2024-09-19T06:46:23.217854+0000","last_undegraded":"2024-09-19T06:46:23.217854+0000","last_fullsized":"2024-09-19T06:46:23.217854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:02.007521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2390477,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":2297,"num_write":153,"num_write_kb":2408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'4488","reported_seq":4564,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:31.359238+0000","last_change":"2024-09-19T06:37:13.469295+0000","last_active":"2024-09-19T06:46:31.359238+0000","last_peered":"2024-09-19T06:46:31.359238+0000","last_clean":"2024-09-19T06:46:31.359238+0000","last_became_active":"2024-09-19T06:37:13.468879+0000","last_became_peered":"2024-09-19T06:37:13.468879+0000","last_unstale":"2024-09-19T06:46:31.359238+0000","last_undegraded":"2024-09-19T06:46:31.359238+0000","last_fullsized":"2024-09-19T06:46:31.359238+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4488,"log_dups_size":0,"ondisk_log_size":4488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:34.380034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310404404,"num_objects":83,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":65540,"num_write_kb":822050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.566185+0000","last_change":"2024-09-19T06:37:09.439264+0000","last_active":"2024-09-19T06:46:00.566185+0000","last_peered":"2024-09-19T06:46:00.566185+0000","last_clean":"2024-09-19T06:46:00.566185+0000","last_became_active":"2024-09-19T06:37:09.438954+0000","last_became_peered":"2024-09-19T06:37:09.438954+0000","last_unstale":"2024-09-19T06:46:00.566185+0000","last_undegraded":"2024-09-19T06:46:00.566185+0000","last_fullsized":"2024-09-19T06:46:00.566185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:55.094093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"34'7","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.185155+0000","last_change":"2024-09-19T06:37:08.437406+0000","last_active":"2024-09-19T06:46:23.185155+0000","last_peered":"2024-09-19T06:46:23.185155+0000","last_clean":"2024-09-19T06:46:23.185155+0000","last_became_active":"2024-09-19T06:37:08.437093+0000","last_became_peered":"2024-09-19T06:37:08.437093+0000","last_unstale":"2024-09-19T06:46:23.185155+0000","last_undegraded":"2024-09-19T06:46:23.185155+0000","last_fullsized":"2024-09-19T06:46:23.185155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:25.158027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"34'4673","reported_seq":4745,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:30.087201+0000","last_change":"2024-09-19T06:37:13.460116+0000","last_active":"2024-09-19T06:46:30.087201+0000","last_peered":"2024-09-19T06:46:30.087201+0000","last_clean":"2024-09-19T06:46:30.087201+0000","last_became_active":"2024-09-19T06:37:13.459707+0000","last_became_peered":"2024-09-19T06:37:13.459707+0000","last_unstale":"2024-09-19T06:46:30.087201+0000","last_undegraded":"2024-09-19T06:46:30.087201+0000","last_fullsized":"2024-09-19T06:46:30.087201+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4673,"log_dups_size":0,"ondisk_log_size":4673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:02.657115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339758714,"num_objects":85,"num_object_clones":0,"num_object_copies":340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":38,"num_read_kb":0,"num_write":68462,"num_write_kb":859940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565428+0000","last_change":"2024-09-19T06:37:09.442670+0000","last_active":"2024-09-19T06:46:00.565428+0000","last_peered":"2024-09-19T06:46:00.565428+0000","last_clean":"2024-09-19T06:46:00.565428+0000","last_became_active":"2024-09-19T06:37:09.442390+0000","last_became_peered":"2024-09-19T06:37:09.442390+0000","last_unstale":"2024-09-19T06:46:00.565428+0000","last_undegraded":"2024-09-19T06:46:00.565428+0000","last_fullsized":"2024-09-19T06:46:00.565428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:02:26.726663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.577499+0000","last_change":"2024-09-19T06:37:08.437263+0000","last_active":"2024-09-19T06:46:05.577499+0000","last_peered":"2024-09-19T06:46:05.577499+0000","last_clean":"2024-09-19T06:46:05.577499+0000","last_became_active":"2024-09-19T06:37:08.436982+0000","last_became_peered":"2024-09-19T06:37:08.436982+0000","last_unstale":"2024-09-19T06:46:05.577499+0000","last_undegraded":"2024-09-19T06:46:05.577499+0000","last_fullsized":"2024-09-19T06:46:05.577499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:14.895925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"34'4713","reported_seq":4793,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.957548+0000","last_change":"2024-09-19T06:37:51.782712+0000","last_active":"2024-09-19T06:46:23.957548+0000","last_peered":"2024-09-19T06:46:23.957548+0000","last_clean":"2024-09-19T06:46:23.957548+0000","last_became_active":"2024-09-19T06:37:51.781602+0000","last_became_peered":"2024-09-19T06:37:51.781602+0000","last_unstale":"2024-09-19T06:46:23.957548+0000","last_undegraded":"2024-09-19T06:46:23.957548+0000","last_fullsized":"2024-09-19T06:46:23.957548+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4713,"log_dups_size":0,"ondisk_log_size":4713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:24.142942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385955277,"num_objects":96,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":68431,"num_write_kb":854704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3,6],"acting":[4,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'10","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565596+0000","last_change":"2024-09-19T06:37:09.439142+0000","last_active":"2024-09-19T06:46:00.565596+0000","last_peered":"2024-09-19T06:46:00.565596+0000","last_clean":"2024-09-19T06:46:00.565596+0000","last_became_active":"2024-09-19T06:37:09.437717+0000","last_became_peered":"2024-09-19T06:37:09.437717+0000","last_unstale":"2024-09-19T06:46:00.565596+0000","last_undegraded":"2024-09-19T06:46:00.565596+0000","last_fullsized":"2024-09-19T06:46:00.565596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:32.934290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.188288+0000","last_change":"2024-09-19T06:37:08.430649+0000","last_active":"2024-09-19T06:46:23.188288+0000","last_peered":"2024-09-19T06:46:23.188288+0000","last_clean":"2024-09-19T06:46:23.188288+0000","last_became_active":"2024-09-19T06:37:08.430324+0000","last_became_peered":"2024-09-19T06:37:08.430324+0000","last_unstale":"2024-09-19T06:46:23.188288+0000","last_undegraded":"2024-09-19T06:46:23.188288+0000","last_fullsized":"2024-09-19T06:46:23.188288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:56.656357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"34'5183","reported_seq":5253,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:31.243506+0000","last_change":"2024-09-19T06:37:13.463695+0000","last_active":"2024-09-19T06:46:31.243506+0000","last_peered":"2024-09-19T06:46:31.243506+0000","last_clean":"2024-09-19T06:46:31.243506+0000","last_became_active":"2024-09-19T06:37:13.463334+0000","last_became_peered":"2024-09-19T06:37:13.463334+0000","last_unstale":"2024-09-19T06:46:31.243506+0000","last_undegraded":"2024-09-19T06:46:31.243506+0000","last_fullsized":"2024-09-19T06:46:31.243506+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5183,"log_dups_size":0,"ondisk_log_size":5183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:46.991800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":319020833,"num_objects":87,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":75184,"num_write_kb":939459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.379327+0000","last_change":"2024-09-19T06:37:09.450168+0000","last_active":"2024-09-19T06:46:23.379327+0000","last_peered":"2024-09-19T06:46:23.379327+0000","last_clean":"2024-09-19T06:46:23.379327+0000","last_became_active":"2024-09-19T06:37:09.449872+0000","last_became_peered":"2024-09-19T06:37:09.449872+0000","last_unstale":"2024-09-19T06:46:23.379327+0000","last_undegraded":"2024-09-19T06:46:23.379327+0000","last_fullsized":"2024-09-19T06:46:23.379327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:02:28.282840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.941787+0000","last_change":"2024-09-19T06:37:08.442428+0000","last_active":"2024-09-19T06:46:01.941787+0000","last_peered":"2024-09-19T06:46:01.941787+0000","last_clean":"2024-09-19T06:46:01.941787+0000","last_became_active":"2024-09-19T06:37:08.442120+0000","last_became_peered":"2024-09-19T06:37:08.442120+0000","last_unstale":"2024-09-19T06:46:01.941787+0000","last_undegraded":"2024-09-19T06:46:01.941787+0000","last_fullsized":"2024-09-19T06:46:01.941787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:48.816822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"34'4868","reported_seq":4949,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:30.419895+0000","last_change":"2024-09-19T06:37:13.471319+0000","last_active":"2024-09-19T06:46:30.419895+0000","last_peered":"2024-09-19T06:46:30.419895+0000","last_clean":"2024-09-19T06:46:30.419895+0000","last_became_active":"2024-09-19T06:37:13.470887+0000","last_became_peered":"2024-09-19T06:37:13.470887+0000","last_unstale":"2024-09-19T06:46:30.419895+0000","last_undegraded":"2024-09-19T06:46:30.419895+0000","last_fullsized":"2024-09-19T06:46:30.419895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4868,"log_dups_size":0,"ondisk_log_size":4868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:21.884985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343992550,"num_objects":88,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":70493,"num_write_kb":907517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'10","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565922+0000","last_change":"2024-09-19T06:37:09.439142+0000","last_active":"2024-09-19T06:46:00.565922+0000","last_peered":"2024-09-19T06:46:00.565922+0000","last_clean":"2024-09-19T06:46:00.565922+0000","last_became_active":"2024-09-19T06:37:09.437635+0000","last_became_peered":"2024-09-19T06:37:09.437635+0000","last_unstale":"2024-09-19T06:46:00.565922+0000","last_undegraded":"2024-09-19T06:46:00.565922+0000","last_fullsized":"2024-09-19T06:46:00.565922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:46.773889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564725+0000","last_change":"2024-09-19T06:37:08.438932+0000","last_active":"2024-09-19T06:46:00.564725+0000","last_peered":"2024-09-19T06:46:00.564725+0000","last_clean":"2024-09-19T06:46:00.564725+0000","last_became_active":"2024-09-19T06:37:08.438405+0000","last_became_peered":"2024-09-19T06:37:08.438405+0000","last_unstale":"2024-09-19T06:46:00.564725+0000","last_undegraded":"2024-09-19T06:46:00.564725+0000","last_fullsized":"2024-09-19T06:46:00.564725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:59.606628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'5166","reported_seq":5246,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:30.689803+0000","last_change":"2024-09-19T06:37:13.459370+0000","last_active":"2024-09-19T06:46:30.689803+0000","last_peered":"2024-09-19T06:46:30.689803+0000","last_clean":"2024-09-19T06:46:30.689803+0000","last_became_active":"2024-09-19T06:37:13.458928+0000","last_became_peered":"2024-09-19T06:37:13.458928+0000","last_unstale":"2024-09-19T06:46:30.689803+0000","last_undegraded":"2024-09-19T06:46:30.689803+0000","last_fullsized":"2024-09-19T06:46:30.689803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5166,"log_dups_size":0,"ondisk_log_size":5166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:00.179404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":344165067,"num_objects":88,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":47,"num_read_kb":0,"num_write":75210,"num_write_kb":949879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'10","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950479+0000","last_change":"2024-09-19T06:37:09.448958+0000","last_active":"2024-09-19T06:46:01.950479+0000","last_peered":"2024-09-19T06:46:01.950479+0000","last_clean":"2024-09-19T06:46:01.950479+0000","last_became_active":"2024-09-19T06:37:09.448697+0000","last_became_peered":"2024-09-19T06:37:09.448697+0000","last_unstale":"2024-09-19T06:46:01.950479+0000","last_undegraded":"2024-09-19T06:46:01.950479+0000","last_fullsized":"2024-09-19T06:46:01.950479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:16.306915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'62","reported_seq":124,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.080571+0000","last_change":"2024-09-19T06:37:08.442685+0000","last_active":"2024-09-19T06:46:23.080571+0000","last_peered":"2024-09-19T06:46:23.080571+0000","last_clean":"2024-09-19T06:46:23.080571+0000","last_became_active":"2024-09-19T06:37:08.442436+0000","last_became_peered":"2024-09-19T06:37:08.442436+0000","last_unstale":"2024-09-19T06:46:23.080571+0000","last_undegraded":"2024-09-19T06:46:23.080571+0000","last_fullsized":"2024-09-19T06:46:23.080571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:09.952733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":32451,"num_write":58,"num_write_kb":8225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"34'4538","reported_seq":4599,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:30.135621+0000","last_change":"2024-09-19T06:37:13.457651+0000","last_active":"2024-09-19T06:46:30.135621+0000","last_peered":"2024-09-19T06:46:30.135621+0000","last_clean":"2024-09-19T06:46:30.135621+0000","last_became_active":"2024-09-19T06:37:13.457246+0000","last_became_peered":"2024-09-19T06:37:13.457246+0000","last_unstale":"2024-09-19T06:46:30.135621+0000","last_undegraded":"2024-09-19T06:46:30.135621+0000","last_fullsized":"2024-09-19T06:46:30.135621+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4538,"log_dups_size":0,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:18.553158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339738624,"num_objects":81,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":66005,"num_write_kb":826143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565529+0000","last_change":"2024-09-19T06:37:09.441212+0000","last_active":"2024-09-19T06:46:00.565529+0000","last_peered":"2024-09-19T06:46:00.565529+0000","last_clean":"2024-09-19T06:46:00.565529+0000","last_became_active":"2024-09-19T06:37:09.440209+0000","last_became_peered":"2024-09-19T06:37:09.440209+0000","last_unstale":"2024-09-19T06:46:00.565529+0000","last_undegraded":"2024-09-19T06:46:00.565529+0000","last_fullsized":"2024-09-19T06:46:00.565529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:52.173784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"34'219","reported_seq":289,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.212226+0000","last_change":"2024-09-19T06:37:08.442615+0000","last_active":"2024-09-19T06:46:23.212226+0000","last_peered":"2024-09-19T06:46:23.212226+0000","last_clean":"2024-09-19T06:46:23.212226+0000","last_became_active":"2024-09-19T06:37:08.442242+0000","last_became_peered":"2024-09-19T06:37:08.442242+0000","last_unstale":"2024-09-19T06:46:23.212226+0000","last_undegraded":"2024-09-19T06:46:23.212226+0000","last_fullsized":"2024-09-19T06:46:23.212226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:23.813400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":49,"num_read_kb":24618,"num_write":215,"num_write_kb":4203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"34'4646","reported_seq":4720,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.330511+0000","last_change":"2024-09-19T06:37:13.464688+0000","last_active":"2024-09-19T06:46:24.330511+0000","last_peered":"2024-09-19T06:46:24.330511+0000","last_clean":"2024-09-19T06:46:24.330511+0000","last_became_active":"2024-09-19T06:37:13.461620+0000","last_became_peered":"2024-09-19T06:37:13.461620+0000","last_unstale":"2024-09-19T06:46:24.330511+0000","last_undegraded":"2024-09-19T06:46:24.330511+0000","last_fullsized":"2024-09-19T06:46:24.330511+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4646,"log_dups_size":0,"ondisk_log_size":4646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:02.928332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369181538,"num_objects":93,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":67687,"num_write_kb":859195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.951250+0000","last_change":"2024-09-19T06:37:09.440021+0000","last_active":"2024-09-19T06:46:01.951250+0000","last_peered":"2024-09-19T06:46:01.951250+0000","last_clean":"2024-09-19T06:46:01.951250+0000","last_became_active":"2024-09-19T06:37:09.437800+0000","last_became_peered":"2024-09-19T06:37:09.437800+0000","last_unstale":"2024-09-19T06:46:01.951250+0000","last_undegraded":"2024-09-19T06:46:01.951250+0000","last_fullsized":"2024-09-19T06:46:01.951250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:51.963097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"34'16","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.204186+0000","last_change":"2024-09-19T06:37:08.434422+0000","last_active":"2024-09-19T06:46:23.204186+0000","last_peered":"2024-09-19T06:46:23.204186+0000","last_clean":"2024-09-19T06:46:23.204186+0000","last_became_active":"2024-09-19T06:37:08.434151+0000","last_became_peered":"2024-09-19T06:37:08.434151+0000","last_unstale":"2024-09-19T06:46:23.204186+0000","last_undegraded":"2024-09-19T06:46:23.204186+0000","last_fullsized":"2024-09-19T06:46:23.204186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:49.540748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":17,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'4787","reported_seq":4869,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.914919+0000","last_change":"2024-09-19T06:37:13.459321+0000","last_active":"2024-09-19T06:46:23.914919+0000","last_peered":"2024-09-19T06:46:23.914919+0000","last_clean":"2024-09-19T06:46:23.914919+0000","last_became_active":"2024-09-19T06:37:13.458924+0000","last_became_peered":"2024-09-19T06:37:13.458924+0000","last_unstale":"2024-09-19T06:46:23.914919+0000","last_undegraded":"2024-09-19T06:46:23.914919+0000","last_fullsized":"2024-09-19T06:46:23.914919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4787,"log_dups_size":0,"ondisk_log_size":4787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:11.428574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":377594865,"num_objects":100,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":49,"num_read_kb":0,"num_write":69701,"num_write_kb":881574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950806+0000","last_change":"2024-09-19T06:37:09.448450+0000","last_active":"2024-09-19T06:46:01.950806+0000","last_peered":"2024-09-19T06:46:01.950806+0000","last_clean":"2024-09-19T06:46:01.950806+0000","last_became_active":"2024-09-19T06:37:09.448173+0000","last_became_peered":"2024-09-19T06:37:09.448173+0000","last_unstale":"2024-09-19T06:46:01.950806+0000","last_undegraded":"2024-09-19T06:46:01.950806+0000","last_fullsized":"2024-09-19T06:46:01.950806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:22.442374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564938+0000","last_change":"2024-09-19T06:37:08.442796+0000","last_active":"2024-09-19T06:46:00.564938+0000","last_peered":"2024-09-19T06:46:00.564938+0000","last_clean":"2024-09-19T06:46:00.564938+0000","last_became_active":"2024-09-19T06:37:08.442126+0000","last_became_peered":"2024-09-19T06:37:08.442126+0000","last_unstale":"2024-09-19T06:46:00.564938+0000","last_undegraded":"2024-09-19T06:46:00.564938+0000","last_fullsized":"2024-09-19T06:46:00.564938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:27.716141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"34'4740","reported_seq":4801,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:30.706478+0000","last_change":"2024-09-19T06:37:13.464100+0000","last_active":"2024-09-19T06:46:30.706478+0000","last_peered":"2024-09-19T06:46:30.706478+0000","last_clean":"2024-09-19T06:46:30.706478+0000","last_became_active":"2024-09-19T06:37:13.462750+0000","last_became_peered":"2024-09-19T06:37:13.462750+0000","last_unstale":"2024-09-19T06:46:30.706478+0000","last_undegraded":"2024-09-19T06:46:30.706478+0000","last_fullsized":"2024-09-19T06:46:30.706478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4740,"log_dups_size":0,"ondisk_log_size":4740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:49.139841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":344001408,"num_objects":89,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":69384,"num_write_kb":873579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'5","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.877347+0000","last_change":"2024-09-19T06:37:51.593841+0000","last_active":"2024-09-19T06:46:01.877347+0000","last_peered":"2024-09-19T06:46:01.877347+0000","last_clean":"2024-09-19T06:46:01.877347+0000","last_became_active":"2024-09-19T06:37:51.593513+0000","last_became_peered":"2024-09-19T06:37:51.593513+0000","last_unstale":"2024-09-19T06:46:01.877347+0000","last_undegraded":"2024-09-19T06:46:01.877347+0000","last_fullsized":"2024-09-19T06:46:01.877347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:08.337914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.942374+0000","last_change":"2024-09-19T06:37:08.439543+0000","last_active":"2024-09-19T06:46:01.942374+0000","last_peered":"2024-09-19T06:46:01.942374+0000","last_clean":"2024-09-19T06:46:01.942374+0000","last_became_active":"2024-09-19T06:37:08.438785+0000","last_became_peered":"2024-09-19T06:37:08.438785+0000","last_unstale":"2024-09-19T06:46:01.942374+0000","last_undegraded":"2024-09-19T06:46:01.942374+0000","last_fullsized":"2024-09-19T06:46:01.942374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:51.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"34'4812","reported_seq":4900,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:30.508451+0000","last_change":"2024-09-19T06:37:13.462327+0000","last_active":"2024-09-19T06:46:30.508451+0000","last_peered":"2024-09-19T06:46:30.508451+0000","last_clean":"2024-09-19T06:46:30.508451+0000","last_became_active":"2024-09-19T06:37:13.461762+0000","last_became_peered":"2024-09-19T06:37:13.461762+0000","last_unstale":"2024-09-19T06:46:30.508451+0000","last_undegraded":"2024-09-19T06:46:30.508451+0000","last_fullsized":"2024-09-19T06:46:30.508451+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4812,"log_dups_size":0,"ondisk_log_size":4812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:26.931537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364934801,"num_objects":93,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":71052,"num_write_kb":900045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'5615","reported_seq":5691,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:31.299252+0000","last_change":"2024-09-19T06:37:13.471309+0000","last_active":"2024-09-19T06:46:31.299252+0000","last_peered":"2024-09-19T06:46:31.299252+0000","last_clean":"2024-09-19T06:46:31.299252+0000","last_became_active":"2024-09-19T06:37:13.470969+0000","last_became_peered":"2024-09-19T06:37:13.470969+0000","last_unstale":"2024-09-19T06:46:31.299252+0000","last_undegraded":"2024-09-19T06:46:31.299252+0000","last_fullsized":"2024-09-19T06:46:31.299252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5615,"log_dups_size":0,"ondisk_log_size":5615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:30.990159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381693066,"num_objects":94,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":81889,"num_write_kb":1028288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.407620+0000","last_change":"2024-09-19T06:37:09.443308+0000","last_active":"2024-09-19T06:46:01.407620+0000","last_peered":"2024-09-19T06:46:01.407620+0000","last_clean":"2024-09-19T06:46:01.407620+0000","last_became_active":"2024-09-19T06:37:09.443069+0000","last_became_peered":"2024-09-19T06:37:09.443069+0000","last_unstale":"2024-09-19T06:46:01.407620+0000","last_undegraded":"2024-09-19T06:46:01.407620+0000","last_fullsized":"2024-09-19T06:46:01.407620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:31:33.708578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"34'28","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.952755+0000","last_change":"2024-09-19T06:37:08.441967+0000","last_active":"2024-09-19T06:46:05.952755+0000","last_peered":"2024-09-19T06:46:05.952755+0000","last_clean":"2024-09-19T06:46:05.952755+0000","last_became_active":"2024-09-19T06:37:08.441698+0000","last_became_peered":"2024-09-19T06:37:08.441698+0000","last_unstale":"2024-09-19T06:46:05.952755+0000","last_undegraded":"2024-09-19T06:46:05.952755+0000","last_fullsized":"2024-09-19T06:46:05.952755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:56.933775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":23,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4739","reported_seq":4812,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:30.894632+0000","last_change":"2024-09-19T06:37:13.470903+0000","last_active":"2024-09-19T06:46:30.894632+0000","last_peered":"2024-09-19T06:46:30.894632+0000","last_clean":"2024-09-19T06:46:30.894632+0000","last_became_active":"2024-09-19T06:37:13.470528+0000","last_became_peered":"2024-09-19T06:37:13.470528+0000","last_unstale":"2024-09-19T06:46:30.894632+0000","last_undegraded":"2024-09-19T06:46:30.894632+0000","last_fullsized":"2024-09-19T06:46:30.894632+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4739,"log_dups_size":0,"ondisk_log_size":4739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:45.999436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339821772,"num_objects":92,"num_object_clones":0,"num_object_copies":368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":69149,"num_write_kb":882580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'14","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562486+0000","last_change":"2024-09-19T06:37:09.448953+0000","last_active":"2024-09-19T06:46:00.562486+0000","last_peered":"2024-09-19T06:46:00.562486+0000","last_clean":"2024-09-19T06:46:00.562486+0000","last_became_active":"2024-09-19T06:37:09.448658+0000","last_became_peered":"2024-09-19T06:37:09.448658+0000","last_unstale":"2024-09-19T06:46:00.562486+0000","last_undegraded":"2024-09-19T06:46:00.562486+0000","last_fullsized":"2024-09-19T06:46:00.562486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:07.333392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562651+0000","last_change":"2024-09-19T06:37:08.440800+0000","last_active":"2024-09-19T06:46:00.562651+0000","last_peered":"2024-09-19T06:46:00.562651+0000","last_clean":"2024-09-19T06:46:00.562651+0000","last_became_active":"2024-09-19T06:37:08.440591+0000","last_became_peered":"2024-09-19T06:37:08.440591+0000","last_unstale":"2024-09-19T06:46:00.562651+0000","last_undegraded":"2024-09-19T06:46:00.562651+0000","last_fullsized":"2024-09-19T06:46:00.562651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:05.540261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'20","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.942090+0000","last_change":"2024-09-19T06:37:08.441268+0000","last_active":"2024-09-19T06:46:01.942090+0000","last_peered":"2024-09-19T06:46:01.942090+0000","last_clean":"2024-09-19T06:46:01.942090+0000","last_became_active":"2024-09-19T06:37:08.440969+0000","last_became_peered":"2024-09-19T06:37:08.440969+0000","last_unstale":"2024-09-19T06:46:01.942090+0000","last_undegraded":"2024-09-19T06:46:01.942090+0000","last_fullsized":"2024-09-19T06:46:01.942090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:59.426336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":18,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950785+0000","last_change":"2024-09-19T06:37:09.444857+0000","last_active":"2024-09-19T06:46:01.950785+0000","last_peered":"2024-09-19T06:46:01.950785+0000","last_clean":"2024-09-19T06:46:01.950785+0000","last_became_active":"2024-09-19T06:37:09.444562+0000","last_became_peered":"2024-09-19T06:37:09.444562+0000","last_unstale":"2024-09-19T06:46:01.950785+0000","last_undegraded":"2024-09-19T06:46:01.950785+0000","last_fullsized":"2024-09-19T06:46:01.950785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:02.470787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"34'3850","reported_seq":3912,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:31.817190+0000","last_change":"2024-09-19T06:37:13.467183+0000","last_active":"2024-09-19T06:46:31.817190+0000","last_peered":"2024-09-19T06:46:31.817190+0000","last_clean":"2024-09-19T06:46:31.817190+0000","last_became_active":"2024-09-19T06:37:13.466765+0000","last_became_peered":"2024-09-19T06:37:13.466765+0000","last_unstale":"2024-09-19T06:46:31.817190+0000","last_undegraded":"2024-09-19T06:46:31.817190+0000","last_fullsized":"2024-09-19T06:46:31.817190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":3850,"log_dups_size":0,"ondisk_log_size":3850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:35.184815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222299839,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":56431,"num_write_kb":718624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'987","reported_seq":1040,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.590330+0000","last_change":"2024-09-19T06:37:08.443993+0000","last_active":"2024-09-19T06:46:05.590330+0000","last_peered":"2024-09-19T06:46:05.590330+0000","last_clean":"2024-09-19T06:46:05.590330+0000","last_became_active":"2024-09-19T06:37:08.443774+0000","last_became_peered":"2024-09-19T06:37:08.443774+0000","last_unstale":"2024-09-19T06:46:05.590330+0000","last_undegraded":"2024-09-19T06:46:05.590330+0000","last_fullsized":"2024-09-19T06:46:05.590330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":987,"log_dups_size":0,"ondisk_log_size":987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:16.005073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":42342,"num_write":985,"num_write_kb":4941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.951295+0000","last_change":"2024-09-19T06:37:09.440258+0000","last_active":"2024-09-19T06:46:01.951295+0000","last_peered":"2024-09-19T06:46:01.951295+0000","last_clean":"2024-09-19T06:46:01.951295+0000","last_became_active":"2024-09-19T06:37:09.438457+0000","last_became_peered":"2024-09-19T06:37:09.438457+0000","last_unstale":"2024-09-19T06:46:01.951295+0000","last_undegraded":"2024-09-19T06:46:01.951295+0000","last_fullsized":"2024-09-19T06:46:01.951295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:24.636340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'5309","reported_seq":5378,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:30.668094+0000","last_change":"2024-09-19T06:37:13.462800+0000","last_active":"2024-09-19T06:46:30.668094+0000","last_peered":"2024-09-19T06:46:30.668094+0000","last_clean":"2024-09-19T06:46:30.668094+0000","last_became_active":"2024-09-19T06:37:13.462393+0000","last_became_peered":"2024-09-19T06:37:13.462393+0000","last_unstale":"2024-09-19T06:46:30.668094+0000","last_undegraded":"2024-09-19T06:46:30.668094+0000","last_fullsized":"2024-09-19T06:46:30.668094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5309,"log_dups_size":0,"ondisk_log_size":5309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:35.901637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402758892,"num_objects":103,"num_object_clones":0,"num_object_copies":412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":77274,"num_write_kb":974522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.941457+0000","last_change":"2024-09-19T06:37:09.450421+0000","last_active":"2024-09-19T06:46:01.941457+0000","last_peered":"2024-09-19T06:46:01.941457+0000","last_clean":"2024-09-19T06:46:01.941457+0000","last_became_active":"2024-09-19T06:37:09.450147+0000","last_became_peered":"2024-09-19T06:37:09.450147+0000","last_unstale":"2024-09-19T06:46:01.941457+0000","last_undegraded":"2024-09-19T06:46:01.941457+0000","last_fullsized":"2024-09-19T06:46:01.941457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:42.949759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'11","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.877114+0000","last_change":"2024-09-19T06:37:09.435131+0000","last_active":"2024-09-19T06:46:01.877114+0000","last_peered":"2024-09-19T06:46:01.877114+0000","last_clean":"2024-09-19T06:46:01.877114+0000","last_became_active":"2024-09-19T06:37:09.434840+0000","last_became_peered":"2024-09-19T06:37:09.434840+0000","last_unstale":"2024-09-19T06:46:01.877114+0000","last_undegraded":"2024-09-19T06:46:01.877114+0000","last_fullsized":"2024-09-19T06:46:01.877114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:20.484554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"34'9","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564649+0000","last_change":"2024-09-19T06:37:09.445196+0000","last_active":"2024-09-19T06:46:00.564649+0000","last_peered":"2024-09-19T06:46:00.564649+0000","last_clean":"2024-09-19T06:46:00.564649+0000","last_became_active":"2024-09-19T06:37:09.444907+0000","last_became_peered":"2024-09-19T06:37:09.444907+0000","last_unstale":"2024-09-19T06:46:00.564649+0000","last_undegraded":"2024-09-19T06:46:00.564649+0000","last_fullsized":"2024-09-19T06:46:00.564649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:17.605675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"34'9","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950683+0000","last_change":"2024-09-19T06:37:09.447966+0000","last_active":"2024-09-19T06:46:01.950683+0000","last_peered":"2024-09-19T06:46:01.950683+0000","last_clean":"2024-09-19T06:46:01.950683+0000","last_became_active":"2024-09-19T06:37:09.447692+0000","last_became_peered":"2024-09-19T06:37:09.447692+0000","last_unstale":"2024-09-19T06:46:01.950683+0000","last_undegraded":"2024-09-19T06:46:01.950683+0000","last_fullsized":"2024-09-19T06:46:01.950683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:01.517824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'7","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.408272+0000","last_change":"2024-09-19T06:37:51.596144+0000","last_active":"2024-09-19T06:46:01.408272+0000","last_peered":"2024-09-19T06:46:01.408272+0000","last_clean":"2024-09-19T06:46:01.408272+0000","last_became_active":"2024-09-19T06:37:51.595875+0000","last_became_peered":"2024-09-19T06:37:51.595875+0000","last_unstale":"2024-09-19T06:46:01.408272+0000","last_undegraded":"2024-09-19T06:46:01.408272+0000","last_fullsized":"2024-09-19T06:46:01.408272+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:30.846248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"28'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.408530+0000","last_change":"2024-09-19T06:37:09.441782+0000","last_active":"2024-09-19T06:46:01.408530+0000","last_peered":"2024-09-19T06:46:01.408530+0000","last_clean":"2024-09-19T06:46:01.408530+0000","last_became_active":"2024-09-19T06:37:09.441456+0000","last_became_peered":"2024-09-19T06:37:09.441456+0000","last_unstale":"2024-09-19T06:46:01.408530+0000","last_undegraded":"2024-09-19T06:46:01.408530+0000","last_fullsized":"2024-09-19T06:46:01.408530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:04:28.458974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"34'5","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.942429+0000","last_change":"2024-09-19T06:37:09.449856+0000","last_active":"2024-09-19T06:46:01.942429+0000","last_peered":"2024-09-19T06:46:01.942429+0000","last_clean":"2024-09-19T06:46:01.942429+0000","last_became_active":"2024-09-19T06:37:09.449562+0000","last_became_peered":"2024-09-19T06:37:09.449562+0000","last_unstale":"2024-09-19T06:46:01.942429+0000","last_undegraded":"2024-09-19T06:46:01.942429+0000","last_fullsized":"2024-09-19T06:46:01.942429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:49.182126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'9","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.563653+0000","last_change":"2024-09-19T06:37:09.438551+0000","last_active":"2024-09-19T06:46:00.563653+0000","last_peered":"2024-09-19T06:46:00.563653+0000","last_clean":"2024-09-19T06:46:00.563653+0000","last_became_active":"2024-09-19T06:37:09.437624+0000","last_became_peered":"2024-09-19T06:37:09.437624+0000","last_unstale":"2024-09-19T06:46:00.563653+0000","last_undegraded":"2024-09-19T06:46:00.563653+0000","last_fullsized":"2024-09-19T06:46:00.563653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:46.565780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564849+0000","last_change":"2024-09-19T06:37:09.438737+0000","last_active":"2024-09-19T06:46:00.564849+0000","last_peered":"2024-09-19T06:46:00.564849+0000","last_clean":"2024-09-19T06:46:00.564849+0000","last_became_active":"2024-09-19T06:37:09.438453+0000","last_became_peered":"2024-09-19T06:37:09.438453+0000","last_unstale":"2024-09-19T06:46:00.564849+0000","last_undegraded":"2024-09-19T06:46:00.564849+0000","last_fullsized":"2024-09-19T06:46:00.564849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.982275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"34'11","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.628456+0000","last_change":"2024-09-19T06:37:09.442093+0000","last_active":"2024-09-19T06:46:05.628456+0000","last_peered":"2024-09-19T06:46:05.628456+0000","last_clean":"2024-09-19T06:46:05.628456+0000","last_became_active":"2024-09-19T06:37:09.439710+0000","last_became_peered":"2024-09-19T06:37:09.439710+0000","last_unstale":"2024-09-19T06:46:05.628456+0000","last_undegraded":"2024-09-19T06:46:05.628456+0000","last_fullsized":"2024-09-19T06:46:05.628456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:02.626854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"34'10","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.877178+0000","last_change":"2024-09-19T06:37:51.593282+0000","last_active":"2024-09-19T06:46:01.877178+0000","last_peered":"2024-09-19T06:46:01.877178+0000","last_clean":"2024-09-19T06:46:01.877178+0000","last_became_active":"2024-09-19T06:37:51.592846+0000","last_became_peered":"2024-09-19T06:37:51.592846+0000","last_unstale":"2024-09-19T06:46:01.877178+0000","last_undegraded":"2024-09-19T06:46:01.877178+0000","last_fullsized":"2024-09-19T06:46:01.877178+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:03:58.694299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"34'9","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:16.398784+0000","last_change":"2024-09-19T06:37:09.449633+0000","last_active":"2024-09-19T06:46:16.398784+0000","last_peered":"2024-09-19T06:46:16.398784+0000","last_clean":"2024-09-19T06:46:16.398784+0000","last_became_active":"2024-09-19T06:37:09.449379+0000","last_became_peered":"2024-09-19T06:37:09.449379+0000","last_unstale":"2024-09-19T06:46:16.398784+0000","last_undegraded":"2024-09-19T06:46:16.398784+0000","last_fullsized":"2024-09-19T06:46:16.398784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:29.565038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:16.123078+0000","last_change":"2024-09-19T06:37:09.447808+0000","last_active":"2024-09-19T06:46:16.123078+0000","last_peered":"2024-09-19T06:46:16.123078+0000","last_clean":"2024-09-19T06:46:16.123078+0000","last_became_active":"2024-09-19T06:37:09.447514+0000","last_became_peered":"2024-09-19T06:37:09.447514+0000","last_unstale":"2024-09-19T06:46:16.123078+0000","last_undegraded":"2024-09-19T06:46:16.123078+0000","last_fullsized":"2024-09-19T06:46:16.123078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:04.653997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'10","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565955+0000","last_change":"2024-09-19T06:37:09.439605+0000","last_active":"2024-09-19T06:46:00.565955+0000","last_peered":"2024-09-19T06:46:00.565955+0000","last_clean":"2024-09-19T06:46:00.565955+0000","last_became_active":"2024-09-19T06:37:09.432601+0000","last_became_peered":"2024-09-19T06:37:09.432601+0000","last_unstale":"2024-09-19T06:46:00.565955+0000","last_undegraded":"2024-09-19T06:46:00.565955+0000","last_fullsized":"2024-09-19T06:46:00.565955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:50.640062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"34'10","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.798212+0000","last_change":"2024-09-19T06:37:09.440268+0000","last_active":"2024-09-19T06:46:23.798212+0000","last_peered":"2024-09-19T06:46:23.798212+0000","last_clean":"2024-09-19T06:46:23.798212+0000","last_became_active":"2024-09-19T06:37:09.439937+0000","last_became_peered":"2024-09-19T06:37:09.439937+0000","last_unstale":"2024-09-19T06:46:23.798212+0000","last_undegraded":"2024-09-19T06:46:23.798212+0000","last_fullsized":"2024-09-19T06:46:23.798212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:32:46.182979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565483+0000","last_change":"2024-09-19T06:37:09.437080+0000","last_active":"2024-09-19T06:46:00.565483+0000","last_peered":"2024-09-19T06:46:00.565483+0000","last_clean":"2024-09-19T06:46:00.565483+0000","last_became_active":"2024-09-19T06:37:09.436752+0000","last_became_peered":"2024-09-19T06:37:09.436752+0000","last_unstale":"2024-09-19T06:46:00.565483+0000","last_undegraded":"2024-09-19T06:46:00.565483+0000","last_fullsized":"2024-09-19T06:46:00.565483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:31.423640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"34'11","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.196400+0000","last_change":"2024-09-19T06:37:09.448942+0000","last_active":"2024-09-19T06:46:23.196400+0000","last_peered":"2024-09-19T06:46:23.196400+0000","last_clean":"2024-09-19T06:46:23.196400+0000","last_became_active":"2024-09-19T06:37:09.448647+0000","last_became_peered":"2024-09-19T06:37:09.448647+0000","last_unstale":"2024-09-19T06:46:23.196400+0000","last_undegraded":"2024-09-19T06:46:23.196400+0000","last_fullsized":"2024-09-19T06:46:23.196400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:49.027909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'10","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.407626+0000","last_change":"2024-09-19T06:37:09.445015+0000","last_active":"2024-09-19T06:46:01.407626+0000","last_peered":"2024-09-19T06:46:01.407626+0000","last_clean":"2024-09-19T06:46:01.407626+0000","last_became_active":"2024-09-19T06:37:09.444737+0000","last_became_peered":"2024-09-19T06:37:09.444737+0000","last_unstale":"2024-09-19T06:46:01.407626+0000","last_undegraded":"2024-09-19T06:46:01.407626+0000","last_fullsized":"2024-09-19T06:46:01.407626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:16.194580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'10","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950483+0000","last_change":"2024-09-19T06:37:09.446025+0000","last_active":"2024-09-19T06:46:01.950483+0000","last_peered":"2024-09-19T06:46:01.950483+0000","last_clean":"2024-09-19T06:46:01.950483+0000","last_became_active":"2024-09-19T06:37:09.445503+0000","last_became_peered":"2024-09-19T06:37:09.445503+0000","last_unstale":"2024-09-19T06:46:01.950483+0000","last_undegraded":"2024-09-19T06:46:01.950483+0000","last_fullsized":"2024-09-19T06:46:01.950483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:30.469995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.563043+0000","last_change":"2024-09-19T06:37:09.441302+0000","last_active":"2024-09-19T06:46:00.563043+0000","last_peered":"2024-09-19T06:46:00.563043+0000","last_clean":"2024-09-19T06:46:00.563043+0000","last_became_active":"2024-09-19T06:37:09.439767+0000","last_became_peered":"2024-09-19T06:37:09.439767+0000","last_unstale":"2024-09-19T06:46:00.563043+0000","last_undegraded":"2024-09-19T06:46:00.563043+0000","last_fullsized":"2024-09-19T06:46:00.563043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:01.038823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.951163+0000","last_change":"2024-09-19T06:37:09.440976+0000","last_active":"2024-09-19T06:46:01.951163+0000","last_peered":"2024-09-19T06:46:01.951163+0000","last_clean":"2024-09-19T06:46:01.951163+0000","last_became_active":"2024-09-19T06:37:09.440702+0000","last_became_peered":"2024-09-19T06:37:09.440702+0000","last_unstale":"2024-09-19T06:46:01.951163+0000","last_undegraded":"2024-09-19T06:46:01.951163+0000","last_fullsized":"2024-09-19T06:46:01.951163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:21.281400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'11","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.942156+0000","last_change":"2024-09-19T06:37:09.442301+0000","last_active":"2024-09-19T06:46:01.942156+0000","last_peered":"2024-09-19T06:46:01.942156+0000","last_clean":"2024-09-19T06:46:01.942156+0000","last_became_active":"2024-09-19T06:37:09.442053+0000","last_became_peered":"2024-09-19T06:37:09.442053+0000","last_unstale":"2024-09-19T06:46:01.942156+0000","last_undegraded":"2024-09-19T06:46:01.942156+0000","last_fullsized":"2024-09-19T06:46:01.942156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:26.189384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'9","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.942136+0000","last_change":"2024-09-19T06:37:09.441525+0000","last_active":"2024-09-19T06:46:01.942136+0000","last_peered":"2024-09-19T06:46:01.942136+0000","last_clean":"2024-09-19T06:46:01.942136+0000","last_became_active":"2024-09-19T06:37:09.441179+0000","last_became_peered":"2024-09-19T06:37:09.441179+0000","last_unstale":"2024-09-19T06:46:01.942136+0000","last_undegraded":"2024-09-19T06:46:01.942136+0000","last_fullsized":"2024-09-19T06:46:01.942136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:47.235113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'10","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.566138+0000","last_change":"2024-09-19T06:37:09.437163+0000","last_active":"2024-09-19T06:46:00.566138+0000","last_peered":"2024-09-19T06:46:00.566138+0000","last_clean":"2024-09-19T06:46:00.566138+0000","last_became_active":"2024-09-19T06:37:09.436892+0000","last_became_peered":"2024-09-19T06:37:09.436892+0000","last_unstale":"2024-09-19T06:46:00.566138+0000","last_undegraded":"2024-09-19T06:46:00.566138+0000","last_fullsized":"2024-09-19T06:46:00.566138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:47:58.347385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562140+0000","last_change":"2024-09-19T06:37:09.437524+0000","last_active":"2024-09-19T06:46:00.562140+0000","last_peered":"2024-09-19T06:46:00.562140+0000","last_clean":"2024-09-19T06:46:00.562140+0000","last_became_active":"2024-09-19T06:37:09.437023+0000","last_became_peered":"2024-09-19T06:37:09.437023+0000","last_unstale":"2024-09-19T06:46:00.562140+0000","last_undegraded":"2024-09-19T06:46:00.562140+0000","last_fullsized":"2024-09-19T06:46:00.562140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:31.398914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565598+0000","last_change":"2024-09-19T06:37:09.448814+0000","last_active":"2024-09-19T06:46:00.565598+0000","last_peered":"2024-09-19T06:46:00.565598+0000","last_clean":"2024-09-19T06:46:00.565598+0000","last_became_active":"2024-09-19T06:37:09.448547+0000","last_became_peered":"2024-09-19T06:37:09.448547+0000","last_unstale":"2024-09-19T06:46:00.565598+0000","last_undegraded":"2024-09-19T06:46:00.565598+0000","last_fullsized":"2024-09-19T06:46:00.565598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:13.526300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'7","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564426+0000","last_change":"2024-09-19T06:37:09.446910+0000","last_active":"2024-09-19T06:46:00.564426+0000","last_peered":"2024-09-19T06:46:00.564426+0000","last_clean":"2024-09-19T06:46:00.564426+0000","last_became_active":"2024-09-19T06:37:09.446603+0000","last_became_peered":"2024-09-19T06:37:09.446603+0000","last_unstale":"2024-09-19T06:46:00.564426+0000","last_undegraded":"2024-09-19T06:46:00.564426+0000","last_fullsized":"2024-09-19T06:46:00.564426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:47.006354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565756+0000","last_change":"2024-09-19T06:37:09.430160+0000","last_active":"2024-09-19T06:46:00.565756+0000","last_peered":"2024-09-19T06:46:00.565756+0000","last_clean":"2024-09-19T06:46:00.565756+0000","last_became_active":"2024-09-19T06:37:09.429813+0000","last_became_peered":"2024-09-19T06:37:09.429813+0000","last_unstale":"2024-09-19T06:46:00.565756+0000","last_undegraded":"2024-09-19T06:46:00.565756+0000","last_fullsized":"2024-09-19T06:46:00.565756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:10.353834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'5","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.877259+0000","last_change":"2024-09-19T06:37:51.782148+0000","last_active":"2024-09-19T06:46:01.877259+0000","last_peered":"2024-09-19T06:46:01.877259+0000","last_clean":"2024-09-19T06:46:01.877259+0000","last_became_active":"2024-09-19T06:37:51.781695+0000","last_became_peered":"2024-09-19T06:37:51.781695+0000","last_unstale":"2024-09-19T06:46:01.877259+0000","last_undegraded":"2024-09-19T06:46:01.877259+0000","last_fullsized":"2024-09-19T06:46:01.877259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:13.160550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950209+0000","last_change":"2024-09-19T06:37:09.446789+0000","last_active":"2024-09-19T06:46:01.950209+0000","last_peered":"2024-09-19T06:46:01.950209+0000","last_clean":"2024-09-19T06:46:01.950209+0000","last_became_active":"2024-09-19T06:37:09.446557+0000","last_became_peered":"2024-09-19T06:37:09.446557+0000","last_unstale":"2024-09-19T06:46:01.950209+0000","last_undegraded":"2024-09-19T06:46:01.950209+0000","last_fullsized":"2024-09-19T06:46:01.950209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:18.119474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.408917+0000","last_change":"2024-09-19T06:37:09.448093+0000","last_active":"2024-09-19T06:46:01.408917+0000","last_peered":"2024-09-19T06:46:01.408917+0000","last_clean":"2024-09-19T06:46:01.408917+0000","last_became_active":"2024-09-19T06:37:09.447753+0000","last_became_peered":"2024-09-19T06:37:09.447753+0000","last_unstale":"2024-09-19T06:46:01.408917+0000","last_undegraded":"2024-09-19T06:46:01.408917+0000","last_fullsized":"2024-09-19T06:46:01.408917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:11.944092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.566032+0000","last_change":"2024-09-19T06:37:09.442798+0000","last_active":"2024-09-19T06:46:00.566032+0000","last_peered":"2024-09-19T06:46:00.566032+0000","last_clean":"2024-09-19T06:46:00.566032+0000","last_became_active":"2024-09-19T06:37:09.442047+0000","last_became_peered":"2024-09-19T06:37:09.442047+0000","last_unstale":"2024-09-19T06:46:00.566032+0000","last_undegraded":"2024-09-19T06:46:00.566032+0000","last_fullsized":"2024-09-19T06:46:00.566032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:33.193185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":11381604169,"num_objects":2904,"num_object_clones":0,"num_object_copies":11616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2904,"num_whiteouts":0,"num_read":1242,"num_read_kb":0,"num_write":2244916,"num_write_kb":28311472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13286993920,"data_stored":22662463488,"data_compressed":1244095370,"data_compressed_allocated":4945981440,"data_compressed_original":14321451008,"omap_allocated":0,"internal_metadata":0},"log_size":154005,"ondisk_log_size":154005,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":476,"ondisk_log_size":476,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65400706,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":467,"num_read_kb":289484,"num_write":3819,"num_write_kb":66806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33345536,"data_stored":130801311,"data_compressed":14149544,"data_compressed_allocated":17014784,"data_compressed_original":114532352,"omap_allocated":0,"internal_metadata":0},"log_size":3704,"ondisk_log_size":3704,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65040,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509558,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1860204,"kb_used_data":1175772,"kb_used_omap":1,"kb_used_meta":684414,"kb_avail":92511636,"statfs":{"total":96636764160,"available":94731915264,"internally_reserved":0,"allocated":1203990528,"data_stored":2068322273,"data_compressed":114170679,"data_compressed_allocated":451706880,"data_compressed_original":1316245504,"omap_allocated":1595,"internal_metadata":700840389},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509557,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2741744,"kb_used_data":1776864,"kb_used_omap":1,"kb_used_meta":964862,"kb_avail":91630096,"statfs":{"total":96636764160,"available":93829218304,"internally_reserved":0,"allocated":1819508736,"data_stored":3105010060,"data_compressed":171329329,"data_compressed_allocated":674234368,"data_compressed_original":1959952384,"omap_allocated":1595,"internal_metadata":988019141},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509557,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2223252,"kb_used_data":1375684,"kb_used_omap":1,"kb_used_meta":847550,"kb_avail":92148588,"statfs":{"total":96636764160,"available":94360154112,"internally_reserved":0,"allocated":1408700416,"data_stored":2421730341,"data_compressed":134264090,"data_compressed_allocated":527233024,"data_compressed_original":1540481024,"omap_allocated":1595,"internal_metadata":867891653},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,3,2,0,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542261,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2449536,"kb_used_data":1575536,"kb_used_omap":1,"kb_used_meta":873982,"kb_avail":91922304,"statfs":{"total":96636764160,"available":94128439296,"internally_reserved":0,"allocated":1613348864,"data_stored":2765507565,"data_compressed":152489907,"data_compressed_allocated":598831104,"data_compressed_original":1751199744,"omap_allocated":1590,"internal_metadata":894958026},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542260,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2603380,"kb_used_data":1664612,"kb_used_omap":1,"kb_used_meta":938750,"kb_avail":91768460,"statfs":{"total":96636764160,"available":93970903040,"internally_reserved":0,"allocated":1704562688,"data_stored":2922392103,"data_compressed":161761826,"data_compressed_allocated":636084224,"data_compressed_original":1854124032,"omap_allocated":1594,"internal_metadata":961280454},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542259,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3355992,"kb_used_data":2191548,"kb_used_omap":1,"kb_used_meta":1160702,"kb_avail":91015848,"statfs":{"total":96636764160,"available":93200228352,"internally_reserved":0,"allocated":2244145152,"data_stored":3828656639,"data_compressed":210540713,"data_compressed_allocated":833662976,"data_compressed_original":2418384896,"omap_allocated":1593,"internal_metadata":1188559303},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,2,2,4,7,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542258,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3548688,"kb_used_data":2320384,"kb_used_omap":1,"kb_used_meta":1228286,"kb_avail":90823152,"statfs":{"total":96636764160,"available":93002907648,"internally_reserved":0,"allocated":2376073216,"data_stored":4057641390,"data_compressed":223574906,"data_compressed_allocated":883261440,"data_compressed_original":2565042176,"omap_allocated":1595,"internal_metadata":1257765317},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574967,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1989704,"kb_used_data":1224312,"kb_used_omap":1,"kb_used_meta":765374,"kb_avail":92382136,"statfs":{"total":96636764160,"available":94599307264,"internally_reserved":0,"allocated":1253695488,"data_stored":2142410591,"data_compressed":117612055,"data_compressed_allocated":467136512,"data_compressed_original":1356054528,"omap_allocated":1595,"internal_metadata":783743429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1,1,3,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4018176,"data_stored":20972158,"data_compressed":2327138,"data_compressed_allocated":2707456,"data_compressed_original":19673088,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3305472,"data_stored":14973479,"data_compressed":1661240,"data_compressed_allocated":2039808,"data_compressed_original":13717504,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":94269,"data_compressed":5056,"data_compressed_allocated":8192,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5226496,"data_stored":12677752,"data_compressed":1395672,"data_compressed_allocated":1748992,"data_compressed_original":9207808,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5414912,"data_stored":23362053,"data_compressed":2560869,"data_compressed_allocated":2981888,"data_compressed_original":20942848,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1662976,"data_stored":8388698,"data_compressed":865550,"data_compressed_allocated":1097728,"data_compressed_original":7827456,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3923968,"data_stored":16777888,"data_compressed":1995942,"data_compressed_allocated":2461696,"data_compressed_original":15323136,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9711616,"data_stored":33555014,"data_compressed":3338077,"data_compressed_allocated":3969024,"data_compressed_original":27815936,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1351966720,"data_stored":2309824512,"data_compressed":127069757,"data_compressed_allocated":505569280,"data_compressed_original":1463427072,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2372399104,"data_stored":4042502144,"data_compressed":221913666,"data_compressed_allocated":881221632,"data_compressed_original":2551324672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1168445440,"data_stored":1993252864,"data_compressed":109511749,"data_compressed_allocated":435421184,"data_compressed_original":1260228608,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2139357184,"data_stored":3645943808,"data_compressed":200186526,"data_compressed_allocated":795586560,"data_compressed_original":2302173184,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1813725184,"data_stored":3081482240,"data_compressed":168768460,"data_compressed_allocated":671252480,"data_compressed_original":1939009536,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1201958912,"data_stored":2059767808,"data_compressed":113305129,"data_compressed_allocated":450609152,"data_compressed_original":1308418048,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1635938304,"data_stored":2798493696,"data_compressed":154220773,"data_compressed_allocated":611504128,"data_compressed_original":1774059520,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1603203072,"data_stored":2731196416,"data_compressed":149119310,"data_compressed_allocated":594817024,"data_compressed_original":1722810368,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:46:32.397 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T06:46:32.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.562+0000 7fc82445a640 1 Processor -- start 2024-09-19T06:46:32.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.562+0000 7fc82445a640 1 -- start start 2024-09-19T06:46:32.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.563+0000 7fc82445a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc81c0d1120 0x7fc81c15da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:32.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.563+0000 7fc82445a640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc81c15dfa0 0x7fc81c0b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:32.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.563+0000 7fc82445a640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc81c15c9c0 con 0x7fc81c0d0d40 2024-09-19T06:46:32.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.563+0000 7fc82445a640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fc81c15c770 con 0x7fc81c15dfa0 2024-09-19T06:46:32.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.563+0000 7fc82445a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc81c15e450 con 0x7fc81c0d1120 2024-09-19T06:46:32.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.563+0000 7fc8229f7640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc81c15dfa0 0x7fc81c0b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:32.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.563+0000 7fc8221f6640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc81c0d0d40 0x7fc81c0ca6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:44296/0 (socket says 172.21.15.86:44296) 2024-09-19T06:46:32.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.563+0000 7fc8221f6640 1 -- 172.21.15.86:0/3011449839 learned_addr learned my addr 172.21.15.86:0/3011449839 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:46:32.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.564+0000 7fc8219f5640 1 --2- 172.21.15.86:0/3011449839 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc81c0d1120 0x7fc81c15da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:32.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.564+0000 7fc8229f7640 1 -- 172.21.15.86:0/3011449839 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc81c0d1120 msgr2=0x7fc81c15da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:32.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.564+0000 7fc8229f7640 1 --2- 172.21.15.86:0/3011449839 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc81c0d1120 0x7fc81c15da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:32.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.564+0000 7fc8229f7640 1 -- 172.21.15.86:0/3011449839 >> v1:172.21.15.86:6789/0 conn(0x7fc81c0d0d40 legacy=0x7fc81c0ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:32.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.564+0000 7fc8229f7640 1 -- 172.21.15.86:0/3011449839 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81c15cca0 con 0x7fc81c15dfa0 2024-09-19T06:46:32.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.564+0000 7fc8211f4640 1 -- 172.21.15.86:0/3011449839 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3790755866 0 0) 0x7fc81c15c9c0 con 0x7fc81c0d0d40 2024-09-19T06:46:32.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.564+0000 7fc8229f7640 1 --2- 172.21.15.86:0/3011449839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc81c15dfa0 0x7fc81c0b4b60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc814009d90 tx=0x7fc81402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4995d31ef059360a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:32.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.564+0000 7fc8211f4640 1 -- 172.21.15.86:0/3011449839 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc814007740 con 0x7fc81c15dfa0 2024-09-19T06:46:32.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.564+0000 7fc8211f4640 1 -- 172.21.15.86:0/3011449839 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8140078e0 con 0x7fc81c15dfa0 2024-09-19T06:46:32.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.565+0000 7fc8211f4640 1 -- 172.21.15.86:0/3011449839 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc814007cb0 con 0x7fc81c15dfa0 2024-09-19T06:46:32.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.565+0000 7fc82445a640 1 -- 172.21.15.86:0/3011449839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc81c15dfa0 msgr2=0x7fc81c0b4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:32.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.565+0000 7fc82445a640 1 --2- 172.21.15.86:0/3011449839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc81c15dfa0 0x7fc81c0b4b60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc814009d90 tx=0x7fc81402a660 comp rx=0 tx=0).stop 2024-09-19T06:46:32.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.565+0000 7fc82445a640 1 -- 172.21.15.86:0/3011449839 shutdown_connections 2024-09-19T06:46:32.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.565+0000 7fc82445a640 1 --2- 172.21.15.86:0/3011449839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc81c15dfa0 0x7fc81c0b4b60 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:32.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.565+0000 7fc82445a640 1 --2- 172.21.15.86:0/3011449839 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc81c0d1120 0x7fc81c15da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:32.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.565+0000 7fc82445a640 1 -- 172.21.15.86:0/3011449839 >> 172.21.15.86:0/3011449839 conn(0x7fc81c06d910 msgr2=0x7fc81c06dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:32.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.565+0000 7fc82445a640 1 -- 172.21.15.86:0/3011449839 shutdown_connections 2024-09-19T06:46:32.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.565+0000 7fc82445a640 1 -- 172.21.15.86:0/3011449839 wait complete. 2024-09-19T06:46:32.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.566+0000 7fc82445a640 1 Processor -- start 2024-09-19T06:46:32.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.566+0000 7fc82445a640 1 -- start start 2024-09-19T06:46:32.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.567+0000 7fc82445a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc81c0d0d40 0x7fc81c1f1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:32.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.567+0000 7fc82445a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc81c0d1120 0x7fc81c1f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:32.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.567+0000 7fc82445a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc81c15dfa0 0x7fc81c156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:32.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.567+0000 7fc82445a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc81c15d260 con 0x7fc81c0d0d40 2024-09-19T06:46:32.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.567+0000 7fc82445a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc81c0b3f20 con 0x7fc81c0d1120 2024-09-19T06:46:32.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.567+0000 7fc82445a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc81c0cadd0 con 0x7fc81c15dfa0 2024-09-19T06:46:32.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.567+0000 7fc8221f6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc81c0d0d40 0x7fc81c1f1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:32.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.567+0000 7fc8221f6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc81c0d0d40 0x7fc81c1f1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60986/0 (socket says 172.21.15.86:60986) 2024-09-19T06:46:32.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.567+0000 7fc8221f6640 1 -- 172.21.15.86:0/1154693605 learned_addr learned my addr 172.21.15.86:0/1154693605 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:32.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.567+0000 7fc8229f7640 1 --2- 172.21.15.86:0/1154693605 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc81c15dfa0 0x7fc81c156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:32.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.567+0000 7fc8219f5640 1 --2- 172.21.15.86:0/1154693605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc81c0d1120 0x7fc81c1f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:32.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.568+0000 7fc8221f6640 1 -- 172.21.15.86:0/1154693605 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc81c15dfa0 msgr2=0x7fc81c156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:32.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.568+0000 7fc8221f6640 1 --2- 172.21.15.86:0/1154693605 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc81c15dfa0 0x7fc81c156680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:32.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.568+0000 7fc8221f6640 1 -- 172.21.15.86:0/1154693605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc81c0d1120 msgr2=0x7fc81c1f3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:32.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.568+0000 7fc8221f6640 1 --2- 172.21.15.86:0/1154693605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc81c0d1120 0x7fc81c1f3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:32.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.568+0000 7fc8221f6640 1 -- 172.21.15.86:0/1154693605 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81c0c50d0 con 0x7fc81c0d0d40 2024-09-19T06:46:32.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.568+0000 7fc8221f6640 1 --2- 172.21.15.86:0/1154693605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc81c0d0d40 0x7fc81c1f1200 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc81800c500 tx=0x7fc81800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:32.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.568+0000 7fc80effd640 1 -- 172.21.15.86:0/1154693605 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818018070 con 0x7fc81c0d0d40 2024-09-19T06:46:32.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.568+0000 7fc80effd640 1 -- 172.21.15.86:0/1154693605 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc818007580 con 0x7fc81c0d0d40 2024-09-19T06:46:32.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.568+0000 7fc82445a640 1 -- 172.21.15.86:0/1154693605 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc81c0c5390 con 0x7fc81c0d0d40 2024-09-19T06:46:32.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.568+0000 7fc80effd640 1 -- 172.21.15.86:0/1154693605 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818004a20 con 0x7fc81c0d0d40 2024-09-19T06:46:32.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.568+0000 7fc82445a640 1 -- 172.21.15.86:0/1154693605 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc81c0c5950 con 0x7fc81c0d0d40 2024-09-19T06:46:32.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.570+0000 7fc82445a640 1 -- 172.21.15.86:0/1154693605 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc81c0c9eb0 con 0x7fc81c0d0d40 2024-09-19T06:46:32.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.570+0000 7fc80effd640 1 -- 172.21.15.86:0/1154693605 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc81801b070 con 0x7fc81c0d0d40 2024-09-19T06:46:32.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.571+0000 7fc80effd640 1 --2- 172.21.15.86:0/1154693605 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc80006c2b0 0x7fc80006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:32.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.571+0000 7fc80effd640 1 -- 172.21.15.86:0/1154693605 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7fc81808ad00 con 0x7fc81c0d0d40 2024-09-19T06:46:32.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.571+0000 7fc8219f5640 1 --2- 172.21.15.86:0/1154693605 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc80006c2b0 0x7fc80006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:32.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.571+0000 7fc8219f5640 1 --2- 172.21.15.86:0/1154693605 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc80006c2b0 0x7fc80006e770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc81c1eaff0 tx=0x7fc810008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:32.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.575+0000 7fc80effd640 1 -- 172.21.15.86:0/1154693605 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc81c0c9eb0 con 0x7fc81c0d0d40 2024-09-19T06:46:32.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.773+0000 7fc82445a640 1 -- 172.21.15.86:0/1154693605 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc81c15da40 con 0x7fc81c0d0d40 2024-09-19T06:46:32.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.774+0000 7fc80effd640 1 -- 172.21.15.86:0/1154693605 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+19753 (secure 0 0 0) 0x7fc818058810 con 0x7fc81c0d0d40 2024-09-19T06:46:32.775 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:46:32.775 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":34,"fsid":"1785f09f-0959-457d-8c4a-6cce2e655a37","created":"2024-09-19T06:36:45.671544+0000","modified":"2024-09-19T06:46:00.558378+0000","last_up_change":"2024-09-19T06:36:56.765680+0000","last_in_change":"2024-09-19T06:36:47.816681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:36:57.770634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:37:06.588120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:37:07.739726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T06:37:11.457476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bd3ce3f2-2a37-40ec-8dc3-69246437277c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6827","nonce":1588074611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6829","nonce":1588074611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6833","nonce":1588074611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6831","nonce":1588074611}]},"public_addr":"172.21.15.86:6827/1588074611","cluster_addr":"172.21.15.86:6829/1588074611","heartbeat_back_addr":"172.21.15.86:6833/1588074611","heartbeat_front_addr":"172.21.15.86:6831/1588074611","state":["exists","up"]},{"osd":1,"uuid":"871d7d23-ed03-4629-bca9-5b71ad0d926a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6819","nonce":1785682938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6821","nonce":1785682938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6825","nonce":1785682938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6823","nonce":1785682938}]},"public_addr":"172.21.15.86:6819/1785682938","cluster_addr":"172.21.15.86:6821/1785682938","heartbeat_back_addr":"172.21.15.86:6825/1785682938","heartbeat_front_addr":"172.21.15.86:6823/1785682938","state":["exists","up"]},{"osd":2,"uuid":"39d3562d-8c52-4af9-935a-2d90abb8b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6801","nonce":3306127846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6803","nonce":3306127846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6807","nonce":3306127846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6805","nonce":3306127846}]},"public_addr":"172.21.15.86:6801/3306127846","cluster_addr":"172.21.15.86:6803/3306127846","heartbeat_back_addr":"172.21.15.86:6807/3306127846","heartbeat_front_addr":"172.21.15.86:6805/3306127846","state":["exists","up"]},{"osd":3,"uuid":"7f88c5b1-042c-4a9f-a674-32456e0644a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6809","nonce":694275178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6811","nonce":694275178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6815","nonce":694275178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6813","nonce":694275178}]},"public_addr":"172.21.15.86:6809/694275178","cluster_addr":"172.21.15.86:6811/694275178","heartbeat_back_addr":"172.21.15.86:6815/694275178","heartbeat_front_addr":"172.21.15.86:6813/694275178","state":["exists","up"]},{"osd":4,"uuid":"18aa391b-0863-48bf-bff6-107e22ee9752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6811","nonce":1326795640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6815","nonce":1326795640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6823","nonce":1326795640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6819","nonce":1326795640}]},"public_addr":"172.21.15.169:6811/1326795640","cluster_addr":"172.21.15.169:6815/1326795640","heartbeat_back_addr":"172.21.15.169:6823/1326795640","heartbeat_front_addr":"172.21.15.169:6819/1326795640","state":["exists","up"]},{"osd":5,"uuid":"90fa5ca6-1815-4af1-a664-b45a9e19dd56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6825","nonce":3538913242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6827","nonce":3538913242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6831","nonce":3538913242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6829","nonce":3538913242}]},"public_addr":"172.21.15.169:6825/3538913242","cluster_addr":"172.21.15.169:6827/3538913242","heartbeat_back_addr":"172.21.15.169:6831/3538913242","heartbeat_front_addr":"172.21.15.169:6829/3538913242","state":["exists","up"]},{"osd":6,"uuid":"8b2019fc-6cc2-4394-9a7c-7951544f7cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6810","nonce":494424253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6814","nonce":494424253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6822","nonce":494424253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6818","nonce":494424253}]},"public_addr":"172.21.15.169:6810/494424253","cluster_addr":"172.21.15.169:6814/494424253","heartbeat_back_addr":"172.21.15.169:6822/494424253","heartbeat_front_addr":"172.21.15.169:6818/494424253","state":["exists","up"]},{"osd":7,"uuid":"622e3b2c-5302-4b0a-b7f2-f4050801401e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6801","nonce":797235989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6803","nonce":797235989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6807","nonce":797235989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6805","nonce":797235989}]},"public_addr":"172.21.15.169:6801/797235989","cluster_addr":"172.21.15.169:6803/797235989","heartbeat_back_addr":"172.21.15.169:6807/797235989","heartbeat_front_addr":"172.21.15.169:6805/797235989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.130643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.611572+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:53.419992+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.560112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.112065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.774642+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.341946+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.117884+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6839/22518982":"2024-09-20T06:46:00.558337+0000","172.21.15.86:6838/22518982":"2024-09-20T06:46:00.558337+0000","172.21.15.169:6837/3116130916":"2024-09-20T06:44:35.535883+0000","172.21.15.169:6837/2213887583":"2024-09-20T06:42:05.505758+0000","172.21.15.169:6836/3116130916":"2024-09-20T06:44:35.535883+0000","172.21.15.86:6839/1006149510":"2024-09-20T06:43:55.528921+0000","172.21.15.86:6838/1006149510":"2024-09-20T06:43:55.528921+0000","172.21.15.169:6836/2213887583":"2024-09-20T06:42:05.505758+0000","172.21.15.86:6838/1060607293":"2024-09-20T06:40:55.493588+0000","172.21.15.86:6839/1060607293":"2024-09-20T06:40:55.493588+0000","172.21.15.169:6837/201961024":"2024-09-20T06:39:15.476134+0000","172.21.15.169:6836/201961024":"2024-09-20T06:39:15.476134+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:46:32.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.776+0000 7fc82445a640 1 -- 172.21.15.86:0/1154693605 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc80006c2b0 msgr2=0x7fc80006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:32.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.776+0000 7fc82445a640 1 --2- 172.21.15.86:0/1154693605 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc80006c2b0 0x7fc80006e770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc81c1eaff0 tx=0x7fc810008040 comp rx=0 tx=0).stop 2024-09-19T06:46:32.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.776+0000 7fc82445a640 1 -- 172.21.15.86:0/1154693605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc81c0d0d40 msgr2=0x7fc81c1f1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:32.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.776+0000 7fc82445a640 1 --2- 172.21.15.86:0/1154693605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc81c0d0d40 0x7fc81c1f1200 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc81800c500 tx=0x7fc81800c9c0 comp rx=0 tx=0).stop 2024-09-19T06:46:32.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.776+0000 7fc82445a640 1 -- 172.21.15.86:0/1154693605 shutdown_connections 2024-09-19T06:46:32.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.776+0000 7fc82445a640 1 --2- 172.21.15.86:0/1154693605 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fc80006c2b0 0x7fc80006e770 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:32.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.776+0000 7fc82445a640 1 --2- 172.21.15.86:0/1154693605 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc81c15dfa0 0x7fc81c156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:32.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.776+0000 7fc82445a640 1 --2- 172.21.15.86:0/1154693605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc81c0d1120 0x7fc81c1f3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:32.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.776+0000 7fc82445a640 1 --2- 172.21.15.86:0/1154693605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc81c0d0d40 0x7fc81c1f1200 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:32.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.776+0000 7fc82445a640 1 -- 172.21.15.86:0/1154693605 >> 172.21.15.86:0/1154693605 conn(0x7fc81c06d910 msgr2=0x7fc81c0c81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:32.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.776+0000 7fc82445a640 1 -- 172.21.15.86:0/1154693605 shutdown_connections 2024-09-19T06:46:32.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:32.776+0000 7fc82445a640 1 -- 172.21.15.86:0/1154693605 wait complete. 2024-09-19T06:46:33.789 INFO:tasks.ceph:Scrubbing osd.0 2024-09-19T06:46:33.789 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-19T06:46:33.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.892+0000 7fd77583c640 1 Processor -- start 2024-09-19T06:46:33.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.893+0000 7fd77583c640 1 -- start start 2024-09-19T06:46:33.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.893+0000 7fd77583c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd7700ceb40 0x7fd77006d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:33.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.893+0000 7fd77583c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd7700cef20 0x7fd770155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:33.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.893+0000 7fd77583c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7700c8e60 con 0x7fd7700c92b0 2024-09-19T06:46:33.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.893+0000 7fd77583c640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fd77015b210 con 0x7fd7700cef20 2024-09-19T06:46:33.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.893+0000 7fd77583c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fd77015b4d0 con 0x7fd7700ceb40 2024-09-19T06:46:33.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.893+0000 7fd76e7fc640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd7700cef20 0x7fd770155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:33.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.894+0000 7fd76e7fc640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd7700cef20 0x7fd770155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:32770/0 (socket says 172.21.15.86:32770) 2024-09-19T06:46:33.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.894+0000 7fd76e7fc640 1 -- 172.21.15.86:0/98664639 learned_addr learned my addr 172.21.15.86:0/98664639 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:33.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.894+0000 7fd76effd640 1 --2- 172.21.15.86:0/98664639 >> v2:172.21.15.169:3300/0 conn(0x7fd7700ceb40 0x7fd77006d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:33.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.894+0000 7fd76e7fc640 1 -- 172.21.15.86:0/98664639 >> v2:172.21.15.169:3300/0 conn(0x7fd7700ceb40 msgr2=0x7fd77006d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:33.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.894+0000 7fd76e7fc640 1 --2- 172.21.15.86:0/98664639 >> v2:172.21.15.169:3300/0 conn(0x7fd7700ceb40 0x7fd77006d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:33.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.894+0000 7fd76e7fc640 1 -- 172.21.15.86:0/98664639 >> v1:172.21.15.169:6789/0 conn(0x7fd7700c92b0 legacy=0x7fd770070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:33.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.894+0000 7fd76e7fc640 1 -- 172.21.15.86:0/98664639 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd77015b7b0 con 0x7fd7700cef20 2024-09-19T06:46:33.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.895+0000 7fd76e7fc640 1 --2- 172.21.15.86:0/98664639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7700cef20 0x7fd770155060 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd770073460 tx=0x7fd75802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44cc713f010d4661 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:33.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.895+0000 7fd76dffb640 1 -- 172.21.15.86:0/98664639 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd758037070 con 0x7fd7700cef20 2024-09-19T06:46:33.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.895+0000 7fd76dffb640 1 -- 172.21.15.86:0/98664639 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd758032440 con 0x7fd7700cef20 2024-09-19T06:46:33.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.895+0000 7fd76dffb640 1 -- 172.21.15.86:0/98664639 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd758032810 con 0x7fd7700cef20 2024-09-19T06:46:33.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.895+0000 7fd77583c640 1 -- 172.21.15.86:0/98664639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7700cef20 msgr2=0x7fd770155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:33.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.895+0000 7fd77583c640 1 --2- 172.21.15.86:0/98664639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7700cef20 0x7fd770155060 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd770073460 tx=0x7fd75802a230 comp rx=0 tx=0).stop 2024-09-19T06:46:33.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.895+0000 7fd77583c640 1 -- 172.21.15.86:0/98664639 shutdown_connections 2024-09-19T06:46:33.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.895+0000 7fd77583c640 1 --2- 172.21.15.86:0/98664639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7700cef20 0x7fd770155060 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:33.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.895+0000 7fd77583c640 1 --2- 172.21.15.86:0/98664639 >> v2:172.21.15.169:3300/0 conn(0x7fd7700ceb40 0x7fd77006d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:33.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.895+0000 7fd77583c640 1 -- 172.21.15.86:0/98664639 >> 172.21.15.86:0/98664639 conn(0x7fd770067890 msgr2=0x7fd770067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:33.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.895+0000 7fd77583c640 1 -- 172.21.15.86:0/98664639 shutdown_connections 2024-09-19T06:46:33.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.895+0000 7fd77583c640 1 -- 172.21.15.86:0/98664639 wait complete. 2024-09-19T06:46:33.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.897+0000 7fd77583c640 1 Processor -- start 2024-09-19T06:46:33.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.897+0000 7fd77583c640 1 -- start start 2024-09-19T06:46:33.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.897+0000 7fd77583c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7700c92b0 0x7fd7701f1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:33.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.897+0000 7fd77583c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7700ceb40 0x7fd77015cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:33.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.897+0000 7fd77583c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7700cef20 0x7fd7700c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:33.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.897+0000 7fd77583c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd770071280 con 0x7fd7700cef20 2024-09-19T06:46:33.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.897+0000 7fd77583c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd77015bd70 con 0x7fd7700ceb40 2024-09-19T06:46:33.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.897+0000 7fd77583c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd770071400 con 0x7fd7700c92b0 2024-09-19T06:46:33.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.898+0000 7fd76f7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7700cef20 0x7fd7700c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:33.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.898+0000 7fd76f7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7700cef20 0x7fd7700c7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:32780/0 (socket says 172.21.15.86:32780) 2024-09-19T06:46:33.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.898+0000 7fd76effd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7700c92b0 0x7fd7701f1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:33.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.898+0000 7fd76e7fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7700ceb40 0x7fd77015cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:33.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.898+0000 7fd76f7fe640 1 -- 172.21.15.86:0/2910686099 learned_addr learned my addr 172.21.15.86:0/2910686099 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:33.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.898+0000 7fd76f7fe640 1 -- 172.21.15.86:0/2910686099 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7700c92b0 msgr2=0x7fd7701f1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:33.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.898+0000 7fd76f7fe640 1 --2- 172.21.15.86:0/2910686099 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7700c92b0 0x7fd7701f1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:33.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.898+0000 7fd76f7fe640 1 -- 172.21.15.86:0/2910686099 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7700ceb40 msgr2=0x7fd77015cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:33.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.898+0000 7fd76f7fe640 1 --2- 172.21.15.86:0/2910686099 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7700ceb40 0x7fd77015cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:33.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.898+0000 7fd76f7fe640 1 -- 172.21.15.86:0/2910686099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd77015de40 con 0x7fd7700cef20 2024-09-19T06:46:33.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.898+0000 7fd76f7fe640 1 --2- 172.21.15.86:0/2910686099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7700cef20 0x7fd7700c7af0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd76800c780 tx=0x7fd76800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:33.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.898+0000 7fd767fff640 1 -- 172.21.15.86:0/2910686099 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd768004b60 con 0x7fd7700cef20 2024-09-19T06:46:33.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.898+0000 7fd767fff640 1 -- 172.21.15.86:0/2910686099 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd768004d00 con 0x7fd7700cef20 2024-09-19T06:46:33.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.898+0000 7fd77583c640 1 -- 172.21.15.86:0/2910686099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd77015e120 con 0x7fd7700cef20 2024-09-19T06:46:33.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.898+0000 7fd767fff640 1 -- 172.21.15.86:0/2910686099 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76800aa90 con 0x7fd7700cef20 2024-09-19T06:46:33.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.898+0000 7fd77583c640 1 -- 172.21.15.86:0/2910686099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd77015e6e0 con 0x7fd7700cef20 2024-09-19T06:46:33.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.899+0000 7fd77583c640 1 -- 172.21.15.86:0/2910686099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd770073dc0 con 0x7fd7700cef20 2024-09-19T06:46:33.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.900+0000 7fd767fff640 1 -- 172.21.15.86:0/2910686099 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd76800ac30 con 0x7fd7700cef20 2024-09-19T06:46:33.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.900+0000 7fd767fff640 1 --2- 172.21.15.86:0/2910686099 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd75006c2e0 0x7fd75006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:33.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.900+0000 7fd767fff640 1 -- 172.21.15.86:0/2910686099 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7fd76808bba0 con 0x7fd7700cef20 2024-09-19T06:46:33.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.900+0000 7fd76effd640 1 --2- 172.21.15.86:0/2910686099 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd75006c2e0 0x7fd75006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:33.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.900+0000 7fd767fff640 1 --2- 172.21.15.86:0/2910686099 >> [v2:172.21.15.86:6826/1588074611,v1:172.21.15.86:6827/1588074611] conn(0x7fd750076130 0x7fd7500785d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:33.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.900+0000 7fd767fff640 1 -- 172.21.15.86:0/2910686099 --> [v2:172.21.15.86:6826/1588074611,v1:172.21.15.86:6827/1588074611] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd76801fec0 con 0x7fd750076130 2024-09-19T06:46:33.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.900+0000 7fd767fff640 1 -- 172.21.15.86:0/2910686099 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd7680902c0 con 0x7fd7700cef20 2024-09-19T06:46:33.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.900+0000 7fd76e7fc640 1 --2- 172.21.15.86:0/2910686099 >> [v2:172.21.15.86:6826/1588074611,v1:172.21.15.86:6827/1588074611] conn(0x7fd750076130 0x7fd7500785d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:33.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.901+0000 7fd76effd640 1 --2- 172.21.15.86:0/2910686099 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd75006c2e0 0x7fd75006e7a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd760006fd0 tx=0x7fd760008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:33.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.901+0000 7fd76e7fc640 1 --2- 172.21.15.86:0/2910686099 >> [v2:172.21.15.86:6826/1588074611,v1:172.21.15.86:6827/1588074611] conn(0x7fd750076130 0x7fd7500785d0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:33.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.901+0000 7fd767fff640 1 -- 172.21.15.86:0/2910686099 <== osd.0 v2:172.21.15.86:6826/1588074611 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd76801fec0 con 0x7fd750076130 2024-09-19T06:46:33.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.914+0000 7fd77583c640 1 -- 172.21.15.86:0/2910686099 --> [v2:172.21.15.86:6826/1588074611,v1:172.21.15.86:6827/1588074611] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd7700c6e10 con 0x7fd750076130 2024-09-19T06:46:33.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.914+0000 7fd767fff640 1 -- 172.21.15.86:0/2910686099 <== osd.0 v2:172.21.15.86:6826/1588074611 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd7700c6e10 con 0x7fd750076130 2024-09-19T06:46:33.916 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-19T06:46:33.916 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T06:46:33.916 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-19T06:46:33.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.914+0000 7fd77583c640 1 -- 172.21.15.86:0/2910686099 >> [v2:172.21.15.86:6826/1588074611,v1:172.21.15.86:6827/1588074611] conn(0x7fd750076130 msgr2=0x7fd7500785d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:33.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.914+0000 7fd77583c640 1 --2- 172.21.15.86:0/2910686099 >> [v2:172.21.15.86:6826/1588074611,v1:172.21.15.86:6827/1588074611] conn(0x7fd750076130 0x7fd7500785d0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:33.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.915+0000 7fd77583c640 1 -- 172.21.15.86:0/2910686099 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd75006c2e0 msgr2=0x7fd75006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:33.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.915+0000 7fd77583c640 1 --2- 172.21.15.86:0/2910686099 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd75006c2e0 0x7fd75006e7a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd760006fd0 tx=0x7fd760008040 comp rx=0 tx=0).stop 2024-09-19T06:46:33.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.915+0000 7fd77583c640 1 -- 172.21.15.86:0/2910686099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7700cef20 msgr2=0x7fd7700c7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:33.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.915+0000 7fd77583c640 1 --2- 172.21.15.86:0/2910686099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7700cef20 0x7fd7700c7af0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd76800c780 tx=0x7fd76800cc40 comp rx=0 tx=0).stop 2024-09-19T06:46:33.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.915+0000 7fd76f7fe640 1 -- 172.21.15.86:0/2910686099 reap_dead start 2024-09-19T06:46:33.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.915+0000 7fd77583c640 1 -- 172.21.15.86:0/2910686099 shutdown_connections 2024-09-19T06:46:33.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.915+0000 7fd77583c640 1 -- 172.21.15.86:0/2910686099 >> 172.21.15.86:0/2910686099 conn(0x7fd770067890 msgr2=0x7fd7700cd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:33.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.915+0000 7fd77583c640 1 -- 172.21.15.86:0/2910686099 shutdown_connections 2024-09-19T06:46:33.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:33.915+0000 7fd77583c640 1 -- 172.21.15.86:0/2910686099 wait complete. 2024-09-19T06:46:33.926 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-19T06:46:34.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.056+0000 7f4e594ca640 1 Processor -- start 2024-09-19T06:46:34.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.056+0000 7f4e594ca640 1 -- start start 2024-09-19T06:46:34.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.058+0000 7f4e594ca640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e4c0dce90 0x7f4e4c005a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:34.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.058+0000 7f4e594ca640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4e4c04aa40 0x7f4e4c046390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:34.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.058+0000 7f4e594ca640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4e4c0e6030 0x7f4e4c0e64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:34.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.058+0000 7f4e594ca640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f4e4c045660 con 0x7f4e4c04aa40 2024-09-19T06:46:34.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.058+0000 7f4e594ca640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f4e4c045f00 con 0x7f4e4c0e6030 2024-09-19T06:46:34.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.058+0000 7f4e594ca640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4e4c0dd270 con 0x7f4e4c0dce90 2024-09-19T06:46:34.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.058+0000 7f4e537fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4e4c04aa40 0x7f4e4c046390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:34.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.058+0000 7f4e537fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4e4c04aa40 0x7f4e4c046390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:32796/0 (socket says 172.21.15.86:32796) 2024-09-19T06:46:34.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.058+0000 7f4e537fe640 1 -- 172.21.15.86:0/30126126 learned_addr learned my addr 172.21.15.86:0/30126126 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:34.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.059+0000 7f4e537fe640 1 -- 172.21.15.86:0/30126126 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e4c0dce90 msgr2=0x7f4e4c005a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:34.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.059+0000 7f4e537fe640 1 --2- 172.21.15.86:0/30126126 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e4c0dce90 0x7f4e4c005a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.059+0000 7f4e537fe640 1 -- 172.21.15.86:0/30126126 >> v2:172.21.15.169:3300/0 conn(0x7f4e4c0e6030 msgr2=0x7f4e4c0e64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:34.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.059+0000 7f4e537fe640 1 --2- 172.21.15.86:0/30126126 >> v2:172.21.15.169:3300/0 conn(0x7f4e4c0e6030 0x7f4e4c0e64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.059+0000 7f4e537fe640 1 -- 172.21.15.86:0/30126126 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e4c0468d0 con 0x7f4e4c04aa40 2024-09-19T06:46:34.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.060+0000 7f4e537fe640 1 --2- 172.21.15.86:0/30126126 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e4c04aa40 0x7f4e4c046390 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c0328d0 tx=0x7f4e4002a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33121eb988f685ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:34.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.061+0000 7f4e52ffd640 1 -- 172.21.15.86:0/30126126 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40037070 con 0x7f4e4c04aa40 2024-09-19T06:46:34.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.061+0000 7f4e52ffd640 1 -- 172.21.15.86:0/30126126 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e40032440 con 0x7f4e4c04aa40 2024-09-19T06:46:34.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.062+0000 7f4e594ca640 1 -- 172.21.15.86:0/30126126 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e4c04aa40 msgr2=0x7f4e4c046390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:34.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.062+0000 7f4e594ca640 1 --2- 172.21.15.86:0/30126126 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e4c04aa40 0x7f4e4c046390 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c0328d0 tx=0x7f4e4002a1f0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.065+0000 7f4e594ca640 1 -- 172.21.15.86:0/30126126 shutdown_connections 2024-09-19T06:46:34.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.065+0000 7f4e594ca640 1 --2- 172.21.15.86:0/30126126 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e4c04aa40 0x7f4e4c046390 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.065+0000 7f4e594ca640 1 --2- 172.21.15.86:0/30126126 >> v2:172.21.15.169:3300/0 conn(0x7f4e4c0e6030 0x7f4e4c0e64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.065+0000 7f4e594ca640 1 --2- 172.21.15.86:0/30126126 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e4c0dce90 0x7f4e4c005a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.065+0000 7f4e594ca640 1 -- 172.21.15.86:0/30126126 >> 172.21.15.86:0/30126126 conn(0x7f4e4c04fc50 msgr2=0x7f4e4c050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:34.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.065+0000 7f4e594ca640 1 -- 172.21.15.86:0/30126126 shutdown_connections 2024-09-19T06:46:34.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.066+0000 7f4e594ca640 1 -- 172.21.15.86:0/30126126 wait complete. 2024-09-19T06:46:34.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.068+0000 7f4e594ca640 1 Processor -- start 2024-09-19T06:46:34.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.068+0000 7f4e594ca640 1 -- start start 2024-09-19T06:46:34.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.069+0000 7f4e594ca640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e4c04aa40 0x7f4e4c0e3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:34.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.069+0000 7f4e594ca640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e4c0dce90 0x7f4e4c0e5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:34.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.069+0000 7f4e594ca640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e4c0e6030 0x7f4e4c047ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:34.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.069+0000 7f4e594ca640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c0458b0 con 0x7f4e4c0e6030 2024-09-19T06:46:34.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.069+0000 7f4e594ca640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c0e6dc0 con 0x7f4e4c04aa40 2024-09-19T06:46:34.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.069+0000 7f4e594ca640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4e4c045b90 con 0x7f4e4c0dce90 2024-09-19T06:46:34.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.070+0000 7f4e58cc9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e4c0e6030 0x7f4e4c047ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:34.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.070+0000 7f4e58cc9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e4c0e6030 0x7f4e4c047ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:32798/0 (socket says 172.21.15.86:32798) 2024-09-19T06:46:34.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.070+0000 7f4e58cc9640 1 -- 172.21.15.86:0/3425834601 learned_addr learned my addr 172.21.15.86:0/3425834601 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:34.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.070+0000 7f4e53fff640 1 --2- 172.21.15.86:0/3425834601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e4c04aa40 0x7f4e4c0e3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:34.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.070+0000 7f4e537fe640 1 --2- 172.21.15.86:0/3425834601 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e4c0dce90 0x7f4e4c0e5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:34.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.070+0000 7f4e58cc9640 1 -- 172.21.15.86:0/3425834601 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e4c0dce90 msgr2=0x7f4e4c0e5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:34.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.070+0000 7f4e58cc9640 1 --2- 172.21.15.86:0/3425834601 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e4c0dce90 0x7f4e4c0e5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.071+0000 7f4e58cc9640 1 -- 172.21.15.86:0/3425834601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e4c04aa40 msgr2=0x7f4e4c0e3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:34.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.071+0000 7f4e58cc9640 1 --2- 172.21.15.86:0/3425834601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e4c04aa40 0x7f4e4c0e3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.071+0000 7f4e58cc9640 1 -- 172.21.15.86:0/3425834601 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e4c0c4d30 con 0x7f4e4c0e6030 2024-09-19T06:46:34.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.071+0000 7f4e58cc9640 1 --2- 172.21.15.86:0/3425834601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e4c0e6030 0x7f4e4c047ab0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4e540767b0 tx=0x7f4e540692f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:34.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.072+0000 7f4e50ff9640 1 -- 172.21.15.86:0/3425834601 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e540744f0 con 0x7f4e4c0e6030 2024-09-19T06:46:34.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.072+0000 7f4e50ff9640 1 -- 172.21.15.86:0/3425834601 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e54074690 con 0x7f4e4c0e6030 2024-09-19T06:46:34.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.072+0000 7f4e50ff9640 1 -- 172.21.15.86:0/3425834601 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e54074a60 con 0x7f4e4c0e6030 2024-09-19T06:46:34.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.072+0000 7f4e594ca640 1 -- 172.21.15.86:0/3425834601 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e4c0483f0 con 0x7f4e4c0e6030 2024-09-19T06:46:34.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.072+0000 7f4e594ca640 1 -- 172.21.15.86:0/3425834601 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e4c049af0 con 0x7f4e4c0e6030 2024-09-19T06:46:34.076 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.074+0000 7f4e594ca640 1 -- 172.21.15.86:0/3425834601 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e4c046400 con 0x7f4e4c0e6030 2024-09-19T06:46:34.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.084+0000 7f4e50ff9640 1 -- 172.21.15.86:0/3425834601 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4e54096030 con 0x7f4e4c0e6030 2024-09-19T06:46:34.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.085+0000 7f4e50ff9640 1 --2- 172.21.15.86:0/3425834601 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f4e3806c3b0 0x7f4e3806e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:34.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.085+0000 7f4e50ff9640 1 -- 172.21.15.86:0/3425834601 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7f4e54107f40 con 0x7f4e4c0e6030 2024-09-19T06:46:34.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.085+0000 7f4e50ff9640 1 -- 172.21.15.86:0/3425834601 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4e4c046400 con 0x7f4e4c0e6030 2024-09-19T06:46:34.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.090+0000 7f4e53fff640 1 --2- 172.21.15.86:0/3425834601 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f4e3806c3b0 0x7f4e3806e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:34.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.091+0000 7f4e53fff640 1 --2- 172.21.15.86:0/3425834601 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f4e3806c3b0 0x7f4e3806e870 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4e48009990 tx=0x7f4e48009110 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:34.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.418+0000 7f4e594ca640 1 -- 172.21.15.86:0/3425834601 --> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f4e4c0c51e0 con 0x7f4e3806c3b0 2024-09-19T06:46:34.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.420+0000 7f4e50ff9640 1 -- 172.21.15.86:0/3425834601 <== mgr.4105 v2:172.21.15.86:6816/4165134248 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4e4c0c51e0 con 0x7f4e3806c3b0 2024-09-19T06:46:34.424 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 0 to deep-scrub 2024-09-19T06:46:34.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.426+0000 7f4e594ca640 1 -- 172.21.15.86:0/3425834601 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f4e3806c3b0 msgr2=0x7f4e3806e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:34.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.426+0000 7f4e594ca640 1 --2- 172.21.15.86:0/3425834601 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f4e3806c3b0 0x7f4e3806e870 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4e48009990 tx=0x7f4e48009110 comp rx=0 tx=0).stop 2024-09-19T06:46:34.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.426+0000 7f4e594ca640 1 -- 172.21.15.86:0/3425834601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e4c0e6030 msgr2=0x7f4e4c047ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:34.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.426+0000 7f4e594ca640 1 --2- 172.21.15.86:0/3425834601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e4c0e6030 0x7f4e4c047ab0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4e540767b0 tx=0x7f4e540692f0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.426+0000 7f4e594ca640 1 -- 172.21.15.86:0/3425834601 shutdown_connections 2024-09-19T06:46:34.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.426+0000 7f4e594ca640 1 --2- 172.21.15.86:0/3425834601 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f4e3806c3b0 0x7f4e3806e870 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.426+0000 7f4e594ca640 1 --2- 172.21.15.86:0/3425834601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e4c0e6030 0x7f4e4c047ab0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.426+0000 7f4e594ca640 1 --2- 172.21.15.86:0/3425834601 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e4c0dce90 0x7f4e4c0e5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.426+0000 7f4e594ca640 1 --2- 172.21.15.86:0/3425834601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e4c04aa40 0x7f4e4c0e3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.426+0000 7f4e594ca640 1 -- 172.21.15.86:0/3425834601 >> 172.21.15.86:0/3425834601 conn(0x7f4e4c04fc50 msgr2=0x7f4e4c0c7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:34.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.427+0000 7f4e594ca640 1 -- 172.21.15.86:0/3425834601 shutdown_connections 2024-09-19T06:46:34.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.429+0000 7f4e594ca640 1 -- 172.21.15.86:0/3425834601 wait complete. 2024-09-19T06:46:34.451 INFO:tasks.ceph:Scrubbing osd.1 2024-09-19T06:46:34.451 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-19T06:46:34.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.611+0000 7f9e8d2b7640 1 Processor -- start 2024-09-19T06:46:34.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.611+0000 7f9e8d2b7640 1 -- start start 2024-09-19T06:46:34.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.612+0000 7f9e8d2b7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e880c7a40 0x7f9e88072730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:34.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.612+0000 7f9e8d2b7640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9e8806bbc0 0x7f9e881632d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:34.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.612+0000 7f9e8d2b7640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e8806bfc0 con 0x7f9e880c7e20 2024-09-19T06:46:34.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.612+0000 7f9e8d2b7640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f9e88071170 con 0x7f9e8806bbc0 2024-09-19T06:46:34.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.612+0000 7f9e8d2b7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9e88071a00 con 0x7f9e880c7a40 2024-09-19T06:46:34.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.614+0000 7f9e867fc640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9e8806bbc0 0x7f9e881632d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:34.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.614+0000 7f9e867fc640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9e8806bbc0 0x7f9e881632d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:32806/0 (socket says 172.21.15.86:32806) 2024-09-19T06:46:34.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.614+0000 7f9e867fc640 1 -- 172.21.15.86:0/3770662263 learned_addr learned my addr 172.21.15.86:0/3770662263 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:34.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.614+0000 7f9e867fc640 1 -- 172.21.15.86:0/3770662263 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e880c7a40 msgr2=0x7f9e88072730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:46:34.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.614+0000 7f9e867fc640 1 --2- 172.21.15.86:0/3770662263 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e880c7a40 0x7f9e88072730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.614+0000 7f9e867fc640 1 -- 172.21.15.86:0/3770662263 >> v1:172.21.15.169:6789/0 conn(0x7f9e880c7e20 legacy=0x7f9e88159230 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:46:34.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.614+0000 7f9e867fc640 1 -- 172.21.15.86:0/3770662263 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e88163810 con 0x7f9e8806bbc0 2024-09-19T06:46:34.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.616+0000 7f9e867fc640 1 --2- 172.21.15.86:0/3770662263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e8806bbc0 0x7f9e881632d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000b1a0 tx=0x7f9e8002a9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4986728e0d7d1910 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:34.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.618+0000 7f9e85ffb640 1 -- 172.21.15.86:0/3770662263 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e80033020 con 0x7f9e8806bbc0 2024-09-19T06:46:34.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.618+0000 7f9e85ffb640 1 -- 172.21.15.86:0/3770662263 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e8002f3f0 con 0x7f9e8806bbc0 2024-09-19T06:46:34.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.618+0000 7f9e85ffb640 1 -- 172.21.15.86:0/3770662263 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8002f7c0 con 0x7f9e8806bbc0 2024-09-19T06:46:34.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.621+0000 7f9e8d2b7640 1 -- 172.21.15.86:0/3770662263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e8806bbc0 msgr2=0x7f9e881632d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:34.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.621+0000 7f9e8d2b7640 1 --2- 172.21.15.86:0/3770662263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e8806bbc0 0x7f9e881632d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000b1a0 tx=0x7f9e8002a9e0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.621+0000 7f9e8d2b7640 1 -- 172.21.15.86:0/3770662263 shutdown_connections 2024-09-19T06:46:34.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.621+0000 7f9e8d2b7640 1 --2- 172.21.15.86:0/3770662263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e8806bbc0 0x7f9e881632d0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.621+0000 7f9e8d2b7640 1 --2- 172.21.15.86:0/3770662263 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e880c7a40 0x7f9e88072730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.622+0000 7f9e8d2b7640 1 -- 172.21.15.86:0/3770662263 >> 172.21.15.86:0/3770662263 conn(0x7f9e880c9280 msgr2=0x7f9e880c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:34.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.628+0000 7f9e8d2b7640 1 -- 172.21.15.86:0/3770662263 shutdown_connections 2024-09-19T06:46:34.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.632+0000 7f9e8d2b7640 1 -- 172.21.15.86:0/3770662263 wait complete. 2024-09-19T06:46:34.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.634+0000 7f9e8d2b7640 1 Processor -- start 2024-09-19T06:46:34.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.634+0000 7f9e8d2b7640 1 -- start start 2024-09-19T06:46:34.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.635+0000 7f9e8d2b7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e8806bbc0 0x7f9e8815d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:34.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.635+0000 7f9e8d2b7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e880c7a40 0x7f9e8815e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:34.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.635+0000 7f9e8d2b7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e880c7e20 0x7f9e88160f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:34.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.635+0000 7f9e8d2b7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9e88071c50 con 0x7f9e8806bbc0 2024-09-19T06:46:34.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.635+0000 7f9e8d2b7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9e88071680 con 0x7f9e880c7a40 2024-09-19T06:46:34.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.635+0000 7f9e8d2b7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9e88071f30 con 0x7f9e880c7e20 2024-09-19T06:46:34.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.635+0000 7f9e877fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e880c7e20 0x7f9e88160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:34.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.635+0000 7f9e877fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e880c7e20 0x7f9e88160f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:47364/0 (socket says 172.21.15.86:47364) 2024-09-19T06:46:34.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.635+0000 7f9e877fe640 1 -- 172.21.15.86:0/1838143250 learned_addr learned my addr 172.21.15.86:0/1838143250 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:34.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.636+0000 7f9e877fe640 1 -- 172.21.15.86:0/1838143250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e880c7a40 msgr2=0x7f9e8815e000 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:46:34.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.636+0000 7f9e877fe640 1 --2- 172.21.15.86:0/1838143250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e880c7a40 0x7f9e8815e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.636+0000 7f9e877fe640 1 -- 172.21.15.86:0/1838143250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e8806bbc0 msgr2=0x7f9e8815d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:34.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.636+0000 7f9e877fe640 1 --2- 172.21.15.86:0/1838143250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e8806bbc0 0x7f9e8815d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.636+0000 7f9e877fe640 1 -- 172.21.15.86:0/1838143250 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e881565e0 con 0x7f9e880c7e20 2024-09-19T06:46:34.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.645+0000 7f9e877fe640 1 --2- 172.21.15.86:0/1838143250 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e880c7e20 0x7f9e88160f30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00b4c0 tx=0x7f9e7c00b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:34.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.648+0000 7f9e6f7fe640 1 -- 172.21.15.86:0/1838143250 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c015020 con 0x7f9e880c7e20 2024-09-19T06:46:34.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.648+0000 7f9e8d2b7640 1 -- 172.21.15.86:0/1838143250 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e88163160 con 0x7f9e880c7e20 2024-09-19T06:46:34.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.648+0000 7f9e8d2b7640 1 -- 172.21.15.86:0/1838143250 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e88160730 con 0x7f9e880c7e20 2024-09-19T06:46:34.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.649+0000 7f9e8d2b7640 1 -- 172.21.15.86:0/1838143250 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9e880c8e70 con 0x7f9e880c7e20 2024-09-19T06:46:34.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.649+0000 7f9e6f7fe640 1 -- 172.21.15.86:0/1838143250 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e7c011850 con 0x7f9e880c7e20 2024-09-19T06:46:34.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.649+0000 7f9e6f7fe640 1 -- 172.21.15.86:0/1838143250 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c011c40 con 0x7f9e880c7e20 2024-09-19T06:46:34.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.665+0000 7f9e6f7fe640 1 -- 172.21.15.86:0/1838143250 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9e7c018020 con 0x7f9e880c7e20 2024-09-19T06:46:34.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.665+0000 7f9e6f7fe640 1 --2- 172.21.15.86:0/1838143250 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9e7406c380 0x7f9e7406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:34.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.665+0000 7f9e6f7fe640 1 -- 172.21.15.86:0/1838143250 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7f9e7c08bfb0 con 0x7f9e880c7e20 2024-09-19T06:46:34.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.666+0000 7f9e6f7fe640 1 --2- 172.21.15.86:0/1838143250 >> [v2:172.21.15.86:6818/1785682938,v1:172.21.15.86:6819/1785682938] conn(0x7f9e74076240 0x7f9e740786e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:34.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.666+0000 7f9e6f7fe640 1 -- 172.21.15.86:0/1838143250 --> [v2:172.21.15.86:6818/1785682938,v1:172.21.15.86:6819/1785682938] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9e7c006730 con 0x7f9e74076240 2024-09-19T06:46:34.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.666+0000 7f9e6f7fe640 1 -- 172.21.15.86:0/1838143250 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9e7c08c3a0 con 0x7f9e880c7e20 2024-09-19T06:46:34.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.666+0000 7f9e86ffd640 1 --2- 172.21.15.86:0/1838143250 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9e7406c380 0x7f9e7406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:34.668 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.666+0000 7f9e86ffd640 1 --2- 172.21.15.86:0/1838143250 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9e7406c380 0x7f9e7406e840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9e780096f0 tx=0x7f9e78006c40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:34.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.667+0000 7f9e867fc640 1 --2- 172.21.15.86:0/1838143250 >> [v2:172.21.15.86:6818/1785682938,v1:172.21.15.86:6819/1785682938] conn(0x7f9e74076240 0x7f9e740786e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:34.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.668+0000 7f9e867fc640 1 --2- 172.21.15.86:0/1838143250 >> [v2:172.21.15.86:6818/1785682938,v1:172.21.15.86:6819/1785682938] conn(0x7f9e74076240 0x7f9e740786e0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:34.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.670+0000 7f9e6f7fe640 1 -- 172.21.15.86:0/1838143250 <== osd.1 v2:172.21.15.86:6818/1785682938 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9e7c006730 con 0x7f9e74076240 2024-09-19T06:46:34.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.706+0000 7f9e8d2b7640 1 -- 172.21.15.86:0/1838143250 --> [v2:172.21.15.86:6818/1785682938,v1:172.21.15.86:6819/1785682938] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9e88156870 con 0x7f9e74076240 2024-09-19T06:46:34.732 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-19T06:46:34.732 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T06:46:34.732 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-19T06:46:34.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.730+0000 7f9e6f7fe640 1 -- 172.21.15.86:0/1838143250 <== osd.1 v2:172.21.15.86:6818/1785682938 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9e88156870 con 0x7f9e74076240 2024-09-19T06:46:34.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.733+0000 7f9e8d2b7640 1 -- 172.21.15.86:0/1838143250 >> [v2:172.21.15.86:6818/1785682938,v1:172.21.15.86:6819/1785682938] conn(0x7f9e74076240 msgr2=0x7f9e740786e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:34.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.733+0000 7f9e8d2b7640 1 --2- 172.21.15.86:0/1838143250 >> [v2:172.21.15.86:6818/1785682938,v1:172.21.15.86:6819/1785682938] conn(0x7f9e74076240 0x7f9e740786e0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.737+0000 7f9e8d2b7640 1 -- 172.21.15.86:0/1838143250 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9e7406c380 msgr2=0x7f9e7406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:34.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.737+0000 7f9e8d2b7640 1 --2- 172.21.15.86:0/1838143250 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f9e7406c380 0x7f9e7406e840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9e780096f0 tx=0x7f9e78006c40 comp rx=0 tx=0).stop 2024-09-19T06:46:34.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.737+0000 7f9e8d2b7640 1 -- 172.21.15.86:0/1838143250 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e880c7e20 msgr2=0x7f9e88160f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:34.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.737+0000 7f9e8d2b7640 1 --2- 172.21.15.86:0/1838143250 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e880c7e20 0x7f9e88160f30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00b4c0 tx=0x7f9e7c00b980 comp rx=0 tx=0).stop 2024-09-19T06:46:34.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.737+0000 7f9e877fe640 1 -- 172.21.15.86:0/1838143250 reap_dead start 2024-09-19T06:46:34.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.737+0000 7f9e8d2b7640 1 -- 172.21.15.86:0/1838143250 shutdown_connections 2024-09-19T06:46:34.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.737+0000 7f9e8d2b7640 1 -- 172.21.15.86:0/1838143250 >> 172.21.15.86:0/1838143250 conn(0x7f9e880c9280 msgr2=0x7f9e881ea190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:34.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.737+0000 7f9e8d2b7640 1 -- 172.21.15.86:0/1838143250 shutdown_connections 2024-09-19T06:46:34.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.737+0000 7f9e8d2b7640 1 -- 172.21.15.86:0/1838143250 wait complete. 2024-09-19T06:46:34.755 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-19T06:46:34.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.937+0000 7f75f98eb640 1 Processor -- start 2024-09-19T06:46:34.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.937+0000 7f75f98eb640 1 -- start start 2024-09-19T06:46:34.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.939+0000 7f75f98eb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75ec0d8550 0x7f75ec0d8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:34.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.939+0000 7f75f98eb640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f75ec0e1dd0 0x7f75ec0e2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:34.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.939+0000 7f75f98eb640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75ec049500 con 0x7f75ec050e00 2024-09-19T06:46:34.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.939+0000 7f75f98eb640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f75ec04a580 con 0x7f75ec0e1dd0 2024-09-19T06:46:34.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.939+0000 7f75f98eb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f75ec0492b0 con 0x7f75ec0d8550 2024-09-19T06:46:34.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.939+0000 7f75f2ffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75ec0d8550 0x7f75ec0d8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:34.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.939+0000 7f75f2ffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75ec0d8550 0x7f75ec0d8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:47376/0 (socket says 172.21.15.86:47376) 2024-09-19T06:46:34.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.939+0000 7f75f2ffd640 1 -- 172.21.15.86:0/1900142144 learned_addr learned my addr 172.21.15.86:0/1900142144 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:34.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.939+0000 7f75f37fe640 1 --2- 172.21.15.86:0/1900142144 >> v2:172.21.15.169:3300/0 conn(0x7f75ec0e1dd0 0x7f75ec0e2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:34.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.940+0000 7f75f2ffd640 1 -- 172.21.15.86:0/1900142144 >> v2:172.21.15.169:3300/0 conn(0x7f75ec0e1dd0 msgr2=0x7f75ec0e2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:34.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.940+0000 7f75f2ffd640 1 --2- 172.21.15.86:0/1900142144 >> v2:172.21.15.169:3300/0 conn(0x7f75ec0e1dd0 0x7f75ec0e2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.940+0000 7f75f2ffd640 1 -- 172.21.15.86:0/1900142144 >> v1:172.21.15.169:6789/0 conn(0x7f75ec050e00 legacy=0x7f75ec005d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:46:34.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.940+0000 7f75f2ffd640 1 -- 172.21.15.86:0/1900142144 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ec0497e0 con 0x7f75ec0d8550 2024-09-19T06:46:34.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.941+0000 7f75f2ffd640 1 --2- 172.21.15.86:0/1900142144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75ec0d8550 0x7f75ec0d8930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f75f4065240 tx=0x7f75f40a7230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4840a0f5f53ef66 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:34.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.942+0000 7f75f1ffb640 1 -- 172.21.15.86:0/1900142144 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f40b4070 con 0x7f75ec0d8550 2024-09-19T06:46:34.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.942+0000 7f75f1ffb640 1 -- 172.21.15.86:0/1900142144 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75f40af440 con 0x7f75ec0d8550 2024-09-19T06:46:34.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.942+0000 7f75f1ffb640 1 -- 172.21.15.86:0/1900142144 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f40af8b0 con 0x7f75ec0d8550 2024-09-19T06:46:34.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.943+0000 7f75f98eb640 1 -- 172.21.15.86:0/1900142144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75ec0d8550 msgr2=0x7f75ec0d8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:34.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.943+0000 7f75f98eb640 1 --2- 172.21.15.86:0/1900142144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75ec0d8550 0x7f75ec0d8930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f75f4065240 tx=0x7f75f40a7230 comp rx=0 tx=0).stop 2024-09-19T06:46:34.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.944+0000 7f75f98eb640 1 -- 172.21.15.86:0/1900142144 shutdown_connections 2024-09-19T06:46:34.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.944+0000 7f75f98eb640 1 --2- 172.21.15.86:0/1900142144 >> v2:172.21.15.169:3300/0 conn(0x7f75ec0e1dd0 0x7f75ec0e2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.944+0000 7f75f98eb640 1 --2- 172.21.15.86:0/1900142144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75ec0d8550 0x7f75ec0d8930 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.944+0000 7f75f98eb640 1 -- 172.21.15.86:0/1900142144 >> 172.21.15.86:0/1900142144 conn(0x7f75ec00ea10 msgr2=0x7f75ec00fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:34.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.946+0000 7f75f98eb640 1 -- 172.21.15.86:0/1900142144 shutdown_connections 2024-09-19T06:46:34.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.950+0000 7f75f98eb640 1 -- 172.21.15.86:0/1900142144 wait complete. 2024-09-19T06:46:34.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.952+0000 7f75f98eb640 1 Processor -- start 2024-09-19T06:46:34.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.954+0000 7f75f98eb640 1 -- start start 2024-09-19T06:46:34.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.955+0000 7f75f98eb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75ec050e00 0x7f75ec0cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:34.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.955+0000 7f75f98eb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75ec0d8550 0x7f75ec0ce630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:34.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.955+0000 7f75f98eb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75ec0e1dd0 0x7f75ec0e0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:34.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.955+0000 7f75f98eb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec04a080 con 0x7f75ec0d8550 2024-09-19T06:46:34.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.956+0000 7f75f98eb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec049da0 con 0x7f75ec050e00 2024-09-19T06:46:34.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.956+0000 7f75f98eb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f75ec0370b0 con 0x7f75ec0e1dd0 2024-09-19T06:46:34.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.956+0000 7f75f37fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75ec0e1dd0 0x7f75ec0e0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:34.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.956+0000 7f75f37fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75ec0e1dd0 0x7f75ec0e0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:47382/0 (socket says 172.21.15.86:47382) 2024-09-19T06:46:34.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.956+0000 7f75f37fe640 1 -- 172.21.15.86:0/3814611675 learned_addr learned my addr 172.21.15.86:0/3814611675 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:34.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.956+0000 7f75f27fc640 1 --2- 172.21.15.86:0/3814611675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75ec0d8550 0x7f75ec0ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:34.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.956+0000 7f75f2ffd640 1 --2- 172.21.15.86:0/3814611675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75ec050e00 0x7f75ec0cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:34.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.957+0000 7f75f37fe640 1 -- 172.21.15.86:0/3814611675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75ec050e00 msgr2=0x7f75ec0cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:34.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.957+0000 7f75f37fe640 1 --2- 172.21.15.86:0/3814611675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75ec050e00 0x7f75ec0cf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.957+0000 7f75f37fe640 1 -- 172.21.15.86:0/3814611675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75ec0d8550 msgr2=0x7f75ec0ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:34.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.957+0000 7f75f37fe640 1 --2- 172.21.15.86:0/3814611675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75ec0d8550 0x7f75ec0ce630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.957+0000 7f75f37fe640 1 -- 172.21.15.86:0/3814611675 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ec0d12e0 con 0x7f75ec0e1dd0 2024-09-19T06:46:34.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.959+0000 7f75f37fe640 1 --2- 172.21.15.86:0/3814611675 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75ec0e1dd0 0x7f75ec0e0c60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f75e800e820 tx=0x7f75e800ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:34.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.964+0000 7f75dbfff640 1 -- 172.21.15.86:0/3814611675 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e8017070 con 0x7f75ec0e1dd0 2024-09-19T06:46:34.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.964+0000 7f75f98eb640 1 -- 172.21.15.86:0/3814611675 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75ec0cf8e0 con 0x7f75ec0e1dd0 2024-09-19T06:46:34.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.964+0000 7f75f98eb640 1 -- 172.21.15.86:0/3814611675 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f75ec0d0800 con 0x7f75ec0e1dd0 2024-09-19T06:46:34.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.965+0000 7f75dbfff640 1 -- 172.21.15.86:0/3814611675 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e800ee70 con 0x7f75ec0e1dd0 2024-09-19T06:46:34.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.965+0000 7f75dbfff640 1 -- 172.21.15.86:0/3814611675 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e800cb60 con 0x7f75ec0e1dd0 2024-09-19T06:46:34.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.966+0000 7f75d9ffb640 1 -- 172.21.15.86:0/3814611675 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75d4005290 con 0x7f75ec0e1dd0 2024-09-19T06:46:34.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.970+0000 7f75dbfff640 1 -- 172.21.15.86:0/3814611675 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f75e801a070 con 0x7f75ec0e1dd0 2024-09-19T06:46:34.972 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.971+0000 7f75dbfff640 1 --2- 172.21.15.86:0/3814611675 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f75e006c3b0 0x7f75e006e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:34.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.971+0000 7f75dbfff640 1 -- 172.21.15.86:0/3814611675 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7f75e808b930 con 0x7f75ec0e1dd0 2024-09-19T06:46:34.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.971+0000 7f75f2ffd640 1 --2- 172.21.15.86:0/3814611675 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f75e006c3b0 0x7f75e006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:34.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.972+0000 7f75f2ffd640 1 --2- 172.21.15.86:0/3814611675 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f75e006c3b0 0x7f75e006e870 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f75ec051640 tx=0x7f75f40ab000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:34.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:34.975+0000 7f75dbfff640 1 -- 172.21.15.86:0/3814611675 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f75e8059390 con 0x7f75ec0e1dd0 2024-09-19T06:46:35.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.332+0000 7f75d9ffb640 1 -- 172.21.15.86:0/3814611675 --> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f75d4000bc0 con 0x7f75e006c3b0 2024-09-19T06:46:35.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.332+0000 7f75dbfff640 1 -- 172.21.15.86:0/3814611675 <== mgr.4105 v2:172.21.15.86:6816/4165134248 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f75d4000bc0 con 0x7f75e006c3b0 2024-09-19T06:46:35.334 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 1 to deep-scrub 2024-09-19T06:46:35.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.339+0000 7f75f98eb640 1 -- 172.21.15.86:0/3814611675 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f75e006c3b0 msgr2=0x7f75e006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:35.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.339+0000 7f75f98eb640 1 --2- 172.21.15.86:0/3814611675 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f75e006c3b0 0x7f75e006e870 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f75ec051640 tx=0x7f75f40ab000 comp rx=0 tx=0).stop 2024-09-19T06:46:35.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.339+0000 7f75f98eb640 1 -- 172.21.15.86:0/3814611675 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75ec0e1dd0 msgr2=0x7f75ec0e0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:35.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.339+0000 7f75f98eb640 1 --2- 172.21.15.86:0/3814611675 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75ec0e1dd0 0x7f75ec0e0c60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f75e800e820 tx=0x7f75e800ec20 comp rx=0 tx=0).stop 2024-09-19T06:46:35.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.339+0000 7f75f98eb640 1 -- 172.21.15.86:0/3814611675 shutdown_connections 2024-09-19T06:46:35.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.339+0000 7f75f98eb640 1 --2- 172.21.15.86:0/3814611675 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f75e006c3b0 0x7f75e006e870 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:35.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.339+0000 7f75f98eb640 1 --2- 172.21.15.86:0/3814611675 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75ec0e1dd0 0x7f75ec0e0c60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:35.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.339+0000 7f75f98eb640 1 --2- 172.21.15.86:0/3814611675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75ec0d8550 0x7f75ec0ce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:35.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.339+0000 7f75f98eb640 1 --2- 172.21.15.86:0/3814611675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75ec050e00 0x7f75ec0cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:35.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.340+0000 7f75f98eb640 1 -- 172.21.15.86:0/3814611675 >> 172.21.15.86:0/3814611675 conn(0x7f75ec00ea10 msgr2=0x7f75ec053140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:35.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.344+0000 7f75f98eb640 1 -- 172.21.15.86:0/3814611675 shutdown_connections 2024-09-19T06:46:35.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.344+0000 7f75f98eb640 1 -- 172.21.15.86:0/3814611675 wait complete. 2024-09-19T06:46:35.367 INFO:tasks.ceph:Scrubbing osd.2 2024-09-19T06:46:35.367 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-19T06:46:35.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.547+0000 7f6aa422e640 1 Processor -- start 2024-09-19T06:46:35.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.547+0000 7f6aa422e640 1 -- start start 2024-09-19T06:46:35.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.549+0000 7f6aa422e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6a9c06c210 0x7f6a9c156da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:35.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.549+0000 7f6aa422e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a9c06cb70 0x7f6a9c0c8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:35.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.549+0000 7f6aa422e640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a9c0c75e0 con 0x7f6a9c06be30 2024-09-19T06:46:35.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.549+0000 7f6aa422e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f6a9c0c78c0 con 0x7f6a9c06c210 2024-09-19T06:46:35.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.549+0000 7f6aa422e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6a9c0c7ba0 con 0x7f6a9c06cb70 2024-09-19T06:46:35.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.549+0000 7f6aa1fca640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6a9c06be30 0x7f6a9c150c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:44304/0 (socket says 172.21.15.86:44304) 2024-09-19T06:46:35.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.549+0000 7f6aa1fca640 1 -- 172.21.15.86:0/3579109325 learned_addr learned my addr 172.21.15.86:0/3579109325 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:46:35.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.550+0000 7f6aa0fc8640 1 -- 172.21.15.86:0/3579109325 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3276920643 0 0) 0x7f6a9c0c75e0 con 0x7f6a9c06be30 2024-09-19T06:46:35.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.550+0000 7f6aa0fc8640 1 -- 172.21.15.86:0/3579109325 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a88003520 con 0x7f6a9c06be30 2024-09-19T06:46:35.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.550+0000 7f6aa0fc8640 1 -- 172.21.15.86:0/3579109325 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2170514672 0 0) 0x7f6a88003520 con 0x7f6a9c06be30 2024-09-19T06:46:35.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.550+0000 7f6aa0fc8640 1 -- 172.21.15.86:0/3579109325 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a9c06cb70 msgr2=0x7f6a9c0c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:35.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.550+0000 7f6aa0fc8640 1 --2- 172.21.15.86:0/3579109325 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a9c06cb70 0x7f6a9c0c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:35.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.550+0000 7f6aa0fc8640 1 -- 172.21.15.86:0/3579109325 >> v2:172.21.15.169:3300/0 conn(0x7f6a9c06c210 msgr2=0x7f6a9c156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:35.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.550+0000 7f6aa0fc8640 1 --2- 172.21.15.86:0/3579109325 >> v2:172.21.15.169:3300/0 conn(0x7f6a9c06c210 0x7f6a9c156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:35.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.550+0000 7f6aa0fc8640 1 -- 172.21.15.86:0/3579109325 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a9c0c7e80 con 0x7f6a9c06be30 2024-09-19T06:46:35.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.550+0000 7f6aa0fc8640 1 -- 172.21.15.86:0/3579109325 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f6a98001670 con 0x7f6a9c06be30 2024-09-19T06:46:35.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.551+0000 7f6aa0fc8640 1 -- 172.21.15.86:0/3579109325 >> v1:172.21.15.86:6789/0 conn(0x7f6a9c06be30 legacy=0x7f6a9c150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:35.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.551+0000 7f6aa0fc8640 1 --2- 172.21.15.86:0/3579109325 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a9c06cb70 0x7f6a880039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:35.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.551+0000 7f6aa0fc8640 1 --2- 172.21.15.86:0/3579109325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a880040c0 0x7f6a88004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:35.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.551+0000 7f6aa0fc8640 1 --2- 172.21.15.86:0/3579109325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a88004d90 0x7f6a88005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:35.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.551+0000 7f6aa0fc8640 1 -- 172.21.15.86:0/3579109325 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9c0c78c0 con 0x7f6a88004d90 2024-09-19T06:46:35.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.551+0000 7f6aa0fc8640 1 -- 172.21.15.86:0/3579109325 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9c0c7ba0 con 0x7f6a880040c0 2024-09-19T06:46:35.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.551+0000 7f6aa0fc8640 1 -- 172.21.15.86:0/3579109325 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6a8800bd20 con 0x7f6a9c06cb70 2024-09-19T06:46:35.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.551+0000 7f6aa17c9640 1 --2- 172.21.15.86:0/3579109325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a880040c0 0x7f6a88004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:35.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.552+0000 7f6aa17c9640 1 -- 172.21.15.86:0/3579109325 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a9c06cb70 msgr2=0x7f6a880039b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:46:35.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.552+0000 7f6aa17c9640 1 --2- 172.21.15.86:0/3579109325 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a9c06cb70 0x7f6a880039b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:35.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.552+0000 7f6aa17c9640 1 -- 172.21.15.86:0/3579109325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a88004d90 msgr2=0x7f6a88005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:35.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.552+0000 7f6aa17c9640 1 --2- 172.21.15.86:0/3579109325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a88004d90 0x7f6a88005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:35.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.552+0000 7f6aa17c9640 1 -- 172.21.15.86:0/3579109325 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a9c0c7e80 con 0x7f6a880040c0 2024-09-19T06:46:35.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.553+0000 7f6aa17c9640 1 --2- 172.21.15.86:0/3579109325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a880040c0 0x7f6a88004800 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c06c620 tx=0x7f6a88005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18bf51c98e281bc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:35.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.553+0000 7f6aa0fc8640 1 -- 172.21.15.86:0/3579109325 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c037070 con 0x7f6a880040c0 2024-09-19T06:46:35.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.553+0000 7f6aa0fc8640 1 -- 172.21.15.86:0/3579109325 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a8c02aaa0 con 0x7f6a880040c0 2024-09-19T06:46:35.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.554+0000 7f6aa0fc8640 1 -- 172.21.15.86:0/3579109325 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c009460 con 0x7f6a880040c0 2024-09-19T06:46:35.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.554+0000 7f6aa422e640 1 -- 172.21.15.86:0/3579109325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a880040c0 msgr2=0x7f6a88004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:35.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.554+0000 7f6aa422e640 1 --2- 172.21.15.86:0/3579109325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a880040c0 0x7f6a88004800 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c06c620 tx=0x7f6a88005830 comp rx=0 tx=0).stop 2024-09-19T06:46:35.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.554+0000 7f6aa27cb640 1 -- 172.21.15.86:0/3579109325 reap_dead start 2024-09-19T06:46:35.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.554+0000 7f6aa422e640 1 -- 172.21.15.86:0/3579109325 shutdown_connections 2024-09-19T06:46:35.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.554+0000 7f6aa422e640 1 -- 172.21.15.86:0/3579109325 >> 172.21.15.86:0/3579109325 conn(0x7f6a9c0cc530 msgr2=0x7f6a9c0cc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:35.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.558+0000 7f6aa422e640 1 -- 172.21.15.86:0/3579109325 shutdown_connections 2024-09-19T06:46:35.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.558+0000 7f6aa422e640 1 -- 172.21.15.86:0/3579109325 wait complete. 2024-09-19T06:46:35.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.560+0000 7f6aa422e640 1 Processor -- start 2024-09-19T06:46:35.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.560+0000 7f6aa422e640 1 -- start start 2024-09-19T06:46:35.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.561+0000 7f6aa422e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a9c148b10 0x7f6a9c0c4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:35.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.561+0000 7f6aa422e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a9c14eed0 0x7f6a9c1ede90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:35.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.561+0000 7f6aa422e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a9c148ef0 0x7f6a9c1ee3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:35.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.561+0000 7f6aa422e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9c151330 con 0x7f6a9c148b10 2024-09-19T06:46:35.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.561+0000 7f6aa422e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9c0c8440 con 0x7f6a9c148ef0 2024-09-19T06:46:35.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.561+0000 7f6aa422e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6a9c1514b0 con 0x7f6a9c14eed0 2024-09-19T06:46:35.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.562+0000 7f6aa27cb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a9c148ef0 0x7f6a9c1ee3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:35.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.562+0000 7f6aa1fca640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a9c148b10 0x7f6a9c0c4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:35.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.562+0000 7f6aa27cb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a9c148ef0 0x7f6a9c1ee3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:47434/0 (socket says 172.21.15.86:47434) 2024-09-19T06:46:35.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.562+0000 7f6aa27cb640 1 -- 172.21.15.86:0/3576530090 learned_addr learned my addr 172.21.15.86:0/3576530090 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:35.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.563+0000 7f6aa1fca640 1 -- 172.21.15.86:0/3576530090 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a9c14eed0 msgr2=0x7f6a9c1ede90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:46:35.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.563+0000 7f6aa1fca640 1 --2- 172.21.15.86:0/3576530090 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a9c14eed0 0x7f6a9c1ede90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:35.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.564+0000 7f6aa1fca640 1 -- 172.21.15.86:0/3576530090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a9c148ef0 msgr2=0x7f6a9c1ee3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:35.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.564+0000 7f6aa1fca640 1 --2- 172.21.15.86:0/3576530090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a9c148ef0 0x7f6a9c1ee3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:35.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.564+0000 7f6aa1fca640 1 -- 172.21.15.86:0/3576530090 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a9c14e0a0 con 0x7f6a9c148b10 2024-09-19T06:46:35.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.564+0000 7f6aa1fca640 1 --2- 172.21.15.86:0/3576530090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a9c148b10 0x7f6a9c0c4a60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c070a20 tx=0x7f6a9800dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:35.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.565+0000 7f6a927fc640 1 -- 172.21.15.86:0/3576530090 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9800b9b0 con 0x7f6a9c148b10 2024-09-19T06:46:35.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.565+0000 7f6aa422e640 1 -- 172.21.15.86:0/3576530090 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a9c0c3b60 con 0x7f6a9c148b10 2024-09-19T06:46:35.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.565+0000 7f6aa422e640 1 -- 172.21.15.86:0/3576530090 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a9c14e910 con 0x7f6a9c148b10 2024-09-19T06:46:35.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.565+0000 7f6a927fc640 1 -- 172.21.15.86:0/3576530090 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a98015020 con 0x7f6a9c148b10 2024-09-19T06:46:35.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.566+0000 7f6a927fc640 1 -- 172.21.15.86:0/3576530090 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9800bbf0 con 0x7f6a9c148b10 2024-09-19T06:46:35.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.566+0000 7f6aa422e640 1 -- 172.21.15.86:0/3576530090 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6a84001030 con 0x7f6a9c148b10 2024-09-19T06:46:35.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.570+0000 7f6a927fc640 1 -- 172.21.15.86:0/3576530090 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6a980103f0 con 0x7f6a9c148b10 2024-09-19T06:46:35.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.571+0000 7f6a927fc640 1 --2- 172.21.15.86:0/3576530090 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6a80070710 0x7f6a80072bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:35.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.571+0000 7f6a927fc640 1 -- 172.21.15.86:0/3576530090 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7f6a9808c600 con 0x7f6a9c148b10 2024-09-19T06:46:35.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.571+0000 7f6a927fc640 1 --2- 172.21.15.86:0/3576530090 >> [v2:172.21.15.86:6800/3306127846,v1:172.21.15.86:6801/3306127846] conn(0x7f6a8007a5d0 0x7f6a8007ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:35.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.573+0000 7f6a927fc640 1 -- 172.21.15.86:0/3576530090 --> [v2:172.21.15.86:6800/3306127846,v1:172.21.15.86:6801/3306127846] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6a9800ee50 con 0x7f6a8007a5d0 2024-09-19T06:46:35.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.573+0000 7f6aa27cb640 1 --2- 172.21.15.86:0/3576530090 >> [v2:172.21.15.86:6800/3306127846,v1:172.21.15.86:6801/3306127846] conn(0x7f6a8007a5d0 0x7f6a8007ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:35.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.573+0000 7f6a927fc640 1 -- 172.21.15.86:0/3576530090 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6a9808cae0 con 0x7f6a9c148b10 2024-09-19T06:46:35.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.574+0000 7f6aa17c9640 1 --2- 172.21.15.86:0/3576530090 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6a80070710 0x7f6a80072bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:35.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.574+0000 7f6aa27cb640 1 --2- 172.21.15.86:0/3576530090 >> [v2:172.21.15.86:6800/3306127846,v1:172.21.15.86:6801/3306127846] conn(0x7f6a8007a5d0 0x7f6a8007ca70 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:35.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.575+0000 7f6aa17c9640 1 --2- 172.21.15.86:0/3576530090 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6a80070710 0x7f6a80072bd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c034000 tx=0x7f6a8c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:35.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.575+0000 7f6a927fc640 1 -- 172.21.15.86:0/3576530090 <== osd.2 v2:172.21.15.86:6800/3306127846 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6a9800ee50 con 0x7f6a8007a5d0 2024-09-19T06:46:35.606 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.603+0000 7f6aa422e640 1 -- 172.21.15.86:0/3576530090 --> [v2:172.21.15.86:6800/3306127846,v1:172.21.15.86:6801/3306127846] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6a84002e30 con 0x7f6a8007a5d0 2024-09-19T06:46:35.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.605+0000 7f6a927fc640 1 -- 172.21.15.86:0/3576530090 <== osd.2 v2:172.21.15.86:6800/3306127846 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6a84002e30 con 0x7f6a8007a5d0 2024-09-19T06:46:35.609 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-19T06:46:35.609 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T06:46:35.609 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-19T06:46:35.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.608+0000 7f6aa422e640 1 -- 172.21.15.86:0/3576530090 >> [v2:172.21.15.86:6800/3306127846,v1:172.21.15.86:6801/3306127846] conn(0x7f6a8007a5d0 msgr2=0x7f6a8007ca70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:35.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.608+0000 7f6aa422e640 1 --2- 172.21.15.86:0/3576530090 >> [v2:172.21.15.86:6800/3306127846,v1:172.21.15.86:6801/3306127846] conn(0x7f6a8007a5d0 0x7f6a8007ca70 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:35.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.608+0000 7f6aa422e640 1 -- 172.21.15.86:0/3576530090 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6a80070710 msgr2=0x7f6a80072bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:35.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.608+0000 7f6aa422e640 1 --2- 172.21.15.86:0/3576530090 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f6a80070710 0x7f6a80072bd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c034000 tx=0x7f6a8c02e000 comp rx=0 tx=0).stop 2024-09-19T06:46:35.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.608+0000 7f6aa422e640 1 -- 172.21.15.86:0/3576530090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a9c148b10 msgr2=0x7f6a9c0c4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:35.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.608+0000 7f6aa422e640 1 --2- 172.21.15.86:0/3576530090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a9c148b10 0x7f6a9c0c4a60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c070a20 tx=0x7f6a9800dd20 comp rx=0 tx=0).stop 2024-09-19T06:46:35.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.608+0000 7f6aa27cb640 1 -- 172.21.15.86:0/3576530090 reap_dead start 2024-09-19T06:46:35.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.609+0000 7f6aa422e640 1 -- 172.21.15.86:0/3576530090 shutdown_connections 2024-09-19T06:46:35.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.609+0000 7f6aa422e640 1 -- 172.21.15.86:0/3576530090 >> 172.21.15.86:0/3576530090 conn(0x7f6a9c0cc530 msgr2=0x7f6a9c0c8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:35.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.612+0000 7f6aa422e640 1 -- 172.21.15.86:0/3576530090 shutdown_connections 2024-09-19T06:46:35.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.612+0000 7f6aa422e640 1 -- 172.21.15.86:0/3576530090 wait complete. 2024-09-19T06:46:35.645 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-19T06:46:35.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.801+0000 7fcd1c9c4640 1 Processor -- start 2024-09-19T06:46:35.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.801+0000 7fcd1c9c4640 1 -- start start 2024-09-19T06:46:35.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.802+0000 7fcd1c9c4640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcd18151e60 0x7fcd18158720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:35.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.802+0000 7fcd1c9c4640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd180c82c0 con 0x7fcd1806ccd0 2024-09-19T06:46:35.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.802+0000 7fcd1c9c4640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd180c85a0 con 0x7fcd1806db90 2024-09-19T06:46:35.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.802+0000 7fcd1c9c4640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fcd180c5dd0 con 0x7fcd18151e60 2024-09-19T06:46:35.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.803+0000 7fcd16d9d640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fcd1806ccd0 0x7fcd18162620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:44312/0 (socket says 172.21.15.86:44312) 2024-09-19T06:46:35.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.803+0000 7fcd16d9d640 1 -- 172.21.15.86:0/2949394751 learned_addr learned my addr 172.21.15.86:0/2949394751 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:46:35.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.803+0000 7fcd1659c640 1 --2- 172.21.15.86:0/2949394751 >> v2:172.21.15.169:3300/0 conn(0x7fcd18151e60 0x7fcd18158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:35.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.804+0000 7fcd1559a640 1 -- 172.21.15.86:0/2949394751 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2057405187 0 0) 0x7fcd180c82c0 con 0x7fcd1806ccd0 2024-09-19T06:46:35.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.804+0000 7fcd1559a640 1 -- 172.21.15.86:0/2949394751 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd00003520 con 0x7fcd1806ccd0 2024-09-19T06:46:35.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.807+0000 7fcd1559a640 1 -- 172.21.15.86:0/2949394751 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4076668496 0 0) 0x7fcd180c85a0 con 0x7fcd1806db90 2024-09-19T06:46:35.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.807+0000 7fcd1559a640 1 -- 172.21.15.86:0/2949394751 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd180c82c0 con 0x7fcd1806db90 2024-09-19T06:46:35.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.807+0000 7fcd1559a640 1 -- 172.21.15.86:0/2949394751 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2124215712 0 0) 0x7fcd00003520 con 0x7fcd1806ccd0 2024-09-19T06:46:35.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.808+0000 7fcd1559a640 1 -- 172.21.15.86:0/2949394751 >> v2:172.21.15.169:3300/0 conn(0x7fcd18151e60 msgr2=0x7fcd18158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:35.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.808+0000 7fcd1559a640 1 --2- 172.21.15.86:0/2949394751 >> v2:172.21.15.169:3300/0 conn(0x7fcd18151e60 0x7fcd18158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:35.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.808+0000 7fcd1559a640 1 -- 172.21.15.86:0/2949394751 >> v1:172.21.15.169:6789/0 conn(0x7fcd1806db90 legacy=0x7fcd180c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:35.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.808+0000 7fcd1559a640 1 -- 172.21.15.86:0/2949394751 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd180c8880 con 0x7fcd1806ccd0 2024-09-19T06:46:35.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.808+0000 7fcd1559a640 1 -- 172.21.15.86:0/2949394751 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7fcd10001970 con 0x7fcd1806ccd0 2024-09-19T06:46:35.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.808+0000 7fcd1559a640 1 -- 172.21.15.86:0/2949394751 >> v1:172.21.15.86:6789/0 conn(0x7fcd1806ccd0 legacy=0x7fcd18162620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:35.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.808+0000 7fcd1559a640 1 --2- 172.21.15.86:0/2949394751 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd00003b40 0x7fcd00003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:35.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.808+0000 7fcd1559a640 1 --2- 172.21.15.86:0/2949394751 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd00004800 0x7fcd00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:35.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.808+0000 7fcd1559a640 1 --2- 172.21.15.86:0/2949394751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd000051c0 0x7fcd0000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:35.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.808+0000 7fcd1559a640 1 -- 172.21.15.86:0/2949394751 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcd000147f0 con 0x7fcd00004800 2024-09-19T06:46:35.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.808+0000 7fcd1559a640 1 -- 172.21.15.86:0/2949394751 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0000bfb0 con 0x7fcd000051c0 2024-09-19T06:46:35.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.808+0000 7fcd1559a640 1 -- 172.21.15.86:0/2949394751 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcd0000c1b0 con 0x7fcd00003b40 2024-09-19T06:46:35.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.808+0000 7fcd1659c640 1 --2- 172.21.15.86:0/2949394751 >> v2:172.21.15.169:3300/0 conn(0x7fcd18151e60 0x7fcd18158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:35.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.808+0000 7fcd1659c640 1 --2- 172.21.15.86:0/2949394751 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd00003b40 0x7fcd00003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:35.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.809+0000 7fcd1659c640 1 -- 172.21.15.86:0/2949394751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd000051c0 msgr2=0x7fcd0000b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:46:35.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.809+0000 7fcd1659c640 1 --2- 172.21.15.86:0/2949394751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd000051c0 0x7fcd0000b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:35.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.809+0000 7fcd1659c640 1 -- 172.21.15.86:0/2949394751 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd00004800 msgr2=0x7fcd00004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:35.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.809+0000 7fcd1659c640 1 --2- 172.21.15.86:0/2949394751 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd00004800 0x7fcd00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:35.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.809+0000 7fcd1659c640 1 -- 172.21.15.86:0/2949394751 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd180c8880 con 0x7fcd00003b40 2024-09-19T06:46:35.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.810+0000 7fcd16d9d640 1 -- 172.21.15.86:0/2949394751 reap_dead start 2024-09-19T06:46:35.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.810+0000 7fcd1659c640 1 --2- 172.21.15.86:0/2949394751 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd00003b40 0x7fcd00003f20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcd080098a0 tx=0x7fcd00005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=817c5caf1162a7f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:35.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.811+0000 7fcd1559a640 1 -- 172.21.15.86:0/2949394751 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0800f040 con 0x7fcd00003b40 2024-09-19T06:46:35.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.811+0000 7fcd1559a640 1 -- 172.21.15.86:0/2949394751 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd0802ac10 con 0x7fcd00003b40 2024-09-19T06:46:35.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.811+0000 7fcd1559a640 1 -- 172.21.15.86:0/2949394751 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd08004030 con 0x7fcd00003b40 2024-09-19T06:46:35.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.812+0000 7fcd1c9c4640 1 -- 172.21.15.86:0/2949394751 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd00003b40 msgr2=0x7fcd00003f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:35.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.812+0000 7fcd1c9c4640 1 --2- 172.21.15.86:0/2949394751 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd00003b40 0x7fcd00003f20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcd080098a0 tx=0x7fcd00005830 comp rx=0 tx=0).stop 2024-09-19T06:46:35.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.813+0000 7fcd1c9c4640 1 -- 172.21.15.86:0/2949394751 shutdown_connections 2024-09-19T06:46:35.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.813+0000 7fcd1c9c4640 1 --2- 172.21.15.86:0/2949394751 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd00003b40 0x7fcd00003f20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:35.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.813+0000 7fcd1c9c4640 1 -- 172.21.15.86:0/2949394751 >> 172.21.15.86:0/2949394751 conn(0x7fcd180cdd80 msgr2=0x7fcd180ca220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:35.820 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.819+0000 7fcd1c9c4640 1 -- 172.21.15.86:0/2949394751 shutdown_connections 2024-09-19T06:46:35.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.826+0000 7fcd1c9c4640 1 -- 172.21.15.86:0/2949394751 wait complete. 2024-09-19T06:46:35.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.828+0000 7fcd1c9c4640 1 Processor -- start 2024-09-19T06:46:35.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.828+0000 7fcd1c9c4640 1 -- start start 2024-09-19T06:46:35.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.829+0000 7fcd1c9c4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd00003b40 0x7fcd181e3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:35.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.832+0000 7fcd1c9c4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd181e12c0 0x7fcd18150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:35.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.833+0000 7fcd1c9c4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd181e1ac0 0x7fcd181e1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:35.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.833+0000 7fcd1c9c4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1806dfe0 con 0x7fcd181e12c0 2024-09-19T06:46:35.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.833+0000 7fcd1c9c4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcd180c8e40 con 0x7fcd00003b40 2024-09-19T06:46:35.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.833+0000 7fcd1c9c4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcd18152240 con 0x7fcd181e1ac0 2024-09-19T06:46:35.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.833+0000 7fcd15d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd181e12c0 0x7fcd18150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:35.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.833+0000 7fcd15d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd181e12c0 0x7fcd18150de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:32876/0 (socket says 172.21.15.86:32876) 2024-09-19T06:46:35.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.833+0000 7fcd15d9b640 1 -- 172.21.15.86:0/3384569245 learned_addr learned my addr 172.21.15.86:0/3384569245 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:35.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.833+0000 7fcd1659c640 1 --2- 172.21.15.86:0/3384569245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd00003b40 0x7fcd181e3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:35.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.833+0000 7fcd16d9d640 1 --2- 172.21.15.86:0/3384569245 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd181e1ac0 0x7fcd181e1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:35.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.834+0000 7fcd15d9b640 1 -- 172.21.15.86:0/3384569245 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd181e1ac0 msgr2=0x7fcd181e1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:35.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.834+0000 7fcd15d9b640 1 --2- 172.21.15.86:0/3384569245 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd181e1ac0 0x7fcd181e1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:35.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.834+0000 7fcd15d9b640 1 -- 172.21.15.86:0/3384569245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd00003b40 msgr2=0x7fcd181e3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:35.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.834+0000 7fcd15d9b640 1 --2- 172.21.15.86:0/3384569245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd00003b40 0x7fcd181e3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:35.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.834+0000 7fcd15d9b640 1 -- 172.21.15.86:0/3384569245 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd181e3680 con 0x7fcd181e12c0 2024-09-19T06:46:35.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.834+0000 7fcd15d9b640 1 --2- 172.21.15.86:0/3384569245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd181e12c0 0x7fcd18150de0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00c7b0 tx=0x7fcd0c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:35.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.835+0000 7fcd06ffd640 1 -- 172.21.15.86:0/3384569245 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c017070 con 0x7fcd181e12c0 2024-09-19T06:46:35.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.835+0000 7fcd06ffd640 1 -- 172.21.15.86:0/3384569245 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd0c0035f0 con 0x7fcd181e12c0 2024-09-19T06:46:35.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.835+0000 7fcd06ffd640 1 -- 172.21.15.86:0/3384569245 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c00ce60 con 0x7fcd181e12c0 2024-09-19T06:46:35.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.835+0000 7fcd1c9c4640 1 -- 172.21.15.86:0/3384569245 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd181e3ab0 con 0x7fcd181e12c0 2024-09-19T06:46:35.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.835+0000 7fcd1c9c4640 1 -- 172.21.15.86:0/3384569245 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd181e3d70 con 0x7fcd181e12c0 2024-09-19T06:46:35.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.838+0000 7fcd1c9c4640 1 -- 172.21.15.86:0/3384569245 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccfc005290 con 0x7fcd181e12c0 2024-09-19T06:46:35.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.847+0000 7fcd06ffd640 1 -- 172.21.15.86:0/3384569245 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcd0c01a070 con 0x7fcd181e12c0 2024-09-19T06:46:35.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.848+0000 7fcd06ffd640 1 --2- 172.21.15.86:0/3384569245 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fccf806c3b0 0x7fccf806e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:35.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.848+0000 7fcd06ffd640 1 -- 172.21.15.86:0/3384569245 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7fcd0c08af50 con 0x7fcd181e12c0 2024-09-19T06:46:35.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.849+0000 7fcd1659c640 1 --2- 172.21.15.86:0/3384569245 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fccf806c3b0 0x7fccf806e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:35.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.849+0000 7fcd1659c640 1 --2- 172.21.15.86:0/3384569245 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fccf806c3b0 0x7fccf806e870 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcd08033000 tx=0x7fcd0802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:35.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:35.851+0000 7fcd06ffd640 1 -- 172.21.15.86:0/3384569245 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fcd0c058a40 con 0x7fcd181e12c0 2024-09-19T06:46:36.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.178+0000 7fcd1c9c4640 1 -- 172.21.15.86:0/3384569245 --> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fccfc000bc0 con 0x7fccf806c3b0 2024-09-19T06:46:36.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.182+0000 7fcd06ffd640 1 -- 172.21.15.86:0/3384569245 <== mgr.4105 v2:172.21.15.86:6816/4165134248 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fccfc000bc0 con 0x7fccf806c3b0 2024-09-19T06:46:36.186 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 2 to deep-scrub 2024-09-19T06:46:36.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.189+0000 7fcd1c9c4640 1 -- 172.21.15.86:0/3384569245 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fccf806c3b0 msgr2=0x7fccf806e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:36.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.189+0000 7fcd1c9c4640 1 --2- 172.21.15.86:0/3384569245 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fccf806c3b0 0x7fccf806e870 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcd08033000 tx=0x7fcd0802e000 comp rx=0 tx=0).stop 2024-09-19T06:46:36.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.189+0000 7fcd1c9c4640 1 -- 172.21.15.86:0/3384569245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd181e12c0 msgr2=0x7fcd18150de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:36.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.189+0000 7fcd1c9c4640 1 --2- 172.21.15.86:0/3384569245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd181e12c0 0x7fcd18150de0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00c7b0 tx=0x7fcd0c00cc70 comp rx=0 tx=0).stop 2024-09-19T06:46:36.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.192+0000 7fcd1c9c4640 1 -- 172.21.15.86:0/3384569245 shutdown_connections 2024-09-19T06:46:36.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.193+0000 7fcd1c9c4640 1 --2- 172.21.15.86:0/3384569245 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fccf806c3b0 0x7fccf806e870 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.193+0000 7fcd1c9c4640 1 --2- 172.21.15.86:0/3384569245 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd181e1ac0 0x7fcd181e1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.193+0000 7fcd1c9c4640 1 --2- 172.21.15.86:0/3384569245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd181e12c0 0x7fcd18150de0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.193+0000 7fcd1c9c4640 1 --2- 172.21.15.86:0/3384569245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd00003b40 0x7fcd181e3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.193+0000 7fcd1c9c4640 1 -- 172.21.15.86:0/3384569245 >> 172.21.15.86:0/3384569245 conn(0x7fcd180cdd80 msgr2=0x7fcd181561d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:36.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.193+0000 7fcd1c9c4640 1 -- 172.21.15.86:0/3384569245 shutdown_connections 2024-09-19T06:46:36.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.193+0000 7fcd1c9c4640 1 -- 172.21.15.86:0/3384569245 wait complete. 2024-09-19T06:46:36.217 INFO:tasks.ceph:Scrubbing osd.3 2024-09-19T06:46:36.217 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-19T06:46:36.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.402+0000 7fa2aefc6640 1 Processor -- start 2024-09-19T06:46:36.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.402+0000 7fa2aefc6640 1 -- start start 2024-09-19T06:46:36.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.404+0000 7fa2aefc6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa2a8072730 0x7fa2a806bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.404+0000 7fa2aefc6640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a80713a0 con 0x7fa2a80c7a40 2024-09-19T06:46:36.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.404+0000 7fa2aefc6640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a8071680 con 0x7fa2a80c7e20 2024-09-19T06:46:36.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.404+0000 7fa2aefc6640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fa2a8072b60 con 0x7fa2a8072730 2024-09-19T06:46:36.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.404+0000 7fa2ad563640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fa2a80c7e20 0x7fa2a8159230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:50810/0 (socket says 172.21.15.86:50810) 2024-09-19T06:46:36.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.404+0000 7fa2ad563640 1 -- 172.21.15.86:0/3095016763 learned_addr learned my addr 172.21.15.86:0/3095016763 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:46:36.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.407+0000 7fa2a7fff640 1 --2- 172.21.15.86:0/3095016763 >> v2:172.21.15.169:3300/0 conn(0x7fa2a8072730 0x7fa2a806bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:36.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.408+0000 7fa2a77fe640 1 -- 172.21.15.86:0/3095016763 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1519788760 0 0) 0x7fa2a8071680 con 0x7fa2a80c7e20 2024-09-19T06:46:36.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.408+0000 7fa2a77fe640 1 -- 172.21.15.86:0/3095016763 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa28c003520 con 0x7fa2a80c7e20 2024-09-19T06:46:36.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.408+0000 7fa2a77fe640 1 -- 172.21.15.86:0/3095016763 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2003700353 0 0) 0x7fa2a80713a0 con 0x7fa2a80c7a40 2024-09-19T06:46:36.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.408+0000 7fa2a77fe640 1 -- 172.21.15.86:0/3095016763 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2a8071680 con 0x7fa2a80c7a40 2024-09-19T06:46:36.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.408+0000 7fa2a77fe640 1 -- 172.21.15.86:0/3095016763 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 796731486 0 0) 0x7fa2a8071680 con 0x7fa2a80c7a40 2024-09-19T06:46:36.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.409+0000 7fa2a77fe640 1 -- 172.21.15.86:0/3095016763 >> v2:172.21.15.169:3300/0 conn(0x7fa2a8072730 msgr2=0x7fa2a806bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:36.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.409+0000 7fa2a77fe640 1 --2- 172.21.15.86:0/3095016763 >> v2:172.21.15.169:3300/0 conn(0x7fa2a8072730 0x7fa2a806bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.409+0000 7fa2a77fe640 1 -- 172.21.15.86:0/3095016763 >> v1:172.21.15.169:6789/0 conn(0x7fa2a80c7e20 legacy=0x7fa2a8159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:36.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.409+0000 7fa2a77fe640 1 -- 172.21.15.86:0/3095016763 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a8071c50 con 0x7fa2a80c7a40 2024-09-19T06:46:36.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.409+0000 7fa2a77fe640 1 -- 172.21.15.86:0/3095016763 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7fa2a00019f0 con 0x7fa2a80c7a40 2024-09-19T06:46:36.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.409+0000 7fa2a77fe640 1 -- 172.21.15.86:0/3095016763 >> v1:172.21.15.86:6789/0 conn(0x7fa2a80c7a40 legacy=0x7fa2a81632d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:36.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.409+0000 7fa2a77fe640 1 --2- 172.21.15.86:0/3095016763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa28c004ba0 0x7fa28c004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.409+0000 7fa2a77fe640 1 --2- 172.21.15.86:0/3095016763 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa28c0037a0 0x7fa28c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.409+0000 7fa2a77fe640 1 --2- 172.21.15.86:0/3095016763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa28c004160 0x7fa28c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.409+0000 7fa2a77fe640 1 -- 172.21.15.86:0/3095016763 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a8072b60 con 0x7fa28c004ba0 2024-09-19T06:46:36.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.409+0000 7fa2a77fe640 1 -- 172.21.15.86:0/3095016763 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c00bf30 con 0x7fa28c004160 2024-09-19T06:46:36.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.409+0000 7fa2a77fe640 1 -- 172.21.15.86:0/3095016763 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa28c00c130 con 0x7fa28c0037a0 2024-09-19T06:46:36.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.409+0000 7fa2acd62640 1 --2- 172.21.15.86:0/3095016763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa28c004ba0 0x7fa28c004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:36.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.409+0000 7fa2acd62640 1 -- 172.21.15.86:0/3095016763 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa28c0037a0 msgr2=0x7fa28c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:36.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.409+0000 7fa2acd62640 1 --2- 172.21.15.86:0/3095016763 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa28c0037a0 0x7fa28c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.409+0000 7fa2acd62640 1 -- 172.21.15.86:0/3095016763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa28c004160 msgr2=0x7fa28c00b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:46:36.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.409+0000 7fa2acd62640 1 --2- 172.21.15.86:0/3095016763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa28c004160 0x7fa28c00b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.409+0000 7fa2acd62640 1 -- 172.21.15.86:0/3095016763 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a8071c50 con 0x7fa28c004ba0 2024-09-19T06:46:36.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.411+0000 7fa2acd62640 1 --2- 172.21.15.86:0/3095016763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa28c004ba0 0x7fa28c004f80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000c4c0 tx=0x7fa28c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f61dd9fe6b3b490 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:36.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.411+0000 7fa2a77fe640 1 -- 172.21.15.86:0/3095016763 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a000c0e0 con 0x7fa28c004ba0 2024-09-19T06:46:36.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.411+0000 7fa2a77fe640 1 -- 172.21.15.86:0/3095016763 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2a0036600 con 0x7fa28c004ba0 2024-09-19T06:46:36.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.411+0000 7fa2a77fe640 1 -- 172.21.15.86:0/3095016763 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0036a50 con 0x7fa28c004ba0 2024-09-19T06:46:36.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.412+0000 7fa2aefc6640 1 -- 172.21.15.86:0/3095016763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa28c004ba0 msgr2=0x7fa28c004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:36.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.412+0000 7fa2aefc6640 1 --2- 172.21.15.86:0/3095016763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa28c004ba0 0x7fa28c004f80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000c4c0 tx=0x7fa28c005830 comp rx=0 tx=0).stop 2024-09-19T06:46:36.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.413+0000 7fa2ad563640 1 -- 172.21.15.86:0/3095016763 reap_dead start 2024-09-19T06:46:36.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.413+0000 7fa2ad563640 1 -- 172.21.15.86:0/3095016763 reap_dead start 2024-09-19T06:46:36.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.413+0000 7fa2aefc6640 1 -- 172.21.15.86:0/3095016763 shutdown_connections 2024-09-19T06:46:36.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.413+0000 7fa2aefc6640 1 -- 172.21.15.86:0/3095016763 >> 172.21.15.86:0/3095016763 conn(0x7fa2a80c9280 msgr2=0x7fa2a80c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:36.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.420+0000 7fa2aefc6640 1 -- 172.21.15.86:0/3095016763 shutdown_connections 2024-09-19T06:46:36.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.423+0000 7fa2aefc6640 1 -- 172.21.15.86:0/3095016763 wait complete. 2024-09-19T06:46:36.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.425+0000 7fa2aefc6640 1 Processor -- start 2024-09-19T06:46:36.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.425+0000 7fa2aefc6640 1 -- start start 2024-09-19T06:46:36.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.426+0000 7fa2aefc6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2a8162800 0x7fa2a80c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.427+0000 7fa2aefc6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2a8162be0 0x7fa2a8156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.427+0000 7fa2aefc6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2a80c6f40 0x7fa2a81566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.427+0000 7fa2aefc6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a8071a00 con 0x7fa2a80c6f40 2024-09-19T06:46:36.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.427+0000 7fa2aefc6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a80c8e70 con 0x7fa2a8162be0 2024-09-19T06:46:36.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.427+0000 7fa2aefc6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa2a80c8ff0 con 0x7fa2a8162800 2024-09-19T06:46:36.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.427+0000 7fa2ad563640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2a80c6f40 0x7fa2a81566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:36.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.427+0000 7fa2ad563640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2a80c6f40 0x7fa2a81566a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:32898/0 (socket says 172.21.15.86:32898) 2024-09-19T06:46:36.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.427+0000 7fa2ad563640 1 -- 172.21.15.86:0/3971965513 learned_addr learned my addr 172.21.15.86:0/3971965513 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:36.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.427+0000 7fa2a7fff640 1 --2- 172.21.15.86:0/3971965513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2a8162be0 0x7fa2a8156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:36.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.427+0000 7fa2acd62640 1 --2- 172.21.15.86:0/3971965513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2a8162800 0x7fa2a80c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:36.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.427+0000 7fa2ad563640 1 -- 172.21.15.86:0/3971965513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2a8162800 msgr2=0x7fa2a80c6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:36.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.427+0000 7fa2ad563640 1 --2- 172.21.15.86:0/3971965513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2a8162800 0x7fa2a80c6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.427+0000 7fa2ad563640 1 -- 172.21.15.86:0/3971965513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2a8162be0 msgr2=0x7fa2a8156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:36.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.427+0000 7fa2ad563640 1 --2- 172.21.15.86:0/3971965513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2a8162be0 0x7fa2a8156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.427+0000 7fa2ad563640 1 -- 172.21.15.86:0/3971965513 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a8212340 con 0x7fa2a80c6f40 2024-09-19T06:46:36.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.428+0000 7fa2ad563640 1 --2- 172.21.15.86:0/3971965513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2a80c6f40 0x7fa2a81566a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa2a806d680 tx=0x7fa29400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:36.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.428+0000 7fa2a57fa640 1 -- 172.21.15.86:0/3971965513 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294004cb0 con 0x7fa2a80c6f40 2024-09-19T06:46:36.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.429+0000 7fa2aefc6640 1 -- 172.21.15.86:0/3971965513 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a81553a0 con 0x7fa2a80c6f40 2024-09-19T06:46:36.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.429+0000 7fa2aefc6640 1 -- 172.21.15.86:0/3971965513 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a8155960 con 0x7fa2a80c6f40 2024-09-19T06:46:36.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.434+0000 7fa2a57fa640 1 -- 172.21.15.86:0/3971965513 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa294007030 con 0x7fa2a80c6f40 2024-09-19T06:46:36.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.434+0000 7fa2a57fa640 1 -- 172.21.15.86:0/3971965513 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294007420 con 0x7fa2a80c6f40 2024-09-19T06:46:36.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.436+0000 7fa2a57fa640 1 -- 172.21.15.86:0/3971965513 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa2940075c0 con 0x7fa2a80c6f40 2024-09-19T06:46:36.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.436+0000 7fa2a57fa640 1 --2- 172.21.15.86:0/3971965513 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa29006c3b0 0x7fa29006e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.437+0000 7fa2aefc6640 1 -- 172.21.15.86:0/3971965513 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa284001030 con 0x7fa2a80c6f40 2024-09-19T06:46:36.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.437+0000 7fa2a57fa640 1 -- 172.21.15.86:0/3971965513 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7fa29408ade0 con 0x7fa2a80c6f40 2024-09-19T06:46:36.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.437+0000 7fa2a57fa640 1 --2- 172.21.15.86:0/3971965513 >> [v2:172.21.15.86:6808/694275178,v1:172.21.15.86:6809/694275178] conn(0x7fa2900761f0 0x7fa290078690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.437+0000 7fa2a57fa640 1 -- 172.21.15.86:0/3971965513 --> [v2:172.21.15.86:6808/694275178,v1:172.21.15.86:6809/694275178] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa290078d60 con 0x7fa2900761f0 2024-09-19T06:46:36.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.437+0000 7fa2a57fa640 1 -- 172.21.15.86:0/3971965513 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa294054b50 con 0x7fa2a80c6f40 2024-09-19T06:46:36.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.439+0000 7fa2a7fff640 1 --2- 172.21.15.86:0/3971965513 >> [v2:172.21.15.86:6808/694275178,v1:172.21.15.86:6809/694275178] conn(0x7fa2900761f0 0x7fa290078690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:36.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.441+0000 7fa2acd62640 1 --2- 172.21.15.86:0/3971965513 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa29006c3b0 0x7fa29006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:36.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.442+0000 7fa2acd62640 1 --2- 172.21.15.86:0/3971965513 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa29006c3b0 0x7fa29006e870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0035000 tx=0x7fa2a0030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:36.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.455+0000 7fa2a7fff640 1 --2- 172.21.15.86:0/3971965513 >> [v2:172.21.15.86:6808/694275178,v1:172.21.15.86:6809/694275178] conn(0x7fa2900761f0 0x7fa290078690 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:36.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.456+0000 7fa2a57fa640 1 -- 172.21.15.86:0/3971965513 <== osd.3 v2:172.21.15.86:6808/694275178 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa290078d60 con 0x7fa2900761f0 2024-09-19T06:46:36.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.482+0000 7fa2aefc6640 1 -- 172.21.15.86:0/3971965513 --> [v2:172.21.15.86:6808/694275178,v1:172.21.15.86:6809/694275178] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa284002e30 con 0x7fa2900761f0 2024-09-19T06:46:36.490 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-19T06:46:36.491 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T06:46:36.491 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-19T06:46:36.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.489+0000 7fa2a57fa640 1 -- 172.21.15.86:0/3971965513 <== osd.3 v2:172.21.15.86:6808/694275178 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa284002e30 con 0x7fa2900761f0 2024-09-19T06:46:36.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.490+0000 7fa29effd640 1 -- 172.21.15.86:0/3971965513 >> [v2:172.21.15.86:6808/694275178,v1:172.21.15.86:6809/694275178] conn(0x7fa2900761f0 msgr2=0x7fa290078690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:36.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.490+0000 7fa29effd640 1 --2- 172.21.15.86:0/3971965513 >> [v2:172.21.15.86:6808/694275178,v1:172.21.15.86:6809/694275178] conn(0x7fa2900761f0 0x7fa290078690 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.491+0000 7fa29effd640 1 -- 172.21.15.86:0/3971965513 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa29006c3b0 msgr2=0x7fa29006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:36.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.491+0000 7fa29effd640 1 --2- 172.21.15.86:0/3971965513 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa29006c3b0 0x7fa29006e870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0035000 tx=0x7fa2a0030000 comp rx=0 tx=0).stop 2024-09-19T06:46:36.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.491+0000 7fa29effd640 1 -- 172.21.15.86:0/3971965513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2a80c6f40 msgr2=0x7fa2a81566a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:36.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.491+0000 7fa29effd640 1 --2- 172.21.15.86:0/3971965513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2a80c6f40 0x7fa2a81566a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa2a806d680 tx=0x7fa29400c820 comp rx=0 tx=0).stop 2024-09-19T06:46:36.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.491+0000 7fa2ad563640 1 -- 172.21.15.86:0/3971965513 reap_dead start 2024-09-19T06:46:36.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.495+0000 7fa29effd640 1 -- 172.21.15.86:0/3971965513 shutdown_connections 2024-09-19T06:46:36.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.495+0000 7fa29effd640 1 -- 172.21.15.86:0/3971965513 >> 172.21.15.86:0/3971965513 conn(0x7fa2a80c9280 msgr2=0x7fa2a80cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:36.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.500+0000 7fa29effd640 1 -- 172.21.15.86:0/3971965513 shutdown_connections 2024-09-19T06:46:36.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.502+0000 7fa29effd640 1 -- 172.21.15.86:0/3971965513 wait complete. 2024-09-19T06:46:36.523 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-19T06:46:36.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.695+0000 7ff984b86640 1 Processor -- start 2024-09-19T06:46:36.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.696+0000 7ff984b86640 1 -- start start 2024-09-19T06:46:36.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.697+0000 7ff984b86640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff9780dcd90 0x7ff978045d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.697+0000 7ff984b86640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff9780e6640 0x7ff97804aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.697+0000 7ff984b86640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9780e6a70 con 0x7ff97804a680 2024-09-19T06:46:36.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.697+0000 7ff984b86640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7ff978044d40 con 0x7ff9780e6640 2024-09-19T06:46:36.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.697+0000 7ff984b86640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7ff9780dd170 con 0x7ff9780dcd90 2024-09-19T06:46:36.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.698+0000 7ff97dd9b640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ff97804a680 0x7ff9780e5f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:44316/0 (socket says 172.21.15.86:44316) 2024-09-19T06:46:36.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.698+0000 7ff97dd9b640 1 -- 172.21.15.86:0/3186039459 learned_addr learned my addr 172.21.15.86:0/3186039459 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:46:36.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.698+0000 7ff97ed9d640 1 --2- 172.21.15.86:0/3186039459 >> v2:172.21.15.86:3300/0 conn(0x7ff9780e6640 0x7ff97804aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:36.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.699+0000 7ff97ed9d640 1 -- 172.21.15.86:0/3186039459 >> v2:172.21.15.169:3300/0 conn(0x7ff9780dcd90 msgr2=0x7ff978045d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:46:36.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.699+0000 7ff97ed9d640 1 --2- 172.21.15.86:0/3186039459 >> v2:172.21.15.169:3300/0 conn(0x7ff9780dcd90 0x7ff978045d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.699+0000 7ff97d59a640 1 -- 172.21.15.86:0/3186039459 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 184325815 0 0) 0x7ff9780e6a70 con 0x7ff97804a680 2024-09-19T06:46:36.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.699+0000 7ff97ed9d640 1 -- 172.21.15.86:0/3186039459 >> v1:172.21.15.86:6789/0 conn(0x7ff97804a680 legacy=0x7ff9780e5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:36.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.699+0000 7ff97ed9d640 1 -- 172.21.15.86:0/3186039459 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9780e6d30 con 0x7ff9780e6640 2024-09-19T06:46:36.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.700+0000 7ff97ed9d640 1 --2- 172.21.15.86:0/3186039459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9780e6640 0x7ff97804aab0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff978044ec0 tx=0x7ff9800a7110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b427390ba58a25ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:36.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.700+0000 7ff97d59a640 1 -- 172.21.15.86:0/3186039459 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9800b4070 con 0x7ff9780e6640 2024-09-19T06:46:36.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.700+0000 7ff97d59a640 1 -- 172.21.15.86:0/3186039459 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9800af440 con 0x7ff9780e6640 2024-09-19T06:46:36.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.700+0000 7ff97d59a640 1 -- 172.21.15.86:0/3186039459 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9800b4070 con 0x7ff9780e6640 2024-09-19T06:46:36.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.701+0000 7ff984b86640 1 -- 172.21.15.86:0/3186039459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9780e6640 msgr2=0x7ff97804aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:36.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.701+0000 7ff984b86640 1 --2- 172.21.15.86:0/3186039459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9780e6640 0x7ff97804aab0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff978044ec0 tx=0x7ff9800a7110 comp rx=0 tx=0).stop 2024-09-19T06:46:36.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.702+0000 7ff984b86640 1 -- 172.21.15.86:0/3186039459 shutdown_connections 2024-09-19T06:46:36.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.702+0000 7ff984b86640 1 --2- 172.21.15.86:0/3186039459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9780e6640 0x7ff97804aab0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.702+0000 7ff984b86640 1 --2- 172.21.15.86:0/3186039459 >> v2:172.21.15.169:3300/0 conn(0x7ff9780dcd90 0x7ff978045d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.702+0000 7ff984b86640 1 -- 172.21.15.86:0/3186039459 >> 172.21.15.86:0/3186039459 conn(0x7ff97804fc50 msgr2=0x7ff978050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:36.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.703+0000 7ff984b86640 1 -- 172.21.15.86:0/3186039459 shutdown_connections 2024-09-19T06:46:36.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.706+0000 7ff984b86640 1 -- 172.21.15.86:0/3186039459 wait complete. 2024-09-19T06:46:36.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.708+0000 7ff984b86640 1 Processor -- start 2024-09-19T06:46:36.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.708+0000 7ff984b86640 1 -- start start 2024-09-19T06:46:36.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.710+0000 7ff984b86640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff97804a680 0x7ff978047fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.710+0000 7ff984b86640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9780dcd90 0x7ff9780df7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.710+0000 7ff984b86640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9780e6640 0x7ff9780dd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.710+0000 7ff984b86640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff978045550 con 0x7ff9780dcd90 2024-09-19T06:46:36.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.710+0000 7ff984b86640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff978045270 con 0x7ff9780e6640 2024-09-19T06:46:36.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.710+0000 7ff984b86640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff978045830 con 0x7ff97804a680 2024-09-19T06:46:36.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.710+0000 7ff97ed9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9780e6640 0x7ff9780dd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:36.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.710+0000 7ff97ed9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9780e6640 0x7ff9780dd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:47476/0 (socket says 172.21.15.86:47476) 2024-09-19T06:46:36.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.710+0000 7ff97ed9d640 1 -- 172.21.15.86:0/3076428633 learned_addr learned my addr 172.21.15.86:0/3076428633 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:36.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.711+0000 7ff97ed9d640 1 -- 172.21.15.86:0/3076428633 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff97804a680 msgr2=0x7ff978047fa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:46:36.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.711+0000 7ff97ed9d640 1 --2- 172.21.15.86:0/3076428633 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff97804a680 0x7ff978047fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.711+0000 7ff97ed9d640 1 -- 172.21.15.86:0/3076428633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9780dcd90 msgr2=0x7ff9780df7e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:46:36.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.711+0000 7ff97ed9d640 1 --2- 172.21.15.86:0/3076428633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9780dcd90 0x7ff9780df7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.711+0000 7ff97ed9d640 1 -- 172.21.15.86:0/3076428633 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9780cee40 con 0x7ff9780e6640 2024-09-19T06:46:36.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.711+0000 7ff97ed9d640 1 --2- 172.21.15.86:0/3076428633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9780e6640 0x7ff9780dd540 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff980074f80 tx=0x7ff98006a560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:36.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.713+0000 7ff96effd640 1 -- 172.21.15.86:0/3076428633 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9800bf020 con 0x7ff9780e6640 2024-09-19T06:46:36.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.713+0000 7ff96effd640 1 -- 172.21.15.86:0/3076428633 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9800bb720 con 0x7ff9780e6640 2024-09-19T06:46:36.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.713+0000 7ff96effd640 1 -- 172.21.15.86:0/3076428633 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9800b4070 con 0x7ff9780e6640 2024-09-19T06:46:36.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.714+0000 7ff984b86640 1 -- 172.21.15.86:0/3076428633 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9780cf120 con 0x7ff9780e6640 2024-09-19T06:46:36.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.714+0000 7ff984b86640 1 -- 172.21.15.86:0/3076428633 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9780defe0 con 0x7ff9780e6640 2024-09-19T06:46:36.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.716+0000 7ff984b86640 1 -- 172.21.15.86:0/3076428633 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9780df420 con 0x7ff9780e6640 2024-09-19T06:46:36.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.719+0000 7ff96effd640 1 -- 172.21.15.86:0/3076428633 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff9800c2020 con 0x7ff9780e6640 2024-09-19T06:46:36.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.720+0000 7ff96effd640 1 --2- 172.21.15.86:0/3076428633 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff96006c3b0 0x7ff96006e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.720+0000 7ff96effd640 1 -- 172.21.15.86:0/3076428633 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7ff9801294c0 con 0x7ff9780e6640 2024-09-19T06:46:36.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.720+0000 7ff97e59c640 1 --2- 172.21.15.86:0/3076428633 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff96006c3b0 0x7ff96006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:36.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.721+0000 7ff97e59c640 1 --2- 172.21.15.86:0/3076428633 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff96006c3b0 0x7ff96006e870 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff974009670 tx=0x7ff974006bd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:36.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:36.728+0000 7ff96effd640 1 -- 172.21.15.86:0/3076428633 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff9800c9030 con 0x7ff9780e6640 2024-09-19T06:46:37.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.073+0000 7ff984b86640 1 -- 172.21.15.86:0/3076428633 --> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7ff9780dfd20 con 0x7ff96006c3b0 2024-09-19T06:46:37.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.074+0000 7ff96effd640 1 -- 172.21.15.86:0/3076428633 <== mgr.4105 v2:172.21.15.86:6816/4165134248 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff974013430 con 0x7ff96006c3b0 2024-09-19T06:46:37.075 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 3 to deep-scrub 2024-09-19T06:46:37.078 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.077+0000 7ff984b86640 1 -- 172.21.15.86:0/3076428633 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff96006c3b0 msgr2=0x7ff96006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:37.078 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.077+0000 7ff984b86640 1 --2- 172.21.15.86:0/3076428633 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff96006c3b0 0x7ff96006e870 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff974009670 tx=0x7ff974006bd0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.078 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.077+0000 7ff984b86640 1 -- 172.21.15.86:0/3076428633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9780e6640 msgr2=0x7ff9780dd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:37.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.077+0000 7ff984b86640 1 --2- 172.21.15.86:0/3076428633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9780e6640 0x7ff9780dd540 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff980074f80 tx=0x7ff98006a560 comp rx=0 tx=0).stop 2024-09-19T06:46:37.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.080+0000 7ff984b86640 1 -- 172.21.15.86:0/3076428633 shutdown_connections 2024-09-19T06:46:37.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.080+0000 7ff984b86640 1 --2- 172.21.15.86:0/3076428633 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7ff96006c3b0 0x7ff96006e870 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.080+0000 7ff984b86640 1 --2- 172.21.15.86:0/3076428633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9780e6640 0x7ff9780dd540 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.080+0000 7ff984b86640 1 --2- 172.21.15.86:0/3076428633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9780dcd90 0x7ff9780df7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.080+0000 7ff984b86640 1 --2- 172.21.15.86:0/3076428633 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff97804a680 0x7ff978047fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.080+0000 7ff984b86640 1 -- 172.21.15.86:0/3076428633 >> 172.21.15.86:0/3076428633 conn(0x7ff97804fc50 msgr2=0x7ff978005170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:37.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.081+0000 7ff984b86640 1 -- 172.21.15.86:0/3076428633 shutdown_connections 2024-09-19T06:46:37.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.081+0000 7ff984b86640 1 -- 172.21.15.86:0/3076428633 wait complete. 2024-09-19T06:46:37.101 INFO:tasks.ceph:Scrubbing osd.4 2024-09-19T06:46:37.102 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-19T06:46:37.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.300+0000 7f48f739f640 1 Processor -- start 2024-09-19T06:46:37.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.300+0000 7f48f739f640 1 -- start start 2024-09-19T06:46:37.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.302+0000 7f48f739f640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f48e80d8930 0x7f48e804b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:37.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.302+0000 7f48f739f640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f48e8006a40 0x7f48e80e8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:37.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.302+0000 7f48f739f640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48e8046280 con 0x7f48e804bc20 2024-09-19T06:46:37.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.302+0000 7f48f739f640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f48e8008f90 con 0x7f48e80d8930 2024-09-19T06:46:37.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.302+0000 7f48f739f640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f48e80df060 con 0x7f48e8006a40 2024-09-19T06:46:37.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.302+0000 7f48f639d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f48e80d8930 0x7f48e804b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:37.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.302+0000 7f48f639d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f48e80d8930 0x7f48e804b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:32920/0 (socket says 172.21.15.86:32920) 2024-09-19T06:46:37.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.302+0000 7f48f639d640 1 -- 172.21.15.86:0/684329705 learned_addr learned my addr 172.21.15.86:0/684329705 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:37.305 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.303+0000 7f48f639d640 1 -- 172.21.15.86:0/684329705 >> v2:172.21.15.169:3300/0 conn(0x7f48e8006a40 msgr2=0x7f48e80e8f50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:46:37.305 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.303+0000 7f48f639d640 1 --2- 172.21.15.86:0/684329705 >> v2:172.21.15.169:3300/0 conn(0x7f48e8006a40 0x7f48e80e8f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.306 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.303+0000 7f48f639d640 1 -- 172.21.15.86:0/684329705 >> v1:172.21.15.169:6789/0 conn(0x7f48e804bc20 legacy=0x7f48e8046930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:37.306 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.303+0000 7f48f639d640 1 -- 172.21.15.86:0/684329705 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e80de770 con 0x7f48e80d8930 2024-09-19T06:46:37.306 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.304+0000 7f48f639d640 1 --2- 172.21.15.86:0/684329705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e80d8930 0x7f48e804b6e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f48e8033c30 tx=0x7f48ec02a350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8dfe94e8549756 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:37.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.305+0000 7f48f539b640 1 -- 172.21.15.86:0/684329705 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec037070 con 0x7f48e80d8930 2024-09-19T06:46:37.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.305+0000 7f48f539b640 1 -- 172.21.15.86:0/684329705 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ec032640 con 0x7f48e80d8930 2024-09-19T06:46:37.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.305+0000 7f48f539b640 1 -- 172.21.15.86:0/684329705 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec032a50 con 0x7f48e80d8930 2024-09-19T06:46:37.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.306+0000 7f48f739f640 1 -- 172.21.15.86:0/684329705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e80d8930 msgr2=0x7f48e804b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:37.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.306+0000 7f48f739f640 1 --2- 172.21.15.86:0/684329705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e80d8930 0x7f48e804b6e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f48e8033c30 tx=0x7f48ec02a350 comp rx=0 tx=0).stop 2024-09-19T06:46:37.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.307+0000 7f48f739f640 1 -- 172.21.15.86:0/684329705 shutdown_connections 2024-09-19T06:46:37.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.307+0000 7f48f739f640 1 --2- 172.21.15.86:0/684329705 >> v2:172.21.15.169:3300/0 conn(0x7f48e8006a40 0x7f48e80e8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.307+0000 7f48f739f640 1 --2- 172.21.15.86:0/684329705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e80d8930 0x7f48e804b6e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.307+0000 7f48f739f640 1 -- 172.21.15.86:0/684329705 >> 172.21.15.86:0/684329705 conn(0x7f48e8050d60 msgr2=0x7f48e8051170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:37.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.307+0000 7f48f739f640 1 -- 172.21.15.86:0/684329705 shutdown_connections 2024-09-19T06:46:37.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.307+0000 7f48f739f640 1 -- 172.21.15.86:0/684329705 wait complete. 2024-09-19T06:46:37.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.309+0000 7f48f739f640 1 Processor -- start 2024-09-19T06:46:37.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.309+0000 7f48f739f640 1 -- start start 2024-09-19T06:46:37.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.310+0000 7f48f739f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48e8006a40 0x7f48e804e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:37.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.310+0000 7f48f739f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f48e804bc20 0x7f48e804fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:37.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.310+0000 7f48f739f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e80d8930 0x7f48e8174bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:37.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.311+0000 7f48f639d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48e8006a40 0x7f48e804e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:37.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.311+0000 7f48f639d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48e8006a40 0x7f48e804e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:47502/0 (socket says 172.21.15.86:47502) 2024-09-19T06:46:37.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.311+0000 7f48f5b9c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f48e804bc20 0x7f48e804fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:37.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.311+0000 7f48f5b9c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f48e804bc20 0x7f48e804fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.86:47418/0 (socket says 172.21.15.86:47418) 2024-09-19T06:46:37.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.311+0000 7f48f639d640 1 -- 172.21.15.86:0/3699999219 learned_addr learned my addr 172.21.15.86:0/3699999219 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:37.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.311+0000 7f48f739f640 1 -- 172.21.15.86:0/3699999219 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f48e80dea10 con 0x7f48e80d8930 2024-09-19T06:46:37.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.311+0000 7f48f739f640 1 -- 172.21.15.86:0/3699999219 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f48e8045fa0 con 0x7f48e8006a40 2024-09-19T06:46:37.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.311+0000 7f48f739f640 1 -- 172.21.15.86:0/3699999219 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f48e80decf0 con 0x7f48e804bc20 2024-09-19T06:46:37.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.311+0000 7f48f6b9e640 1 --2- 172.21.15.86:0/3699999219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e80d8930 0x7f48e8174bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:37.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.312+0000 7f48f5b9c640 1 -- 172.21.15.86:0/3699999219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48e8006a40 msgr2=0x7f48e804e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:37.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.312+0000 7f48f5b9c640 1 --2- 172.21.15.86:0/3699999219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48e8006a40 0x7f48e804e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.312+0000 7f48f5b9c640 1 -- 172.21.15.86:0/3699999219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e80d8930 msgr2=0x7f48e8174bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:37.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.312+0000 7f48f5b9c640 1 --2- 172.21.15.86:0/3699999219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e80d8930 0x7f48e8174bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.312+0000 7f48f5b9c640 1 -- 172.21.15.86:0/3699999219 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e8048100 con 0x7f48e804bc20 2024-09-19T06:46:37.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.312+0000 7f48f639d640 1 --2- 172.21.15.86:0/3699999219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48e8006a40 0x7f48e804e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:37.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.313+0000 7f48f5b9c640 1 --2- 172.21.15.86:0/3699999219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f48e804bc20 0x7f48e804fed0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f48e000c390 tx=0x7f48e000c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:37.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.313+0000 7f48e6ffd640 1 -- 172.21.15.86:0/3699999219 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e0017070 con 0x7f48e804bc20 2024-09-19T06:46:37.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.313+0000 7f48e6ffd640 1 -- 172.21.15.86:0/3699999219 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e00052d0 con 0x7f48e804bc20 2024-09-19T06:46:37.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.313+0000 7f48f739f640 1 -- 172.21.15.86:0/3699999219 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48e81786f0 con 0x7f48e804bc20 2024-09-19T06:46:37.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.313+0000 7f48f739f640 1 -- 172.21.15.86:0/3699999219 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f48e81789d0 con 0x7f48e804bc20 2024-09-19T06:46:37.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.314+0000 7f48e6ffd640 1 -- 172.21.15.86:0/3699999219 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e0003830 con 0x7f48e804bc20 2024-09-19T06:46:37.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.315+0000 7f48f739f640 1 -- 172.21.15.86:0/3699999219 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f48d8001030 con 0x7f48e804bc20 2024-09-19T06:46:37.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.324+0000 7f48e6ffd640 1 -- 172.21.15.86:0/3699999219 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f48e001a070 con 0x7f48e804bc20 2024-09-19T06:46:37.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.324+0000 7f48e6ffd640 1 --2- 172.21.15.86:0/3699999219 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f48d406c3b0 0x7f48d406e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:37.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.325+0000 7f48f639d640 1 --2- 172.21.15.86:0/3699999219 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f48d406c3b0 0x7f48d406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:37.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.326+0000 7f48f639d640 1 --2- 172.21.15.86:0/3699999219 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f48d406c3b0 0x7f48d406e870 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009630 tx=0x7f48ec02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:37.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.326+0000 7f48e6ffd640 1 -- 172.21.15.86:0/3699999219 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7f48e008b420 con 0x7f48e804bc20 2024-09-19T06:46:37.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.326+0000 7f48e6ffd640 1 --2- 172.21.15.86:0/3699999219 >> [v2:172.21.15.169:6809/1326795640,v1:172.21.15.169:6811/1326795640] conn(0x7f48d40761f0 0x7f48d4078690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:37.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.326+0000 7f48e6ffd640 1 -- 172.21.15.86:0/3699999219 --> [v2:172.21.15.169:6809/1326795640,v1:172.21.15.169:6811/1326795640] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48d4078d60 con 0x7f48d40761f0 2024-09-19T06:46:37.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.326+0000 7f48e6ffd640 1 -- 172.21.15.86:0/3699999219 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f48e008b810 con 0x7f48e804bc20 2024-09-19T06:46:37.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.327+0000 7f48f6b9e640 1 --2- 172.21.15.86:0/3699999219 >> [v2:172.21.15.169:6809/1326795640,v1:172.21.15.169:6811/1326795640] conn(0x7f48d40761f0 0x7f48d4078690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:37.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.331+0000 7f48f6b9e640 1 --2- 172.21.15.86:0/3699999219 >> [v2:172.21.15.169:6809/1326795640,v1:172.21.15.169:6811/1326795640] conn(0x7f48d40761f0 0x7f48d4078690 crc :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:37.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.332+0000 7f48e6ffd640 1 -- 172.21.15.86:0/3699999219 <== osd.4 v2:172.21.15.169:6809/1326795640 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f48d4078d60 con 0x7f48d40761f0 2024-09-19T06:46:37.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.361+0000 7f48f739f640 1 -- 172.21.15.86:0/3699999219 --> [v2:172.21.15.169:6809/1326795640,v1:172.21.15.169:6811/1326795640] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f48d8002d50 con 0x7f48d40761f0 2024-09-19T06:46:37.366 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-19T06:46:37.366 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T06:46:37.366 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-19T06:46:37.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.364+0000 7f48e6ffd640 1 -- 172.21.15.86:0/3699999219 <== osd.4 v2:172.21.15.169:6809/1326795640 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f48d8002d50 con 0x7f48d40761f0 2024-09-19T06:46:37.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.365+0000 7f48e4ff9640 1 -- 172.21.15.86:0/3699999219 >> [v2:172.21.15.169:6809/1326795640,v1:172.21.15.169:6811/1326795640] conn(0x7f48d40761f0 msgr2=0x7f48d4078690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:37.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.365+0000 7f48e4ff9640 1 --2- 172.21.15.86:0/3699999219 >> [v2:172.21.15.169:6809/1326795640,v1:172.21.15.169:6811/1326795640] conn(0x7f48d40761f0 0x7f48d4078690 crc :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.365+0000 7f48e4ff9640 1 -- 172.21.15.86:0/3699999219 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f48d406c3b0 msgr2=0x7f48d406e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:37.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.365+0000 7f48e4ff9640 1 --2- 172.21.15.86:0/3699999219 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f48d406c3b0 0x7f48d406e870 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009630 tx=0x7f48ec02e000 comp rx=0 tx=0).stop 2024-09-19T06:46:37.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.365+0000 7f48e4ff9640 1 -- 172.21.15.86:0/3699999219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f48e804bc20 msgr2=0x7f48e804fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:37.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.366+0000 7f48e4ff9640 1 --2- 172.21.15.86:0/3699999219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f48e804bc20 0x7f48e804fed0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f48e000c390 tx=0x7f48e000c850 comp rx=0 tx=0).stop 2024-09-19T06:46:37.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.366+0000 7f48f6b9e640 1 -- 172.21.15.86:0/3699999219 reap_dead start 2024-09-19T06:46:37.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.366+0000 7f48e4ff9640 1 -- 172.21.15.86:0/3699999219 shutdown_connections 2024-09-19T06:46:37.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.366+0000 7f48e4ff9640 1 -- 172.21.15.86:0/3699999219 >> 172.21.15.86:0/3699999219 conn(0x7f48e8050d60 msgr2=0x7f48e804c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:37.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.366+0000 7f48e4ff9640 1 -- 172.21.15.86:0/3699999219 shutdown_connections 2024-09-19T06:46:37.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.366+0000 7f48e4ff9640 1 -- 172.21.15.86:0/3699999219 wait complete. 2024-09-19T06:46:37.388 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-19T06:46:37.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.555+0000 7f2a85c4c640 1 Processor -- start 2024-09-19T06:46:37.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.555+0000 7f2a85c4c640 1 -- start start 2024-09-19T06:46:37.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.556+0000 7f2a85c4c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2a800c32b0 0x7f2a8015af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:37.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.556+0000 7f2a85c4c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2a800c7580 0x7f2a800c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:37.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.556+0000 7f2a85c4c640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a800718e0 con 0x7f2a80070ed0 2024-09-19T06:46:37.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.556+0000 7f2a85c4c640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f2a800c8bc0 con 0x7f2a800c32b0 2024-09-19T06:46:37.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.556+0000 7f2a85c4c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f2a800c8ea0 con 0x7f2a800c7580 2024-09-19T06:46:37.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.556+0000 7f2a7ffff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2a800c7580 0x7f2a800c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:37.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.560+0000 7f2a7ffff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2a800c7580 0x7f2a800c7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.86:47518/0 (socket says 172.21.15.86:47518) 2024-09-19T06:46:37.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.560+0000 7f2a7ffff640 1 -- 172.21.15.86:0/3570224877 learned_addr learned my addr 172.21.15.86:0/3570224877 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:37.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.563+0000 7f2a7f7fe640 1 --2- 172.21.15.86:0/3570224877 >> v2:172.21.15.86:3300/0 conn(0x7f2a800c32b0 0x7f2a8015af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:37.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.564+0000 7f2a7ffff640 1 -- 172.21.15.86:0/3570224877 >> v2:172.21.15.86:3300/0 conn(0x7f2a800c32b0 msgr2=0x7f2a8015af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:37.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.564+0000 7f2a7ffff640 1 --2- 172.21.15.86:0/3570224877 >> v2:172.21.15.86:3300/0 conn(0x7f2a800c32b0 0x7f2a8015af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.564+0000 7f2a7ffff640 1 -- 172.21.15.86:0/3570224877 >> v1:172.21.15.86:6789/0 conn(0x7f2a80070ed0 legacy=0x7f2a801511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:37.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.564+0000 7f2a7ffff640 1 -- 172.21.15.86:0/3570224877 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a80071600 con 0x7f2a800c7580 2024-09-19T06:46:37.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.572+0000 7f2a7ffff640 1 --2- 172.21.15.86:0/3570224877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a800c7580 0x7f2a800c7a30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2a800c6e20 tx=0x7f2a7002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb808c76fb0c4ceb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:37.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.574+0000 7f2a7e7fc640 1 -- 172.21.15.86:0/3570224877 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a70037070 con 0x7f2a800c7580 2024-09-19T06:46:37.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.574+0000 7f2a7e7fc640 1 -- 172.21.15.86:0/3570224877 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a70032440 con 0x7f2a800c7580 2024-09-19T06:46:37.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.574+0000 7f2a7e7fc640 1 -- 172.21.15.86:0/3570224877 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a70032810 con 0x7f2a800c7580 2024-09-19T06:46:37.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.576+0000 7f2a85c4c640 1 -- 172.21.15.86:0/3570224877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a800c7580 msgr2=0x7f2a800c7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:37.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.576+0000 7f2a85c4c640 1 --2- 172.21.15.86:0/3570224877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a800c7580 0x7f2a800c7a30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2a800c6e20 tx=0x7f2a7002a210 comp rx=0 tx=0).stop 2024-09-19T06:46:37.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.578+0000 7f2a85c4c640 1 -- 172.21.15.86:0/3570224877 shutdown_connections 2024-09-19T06:46:37.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.578+0000 7f2a85c4c640 1 --2- 172.21.15.86:0/3570224877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a800c7580 0x7f2a800c7a30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.578+0000 7f2a85c4c640 1 --2- 172.21.15.86:0/3570224877 >> v2:172.21.15.86:3300/0 conn(0x7f2a800c32b0 0x7f2a8015af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.578+0000 7f2a85c4c640 1 -- 172.21.15.86:0/3570224877 >> 172.21.15.86:0/3570224877 conn(0x7f2a800c9280 msgr2=0x7f2a800c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:37.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.579+0000 7f2a85c4c640 1 -- 172.21.15.86:0/3570224877 shutdown_connections 2024-09-19T06:46:37.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.579+0000 7f2a85c4c640 1 -- 172.21.15.86:0/3570224877 wait complete. 2024-09-19T06:46:37.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.580+0000 7f2a85c4c640 1 Processor -- start 2024-09-19T06:46:37.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.581+0000 7f2a85c4c640 1 -- start start 2024-09-19T06:46:37.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.582+0000 7f2a85c4c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a80070ed0 0x7f2a8014f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:37.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.582+0000 7f2a7f7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a80070ed0 0x7f2a8014f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:37.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.582+0000 7f2a7f7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a80070ed0 0x7f2a8014f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:32944/0 (socket says 172.21.15.86:32944) 2024-09-19T06:46:37.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.582+0000 7f2a7f7fe640 1 -- 172.21.15.86:0/2974612919 learned_addr learned my addr 172.21.15.86:0/2974612919 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:37.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.582+0000 7f2a85c4c640 1 --2- 172.21.15.86:0/2974612919 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a800c32b0 0x7f2a8014d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:37.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.582+0000 7f2a85c4c640 1 --2- 172.21.15.86:0/2974612919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a800c7580 0x7f2a80152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:37.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.582+0000 7f2a85c4c640 1 -- 172.21.15.86:0/2974612919 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2a800c3890 con 0x7f2a80070ed0 2024-09-19T06:46:37.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.582+0000 7f2a85c4c640 1 -- 172.21.15.86:0/2974612919 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2a80071300 con 0x7f2a800c7580 2024-09-19T06:46:37.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.582+0000 7f2a85c4c640 1 -- 172.21.15.86:0/2974612919 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2a80072260 con 0x7f2a800c32b0 2024-09-19T06:46:37.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.583+0000 7f2a7f7fe640 1 -- 172.21.15.86:0/2974612919 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a800c32b0 msgr2=0x7f2a8014d480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:46:37.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.583+0000 7f2a7f7fe640 1 --2- 172.21.15.86:0/2974612919 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a800c32b0 0x7f2a8014d480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.583+0000 7f2a7f7fe640 1 -- 172.21.15.86:0/2974612919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a800c7580 msgr2=0x7f2a80152830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:46:37.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.583+0000 7f2a7f7fe640 1 --2- 172.21.15.86:0/2974612919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a800c7580 0x7f2a80152830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.583+0000 7f2a7f7fe640 1 -- 172.21.15.86:0/2974612919 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a8012dd10 con 0x7f2a80070ed0 2024-09-19T06:46:37.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.583+0000 7f2a7f7fe640 1 --2- 172.21.15.86:0/2974612919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a80070ed0 0x7f2a8014f990 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400d920 tx=0x7f2a7400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:37.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.584+0000 7f2a67fff640 1 -- 172.21.15.86:0/2974612919 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7400b780 con 0x7f2a80070ed0 2024-09-19T06:46:37.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.584+0000 7f2a85c4c640 1 -- 172.21.15.86:0/2974612919 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a80153f80 con 0x7f2a80070ed0 2024-09-19T06:46:37.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.584+0000 7f2a85c4c640 1 -- 172.21.15.86:0/2974612919 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a80154220 con 0x7f2a80070ed0 2024-09-19T06:46:37.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.585+0000 7f2a67fff640 1 -- 172.21.15.86:0/2974612919 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a74019070 con 0x7f2a80070ed0 2024-09-19T06:46:37.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.586+0000 7f2a67fff640 1 -- 172.21.15.86:0/2974612919 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7400bb20 con 0x7f2a80070ed0 2024-09-19T06:46:37.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.587+0000 7f2a85c4c640 1 -- 172.21.15.86:0/2974612919 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a60005290 con 0x7f2a80070ed0 2024-09-19T06:46:37.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.589+0000 7f2a67fff640 1 -- 172.21.15.86:0/2974612919 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2a7400bcc0 con 0x7f2a80070ed0 2024-09-19T06:46:37.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.590+0000 7f2a67fff640 1 --2- 172.21.15.86:0/2974612919 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2a6c06c3b0 0x7f2a6c06e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:37.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.590+0000 7f2a67fff640 1 -- 172.21.15.86:0/2974612919 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7f2a7408be90 con 0x7f2a80070ed0 2024-09-19T06:46:37.594 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.593+0000 7f2a7effd640 1 --2- 172.21.15.86:0/2974612919 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2a6c06c3b0 0x7f2a6c06e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:37.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.594+0000 7f2a7effd640 1 --2- 172.21.15.86:0/2974612919 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2a6c06c3b0 0x7f2a6c06e870 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2a8014d1a0 tx=0x7f2a78007cd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:37.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.598+0000 7f2a67fff640 1 -- 172.21.15.86:0/2974612919 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2a7405a060 con 0x7f2a80070ed0 2024-09-19T06:46:37.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.939+0000 7f2a85c4c640 1 -- 172.21.15.86:0/2974612919 --> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f2a60000bc0 con 0x7f2a6c06c3b0 2024-09-19T06:46:37.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.943+0000 7f2a67fff640 1 -- 172.21.15.86:0/2974612919 <== mgr.4105 v2:172.21.15.86:6816/4165134248 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2a60000bc0 con 0x7f2a6c06c3b0 2024-09-19T06:46:37.947 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 4 to deep-scrub 2024-09-19T06:46:37.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.946+0000 7f2a85c4c640 1 -- 172.21.15.86:0/2974612919 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2a6c06c3b0 msgr2=0x7f2a6c06e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:37.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.946+0000 7f2a85c4c640 1 --2- 172.21.15.86:0/2974612919 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2a6c06c3b0 0x7f2a6c06e870 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2a8014d1a0 tx=0x7f2a78007cd0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.946+0000 7f2a85c4c640 1 -- 172.21.15.86:0/2974612919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a80070ed0 msgr2=0x7f2a8014f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:37.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.946+0000 7f2a85c4c640 1 --2- 172.21.15.86:0/2974612919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a80070ed0 0x7f2a8014f990 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400d920 tx=0x7f2a7400dde0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.947+0000 7f2a85c4c640 1 -- 172.21.15.86:0/2974612919 shutdown_connections 2024-09-19T06:46:37.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.947+0000 7f2a85c4c640 1 --2- 172.21.15.86:0/2974612919 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f2a6c06c3b0 0x7f2a6c06e870 secure :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2a8014d1a0 tx=0x7f2a78007cd0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.947+0000 7f2a85c4c640 1 --2- 172.21.15.86:0/2974612919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a800c7580 0x7f2a80152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.947+0000 7f2a85c4c640 1 --2- 172.21.15.86:0/2974612919 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a800c32b0 0x7f2a8014d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.947+0000 7f2a85c4c640 1 --2- 172.21.15.86:0/2974612919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a80070ed0 0x7f2a8014f990 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.947+0000 7f2a85c4c640 1 -- 172.21.15.86:0/2974612919 >> 172.21.15.86:0/2974612919 conn(0x7f2a800c9280 msgr2=0x7f2a800c5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:37.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.947+0000 7f2a85c4c640 1 -- 172.21.15.86:0/2974612919 shutdown_connections 2024-09-19T06:46:37.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:37.947+0000 7f2a85c4c640 1 -- 172.21.15.86:0/2974612919 wait complete. 2024-09-19T06:46:37.972 INFO:tasks.ceph:Scrubbing osd.5 2024-09-19T06:46:37.973 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-19T06:46:38.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.125+0000 7fac60a37640 1 Processor -- start 2024-09-19T06:46:38.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.125+0000 7fac60a37640 1 -- start start 2024-09-19T06:46:38.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.126+0000 7fac60a37640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac5c152e50 0x7fac5c06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.126+0000 7fac60a37640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fac5c0c4670 0x7fac5c0704d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.126+0000 7fac60a37640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac5c06d5c0 con 0x7fac5c153230 2024-09-19T06:46:38.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.126+0000 7fac60a37640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fac5c06d390 con 0x7fac5c0c4670 2024-09-19T06:46:38.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.126+0000 7fac60a37640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fac5c06fab0 con 0x7fac5c152e50 2024-09-19T06:46:38.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.126+0000 7fac5a59c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac5c152e50 0x7fac5c06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.126+0000 7fac5ad9d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fac5c0c4670 0x7fac5c0704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.126+0000 7fac59d9b640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fac5c153230 0x7fac5c0c6ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:50830/0 (socket says 172.21.15.86:50830) 2024-09-19T06:46:38.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.126+0000 7fac59d9b640 1 -- 172.21.15.86:0/663643277 learned_addr learned my addr 172.21.15.86:0/663643277 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:46:38.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.126+0000 7fac5a59c640 1 -- 172.21.15.86:0/663643277 >> v2:172.21.15.169:3300/0 conn(0x7fac5c0c4670 msgr2=0x7fac5c0704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:38.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.126+0000 7fac5a59c640 1 --2- 172.21.15.86:0/663643277 >> v2:172.21.15.169:3300/0 conn(0x7fac5c0c4670 0x7fac5c0704d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.126+0000 7fac5a59c640 1 -- 172.21.15.86:0/663643277 >> v1:172.21.15.169:6789/0 conn(0x7fac5c153230 legacy=0x7fac5c0c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.126+0000 7fac5a59c640 1 -- 172.21.15.86:0/663643277 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c06d860 con 0x7fac5c152e50 2024-09-19T06:46:38.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.126+0000 7fac5ad9d640 1 --2- 172.21.15.86:0/663643277 >> v2:172.21.15.169:3300/0 conn(0x7fac5c0c4670 0x7fac5c0704d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:38.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.127+0000 7fac5a59c640 1 --2- 172.21.15.86:0/663643277 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac5c152e50 0x7fac5c06ff90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0097a0 tx=0x7fac4c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6e8ccc520175c77 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:38.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.127+0000 7fac5959a640 1 -- 172.21.15.86:0/663643277 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c037070 con 0x7fac5c152e50 2024-09-19T06:46:38.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.127+0000 7fac5959a640 1 -- 172.21.15.86:0/663643277 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac4c032440 con 0x7fac5c152e50 2024-09-19T06:46:38.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.127+0000 7fac5959a640 1 -- 172.21.15.86:0/663643277 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c032810 con 0x7fac5c152e50 2024-09-19T06:46:38.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.128+0000 7fac60a37640 1 -- 172.21.15.86:0/663643277 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac5c152e50 msgr2=0x7fac5c06ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.128+0000 7fac60a37640 1 --2- 172.21.15.86:0/663643277 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac5c152e50 0x7fac5c06ff90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0097a0 tx=0x7fac4c02a180 comp rx=0 tx=0).stop 2024-09-19T06:46:38.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.128+0000 7fac60a37640 1 -- 172.21.15.86:0/663643277 shutdown_connections 2024-09-19T06:46:38.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.128+0000 7fac60a37640 1 --2- 172.21.15.86:0/663643277 >> v2:172.21.15.169:3300/0 conn(0x7fac5c0c4670 0x7fac5c0704d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.128+0000 7fac60a37640 1 --2- 172.21.15.86:0/663643277 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac5c152e50 0x7fac5c06ff90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.128+0000 7fac60a37640 1 -- 172.21.15.86:0/663643277 >> 172.21.15.86:0/663643277 conn(0x7fac5c0cd970 msgr2=0x7fac5c0cdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:38.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.128+0000 7fac60a37640 1 -- 172.21.15.86:0/663643277 shutdown_connections 2024-09-19T06:46:38.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.128+0000 7fac60a37640 1 -- 172.21.15.86:0/663643277 wait complete. 2024-09-19T06:46:38.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.129+0000 7fac60a37640 1 Processor -- start 2024-09-19T06:46:38.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.129+0000 7fac60a37640 1 -- start start 2024-09-19T06:46:38.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.130+0000 7fac60a37640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac5c0c4670 0x7fac5c1577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.130+0000 7fac60a37640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac5c152e50 0x7fac5c151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.130+0000 7fac60a37640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac5c153230 0x7fac5c151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.130+0000 7fac60a37640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c06bbc0 con 0x7fac5c0c4670 2024-09-19T06:46:38.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.130+0000 7fac60a37640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c06de20 con 0x7fac5c153230 2024-09-19T06:46:38.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.130+0000 7fac60a37640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fac5c0c75b0 con 0x7fac5c152e50 2024-09-19T06:46:38.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.130+0000 7fac5a59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac5c0c4670 0x7fac5c1577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.130+0000 7fac59d9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac5c152e50 0x7fac5c151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.130+0000 7fac5a59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac5c0c4670 0x7fac5c1577d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:32958/0 (socket says 172.21.15.86:32958) 2024-09-19T06:46:38.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.130+0000 7fac5a59c640 1 -- 172.21.15.86:0/2828844768 learned_addr learned my addr 172.21.15.86:0/2828844768 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:38.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.130+0000 7fac5ad9d640 1 --2- 172.21.15.86:0/2828844768 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac5c153230 0x7fac5c151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.130+0000 7fac5a59c640 1 -- 172.21.15.86:0/2828844768 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac5c152e50 msgr2=0x7fac5c151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.130+0000 7fac5a59c640 1 --2- 172.21.15.86:0/2828844768 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac5c152e50 0x7fac5c151010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.130+0000 7fac5a59c640 1 -- 172.21.15.86:0/2828844768 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac5c153230 msgr2=0x7fac5c151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.130+0000 7fac5a59c640 1 --2- 172.21.15.86:0/2828844768 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac5c153230 0x7fac5c151550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.130+0000 7fac5a59c640 1 -- 172.21.15.86:0/2828844768 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c158190 con 0x7fac5c0c4670 2024-09-19T06:46:38.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.130+0000 7fac5ad9d640 1 --2- 172.21.15.86:0/2828844768 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac5c153230 0x7fac5c151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:38.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.130+0000 7fac59d9b640 1 --2- 172.21.15.86:0/2828844768 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac5c152e50 0x7fac5c151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:38.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.130+0000 7fac5a59c640 1 --2- 172.21.15.86:0/2828844768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac5c0c4670 0x7fac5c1577d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0098c0 tx=0x7fac4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:38.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.131+0000 7fac4affd640 1 -- 172.21.15.86:0/2828844768 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c037040 con 0x7fac5c0c4670 2024-09-19T06:46:38.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.131+0000 7fac4affd640 1 -- 172.21.15.86:0/2828844768 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac4c030440 con 0x7fac5c0c4670 2024-09-19T06:46:38.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.131+0000 7fac60a37640 1 -- 172.21.15.86:0/2828844768 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac5c158470 con 0x7fac5c0c4670 2024-09-19T06:46:38.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.131+0000 7fac4affd640 1 -- 172.21.15.86:0/2828844768 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c030810 con 0x7fac5c0c4670 2024-09-19T06:46:38.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.131+0000 7fac60a37640 1 -- 172.21.15.86:0/2828844768 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac5c14ef50 con 0x7fac5c0c4670 2024-09-19T06:46:38.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.132+0000 7fac60a37640 1 -- 172.21.15.86:0/2828844768 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fac5c1586b0 con 0x7fac5c0c4670 2024-09-19T06:46:38.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.132+0000 7fac4affd640 1 -- 172.21.15.86:0/2828844768 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fac4c044020 con 0x7fac5c0c4670 2024-09-19T06:46:38.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.133+0000 7fac4affd640 1 --2- 172.21.15.86:0/2828844768 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fac3c06c2b0 0x7fac3c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.133+0000 7fac4affd640 1 -- 172.21.15.86:0/2828844768 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7fac4c0abb90 con 0x7fac5c0c4670 2024-09-19T06:46:38.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.133+0000 7fac59d9b640 1 --2- 172.21.15.86:0/2828844768 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fac3c06c2b0 0x7fac3c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.133+0000 7fac4affd640 1 --2- 172.21.15.86:0/2828844768 >> [v2:172.21.15.169:6824/3538913242,v1:172.21.15.169:6825/3538913242] conn(0x7fac3c0760f0 0x7fac3c078590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.133+0000 7fac4affd640 1 -- 172.21.15.86:0/2828844768 --> [v2:172.21.15.169:6824/3538913242,v1:172.21.15.169:6825/3538913242] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fac4c032440 con 0x7fac3c0760f0 2024-09-19T06:46:38.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.133+0000 7fac4affd640 1 -- 172.21.15.86:0/2828844768 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fac4c0ae290 con 0x7fac5c0c4670 2024-09-19T06:46:38.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.133+0000 7fac5ad9d640 1 --2- 172.21.15.86:0/2828844768 >> [v2:172.21.15.169:6824/3538913242,v1:172.21.15.169:6825/3538913242] conn(0x7fac3c0760f0 0x7fac3c078590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.133+0000 7fac59d9b640 1 --2- 172.21.15.86:0/2828844768 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fac3c06c2b0 0x7fac3c06e770 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fac5c0cbbc0 tx=0x7fac50007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:38.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.133+0000 7fac5ad9d640 1 --2- 172.21.15.86:0/2828844768 >> [v2:172.21.15.169:6824/3538913242,v1:172.21.15.169:6825/3538913242] conn(0x7fac3c0760f0 0x7fac3c078590 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:38.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.134+0000 7fac4affd640 1 -- 172.21.15.86:0/2828844768 <== osd.5 v2:172.21.15.169:6824/3538913242 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fac4c032440 con 0x7fac3c0760f0 2024-09-19T06:46:38.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.147+0000 7fac60a37640 1 -- 172.21.15.86:0/2828844768 --> [v2:172.21.15.169:6824/3538913242,v1:172.21.15.169:6825/3538913242] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fac5c15d110 con 0x7fac3c0760f0 2024-09-19T06:46:38.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.147+0000 7fac4affd640 1 -- 172.21.15.86:0/2828844768 <== osd.5 v2:172.21.15.169:6824/3538913242 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fac5c15d110 con 0x7fac3c0760f0 2024-09-19T06:46:38.149 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-19T06:46:38.149 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T06:46:38.149 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-19T06:46:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.147+0000 7fac60a37640 1 -- 172.21.15.86:0/2828844768 >> [v2:172.21.15.169:6824/3538913242,v1:172.21.15.169:6825/3538913242] conn(0x7fac3c0760f0 msgr2=0x7fac3c078590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.147+0000 7fac60a37640 1 --2- 172.21.15.86:0/2828844768 >> [v2:172.21.15.169:6824/3538913242,v1:172.21.15.169:6825/3538913242] conn(0x7fac3c0760f0 0x7fac3c078590 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.147+0000 7fac60a37640 1 -- 172.21.15.86:0/2828844768 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fac3c06c2b0 msgr2=0x7fac3c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.147+0000 7fac60a37640 1 --2- 172.21.15.86:0/2828844768 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fac3c06c2b0 0x7fac3c06e770 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fac5c0cbbc0 tx=0x7fac50007e80 comp rx=0 tx=0).stop 2024-09-19T06:46:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.147+0000 7fac60a37640 1 -- 172.21.15.86:0/2828844768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac5c0c4670 msgr2=0x7fac5c1577d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.147+0000 7fac60a37640 1 --2- 172.21.15.86:0/2828844768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac5c0c4670 0x7fac5c1577d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0098c0 tx=0x7fac4c0046c0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.147+0000 7fac5ad9d640 1 -- 172.21.15.86:0/2828844768 reap_dead start 2024-09-19T06:46:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.147+0000 7fac60a37640 1 -- 172.21.15.86:0/2828844768 shutdown_connections 2024-09-19T06:46:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.147+0000 7fac60a37640 1 -- 172.21.15.86:0/2828844768 >> 172.21.15.86:0/2828844768 conn(0x7fac5c0cd970 msgr2=0x7fac5c0cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.147+0000 7fac60a37640 1 -- 172.21.15.86:0/2828844768 shutdown_connections 2024-09-19T06:46:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.147+0000 7fac60a37640 1 -- 172.21.15.86:0/2828844768 wait complete. 2024-09-19T06:46:38.159 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-19T06:46:38.260 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.259+0000 7f7ae54ac640 1 Processor -- start 2024-09-19T06:46:38.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.259+0000 7f7ae54ac640 1 -- start start 2024-09-19T06:46:38.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.260+0000 7f7ae54ac640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7ae00d0d40 0x7f7ae00ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.260+0000 7f7ae54ac640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ae00d1120 0x7f7ae00cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.260+0000 7f7ae54ac640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ae015c9c0 con 0x7f7ae015da60 2024-09-19T06:46:38.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.260+0000 7f7ae54ac640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f7ae015c770 con 0x7f7ae00d0d40 2024-09-19T06:46:38.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.260+0000 7f7ae54ac640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7ae00b3f20 con 0x7f7ae00d1120 2024-09-19T06:46:38.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.260+0000 7f7adf7fe640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f7ae015da60 0x7f7ae00b4b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:44336/0 (socket says 172.21.15.86:44336) 2024-09-19T06:46:38.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.260+0000 7f7adf7fe640 1 -- 172.21.15.86:0/1200813056 learned_addr learned my addr 172.21.15.86:0/1200813056 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:46:38.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.260+0000 7f7adeffd640 1 --2- 172.21.15.86:0/1200813056 >> v2:172.21.15.169:3300/0 conn(0x7f7ae00d0d40 0x7f7ae00ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.260+0000 7f7ad7fff640 1 --2- 172.21.15.86:0/1200813056 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ae00d1120 0x7f7ae00cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.260+0000 7f7ade7fc640 1 -- 172.21.15.86:0/1200813056 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3228220049 0 0) 0x7f7ae015c9c0 con 0x7f7ae015da60 2024-09-19T06:46:38.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.260+0000 7f7ade7fc640 1 -- 172.21.15.86:0/1200813056 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7acc003520 con 0x7f7ae015da60 2024-09-19T06:46:38.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.260+0000 7f7ade7fc640 1 -- 172.21.15.86:0/1200813056 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 106905349 0 0) 0x7f7acc003520 con 0x7f7ae015da60 2024-09-19T06:46:38.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.260+0000 7f7ade7fc640 1 -- 172.21.15.86:0/1200813056 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ae00d1120 msgr2=0x7f7ae00cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:38.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.260+0000 7f7ade7fc640 1 --2- 172.21.15.86:0/1200813056 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ae00d1120 0x7f7ae00cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.260+0000 7f7ade7fc640 1 -- 172.21.15.86:0/1200813056 >> v2:172.21.15.169:3300/0 conn(0x7f7ae00d0d40 msgr2=0x7f7ae00ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:38.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.260+0000 7f7ade7fc640 1 --2- 172.21.15.86:0/1200813056 >> v2:172.21.15.169:3300/0 conn(0x7f7ae00d0d40 0x7f7ae00ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.260+0000 7f7ade7fc640 1 -- 172.21.15.86:0/1200813056 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae015cca0 con 0x7f7ae015da60 2024-09-19T06:46:38.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.260+0000 7f7ade7fc640 1 -- 172.21.15.86:0/1200813056 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f7ad80019f0 con 0x7f7ae015da60 2024-09-19T06:46:38.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.261+0000 7f7ade7fc640 1 -- 172.21.15.86:0/1200813056 >> v1:172.21.15.86:6789/0 conn(0x7f7ae015da60 legacy=0x7f7ae00b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.261+0000 7f7ade7fc640 1 --2- 172.21.15.86:0/1200813056 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ae00d1120 0x7f7acc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.261+0000 7f7ade7fc640 1 --2- 172.21.15.86:0/1200813056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7acc003f30 0x7f7acc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.261+0000 7f7ade7fc640 1 --2- 172.21.15.86:0/1200813056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7acc004d40 0x7f7acc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.261+0000 7f7ade7fc640 1 -- 172.21.15.86:0/1200813056 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae015c770 con 0x7f7acc004d40 2024-09-19T06:46:38.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.261+0000 7f7ade7fc640 1 -- 172.21.15.86:0/1200813056 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae00b3f20 con 0x7f7acc003f30 2024-09-19T06:46:38.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.261+0000 7f7ade7fc640 1 -- 172.21.15.86:0/1200813056 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7acc00b9c0 con 0x7f7ae00d1120 2024-09-19T06:46:38.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.261+0000 7f7adf7fe640 1 --2- 172.21.15.86:0/1200813056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7acc004d40 0x7f7acc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.261+0000 7f7adeffd640 1 --2- 172.21.15.86:0/1200813056 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ae00d1120 0x7f7acc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.261+0000 7f7ad7fff640 1 --2- 172.21.15.86:0/1200813056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7acc003f30 0x7f7acc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.261+0000 7f7adf7fe640 1 -- 172.21.15.86:0/1200813056 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ae00d1120 msgr2=0x7f7acc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:38.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.261+0000 7f7adf7fe640 1 --2- 172.21.15.86:0/1200813056 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ae00d1120 0x7f7acc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.261+0000 7f7adf7fe640 1 -- 172.21.15.86:0/1200813056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7acc003f30 msgr2=0x7f7acc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:38.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.261+0000 7f7adf7fe640 1 --2- 172.21.15.86:0/1200813056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7acc003f30 0x7f7acc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.261+0000 7f7adf7fe640 1 -- 172.21.15.86:0/1200813056 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7acc003520 con 0x7f7acc004d40 2024-09-19T06:46:38.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.262+0000 7f7adf7fe640 1 --2- 172.21.15.86:0/1200813056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7acc004d40 0x7f7acc0051c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800a870 tx=0x7f7acc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2118ab7d311b991 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:38.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.262+0000 7f7ade7fc640 1 -- 172.21.15.86:0/1200813056 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad800a4c0 con 0x7f7acc004d40 2024-09-19T06:46:38.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.262+0000 7f7ade7fc640 1 -- 172.21.15.86:0/1200813056 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad802f070 con 0x7f7acc004d40 2024-09-19T06:46:38.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.262+0000 7f7ade7fc640 1 -- 172.21.15.86:0/1200813056 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad802bcb0 con 0x7f7acc004d40 2024-09-19T06:46:38.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.262+0000 7f7ae54ac640 1 -- 172.21.15.86:0/1200813056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7acc004d40 msgr2=0x7f7acc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.262+0000 7f7ae54ac640 1 --2- 172.21.15.86:0/1200813056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7acc004d40 0x7f7acc0051c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800a870 tx=0x7f7acc005830 comp rx=0 tx=0).stop 2024-09-19T06:46:38.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.262+0000 7f7adf7fe640 1 -- 172.21.15.86:0/1200813056 reap_dead start 2024-09-19T06:46:38.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.262+0000 7f7ae54ac640 1 -- 172.21.15.86:0/1200813056 shutdown_connections 2024-09-19T06:46:38.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.262+0000 7f7ae54ac640 1 -- 172.21.15.86:0/1200813056 >> 172.21.15.86:0/1200813056 conn(0x7f7ae006d910 msgr2=0x7f7ae006dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:38.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.262+0000 7f7ae54ac640 1 -- 172.21.15.86:0/1200813056 shutdown_connections 2024-09-19T06:46:38.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.262+0000 7f7ae54ac640 1 -- 172.21.15.86:0/1200813056 wait complete. 2024-09-19T06:46:38.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.264+0000 7f7ae54ac640 1 Processor -- start 2024-09-19T06:46:38.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.264+0000 7f7ae54ac640 1 -- start start 2024-09-19T06:46:38.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.264+0000 7f7ae54ac640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7acc004d40 0x7f7ae0158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.264+0000 7f7ae54ac640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ae015bf90 0x7f7ae0154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.264+0000 7f7ae54ac640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ae0155270 0x7f7ae01f4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.264+0000 7f7ae54ac640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae00cac00 con 0x7f7ae0155270 2024-09-19T06:46:38.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.264+0000 7f7ae54ac640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae015d260 con 0x7f7ae015bf90 2024-09-19T06:46:38.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.264+0000 7f7ae54ac640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7ae00cad80 con 0x7f7acc004d40 2024-09-19T06:46:38.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.264+0000 7f7adf7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ae0155270 0x7f7ae01f4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.264+0000 7f7adf7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ae0155270 0x7f7ae01f4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:32986/0 (socket says 172.21.15.86:32986) 2024-09-19T06:46:38.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.264+0000 7f7adf7fe640 1 -- 172.21.15.86:0/3357959701 learned_addr learned my addr 172.21.15.86:0/3357959701 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:38.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.264+0000 7f7adeffd640 1 --2- 172.21.15.86:0/3357959701 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7acc004d40 0x7f7ae0158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.264+0000 7f7ad7fff640 1 --2- 172.21.15.86:0/3357959701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ae015bf90 0x7f7ae0154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.265+0000 7f7adf7fe640 1 -- 172.21.15.86:0/3357959701 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7acc004d40 msgr2=0x7f7ae0158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.265+0000 7f7adf7fe640 1 --2- 172.21.15.86:0/3357959701 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7acc004d40 0x7f7ae0158400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.265+0000 7f7adf7fe640 1 -- 172.21.15.86:0/3357959701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ae015bf90 msgr2=0x7f7ae0154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.265+0000 7f7adf7fe640 1 --2- 172.21.15.86:0/3357959701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ae015bf90 0x7f7ae0154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.265+0000 7f7adf7fe640 1 -- 172.21.15.86:0/3357959701 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae015ed80 con 0x7f7ae0155270 2024-09-19T06:46:38.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.265+0000 7f7adf7fe640 1 --2- 172.21.15.86:0/3357959701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ae0155270 0x7f7ae01f4250 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800a990 tx=0x7f7ad8001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:38.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.265+0000 7f7ad77fe640 1 -- 172.21.15.86:0/3357959701 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad800a4c0 con 0x7f7ae0155270 2024-09-19T06:46:38.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.265+0000 7f7ad77fe640 1 -- 172.21.15.86:0/3357959701 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad8034470 con 0x7f7ae0155270 2024-09-19T06:46:38.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.265+0000 7f7ae54ac640 1 -- 172.21.15.86:0/3357959701 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae015f060 con 0x7f7ae0155270 2024-09-19T06:46:38.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.265+0000 7f7ad77fe640 1 -- 172.21.15.86:0/3357959701 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8002030 con 0x7f7ae0155270 2024-09-19T06:46:38.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.265+0000 7f7ae54ac640 1 -- 172.21.15.86:0/3357959701 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae0157c00 con 0x7f7ae0155270 2024-09-19T06:46:38.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.266+0000 7f7ae54ac640 1 -- 172.21.15.86:0/3357959701 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ae006e250 con 0x7f7ae0155270 2024-09-19T06:46:38.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.267+0000 7f7ad77fe640 1 -- 172.21.15.86:0/3357959701 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7ad8034820 con 0x7f7ae0155270 2024-09-19T06:46:38.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.267+0000 7f7ad77fe640 1 --2- 172.21.15.86:0/3357959701 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7ac006c2e0 0x7f7ac006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.267+0000 7f7ad77fe640 1 -- 172.21.15.86:0/3357959701 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7f7ad80ab900 con 0x7f7ae0155270 2024-09-19T06:46:38.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.267+0000 7f7adeffd640 1 --2- 172.21.15.86:0/3357959701 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7ac006c2e0 0x7f7ac006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.267+0000 7f7adeffd640 1 --2- 172.21.15.86:0/3357959701 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7ac006c2e0 0x7f7ac006e7a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009c40 tx=0x7f7ad0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:38.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.271+0000 7f7ad77fe640 1 -- 172.21.15.86:0/3357959701 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7ae006e250 con 0x7f7ae0155270 2024-09-19T06:46:38.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.441+0000 7f7ae54ac640 1 -- 172.21.15.86:0/3357959701 --> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f7ae00ca6c0 con 0x7f7ac006c2e0 2024-09-19T06:46:38.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.442+0000 7f7ad77fe640 1 -- 172.21.15.86:0/3357959701 <== mgr.4105 v2:172.21.15.86:6816/4165134248 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7ae00ca6c0 con 0x7f7ac006c2e0 2024-09-19T06:46:38.443 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 5 to deep-scrub 2024-09-19T06:46:38.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.444+0000 7f7ae54ac640 1 -- 172.21.15.86:0/3357959701 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7ac006c2e0 msgr2=0x7f7ac006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.444+0000 7f7ae54ac640 1 --2- 172.21.15.86:0/3357959701 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7ac006c2e0 0x7f7ac006e7a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009c40 tx=0x7f7ad0009190 comp rx=0 tx=0).stop 2024-09-19T06:46:38.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.444+0000 7f7ae54ac640 1 -- 172.21.15.86:0/3357959701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ae0155270 msgr2=0x7f7ae01f4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.444+0000 7f7ae54ac640 1 --2- 172.21.15.86:0/3357959701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ae0155270 0x7f7ae01f4250 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800a990 tx=0x7f7ad8001360 comp rx=0 tx=0).stop 2024-09-19T06:46:38.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.444+0000 7f7ae54ac640 1 -- 172.21.15.86:0/3357959701 shutdown_connections 2024-09-19T06:46:38.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.444+0000 7f7ae54ac640 1 --2- 172.21.15.86:0/3357959701 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7ac006c2e0 0x7f7ac006e7a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.444+0000 7f7ae54ac640 1 --2- 172.21.15.86:0/3357959701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ae0155270 0x7f7ae01f4250 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.444+0000 7f7ae54ac640 1 --2- 172.21.15.86:0/3357959701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ae015bf90 0x7f7ae0154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.444+0000 7f7ae54ac640 1 --2- 172.21.15.86:0/3357959701 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7acc004d40 0x7f7ae0158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.444+0000 7f7ae54ac640 1 -- 172.21.15.86:0/3357959701 >> 172.21.15.86:0/3357959701 conn(0x7f7ae006d910 msgr2=0x7f7ae00b40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:38.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.444+0000 7f7ae54ac640 1 -- 172.21.15.86:0/3357959701 shutdown_connections 2024-09-19T06:46:38.447 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.444+0000 7f7ae54ac640 1 -- 172.21.15.86:0/3357959701 wait complete. 2024-09-19T06:46:38.456 INFO:tasks.ceph:Scrubbing osd.6 2024-09-19T06:46:38.456 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-19T06:46:38.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.562+0000 7f9070786640 1 Processor -- start 2024-09-19T06:46:38.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.562+0000 7f9070786640 1 -- start start 2024-09-19T06:46:38.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.563+0000 7f9070786640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f90680c4060 0x7f90680c25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.563+0000 7f9070786640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f906815f090 con 0x7f906806d610 2024-09-19T06:46:38.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.563+0000 7f9070786640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9068067900 con 0x7f90680c21f0 2024-09-19T06:46:38.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.563+0000 7f9070786640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f906806e4a0 con 0x7f90680c4060 2024-09-19T06:46:38.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.563+0000 7f906dd21640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f906806d610 0x7f90681639a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:44352/0 (socket says 172.21.15.86:44352) 2024-09-19T06:46:38.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.563+0000 7f906dd21640 1 -- 172.21.15.86:0/538778587 learned_addr learned my addr 172.21.15.86:0/538778587 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:46:38.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.563+0000 7f906ed23640 1 --2- 172.21.15.86:0/538778587 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f90680c4060 0x7f90680c25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.563+0000 7f906d520640 1 -- 172.21.15.86:0/538778587 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4270388130 0 0) 0x7f906815f090 con 0x7f906806d610 2024-09-19T06:46:38.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.563+0000 7f906d520640 1 -- 172.21.15.86:0/538778587 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9054003520 con 0x7f906806d610 2024-09-19T06:46:38.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.563+0000 7f906d520640 1 -- 172.21.15.86:0/538778587 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3459067752 0 0) 0x7f9054003520 con 0x7f906806d610 2024-09-19T06:46:38.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.563+0000 7f906d520640 1 -- 172.21.15.86:0/538778587 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f90680c4060 msgr2=0x7f90680c25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:38.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.563+0000 7f906d520640 1 --2- 172.21.15.86:0/538778587 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f90680c4060 0x7f90680c25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.563+0000 7f906d520640 1 -- 172.21.15.86:0/538778587 >> v1:172.21.15.169:6789/0 conn(0x7f90680c21f0 legacy=0x7f906806cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.563+0000 7f906d520640 1 -- 172.21.15.86:0/538778587 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f906815f350 con 0x7f906806d610 2024-09-19T06:46:38.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.563+0000 7f906d520640 1 -- 172.21.15.86:0/538778587 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f9058001670 con 0x7f906806d610 2024-09-19T06:46:38.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.563+0000 7f906d520640 1 -- 172.21.15.86:0/538778587 >> v1:172.21.15.86:6789/0 conn(0x7f906806d610 legacy=0x7f90681639a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.563+0000 7f906d520640 1 --2- 172.21.15.86:0/538778587 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f90680c4060 0x7f90540039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.563+0000 7f906d520640 1 --2- 172.21.15.86:0/538778587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9054003f60 0x7f9054004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.563+0000 7f906d520640 1 --2- 172.21.15.86:0/538778587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9054004d40 0x7f90540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.563+0000 7f906d520640 1 -- 172.21.15.86:0/538778587 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f906806e4a0 con 0x7f9054004d40 2024-09-19T06:46:38.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.563+0000 7f906d520640 1 -- 172.21.15.86:0/538778587 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f905400bb30 con 0x7f9054003f60 2024-09-19T06:46:38.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.563+0000 7f906d520640 1 -- 172.21.15.86:0/538778587 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f905400bd30 con 0x7f90680c4060 2024-09-19T06:46:38.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.564+0000 7f906ed23640 1 --2- 172.21.15.86:0/538778587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9054004d40 0x7f90540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.564+0000 7f906e522640 1 --2- 172.21.15.86:0/538778587 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f90680c4060 0x7f90540039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.564+0000 7f906dd21640 1 --2- 172.21.15.86:0/538778587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9054003f60 0x7f9054004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.564+0000 7f906ed23640 1 -- 172.21.15.86:0/538778587 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f90680c4060 msgr2=0x7f90540039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:38.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.564+0000 7f906ed23640 1 --2- 172.21.15.86:0/538778587 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f90680c4060 0x7f90540039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.564+0000 7f906ed23640 1 -- 172.21.15.86:0/538778587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9054003f60 msgr2=0x7f9054004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:38.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.564+0000 7f906ed23640 1 --2- 172.21.15.86:0/538778587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9054003f60 0x7f9054004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.564+0000 7f906ed23640 1 -- 172.21.15.86:0/538778587 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9054003520 con 0x7f9054004d40 2024-09-19T06:46:38.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.564+0000 7f906dd21640 1 --2- 172.21.15.86:0/538778587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9054003f60 0x7f9054004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:38.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.564+0000 7f906ed23640 1 --2- 172.21.15.86:0/538778587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9054004d40 0x7f90540051c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9060009f90 tx=0x7f9054005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6998c12bb1892e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:38.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.565+0000 7f906d520640 1 -- 172.21.15.86:0/538778587 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9060009c10 con 0x7f9054004d40 2024-09-19T06:46:38.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.565+0000 7f906d520640 1 -- 172.21.15.86:0/538778587 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9060036070 con 0x7f9054004d40 2024-09-19T06:46:38.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.565+0000 7f906d520640 1 -- 172.21.15.86:0/538778587 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9060031810 con 0x7f9054004d40 2024-09-19T06:46:38.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.565+0000 7f9070786640 1 -- 172.21.15.86:0/538778587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9054004d40 msgr2=0x7f90540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.565+0000 7f9070786640 1 --2- 172.21.15.86:0/538778587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9054004d40 0x7f90540051c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9060009f90 tx=0x7f9054005830 comp rx=0 tx=0).stop 2024-09-19T06:46:38.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.565+0000 7f906ed23640 1 -- 172.21.15.86:0/538778587 reap_dead start 2024-09-19T06:46:38.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.565+0000 7f9070786640 1 -- 172.21.15.86:0/538778587 shutdown_connections 2024-09-19T06:46:38.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.565+0000 7f9070786640 1 -- 172.21.15.86:0/538778587 >> 172.21.15.86:0/538778587 conn(0x7f906806bbc0 msgr2=0x7f906806bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:38.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.565+0000 7f9070786640 1 -- 172.21.15.86:0/538778587 shutdown_connections 2024-09-19T06:46:38.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.565+0000 7f9070786640 1 -- 172.21.15.86:0/538778587 wait complete. 2024-09-19T06:46:38.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.566+0000 7f9070786640 1 Processor -- start 2024-09-19T06:46:38.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.566+0000 7f9070786640 1 -- start start 2024-09-19T06:46:38.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.567+0000 7f9070786640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9054004d40 0x7f90680c4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.567+0000 7f9070786640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90680c71b0 0x7f90680cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.567+0000 7f9070786640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f90681529d0 0x7f9068152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.567+0000 7f9070786640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9068067bc0 con 0x7f9054004d40 2024-09-19T06:46:38.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.567+0000 7f9070786640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f90680c91e0 con 0x7f90680c71b0 2024-09-19T06:46:38.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.567+0000 7f9070786640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f90680b2f00 con 0x7f90681529d0 2024-09-19T06:46:38.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.567+0000 7f906e522640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9054004d40 0x7f90680c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.567+0000 7f906e522640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9054004d40 0x7f90680c4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33000/0 (socket says 172.21.15.86:33000) 2024-09-19T06:46:38.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.567+0000 7f906e522640 1 -- 172.21.15.86:0/2670278304 learned_addr learned my addr 172.21.15.86:0/2670278304 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:38.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.567+0000 7f906ed23640 1 --2- 172.21.15.86:0/2670278304 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f90681529d0 0x7f9068152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.567+0000 7f906dd21640 1 --2- 172.21.15.86:0/2670278304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90680c71b0 0x7f90680cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.567+0000 7f906e522640 1 -- 172.21.15.86:0/2670278304 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f90681529d0 msgr2=0x7f9068152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.567+0000 7f906e522640 1 --2- 172.21.15.86:0/2670278304 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f90681529d0 0x7f9068152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.567+0000 7f906e522640 1 -- 172.21.15.86:0/2670278304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90680c71b0 msgr2=0x7f90680cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.567+0000 7f906e522640 1 --2- 172.21.15.86:0/2670278304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90680c71b0 0x7f90680cc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.567+0000 7f906e522640 1 -- 172.21.15.86:0/2670278304 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90681f4410 con 0x7f9054004d40 2024-09-19T06:46:38.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.567+0000 7f906ed23640 1 --2- 172.21.15.86:0/2670278304 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f90681529d0 0x7f9068152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:38.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.568+0000 7f906e522640 1 --2- 172.21.15.86:0/2670278304 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9054004d40 0x7f90680c4540 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f906400e550 tx=0x7f906400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:38.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.568+0000 7f905effd640 1 -- 172.21.15.86:0/2670278304 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90640052e0 con 0x7f9054004d40 2024-09-19T06:46:38.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.568+0000 7f905effd640 1 -- 172.21.15.86:0/2670278304 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9064018070 con 0x7f9054004d40 2024-09-19T06:46:38.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.568+0000 7f9070786640 1 -- 172.21.15.86:0/2670278304 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9068153390 con 0x7f9054004d40 2024-09-19T06:46:38.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.568+0000 7f905effd640 1 -- 172.21.15.86:0/2670278304 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9064003810 con 0x7f9054004d40 2024-09-19T06:46:38.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.568+0000 7f9070786640 1 -- 172.21.15.86:0/2670278304 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90680c6d90 con 0x7f9054004d40 2024-09-19T06:46:38.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.569+0000 7f9070786640 1 -- 172.21.15.86:0/2670278304 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9068155740 con 0x7f9054004d40 2024-09-19T06:46:38.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.569+0000 7f905effd640 1 -- 172.21.15.86:0/2670278304 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f90640039b0 con 0x7f9054004d40 2024-09-19T06:46:38.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.570+0000 7f905effd640 1 --2- 172.21.15.86:0/2670278304 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f904c06c2b0 0x7f904c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.570+0000 7f905effd640 1 -- 172.21.15.86:0/2670278304 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7f906408b6f0 con 0x7f9054004d40 2024-09-19T06:46:38.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.570+0000 7f906dd21640 1 --2- 172.21.15.86:0/2670278304 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f904c06c2b0 0x7f904c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.570+0000 7f905effd640 1 --2- 172.21.15.86:0/2670278304 >> [v2:172.21.15.169:6808/494424253,v1:172.21.15.169:6810/494424253] conn(0x7f904c076100 0x7f904c0785a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.570+0000 7f905effd640 1 -- 172.21.15.86:0/2670278304 --> [v2:172.21.15.169:6808/494424253,v1:172.21.15.169:6810/494424253] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f906401de50 con 0x7f904c076100 2024-09-19T06:46:38.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.570+0000 7f905effd640 1 -- 172.21.15.86:0/2670278304 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9064092050 con 0x7f9054004d40 2024-09-19T06:46:38.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.570+0000 7f906dd21640 1 --2- 172.21.15.86:0/2670278304 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f904c06c2b0 0x7f904c06e770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f90680c65b0 tx=0x7f9058007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:38.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.570+0000 7f906ed23640 1 --2- 172.21.15.86:0/2670278304 >> [v2:172.21.15.169:6808/494424253,v1:172.21.15.169:6810/494424253] conn(0x7f904c076100 0x7f904c0785a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.571+0000 7f906ed23640 1 --2- 172.21.15.86:0/2670278304 >> [v2:172.21.15.169:6808/494424253,v1:172.21.15.169:6810/494424253] conn(0x7f904c076100 0x7f904c0785a0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:38.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.571+0000 7f905effd640 1 -- 172.21.15.86:0/2670278304 <== osd.6 v2:172.21.15.169:6808/494424253 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f906401de50 con 0x7f904c076100 2024-09-19T06:46:38.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.584+0000 7f9070786640 1 -- 172.21.15.86:0/2670278304 --> [v2:172.21.15.169:6808/494424253,v1:172.21.15.169:6810/494424253] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f90680c7830 con 0x7f904c076100 2024-09-19T06:46:38.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.584+0000 7f905effd640 1 -- 172.21.15.86:0/2670278304 <== osd.6 v2:172.21.15.169:6808/494424253 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f90680c7830 con 0x7f904c076100 2024-09-19T06:46:38.587 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-19T06:46:38.587 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T06:46:38.587 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-19T06:46:38.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.585+0000 7f9070786640 1 -- 172.21.15.86:0/2670278304 >> [v2:172.21.15.169:6808/494424253,v1:172.21.15.169:6810/494424253] conn(0x7f904c076100 msgr2=0x7f904c0785a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.585+0000 7f9070786640 1 --2- 172.21.15.86:0/2670278304 >> [v2:172.21.15.169:6808/494424253,v1:172.21.15.169:6810/494424253] conn(0x7f904c076100 0x7f904c0785a0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.585+0000 7f9070786640 1 -- 172.21.15.86:0/2670278304 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f904c06c2b0 msgr2=0x7f904c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.585+0000 7f9070786640 1 --2- 172.21.15.86:0/2670278304 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f904c06c2b0 0x7f904c06e770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f90680c65b0 tx=0x7f9058007040 comp rx=0 tx=0).stop 2024-09-19T06:46:38.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.585+0000 7f9070786640 1 -- 172.21.15.86:0/2670278304 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9054004d40 msgr2=0x7f90680c4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.585+0000 7f9070786640 1 --2- 172.21.15.86:0/2670278304 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9054004d40 0x7f90680c4540 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f906400e550 tx=0x7f906400ea10 comp rx=0 tx=0).stop 2024-09-19T06:46:38.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.585+0000 7f906ed23640 1 -- 172.21.15.86:0/2670278304 reap_dead start 2024-09-19T06:46:38.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.585+0000 7f9070786640 1 -- 172.21.15.86:0/2670278304 shutdown_connections 2024-09-19T06:46:38.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.585+0000 7f9070786640 1 -- 172.21.15.86:0/2670278304 >> 172.21.15.86:0/2670278304 conn(0x7f906806bbc0 msgr2=0x7f90680c80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:38.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.585+0000 7f9070786640 1 -- 172.21.15.86:0/2670278304 shutdown_connections 2024-09-19T06:46:38.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.585+0000 7f9070786640 1 -- 172.21.15.86:0/2670278304 wait complete. 2024-09-19T06:46:38.597 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-19T06:46:38.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.695+0000 7f963f38d640 1 Processor -- start 2024-09-19T06:46:38.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.695+0000 7f963f38d640 1 -- start start 2024-09-19T06:46:38.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.696+0000 7f963f38d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9638151750 0x7f9638157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.696+0000 7f963f38d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96380c85c0 0x7f9638070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.696+0000 7f963f38d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f96380c89e0 0x7f9638071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.696+0000 7f963f38d640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f96380c8ea0 con 0x7f96380c89e0 2024-09-19T06:46:38.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.696+0000 7f963f38d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f9638158420 con 0x7f9638151750 2024-09-19T06:46:38.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.696+0000 7f963f38d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9638072fb0 con 0x7f96380c85c0 2024-09-19T06:46:38.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.696+0000 7f963d92a640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f96380c89e0 0x7f9638071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.696+0000 7f963d92a640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f96380c89e0 0x7f9638071410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33004/0 (socket says 172.21.15.86:33004) 2024-09-19T06:46:38.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.696+0000 7f963d92a640 1 -- 172.21.15.86:0/2173361856 learned_addr learned my addr 172.21.15.86:0/2173361856 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:38.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.696+0000 7f963c928640 1 --2- 172.21.15.86:0/2173361856 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96380c85c0 0x7f9638070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.696+0000 7f963d92a640 1 -- 172.21.15.86:0/2173361856 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96380c85c0 msgr2=0x7f9638070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:38.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.696+0000 7f963d92a640 1 --2- 172.21.15.86:0/2173361856 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96380c85c0 0x7f9638070ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.696+0000 7f963d92a640 1 -- 172.21.15.86:0/2173361856 >> v2:172.21.15.169:3300/0 conn(0x7f9638151750 msgr2=0x7f9638157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:38.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.696+0000 7f963d129640 1 --2- 172.21.15.86:0/2173361856 >> v2:172.21.15.169:3300/0 conn(0x7f9638151750 0x7f9638157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.696+0000 7f963d92a640 1 --2- 172.21.15.86:0/2173361856 >> v2:172.21.15.169:3300/0 conn(0x7f9638151750 0x7f9638157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.696+0000 7f963d92a640 1 -- 172.21.15.86:0/2173361856 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96380723e0 con 0x7f96380c89e0 2024-09-19T06:46:38.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.696+0000 7f963d129640 1 --2- 172.21.15.86:0/2173361856 >> v2:172.21.15.169:3300/0 conn(0x7f9638151750 0x7f9638157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:46:38.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.697+0000 7f963d92a640 1 --2- 172.21.15.86:0/2173361856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96380c89e0 0x7f9638071410 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f963806f970 tx=0x7f963402c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f05bd338787d30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:38.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.697+0000 7f962ffff640 1 -- 172.21.15.86:0/2173361856 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9634009600 con 0x7f96380c89e0 2024-09-19T06:46:38.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.697+0000 7f962ffff640 1 -- 172.21.15.86:0/2173361856 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9634037070 con 0x7f96380c89e0 2024-09-19T06:46:38.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.697+0000 7f962ffff640 1 -- 172.21.15.86:0/2173361856 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96340099c0 con 0x7f96380c89e0 2024-09-19T06:46:38.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.698+0000 7f963f38d640 1 -- 172.21.15.86:0/2173361856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96380c89e0 msgr2=0x7f9638071410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.698+0000 7f963f38d640 1 --2- 172.21.15.86:0/2173361856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96380c89e0 0x7f9638071410 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f963806f970 tx=0x7f963402c930 comp rx=0 tx=0).stop 2024-09-19T06:46:38.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.698+0000 7f963f38d640 1 -- 172.21.15.86:0/2173361856 shutdown_connections 2024-09-19T06:46:38.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.698+0000 7f963f38d640 1 --2- 172.21.15.86:0/2173361856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96380c89e0 0x7f9638071410 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.698+0000 7f963f38d640 1 --2- 172.21.15.86:0/2173361856 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96380c85c0 0x7f9638070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.698+0000 7f963f38d640 1 --2- 172.21.15.86:0/2173361856 >> v2:172.21.15.169:3300/0 conn(0x7f9638151750 0x7f9638157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.698+0000 7f963f38d640 1 -- 172.21.15.86:0/2173361856 >> 172.21.15.86:0/2173361856 conn(0x7f96380c9280 msgr2=0x7f96380c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:38.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.698+0000 7f963f38d640 1 -- 172.21.15.86:0/2173361856 shutdown_connections 2024-09-19T06:46:38.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.698+0000 7f963f38d640 1 -- 172.21.15.86:0/2173361856 wait complete. 2024-09-19T06:46:38.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.699+0000 7f963f38d640 1 Processor -- start 2024-09-19T06:46:38.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.699+0000 7f963f38d640 1 -- start start 2024-09-19T06:46:38.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.700+0000 7f963f38d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96380c85c0 0x7f96381f04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.700+0000 7f963f38d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96380c89e0 0x7f96381564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.700+0000 7f963f38d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9638151750 0x7f963814b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.700+0000 7f963f38d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9638072c40 con 0x7f9638151750 2024-09-19T06:46:38.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.700+0000 7f963f38d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9638072960 con 0x7f96380c85c0 2024-09-19T06:46:38.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.700+0000 7f963f38d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9638151b30 con 0x7f96380c89e0 2024-09-19T06:46:38.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.700+0000 7f963d92a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9638151750 0x7f963814b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.700+0000 7f963d92a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9638151750 0x7f963814b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33016/0 (socket says 172.21.15.86:33016) 2024-09-19T06:46:38.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.700+0000 7f963d92a640 1 -- 172.21.15.86:0/2014478751 learned_addr learned my addr 172.21.15.86:0/2014478751 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:38.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.700+0000 7f963c928640 1 --2- 172.21.15.86:0/2014478751 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96380c89e0 0x7f96381564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.700+0000 7f963d129640 1 --2- 172.21.15.86:0/2014478751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96380c85c0 0x7f96381f04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.701+0000 7f963d92a640 1 -- 172.21.15.86:0/2014478751 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96380c89e0 msgr2=0x7f96381564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.701+0000 7f963d92a640 1 --2- 172.21.15.86:0/2014478751 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96380c89e0 0x7f96381564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.701+0000 7f963d92a640 1 -- 172.21.15.86:0/2014478751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96380c85c0 msgr2=0x7f96381f04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.701+0000 7f963d92a640 1 --2- 172.21.15.86:0/2014478751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96380c85c0 0x7f96381f04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.701+0000 7f963d92a640 1 -- 172.21.15.86:0/2014478751 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9638155160 con 0x7f9638151750 2024-09-19T06:46:38.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.701+0000 7f963d92a640 1 --2- 172.21.15.86:0/2014478751 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9638151750 0x7f963814b7f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f963402c970 tx=0x7f9634004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:38.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.701+0000 7f962dffb640 1 -- 172.21.15.86:0/2014478751 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9634009dc0 con 0x7f9638151750 2024-09-19T06:46:38.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.701+0000 7f962dffb640 1 -- 172.21.15.86:0/2014478751 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9634032420 con 0x7f9638151750 2024-09-19T06:46:38.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.701+0000 7f963f38d640 1 -- 172.21.15.86:0/2014478751 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9638155440 con 0x7f9638151750 2024-09-19T06:46:38.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.701+0000 7f962dffb640 1 -- 172.21.15.86:0/2014478751 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9634032810 con 0x7f9638151750 2024-09-19T06:46:38.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.701+0000 7f963f38d640 1 -- 172.21.15.86:0/2014478751 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9638155a00 con 0x7f9638151750 2024-09-19T06:46:38.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.702+0000 7f963f38d640 1 -- 172.21.15.86:0/2014478751 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96380c3610 con 0x7f9638151750 2024-09-19T06:46:38.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.703+0000 7f962dffb640 1 -- 172.21.15.86:0/2014478751 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f96340329b0 con 0x7f9638151750 2024-09-19T06:46:38.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.703+0000 7f962dffb640 1 --2- 172.21.15.86:0/2014478751 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f961c06c2b0 0x7f961c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.703+0000 7f962dffb640 1 -- 172.21.15.86:0/2014478751 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7f96340ac850 con 0x7f9638151750 2024-09-19T06:46:38.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.703+0000 7f963d129640 1 --2- 172.21.15.86:0/2014478751 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f961c06c2b0 0x7f961c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.713+0000 7f962dffb640 1 -- 172.21.15.86:0/2014478751 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f963407a3f0 con 0x7f9638151750 2024-09-19T06:46:38.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:38.714+0000 7f963d129640 1 --2- 172.21.15.86:0/2014478751 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f961c06c2b0 0x7f961c06e770 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f963000ab60 tx=0x7f9630008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:39.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.055+0000 7f963f38d640 1 -- 172.21.15.86:0/2014478751 --> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f9638157ec0 con 0x7f961c06c2b0 2024-09-19T06:46:39.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.056+0000 7f962dffb640 1 -- 172.21.15.86:0/2014478751 <== mgr.4105 v2:172.21.15.86:6816/4165134248 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9638157ec0 con 0x7f961c06c2b0 2024-09-19T06:46:39.057 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 6 to deep-scrub 2024-09-19T06:46:39.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.066+0000 7f963f38d640 1 -- 172.21.15.86:0/2014478751 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f961c06c2b0 msgr2=0x7f961c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.066+0000 7f963f38d640 1 --2- 172.21.15.86:0/2014478751 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f961c06c2b0 0x7f961c06e770 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f963000ab60 tx=0x7f9630008040 comp rx=0 tx=0).stop 2024-09-19T06:46:39.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.066+0000 7f963f38d640 1 -- 172.21.15.86:0/2014478751 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9638151750 msgr2=0x7f963814b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.066+0000 7f963f38d640 1 --2- 172.21.15.86:0/2014478751 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9638151750 0x7f963814b7f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f963402c970 tx=0x7f9634004a40 comp rx=0 tx=0).stop 2024-09-19T06:46:39.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.066+0000 7f963f38d640 1 -- 172.21.15.86:0/2014478751 shutdown_connections 2024-09-19T06:46:39.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.066+0000 7f963f38d640 1 --2- 172.21.15.86:0/2014478751 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f961c06c2b0 0x7f961c06e770 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.066+0000 7f963f38d640 1 --2- 172.21.15.86:0/2014478751 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9638151750 0x7f963814b7f0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.066+0000 7f963f38d640 1 --2- 172.21.15.86:0/2014478751 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96380c89e0 0x7f96381564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.066+0000 7f963f38d640 1 --2- 172.21.15.86:0/2014478751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96380c85c0 0x7f96381f04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.066+0000 7f963f38d640 1 -- 172.21.15.86:0/2014478751 >> 172.21.15.86:0/2014478751 conn(0x7f96380c9280 msgr2=0x7f96380c7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:39.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.067+0000 7f963f38d640 1 -- 172.21.15.86:0/2014478751 shutdown_connections 2024-09-19T06:46:39.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.067+0000 7f963f38d640 1 -- 172.21.15.86:0/2014478751 wait complete. 2024-09-19T06:46:39.089 INFO:tasks.ceph:Scrubbing osd.7 2024-09-19T06:46:39.089 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-19T06:46:39.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.258+0000 7f8f7fe2e640 1 Processor -- start 2024-09-19T06:46:39.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.258+0000 7f8f7fe2e640 1 -- start start 2024-09-19T06:46:39.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.259+0000 7f8f7fe2e640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8f7806f6e0 0x7f8f7806bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.259+0000 7f8f7fe2e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8f780cae40 0x7f8f7806c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.259+0000 7f8f7fe2e640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f78072090 con 0x7f8f781552d0 2024-09-19T06:46:39.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.259+0000 7f8f7fe2e640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f8f7806c640 con 0x7f8f7806f6e0 2024-09-19T06:46:39.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.259+0000 7f8f7fe2e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f8f7806c8f0 con 0x7f8f780cae40 2024-09-19T06:46:39.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.259+0000 7f8f7d3c9640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8f7806f6e0 0x7f8f7806bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.259+0000 7f8f7dbca640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f8f781552d0 0x7f8f78072b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:44354/0 (socket says 172.21.15.86:44354) 2024-09-19T06:46:39.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.259+0000 7f8f7dbca640 1 -- 172.21.15.86:0/3316995160 learned_addr learned my addr 172.21.15.86:0/3316995160 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:46:39.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.259+0000 7f8f7e3cb640 1 --2- 172.21.15.86:0/3316995160 >> v2:172.21.15.169:3300/0 conn(0x7f8f780cae40 0x7f8f7806c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.259+0000 7f8f7d3c9640 1 -- 172.21.15.86:0/3316995160 >> v2:172.21.15.169:3300/0 conn(0x7f8f780cae40 msgr2=0x7f8f7806c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:39.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.259+0000 7f8f7d3c9640 1 --2- 172.21.15.86:0/3316995160 >> v2:172.21.15.169:3300/0 conn(0x7f8f780cae40 0x7f8f7806c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.259+0000 7f8f7d3c9640 1 -- 172.21.15.86:0/3316995160 >> v1:172.21.15.86:6789/0 conn(0x7f8f781552d0 legacy=0x7f8f78072b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.259+0000 7f8f7d3c9640 1 -- 172.21.15.86:0/3316995160 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f7815bac0 con 0x7f8f7806f6e0 2024-09-19T06:46:39.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.259+0000 7f8f7cbc8640 1 -- 172.21.15.86:0/3316995160 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1277467915 0 0) 0x7f8f78072090 con 0x7f8f781552d0 2024-09-19T06:46:39.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.260+0000 7f8f7d3c9640 1 --2- 172.21.15.86:0/3316995160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f7806f6e0 0x7f8f7806bbc0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8f7815f630 tx=0x7f8f6802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9783e0804ac0ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:39.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.260+0000 7f8f7cbc8640 1 -- 172.21.15.86:0/3316995160 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f68037070 con 0x7f8f7806f6e0 2024-09-19T06:46:39.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.260+0000 7f8f7cbc8640 1 -- 172.21.15.86:0/3316995160 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f68032440 con 0x7f8f7806f6e0 2024-09-19T06:46:39.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.260+0000 7f8f7cbc8640 1 -- 172.21.15.86:0/3316995160 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f68032810 con 0x7f8f7806f6e0 2024-09-19T06:46:39.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.261+0000 7f8f7fe2e640 1 -- 172.21.15.86:0/3316995160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f7806f6e0 msgr2=0x7f8f7806bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.261+0000 7f8f7fe2e640 1 --2- 172.21.15.86:0/3316995160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f7806f6e0 0x7f8f7806bbc0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8f7815f630 tx=0x7f8f6802a230 comp rx=0 tx=0).stop 2024-09-19T06:46:39.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.261+0000 7f8f7fe2e640 1 -- 172.21.15.86:0/3316995160 shutdown_connections 2024-09-19T06:46:39.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.261+0000 7f8f7fe2e640 1 --2- 172.21.15.86:0/3316995160 >> v2:172.21.15.169:3300/0 conn(0x7f8f780cae40 0x7f8f7806c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.261+0000 7f8f7fe2e640 1 --2- 172.21.15.86:0/3316995160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f7806f6e0 0x7f8f7806bbc0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.261+0000 7f8f7fe2e640 1 -- 172.21.15.86:0/3316995160 >> 172.21.15.86:0/3316995160 conn(0x7f8f780ca320 msgr2=0x7f8f780ca730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:39.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.261+0000 7f8f7fe2e640 1 -- 172.21.15.86:0/3316995160 shutdown_connections 2024-09-19T06:46:39.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.261+0000 7f8f7fe2e640 1 -- 172.21.15.86:0/3316995160 wait complete. 2024-09-19T06:46:39.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.262+0000 7f8f7fe2e640 1 Processor -- start 2024-09-19T06:46:39.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.262+0000 7f8f7fe2e640 1 -- start start 2024-09-19T06:46:39.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.262+0000 7f8f7fe2e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f7806f6e0 0x7f8f7815a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.263+0000 7f8f7fe2e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f780cae40 0x7f8f781e6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.263+0000 7f8f7fe2e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f781552d0 0x7f8f781f1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.263+0000 7f8f7fe2e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8f780725e0 con 0x7f8f7806f6e0 2024-09-19T06:46:39.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.263+0000 7f8f7fe2e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8f78072300 con 0x7f8f780cae40 2024-09-19T06:46:39.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.263+0000 7f8f7fe2e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8f781556b0 con 0x7f8f781552d0 2024-09-19T06:46:39.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.263+0000 7f8f7dbca640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f7806f6e0 0x7f8f7815a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.263+0000 7f8f7dbca640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f7806f6e0 0x7f8f7815a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33040/0 (socket says 172.21.15.86:33040) 2024-09-19T06:46:39.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.263+0000 7f8f7dbca640 1 -- 172.21.15.86:0/1221369519 learned_addr learned my addr 172.21.15.86:0/1221369519 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:39.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.263+0000 7f8f7d3c9640 1 --2- 172.21.15.86:0/1221369519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f780cae40 0x7f8f781e6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.263+0000 7f8f7e3cb640 1 --2- 172.21.15.86:0/1221369519 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f781552d0 0x7f8f781f1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.263+0000 7f8f7dbca640 1 -- 172.21.15.86:0/1221369519 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f781552d0 msgr2=0x7f8f781f1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.263+0000 7f8f7dbca640 1 --2- 172.21.15.86:0/1221369519 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f781552d0 0x7f8f781f1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.263+0000 7f8f7dbca640 1 -- 172.21.15.86:0/1221369519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f780cae40 msgr2=0x7f8f781e6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.263+0000 7f8f7dbca640 1 --2- 172.21.15.86:0/1221369519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f780cae40 0x7f8f781e6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.263+0000 7f8f7dbca640 1 -- 172.21.15.86:0/1221369519 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f781e77e0 con 0x7f8f7806f6e0 2024-09-19T06:46:39.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.263+0000 7f8f7dbca640 1 --2- 172.21.15.86:0/1221369519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f7806f6e0 0x7f8f7815a470 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400c430 tx=0x7f8f7400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:39.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.263+0000 7f8f6e7fc640 1 -- 172.21.15.86:0/1221369519 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f740074e0 con 0x7f8f7806f6e0 2024-09-19T06:46:39.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.263+0000 7f8f6e7fc640 1 -- 172.21.15.86:0/1221369519 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f740047e0 con 0x7f8f7806f6e0 2024-09-19T06:46:39.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.263+0000 7f8f6e7fc640 1 -- 172.21.15.86:0/1221369519 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f74004bd0 con 0x7f8f7806f6e0 2024-09-19T06:46:39.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.263+0000 7f8f7fe2e640 1 -- 172.21.15.86:0/1221369519 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f781f0d10 con 0x7f8f7806f6e0 2024-09-19T06:46:39.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.263+0000 7f8f7fe2e640 1 -- 172.21.15.86:0/1221369519 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f781e7d30 con 0x7f8f7806f6e0 2024-09-19T06:46:39.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.265+0000 7f8f7fe2e640 1 -- 172.21.15.86:0/1221369519 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8f78070a20 con 0x7f8f7806f6e0 2024-09-19T06:46:39.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.265+0000 7f8f6e7fc640 1 -- 172.21.15.86:0/1221369519 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8f74011070 con 0x7f8f7806f6e0 2024-09-19T06:46:39.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.265+0000 7f8f6e7fc640 1 --2- 172.21.15.86:0/1221369519 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8f5c06c2b0 0x7f8f5c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.265+0000 7f8f6e7fc640 1 -- 172.21.15.86:0/1221369519 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7f8f7408b550 con 0x7f8f7806f6e0 2024-09-19T06:46:39.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.265+0000 7f8f7d3c9640 1 --2- 172.21.15.86:0/1221369519 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8f5c06c2b0 0x7f8f5c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.265+0000 7f8f6e7fc640 1 --2- 172.21.15.86:0/1221369519 >> [v2:172.21.15.169:6800/797235989,v1:172.21.15.169:6801/797235989] conn(0x7f8f5c076100 0x7f8f5c0785a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.265+0000 7f8f6e7fc640 1 -- 172.21.15.86:0/1221369519 --> [v2:172.21.15.169:6800/797235989,v1:172.21.15.169:6801/797235989] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8f7401ce80 con 0x7f8f5c076100 2024-09-19T06:46:39.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.265+0000 7f8f6e7fc640 1 -- 172.21.15.86:0/1221369519 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8f74092050 con 0x7f8f7806f6e0 2024-09-19T06:46:39.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.266+0000 7f8f7d3c9640 1 --2- 172.21.15.86:0/1221369519 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8f5c06c2b0 0x7f8f5c06e770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8f68034000 tx=0x7f8f6802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:39.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.266+0000 7f8f7e3cb640 1 --2- 172.21.15.86:0/1221369519 >> [v2:172.21.15.169:6800/797235989,v1:172.21.15.169:6801/797235989] conn(0x7f8f5c076100 0x7f8f5c0785a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.266+0000 7f8f7e3cb640 1 --2- 172.21.15.86:0/1221369519 >> [v2:172.21.15.169:6800/797235989,v1:172.21.15.169:6801/797235989] conn(0x7f8f5c076100 0x7f8f5c0785a0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:39.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.267+0000 7f8f6e7fc640 1 -- 172.21.15.86:0/1221369519 <== osd.7 v2:172.21.15.169:6800/797235989 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8f7401ce80 con 0x7f8f5c076100 2024-09-19T06:46:39.280 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.279+0000 7f8f7fe2e640 1 -- 172.21.15.86:0/1221369519 --> [v2:172.21.15.169:6800/797235989,v1:172.21.15.169:6801/797235989] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8f7815c160 con 0x7f8f5c076100 2024-09-19T06:46:39.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.279+0000 7f8f6e7fc640 1 -- 172.21.15.86:0/1221369519 <== osd.7 v2:172.21.15.169:6800/797235989 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8f7815c160 con 0x7f8f5c076100 2024-09-19T06:46:39.281 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-19T06:46:39.281 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T06:46:39.281 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-19T06:46:39.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.280+0000 7f8f7fe2e640 1 -- 172.21.15.86:0/1221369519 >> [v2:172.21.15.169:6800/797235989,v1:172.21.15.169:6801/797235989] conn(0x7f8f5c076100 msgr2=0x7f8f5c0785a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.280+0000 7f8f7fe2e640 1 --2- 172.21.15.86:0/1221369519 >> [v2:172.21.15.169:6800/797235989,v1:172.21.15.169:6801/797235989] conn(0x7f8f5c076100 0x7f8f5c0785a0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.280+0000 7f8f7fe2e640 1 -- 172.21.15.86:0/1221369519 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8f5c06c2b0 msgr2=0x7f8f5c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.280+0000 7f8f7fe2e640 1 --2- 172.21.15.86:0/1221369519 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f8f5c06c2b0 0x7f8f5c06e770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8f68034000 tx=0x7f8f6802e000 comp rx=0 tx=0).stop 2024-09-19T06:46:39.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.280+0000 7f8f7fe2e640 1 -- 172.21.15.86:0/1221369519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f7806f6e0 msgr2=0x7f8f7815a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.280+0000 7f8f7fe2e640 1 --2- 172.21.15.86:0/1221369519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f7806f6e0 0x7f8f7815a470 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400c430 tx=0x7f8f7400c8f0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.280+0000 7f8f7e3cb640 1 -- 172.21.15.86:0/1221369519 reap_dead start 2024-09-19T06:46:39.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.280+0000 7f8f7fe2e640 1 -- 172.21.15.86:0/1221369519 shutdown_connections 2024-09-19T06:46:39.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.280+0000 7f8f7fe2e640 1 -- 172.21.15.86:0/1221369519 >> 172.21.15.86:0/1221369519 conn(0x7f8f780ca320 msgr2=0x7f8f7806bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:39.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.280+0000 7f8f7fe2e640 1 -- 172.21.15.86:0/1221369519 shutdown_connections 2024-09-19T06:46:39.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.280+0000 7f8f7fe2e640 1 -- 172.21.15.86:0/1221369519 wait complete. 2024-09-19T06:46:39.292 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-19T06:46:39.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.390+0000 7fd5e2b49640 1 Processor -- start 2024-09-19T06:46:39.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.390+0000 7fd5e2b49640 1 -- start start 2024-09-19T06:46:39.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.390+0000 7fd5e2b49640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd5dc165340 0x7fd5dc168700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.391+0000 7fd5e2b49640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd5dc0c84d0 0x7fd5dc0723d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.391+0000 7fd5e2b49640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5dc0c8a80 con 0x7fd5dc072910 2024-09-19T06:46:39.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.391+0000 7fd5e2b49640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fd5dc168c40 con 0x7fd5dc0c84d0 2024-09-19T06:46:39.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.391+0000 7fd5e2b49640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fd5dc0c8110 con 0x7fd5dc165340 2024-09-19T06:46:39.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.391+0000 7fd5dbfff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd5dc0c84d0 0x7fd5dc0723d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.391+0000 7fd5dbfff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd5dc0c84d0 0x7fd5dc0723d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33048/0 (socket says 172.21.15.86:33048) 2024-09-19T06:46:39.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.391+0000 7fd5dbfff640 1 -- 172.21.15.86:0/1612173362 learned_addr learned my addr 172.21.15.86:0/1612173362 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:39.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.391+0000 7fd5e08e5640 1 --2- 172.21.15.86:0/1612173362 >> v2:172.21.15.169:3300/0 conn(0x7fd5dc165340 0x7fd5dc168700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.428+0000 7fd5dbfff640 1 -- 172.21.15.86:0/1612173362 >> v2:172.21.15.169:3300/0 conn(0x7fd5dc165340 msgr2=0x7fd5dc168700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:39.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.428+0000 7fd5dbfff640 1 --2- 172.21.15.86:0/1612173362 >> v2:172.21.15.169:3300/0 conn(0x7fd5dc165340 0x7fd5dc168700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.428+0000 7fd5dbfff640 1 -- 172.21.15.86:0/1612173362 >> v1:172.21.15.169:6789/0 conn(0x7fd5dc072910 legacy=0x7fd5dc0c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.428+0000 7fd5dbfff640 1 -- 172.21.15.86:0/1612173362 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5dc0c8d40 con 0x7fd5dc0c84d0 2024-09-19T06:46:39.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.391+0000 7fd5db7fe640 1 -- 172.21.15.86:0/1612173362 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2552684458 0 0) 0x7fd5dc0c8a80 con 0x7fd5dc072910 2024-09-19T06:46:39.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.429+0000 7fd5dbfff640 1 --2- 172.21.15.86:0/1612173362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5dc0c84d0 0x7fd5dc0723d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc0708c0 tx=0x7fd5c802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb48ea947330c1a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:39.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.429+0000 7fd5db7fe640 1 -- 172.21.15.86:0/1612173362 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8036070 con 0x7fd5dc0c84d0 2024-09-19T06:46:39.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.429+0000 7fd5db7fe640 1 -- 172.21.15.86:0/1612173362 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c8004230 con 0x7fd5dc0c84d0 2024-09-19T06:46:39.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.429+0000 7fd5db7fe640 1 -- 172.21.15.86:0/1612173362 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c800b040 con 0x7fd5dc0c84d0 2024-09-19T06:46:39.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.429+0000 7fd5e2b49640 1 -- 172.21.15.86:0/1612173362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5dc0c84d0 msgr2=0x7fd5dc0723d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.429+0000 7fd5e2b49640 1 --2- 172.21.15.86:0/1612173362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5dc0c84d0 0x7fd5dc0723d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc0708c0 tx=0x7fd5c802a5f0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.430+0000 7fd5e2b49640 1 -- 172.21.15.86:0/1612173362 shutdown_connections 2024-09-19T06:46:39.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.430+0000 7fd5e2b49640 1 --2- 172.21.15.86:0/1612173362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5dc0c84d0 0x7fd5dc0723d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.430+0000 7fd5e2b49640 1 --2- 172.21.15.86:0/1612173362 >> v2:172.21.15.169:3300/0 conn(0x7fd5dc165340 0x7fd5dc168700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.430+0000 7fd5e2b49640 1 -- 172.21.15.86:0/1612173362 >> 172.21.15.86:0/1612173362 conn(0x7fd5dc0c9280 msgr2=0x7fd5dc0c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:39.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.430+0000 7fd5e2b49640 1 -- 172.21.15.86:0/1612173362 shutdown_connections 2024-09-19T06:46:39.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.430+0000 7fd5e2b49640 1 -- 172.21.15.86:0/1612173362 wait complete. 2024-09-19T06:46:39.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.431+0000 7fd5e2b49640 1 Processor -- start 2024-09-19T06:46:39.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.431+0000 7fd5e2b49640 1 -- start start 2024-09-19T06:46:39.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.432+0000 7fd5e2b49640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5dc072910 0x7fd5dc169840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.432+0000 7fd5e2b49640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd5dc0c84d0 0x7fd5dc06cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.432+0000 7fd5e2b49640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5dc165340 0x7fd5dc1fdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.432+0000 7fd5e2b49640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc071bd0 con 0x7fd5dc165340 2024-09-19T06:46:39.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.432+0000 7fd5e2b49640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc071f40 con 0x7fd5dc072910 2024-09-19T06:46:39.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.432+0000 7fd5e2b49640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd5dc070ed0 con 0x7fd5dc0c84d0 2024-09-19T06:46:39.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.432+0000 7fd5e10e6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5dc165340 0x7fd5dc1fdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.432+0000 7fd5e10e6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5dc165340 0x7fd5dc1fdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33062/0 (socket says 172.21.15.86:33062) 2024-09-19T06:46:39.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.432+0000 7fd5e10e6640 1 -- 172.21.15.86:0/155062746 learned_addr learned my addr 172.21.15.86:0/155062746 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:39.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.432+0000 7fd5e08e5640 1 --2- 172.21.15.86:0/155062746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5dc072910 0x7fd5dc169840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.432+0000 7fd5dbfff640 1 --2- 172.21.15.86:0/155062746 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd5dc0c84d0 0x7fd5dc06cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.432+0000 7fd5e10e6640 1 -- 172.21.15.86:0/155062746 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd5dc0c84d0 msgr2=0x7fd5dc06cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.432+0000 7fd5e10e6640 1 --2- 172.21.15.86:0/155062746 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd5dc0c84d0 0x7fd5dc06cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.432+0000 7fd5e10e6640 1 -- 172.21.15.86:0/155062746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5dc072910 msgr2=0x7fd5dc169840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.432+0000 7fd5e10e6640 1 --2- 172.21.15.86:0/155062746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5dc072910 0x7fd5dc169840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.432+0000 7fd5e10e6640 1 -- 172.21.15.86:0/155062746 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5dc2018b0 con 0x7fd5dc165340 2024-09-19T06:46:39.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.432+0000 7fd5e10e6640 1 --2- 172.21.15.86:0/155062746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5dc165340 0x7fd5dc1fdec0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400c730 tx=0x7fd5d400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:39.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.432+0000 7fd5d97fa640 1 -- 172.21.15.86:0/155062746 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4003da0 con 0x7fd5dc165340 2024-09-19T06:46:39.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.432+0000 7fd5d97fa640 1 -- 172.21.15.86:0/155062746 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d400ce40 con 0x7fd5dc165340 2024-09-19T06:46:39.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.432+0000 7fd5e2b49640 1 -- 172.21.15.86:0/155062746 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5dc201b50 con 0x7fd5dc165340 2024-09-19T06:46:39.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.432+0000 7fd5d97fa640 1 -- 172.21.15.86:0/155062746 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4005270 con 0x7fd5dc165340 2024-09-19T06:46:39.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.432+0000 7fd5e2b49640 1 -- 172.21.15.86:0/155062746 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5dc15a860 con 0x7fd5dc165340 2024-09-19T06:46:39.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.433+0000 7fd5e2b49640 1 -- 172.21.15.86:0/155062746 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5dc164ba0 con 0x7fd5dc165340 2024-09-19T06:46:39.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.434+0000 7fd5d97fa640 1 -- 172.21.15.86:0/155062746 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd5d4005410 con 0x7fd5dc165340 2024-09-19T06:46:39.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.434+0000 7fd5d97fa640 1 --2- 172.21.15.86:0/155062746 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd5c006c2b0 0x7fd5c006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.434+0000 7fd5d97fa640 1 -- 172.21.15.86:0/155062746 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7fd5d408b800 con 0x7fd5dc165340 2024-09-19T06:46:39.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.434+0000 7fd5e08e5640 1 --2- 172.21.15.86:0/155062746 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd5c006c2b0 0x7fd5c006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.435+0000 7fd5e08e5640 1 --2- 172.21.15.86:0/155062746 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd5c006c2b0 0x7fd5c006e770 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd5d000cd70 tx=0x7fd5d000e040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:39.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.439+0000 7fd5d97fa640 1 -- 172.21.15.86:0/155062746 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd5dc164ba0 con 0x7fd5dc165340 2024-09-19T06:46:39.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.606+0000 7fd5e2b49640 1 -- 172.21.15.86:0/155062746 --> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fd5dc06bbc0 con 0x7fd5c006c2b0 2024-09-19T06:46:39.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.606+0000 7fd5d97fa640 1 -- 172.21.15.86:0/155062746 <== mgr.4105 v2:172.21.15.86:6816/4165134248 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd5dc06bbc0 con 0x7fd5c006c2b0 2024-09-19T06:46:39.607 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 7 to deep-scrub 2024-09-19T06:46:39.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.608+0000 7fd5e2b49640 1 -- 172.21.15.86:0/155062746 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd5c006c2b0 msgr2=0x7fd5c006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.608+0000 7fd5e2b49640 1 --2- 172.21.15.86:0/155062746 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd5c006c2b0 0x7fd5c006e770 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd5d000cd70 tx=0x7fd5d000e040 comp rx=0 tx=0).stop 2024-09-19T06:46:39.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.608+0000 7fd5e2b49640 1 -- 172.21.15.86:0/155062746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5dc165340 msgr2=0x7fd5dc1fdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.608+0000 7fd5e2b49640 1 --2- 172.21.15.86:0/155062746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5dc165340 0x7fd5dc1fdec0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400c730 tx=0x7fd5d400cbf0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.608+0000 7fd5e2b49640 1 -- 172.21.15.86:0/155062746 shutdown_connections 2024-09-19T06:46:39.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.608+0000 7fd5e2b49640 1 --2- 172.21.15.86:0/155062746 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fd5c006c2b0 0x7fd5c006e770 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.608+0000 7fd5e2b49640 1 --2- 172.21.15.86:0/155062746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5dc165340 0x7fd5dc1fdec0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.608+0000 7fd5e2b49640 1 --2- 172.21.15.86:0/155062746 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd5dc0c84d0 0x7fd5dc06cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.608+0000 7fd5e2b49640 1 --2- 172.21.15.86:0/155062746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5dc072910 0x7fd5dc169840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.608+0000 7fd5e2b49640 1 -- 172.21.15.86:0/155062746 >> 172.21.15.86:0/155062746 conn(0x7fd5dc0c9280 msgr2=0x7fd5dc0caa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:39.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.608+0000 7fd5e2b49640 1 -- 172.21.15.86:0/155062746 shutdown_connections 2024-09-19T06:46:39.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.608+0000 7fd5e2b49640 1 -- 172.21.15.86:0/155062746 wait complete. 2024-09-19T06:46:39.620 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:46:39.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.716+0000 7f43b8952640 1 Processor -- start 2024-09-19T06:46:39.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.716+0000 7f43b8952640 1 -- start start 2024-09-19T06:46:39.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.717+0000 7f43b8952640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f43b4155240 0x7f43b4072470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.717+0000 7f43b8952640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f43b4072020 0x7f43b4072c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.717+0000 7f43b8952640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43b4074210 con 0x7f43b4073170 2024-09-19T06:46:39.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.717+0000 7f43b8952640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f43b415bef0 con 0x7f43b4155240 2024-09-19T06:46:39.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.717+0000 7f43b8952640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f43b40729b0 con 0x7f43b4072020 2024-09-19T06:46:39.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.717+0000 7f43b259c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f43b4155240 0x7f43b4072470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.717+0000 7f43b2d9d640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f43b4073170 0x7f43b415eb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:44356/0 (socket says 172.21.15.86:44356) 2024-09-19T06:46:39.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.717+0000 7f43b2d9d640 1 -- 172.21.15.86:0/2213987334 learned_addr learned my addr 172.21.15.86:0/2213987334 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:46:39.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.718+0000 7f43b1d9b640 1 --2- 172.21.15.86:0/2213987334 >> v2:172.21.15.169:3300/0 conn(0x7f43b4072020 0x7f43b4072c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.718+0000 7f43b259c640 1 -- 172.21.15.86:0/2213987334 >> v2:172.21.15.169:3300/0 conn(0x7f43b4072020 msgr2=0x7f43b4072c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:39.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.718+0000 7f43b259c640 1 --2- 172.21.15.86:0/2213987334 >> v2:172.21.15.169:3300/0 conn(0x7f43b4072020 0x7f43b4072c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.718+0000 7f43b259c640 1 -- 172.21.15.86:0/2213987334 >> v1:172.21.15.86:6789/0 conn(0x7f43b4073170 legacy=0x7f43b415eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.718+0000 7f43b259c640 1 -- 172.21.15.86:0/2213987334 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b415b370 con 0x7f43b4155240 2024-09-19T06:46:39.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.718+0000 7f43b159a640 1 -- 172.21.15.86:0/2213987334 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4174215770 0 0) 0x7f43ac001110 con 0x7f43b4073170 2024-09-19T06:46:39.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.718+0000 7f43b259c640 1 --2- 172.21.15.86:0/2213987334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b4155240 0x7f43b4072470 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f43b4071fd0 tx=0x7f43a402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e26719b637398 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:39.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.719+0000 7f43b159a640 1 -- 172.21.15.86:0/2213987334 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4007740 con 0x7f43b4155240 2024-09-19T06:46:39.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.719+0000 7f43b159a640 1 -- 172.21.15.86:0/2213987334 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a40078e0 con 0x7f43b4155240 2024-09-19T06:46:39.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.719+0000 7f43b159a640 1 -- 172.21.15.86:0/2213987334 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4007cb0 con 0x7f43b4155240 2024-09-19T06:46:39.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.719+0000 7f43b8952640 1 -- 172.21.15.86:0/2213987334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b4155240 msgr2=0x7f43b4072470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.719+0000 7f43b8952640 1 --2- 172.21.15.86:0/2213987334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b4155240 0x7f43b4072470 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f43b4071fd0 tx=0x7f43a402a680 comp rx=0 tx=0).stop 2024-09-19T06:46:39.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.719+0000 7f43b8952640 1 -- 172.21.15.86:0/2213987334 shutdown_connections 2024-09-19T06:46:39.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.719+0000 7f43b8952640 1 --2- 172.21.15.86:0/2213987334 >> v2:172.21.15.169:3300/0 conn(0x7f43b4072020 0x7f43b4072c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.719+0000 7f43b8952640 1 --2- 172.21.15.86:0/2213987334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b4155240 0x7f43b4072470 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.719+0000 7f43b8952640 1 -- 172.21.15.86:0/2213987334 >> 172.21.15.86:0/2213987334 conn(0x7f43b40cdd80 msgr2=0x7f43b40ca220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:39.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.719+0000 7f43b8952640 1 -- 172.21.15.86:0/2213987334 shutdown_connections 2024-09-19T06:46:39.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.719+0000 7f43b8952640 1 -- 172.21.15.86:0/2213987334 wait complete. 2024-09-19T06:46:39.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.720+0000 7f43b8952640 1 Processor -- start 2024-09-19T06:46:39.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.721+0000 7f43b8952640 1 -- start start 2024-09-19T06:46:39.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.721+0000 7f43b8952640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43b4072020 0x7f43b415a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.721+0000 7f43b8952640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b4073170 0x7f43b41512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.721+0000 7f43b8952640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43b4155240 0x7f43b4145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.721+0000 7f43b8952640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f43b415bc10 con 0x7f43b4073170 2024-09-19T06:46:39.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.721+0000 7f43b8952640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f43b415b930 con 0x7f43b4155240 2024-09-19T06:46:39.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.721+0000 7f43b8952640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f43b415e610 con 0x7f43b4072020 2024-09-19T06:46:39.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.721+0000 7f43b1d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b4073170 0x7f43b41512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.721+0000 7f43b1d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b4073170 0x7f43b41512a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33082/0 (socket says 172.21.15.86:33082) 2024-09-19T06:46:39.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.721+0000 7f43b1d9b640 1 -- 172.21.15.86:0/3239936102 learned_addr learned my addr 172.21.15.86:0/3239936102 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:46:39.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.722+0000 7f43b2d9d640 1 --2- 172.21.15.86:0/3239936102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43b4155240 0x7f43b4145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.722+0000 7f43b259c640 1 --2- 172.21.15.86:0/3239936102 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43b4072020 0x7f43b415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.722+0000 7f43b1d9b640 1 -- 172.21.15.86:0/3239936102 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43b4072020 msgr2=0x7f43b415a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.722+0000 7f43b1d9b640 1 --2- 172.21.15.86:0/3239936102 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43b4072020 0x7f43b415a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.722+0000 7f43b1d9b640 1 -- 172.21.15.86:0/3239936102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43b4155240 msgr2=0x7f43b4145020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.722+0000 7f43b1d9b640 1 --2- 172.21.15.86:0/3239936102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43b4155240 0x7f43b4145020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.722+0000 7f43b1d9b640 1 -- 172.21.15.86:0/3239936102 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b41f13b0 con 0x7f43b4073170 2024-09-19T06:46:39.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.722+0000 7f43b1d9b640 1 --2- 172.21.15.86:0/3239936102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b4073170 0x7f43b41512a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f439c00d5f0 tx=0x7f439c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:39.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.722+0000 7f43aaffd640 1 -- 172.21.15.86:0/3239936102 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c0125f0 con 0x7f43b4073170 2024-09-19T06:46:39.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.722+0000 7f43aaffd640 1 -- 172.21.15.86:0/3239936102 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f439c019070 con 0x7f43b4073170 2024-09-19T06:46:39.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.722+0000 7f43b8952640 1 -- 172.21.15.86:0/3239936102 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b41f1690 con 0x7f43b4073170 2024-09-19T06:46:39.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.722+0000 7f43aaffd640 1 -- 172.21.15.86:0/3239936102 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c0129d0 con 0x7f43b4073170 2024-09-19T06:46:39.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.722+0000 7f43b8952640 1 -- 172.21.15.86:0/3239936102 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b41f1c50 con 0x7f43b4073170 2024-09-19T06:46:39.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.723+0000 7f43b8952640 1 -- 172.21.15.86:0/3239936102 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43b406cf90 con 0x7f43b4073170 2024-09-19T06:46:39.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.723+0000 7f43aaffd640 1 -- 172.21.15.86:0/3239936102 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f439c012b70 con 0x7f43b4073170 2024-09-19T06:46:39.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.724+0000 7f43aaffd640 1 --2- 172.21.15.86:0/3239936102 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f439406c2b0 0x7f439406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.724+0000 7f43aaffd640 1 -- 172.21.15.86:0/3239936102 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7f439c08bdc0 con 0x7f43b4073170 2024-09-19T06:46:39.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.724+0000 7f43b259c640 1 --2- 172.21.15.86:0/3239936102 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f439406c2b0 0x7f439406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.724+0000 7f43b259c640 1 --2- 172.21.15.86:0/3239936102 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f439406c2b0 0x7f439406e770 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f43a4034000 tx=0x7f43a402f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:39.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.728+0000 7f43aaffd640 1 -- 172.21.15.86:0/3239936102 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f43b406cf90 con 0x7f43b4073170 2024-09-19T06:46:39.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.899+0000 7f43b8952640 1 -- 172.21.15.86:0/3239936102 --> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f43b4154a60 con 0x7f439406c2b0 2024-09-19T06:46:39.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.906+0000 7f43aaffd640 1 -- 172.21.15.86:0/3239936102 <== mgr.4105 v2:172.21.15.86:6816/4165134248 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333872 (secure 0 0 0) 0x7f43b4154a60 con 0x7f439406c2b0 2024-09-19T06:46:39.911 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:46:39.913 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-09-19T06:46:39.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.910+0000 7f43b8952640 1 -- 172.21.15.86:0/3239936102 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f439406c2b0 msgr2=0x7f439406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.910+0000 7f43b8952640 1 --2- 172.21.15.86:0/3239936102 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f439406c2b0 0x7f439406e770 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f43a4034000 tx=0x7f43a402f000 comp rx=0 tx=0).stop 2024-09-19T06:46:39.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.910+0000 7f43b8952640 1 -- 172.21.15.86:0/3239936102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b4073170 msgr2=0x7f43b41512a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.910+0000 7f43b8952640 1 --2- 172.21.15.86:0/3239936102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b4073170 0x7f43b41512a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f439c00d5f0 tx=0x7f439c00dab0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.910+0000 7f43b8952640 1 -- 172.21.15.86:0/3239936102 shutdown_connections 2024-09-19T06:46:39.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.910+0000 7f43b8952640 1 --2- 172.21.15.86:0/3239936102 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f439406c2b0 0x7f439406e770 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.910+0000 7f43b8952640 1 --2- 172.21.15.86:0/3239936102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43b4155240 0x7f43b4145020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.910+0000 7f43b8952640 1 --2- 172.21.15.86:0/3239936102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b4073170 0x7f43b41512a0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.910+0000 7f43b8952640 1 --2- 172.21.15.86:0/3239936102 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43b4072020 0x7f43b415a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.910+0000 7f43b8952640 1 -- 172.21.15.86:0/3239936102 >> 172.21.15.86:0/3239936102 conn(0x7f43b40cdd80 msgr2=0x7f43b4073770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:39.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.910+0000 7f43b8952640 1 -- 172.21.15.86:0/3239936102 shutdown_connections 2024-09-19T06:46:39.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:46:39.910+0000 7f43b8952640 1 -- 172.21.15.86:0/3239936102 wait complete. 2024-09-19T06:46:39.922 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":318,"stamp":"2024-09-19T06:46:37.919808+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8029380114,"num_objects":2138,"num_object_clones":0,"num_object_copies":8454,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2138,"num_whiteouts":0,"num_read":1825,"num_read_kb":289584,"num_write":2249721,"num_write_kb":28380838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159299,"ondisk_log_size":159299,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":16789620,"kb_used_data":9179816,"kb_used_omap":12,"kb_used_meta":7605875,"kb_avail":738185100,"statfs":{"total":773094113280,"available":755901542400,"internally_reserved":0,"allocated":9400131584,"data_stored":16118724467,"data_compressed":895585156,"data_compressed_allocated":3513729024,"data_compressed_original":10234019840,"omap_allocated":12752,"internal_metadata":7788416560},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,6,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":86,"apply_latency_ms":86,"commit_latency_ns":86000000,"apply_latency_ns":86000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4865181292,"num_objects":-1160,"num_object_clones":0,"num_object_copies":-4640,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1160,"num_whiteouts":0,"num_read":52,"num_read_kb":97,"num_write":1198,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003614"},"pg_stats":[{"pgid":"2.1f","version":"29'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:18.045945+0000","last_change":"2024-09-19T06:37:08.446272+0000","last_active":"2024-09-19T06:46:18.045945+0000","last_peered":"2024-09-19T06:46:18.045945+0000","last_clean":"2024-09-19T06:46:18.045945+0000","last_became_active":"2024-09-19T06:37:08.446044+0000","last_became_peered":"2024-09-19T06:37:08.446044+0000","last_unstale":"2024-09-19T06:46:18.045945+0000","last_undegraded":"2024-09-19T06:46:18.045945+0000","last_fullsized":"2024-09-19T06:46:18.045945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":20504,"num_write":9,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562503+0000","last_change":"2024-09-19T06:37:09.441539+0000","last_active":"2024-09-19T06:46:00.562503+0000","last_peered":"2024-09-19T06:46:00.562503+0000","last_clean":"2024-09-19T06:46:00.562503+0000","last_became_active":"2024-09-19T06:37:09.440839+0000","last_became_peered":"2024-09-19T06:37:09.440839+0000","last_unstale":"2024-09-19T06:46:00.562503+0000","last_undegraded":"2024-09-19T06:46:00.562503+0000","last_fullsized":"2024-09-19T06:46:00.562503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:49.222252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'5134","reported_seq":5207,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:35.356338+0000","last_change":"2024-09-19T06:37:13.461355+0000","last_active":"2024-09-19T06:46:35.356338+0000","last_peered":"2024-09-19T06:46:35.356338+0000","last_clean":"2024-09-19T06:46:35.356338+0000","last_became_active":"2024-09-19T06:37:13.460936+0000","last_became_peered":"2024-09-19T06:37:13.460936+0000","last_unstale":"2024-09-19T06:46:35.356338+0000","last_undegraded":"2024-09-19T06:46:35.356338+0000","last_fullsized":"2024-09-19T06:46:35.356338+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5134,"log_dups_size":0,"ondisk_log_size":5134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:59.860583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264359949,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":74707,"num_write_kb":941501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'23","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562733+0000","last_change":"2024-09-19T06:37:08.438583+0000","last_active":"2024-09-19T06:46:00.562733+0000","last_peered":"2024-09-19T06:46:00.562733+0000","last_clean":"2024-09-19T06:46:00.562733+0000","last_became_active":"2024-09-19T06:37:08.437921+0000","last_became_peered":"2024-09-19T06:37:08.437921+0000","last_unstale":"2024-09-19T06:46:00.562733+0000","last_undegraded":"2024-09-19T06:46:00.562733+0000","last_fullsized":"2024-09-19T06:46:00.562733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:58:23.269120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":24576,"num_write":22,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'6","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950654+0000","last_change":"2024-09-19T06:37:09.450731+0000","last_active":"2024-09-19T06:46:01.950654+0000","last_peered":"2024-09-19T06:46:01.950654+0000","last_clean":"2024-09-19T06:46:01.950654+0000","last_became_active":"2024-09-19T06:37:09.450430+0000","last_became_peered":"2024-09-19T06:37:09.450430+0000","last_unstale":"2024-09-19T06:46:01.950654+0000","last_undegraded":"2024-09-19T06:46:01.950654+0000","last_fullsized":"2024-09-19T06:46:01.950654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"34'4829","reported_seq":4908,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:33.175979+0000","last_change":"2024-09-19T06:37:13.459445+0000","last_active":"2024-09-19T06:46:33.175979+0000","last_peered":"2024-09-19T06:46:33.175979+0000","last_clean":"2024-09-19T06:46:33.175979+0000","last_became_active":"2024-09-19T06:37:13.459040+0000","last_became_peered":"2024-09-19T06:37:13.459040+0000","last_unstale":"2024-09-19T06:46:33.175979+0000","last_undegraded":"2024-09-19T06:46:33.175979+0000","last_fullsized":"2024-09-19T06:46:33.175979+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4829,"log_dups_size":0,"ondisk_log_size":4829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:37.676097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297821353,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":70604,"num_write_kb":897029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"34'333","reported_seq":394,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.208685+0000","last_change":"2024-09-19T06:37:08.448303+0000","last_active":"2024-09-19T06:46:23.208685+0000","last_peered":"2024-09-19T06:46:23.208685+0000","last_clean":"2024-09-19T06:46:23.208685+0000","last_became_active":"2024-09-19T06:37:08.447559+0000","last_became_peered":"2024-09-19T06:37:08.447559+0000","last_unstale":"2024-09-19T06:46:23.208685+0000","last_undegraded":"2024-09-19T06:46:23.208685+0000","last_fullsized":"2024-09-19T06:46:23.208685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:43.093216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":35254,"num_write":321,"num_write_kb":8395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'7","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565135+0000","last_change":"2024-09-19T06:37:09.445971+0000","last_active":"2024-09-19T06:46:00.565135+0000","last_peered":"2024-09-19T06:46:00.565135+0000","last_clean":"2024-09-19T06:46:00.565135+0000","last_became_active":"2024-09-19T06:37:09.444806+0000","last_became_peered":"2024-09-19T06:37:09.444806+0000","last_unstale":"2024-09-19T06:46:00.565135+0000","last_undegraded":"2024-09-19T06:46:00.565135+0000","last_fullsized":"2024-09-19T06:46:00.565135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:15.765835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4746","reported_seq":4826,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:33.003706+0000","last_change":"2024-09-19T06:37:13.459035+0000","last_active":"2024-09-19T06:46:33.003706+0000","last_peered":"2024-09-19T06:46:33.003706+0000","last_clean":"2024-09-19T06:46:33.003706+0000","last_became_active":"2024-09-19T06:37:13.458588+0000","last_became_peered":"2024-09-19T06:37:13.458588+0000","last_unstale":"2024-09-19T06:46:33.003706+0000","last_undegraded":"2024-09-19T06:46:33.003706+0000","last_fullsized":"2024-09-19T06:46:33.003706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4746,"log_dups_size":0,"ondisk_log_size":4746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:27.900054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314589833,"num_objects":85,"num_object_clones":0,"num_object_copies":340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":47,"num_read_kb":0,"num_write":68511,"num_write_kb":860659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.184523+0000","last_change":"2024-09-19T06:37:08.446363+0000","last_active":"2024-09-19T06:46:23.184523+0000","last_peered":"2024-09-19T06:46:23.184523+0000","last_clean":"2024-09-19T06:46:23.184523+0000","last_became_active":"2024-09-19T06:37:08.446053+0000","last_became_peered":"2024-09-19T06:37:08.446053+0000","last_unstale":"2024-09-19T06:46:23.184523+0000","last_undegraded":"2024-09-19T06:46:23.184523+0000","last_fullsized":"2024-09-19T06:46:23.184523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:22.488347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"34'7","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.403973+0000","last_change":"2024-09-19T06:37:09.445124+0000","last_active":"2024-09-19T06:46:23.403973+0000","last_peered":"2024-09-19T06:46:23.403973+0000","last_clean":"2024-09-19T06:46:23.403973+0000","last_became_active":"2024-09-19T06:37:09.444824+0000","last_became_peered":"2024-09-19T06:37:09.444824+0000","last_unstale":"2024-09-19T06:46:23.403973+0000","last_undegraded":"2024-09-19T06:46:23.403973+0000","last_fullsized":"2024-09-19T06:46:23.403973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:40:05.642055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'4092","reported_seq":4152,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:33.048668+0000","last_change":"2024-09-19T06:37:13.459720+0000","last_active":"2024-09-19T06:46:33.048668+0000","last_peered":"2024-09-19T06:46:33.048668+0000","last_clean":"2024-09-19T06:46:33.048668+0000","last_became_active":"2024-09-19T06:37:13.459350+0000","last_became_peered":"2024-09-19T06:37:13.459350+0000","last_unstale":"2024-09-19T06:46:33.048668+0000","last_undegraded":"2024-09-19T06:46:33.048668+0000","last_fullsized":"2024-09-19T06:46:33.048668+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4092,"log_dups_size":0,"ondisk_log_size":4092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:29.546976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264265122,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":59456,"num_write_kb":744923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.941601+0000","last_change":"2024-09-19T06:37:09.447795+0000","last_active":"2024-09-19T06:46:01.941601+0000","last_peered":"2024-09-19T06:46:01.941601+0000","last_clean":"2024-09-19T06:46:01.941601+0000","last_became_active":"2024-09-19T06:37:09.447502+0000","last_became_peered":"2024-09-19T06:37:09.447502+0000","last_unstale":"2024-09-19T06:46:01.941601+0000","last_undegraded":"2024-09-19T06:46:01.941601+0000","last_fullsized":"2024-09-19T06:46:01.941601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:51.384743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"34'578","reported_seq":631,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:12.370895+0000","last_change":"2024-09-19T06:37:08.446179+0000","last_active":"2024-09-19T06:46:12.370895+0000","last_peered":"2024-09-19T06:46:12.370895+0000","last_clean":"2024-09-19T06:46:12.370895+0000","last_became_active":"2024-09-19T06:37:08.445834+0000","last_became_peered":"2024-09-19T06:37:08.445834+0000","last_unstale":"2024-09-19T06:46:12.370895+0000","last_undegraded":"2024-09-19T06:46:12.370895+0000","last_fullsized":"2024-09-19T06:46:12.370895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:03.783414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":20492,"num_write":569,"num_write_kb":4620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"34'4869","reported_seq":4931,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:33.212029+0000","last_change":"2024-09-19T06:37:13.460344+0000","last_active":"2024-09-19T06:46:33.212029+0000","last_peered":"2024-09-19T06:46:33.212029+0000","last_clean":"2024-09-19T06:46:33.212029+0000","last_became_active":"2024-09-19T06:37:13.459967+0000","last_became_peered":"2024-09-19T06:37:13.459967+0000","last_unstale":"2024-09-19T06:46:33.212029+0000","last_undegraded":"2024-09-19T06:46:33.212029+0000","last_fullsized":"2024-09-19T06:46:33.212029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4869,"log_dups_size":0,"ondisk_log_size":4869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:59.096218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264386100,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":70102,"num_write_kb":882801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.628489+0000","last_change":"2024-09-19T06:37:09.449884+0000","last_active":"2024-09-19T06:46:05.628489+0000","last_peered":"2024-09-19T06:46:05.628489+0000","last_clean":"2024-09-19T06:46:05.628489+0000","last_became_active":"2024-09-19T06:37:09.449645+0000","last_became_peered":"2024-09-19T06:37:09.449645+0000","last_unstale":"2024-09-19T06:46:05.628489+0000","last_undegraded":"2024-09-19T06:46:05.628489+0000","last_fullsized":"2024-09-19T06:46:05.628489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:07.353098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.408234+0000","last_change":"2024-09-19T06:37:08.437022+0000","last_active":"2024-09-19T06:46:01.408234+0000","last_peered":"2024-09-19T06:46:01.408234+0000","last_clean":"2024-09-19T06:46:01.408234+0000","last_became_active":"2024-09-19T06:37:08.436761+0000","last_became_peered":"2024-09-19T06:37:08.436761+0000","last_unstale":"2024-09-19T06:46:01.408234+0000","last_undegraded":"2024-09-19T06:46:01.408234+0000","last_fullsized":"2024-09-19T06:46:01.408234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'5039","reported_seq":5124,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:33.015181+0000","last_change":"2024-09-19T06:37:51.782710+0000","last_active":"2024-09-19T06:46:33.015181+0000","last_peered":"2024-09-19T06:46:33.015181+0000","last_clean":"2024-09-19T06:46:33.015181+0000","last_became_active":"2024-09-19T06:37:51.782257+0000","last_became_peered":"2024-09-19T06:37:51.782257+0000","last_unstale":"2024-09-19T06:46:33.015181+0000","last_undegraded":"2024-09-19T06:46:33.015181+0000","last_fullsized":"2024-09-19T06:46:33.015181+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5039,"log_dups_size":0,"ondisk_log_size":5039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:17:15.241783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272652888,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":44,"num_read_kb":0,"num_write":72282,"num_write_kb":909964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562715+0000","last_change":"2024-09-19T06:37:09.433042+0000","last_active":"2024-09-19T06:46:00.562715+0000","last_peered":"2024-09-19T06:46:00.562715+0000","last_clean":"2024-09-19T06:46:00.562715+0000","last_became_active":"2024-09-19T06:37:09.432589+0000","last_became_peered":"2024-09-19T06:37:09.432589+0000","last_unstale":"2024-09-19T06:46:00.562715+0000","last_undegraded":"2024-09-19T06:46:00.562715+0000","last_fullsized":"2024-09-19T06:46:00.562715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:18.661071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.407807+0000","last_change":"2024-09-19T06:37:08.444408+0000","last_active":"2024-09-19T06:46:01.407807+0000","last_peered":"2024-09-19T06:46:01.407807+0000","last_clean":"2024-09-19T06:46:01.407807+0000","last_became_active":"2024-09-19T06:37:08.444160+0000","last_became_peered":"2024-09-19T06:37:08.444160+0000","last_unstale":"2024-09-19T06:46:01.407807+0000","last_undegraded":"2024-09-19T06:46:01.407807+0000","last_fullsized":"2024-09-19T06:46:01.407807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"34'5634","reported_seq":5710,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:37.102921+0000","last_change":"2024-09-19T06:37:13.466175+0000","last_active":"2024-09-19T06:46:37.102921+0000","last_peered":"2024-09-19T06:46:37.102921+0000","last_clean":"2024-09-19T06:46:37.102921+0000","last_became_active":"2024-09-19T06:37:13.465731+0000","last_became_peered":"2024-09-19T06:37:13.465731+0000","last_unstale":"2024-09-19T06:46:37.102921+0000","last_undegraded":"2024-09-19T06:46:37.102921+0000","last_fullsized":"2024-09-19T06:46:37.102921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5634,"log_dups_size":0,"ondisk_log_size":5634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226589811,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":81220,"num_write_kb":1030279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.951476+0000","last_change":"2024-09-19T06:37:09.437254+0000","last_active":"2024-09-19T06:46:01.951476+0000","last_peered":"2024-09-19T06:46:01.951476+0000","last_clean":"2024-09-19T06:46:01.951476+0000","last_became_active":"2024-09-19T06:37:09.436512+0000","last_became_peered":"2024-09-19T06:37:09.436512+0000","last_unstale":"2024-09-19T06:46:01.951476+0000","last_undegraded":"2024-09-19T06:46:01.951476+0000","last_fullsized":"2024-09-19T06:46:01.951476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:21.893793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"33'797","reported_seq":844,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564196+0000","last_change":"2024-09-19T06:37:08.446216+0000","last_active":"2024-09-19T06:46:00.564196+0000","last_peered":"2024-09-19T06:46:00.564196+0000","last_clean":"2024-09-19T06:46:00.564196+0000","last_became_active":"2024-09-19T06:37:08.445845+0000","last_became_peered":"2024-09-19T06:37:08.445845+0000","last_unstale":"2024-09-19T06:46:00.564196+0000","last_undegraded":"2024-09-19T06:46:00.564196+0000","last_fullsized":"2024-09-19T06:46:00.564196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:04.033283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":8706,"num_write":792,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"34'4194","reported_seq":4261,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:33.347848+0000","last_change":"2024-09-19T06:37:13.462192+0000","last_active":"2024-09-19T06:46:33.347848+0000","last_peered":"2024-09-19T06:46:33.347848+0000","last_clean":"2024-09-19T06:46:33.347848+0000","last_became_active":"2024-09-19T06:37:13.460955+0000","last_became_peered":"2024-09-19T06:37:13.460955+0000","last_unstale":"2024-09-19T06:46:33.347848+0000","last_undegraded":"2024-09-19T06:46:33.347848+0000","last_fullsized":"2024-09-19T06:46:33.347848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4194,"log_dups_size":0,"ondisk_log_size":4194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:53.583488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264456869,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":60547,"num_write_kb":751027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"34'15","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:30.626843+0000","last_change":"2024-09-19T06:37:09.445989+0000","last_active":"2024-09-19T06:46:30.626843+0000","last_peered":"2024-09-19T06:46:30.626843+0000","last_clean":"2024-09-19T06:46:30.626843+0000","last_became_active":"2024-09-19T06:37:09.445705+0000","last_became_peered":"2024-09-19T06:37:09.445705+0000","last_unstale":"2024-09-19T06:46:30.626843+0000","last_undegraded":"2024-09-19T06:46:30.626843+0000","last_fullsized":"2024-09-19T06:46:30.626843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.189422+0000","last_change":"2024-09-19T06:37:08.446226+0000","last_active":"2024-09-19T06:46:23.189422+0000","last_peered":"2024-09-19T06:46:23.189422+0000","last_clean":"2024-09-19T06:46:23.189422+0000","last_became_active":"2024-09-19T06:37:08.445929+0000","last_became_peered":"2024-09-19T06:37:08.445929+0000","last_unstale":"2024-09-19T06:46:23.189422+0000","last_undegraded":"2024-09-19T06:46:23.189422+0000","last_fullsized":"2024-09-19T06:46:23.189422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:32.233033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"34'4945","reported_seq":5020,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:32.981465+0000","last_change":"2024-09-19T06:37:13.462598+0000","last_active":"2024-09-19T06:46:32.981465+0000","last_peered":"2024-09-19T06:46:32.981465+0000","last_clean":"2024-09-19T06:46:32.981465+0000","last_became_active":"2024-09-19T06:37:13.462217+0000","last_became_peered":"2024-09-19T06:37:13.462217+0000","last_unstale":"2024-09-19T06:46:32.981465+0000","last_undegraded":"2024-09-19T06:46:32.981465+0000","last_fullsized":"2024-09-19T06:46:32.981465+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4945,"log_dups_size":0,"ondisk_log_size":4945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:04.109419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285223996,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":71657,"num_write_kb":902613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'10","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.563792+0000","last_change":"2024-09-19T06:37:09.434309+0000","last_active":"2024-09-19T06:46:00.563792+0000","last_peered":"2024-09-19T06:46:00.563792+0000","last_clean":"2024-09-19T06:46:00.563792+0000","last_became_active":"2024-09-19T06:37:09.433897+0000","last_became_peered":"2024-09-19T06:37:09.433897+0000","last_unstale":"2024-09-19T06:46:00.563792+0000","last_undegraded":"2024-09-19T06:46:00.563792+0000","last_fullsized":"2024-09-19T06:46:00.563792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:59.054484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"34'166","reported_seq":215,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:31.096267+0000","last_change":"2024-09-19T06:37:08.441525+0000","last_active":"2024-09-19T06:46:31.096267+0000","last_peered":"2024-09-19T06:46:31.096267+0000","last_clean":"2024-09-19T06:46:31.096267+0000","last_became_active":"2024-09-19T06:37:08.441245+0000","last_became_peered":"2024-09-19T06:37:08.441245+0000","last_unstale":"2024-09-19T06:46:31.096267+0000","last_undegraded":"2024-09-19T06:46:31.096267+0000","last_fullsized":"2024-09-19T06:46:31.096267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":67,"num_write":359,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"34'5364","reported_seq":5440,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:35.452252+0000","last_change":"2024-09-19T06:37:13.468486+0000","last_active":"2024-09-19T06:46:35.452252+0000","last_peered":"2024-09-19T06:46:35.452252+0000","last_clean":"2024-09-19T06:46:35.452252+0000","last_became_active":"2024-09-19T06:37:13.468074+0000","last_became_peered":"2024-09-19T06:37:13.468074+0000","last_unstale":"2024-09-19T06:46:35.452252+0000","last_undegraded":"2024-09-19T06:46:35.452252+0000","last_fullsized":"2024-09-19T06:46:35.452252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5364,"log_dups_size":0,"ondisk_log_size":5364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:36.783781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260061551,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":78223,"num_write_kb":979369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:31.413842+0000","last_change":"2024-09-19T06:37:09.435864+0000","last_active":"2024-09-19T06:46:31.413842+0000","last_peered":"2024-09-19T06:46:31.413842+0000","last_clean":"2024-09-19T06:46:31.413842+0000","last_became_active":"2024-09-19T06:37:09.435597+0000","last_became_peered":"2024-09-19T06:37:09.435597+0000","last_unstale":"2024-09-19T06:46:31.413842+0000","last_undegraded":"2024-09-19T06:46:31.413842+0000","last_fullsized":"2024-09-19T06:46:31.413842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.566013+0000","last_change":"2024-09-19T06:37:08.447931+0000","last_active":"2024-09-19T06:46:00.566013+0000","last_peered":"2024-09-19T06:46:00.566013+0000","last_clean":"2024-09-19T06:46:00.566013+0000","last_became_active":"2024-09-19T06:37:08.447630+0000","last_became_peered":"2024-09-19T06:37:08.447630+0000","last_unstale":"2024-09-19T06:46:00.566013+0000","last_undegraded":"2024-09-19T06:46:00.566013+0000","last_fullsized":"2024-09-19T06:46:00.566013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:17.375740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"34'4485","reported_seq":4560,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:35.407472+0000","last_change":"2024-09-19T06:37:13.468360+0000","last_active":"2024-09-19T06:46:35.407472+0000","last_peered":"2024-09-19T06:46:35.407472+0000","last_clean":"2024-09-19T06:46:35.407472+0000","last_became_active":"2024-09-19T06:37:13.467926+0000","last_became_peered":"2024-09-19T06:37:13.467926+0000","last_unstale":"2024-09-19T06:46:35.407472+0000","last_undegraded":"2024-09-19T06:46:35.407472+0000","last_fullsized":"2024-09-19T06:46:35.407472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":0,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209724275,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":64772,"num_write_kb":802716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"34'11","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:29.516006+0000","last_change":"2024-09-19T06:37:09.441678+0000","last_active":"2024-09-19T06:46:29.516006+0000","last_peered":"2024-09-19T06:46:29.516006+0000","last_clean":"2024-09-19T06:46:29.516006+0000","last_became_active":"2024-09-19T06:37:09.441406+0000","last_became_peered":"2024-09-19T06:37:09.441406+0000","last_unstale":"2024-09-19T06:46:29.516006+0000","last_undegraded":"2024-09-19T06:46:29.516006+0000","last_fullsized":"2024-09-19T06:46:29.516006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:14.638004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"29'1","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.408691+0000","last_change":"2024-09-19T06:37:08.438805+0000","last_active":"2024-09-19T06:46:01.408691+0000","last_peered":"2024-09-19T06:46:01.408691+0000","last_clean":"2024-09-19T06:46:01.408691+0000","last_became_active":"2024-09-19T06:37:08.438528+0000","last_became_peered":"2024-09-19T06:37:08.438528+0000","last_unstale":"2024-09-19T06:46:01.408691+0000","last_undegraded":"2024-09-19T06:46:01.408691+0000","last_fullsized":"2024-09-19T06:46:01.408691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'5431","reported_seq":5497,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:37.230289+0000","last_change":"2024-09-19T06:37:13.459697+0000","last_active":"2024-09-19T06:46:37.230289+0000","last_peered":"2024-09-19T06:46:37.230289+0000","last_clean":"2024-09-19T06:46:37.230289+0000","last_became_active":"2024-09-19T06:37:13.459303+0000","last_became_peered":"2024-09-19T06:37:13.459303+0000","last_unstale":"2024-09-19T06:46:37.230289+0000","last_undegraded":"2024-09-19T06:46:37.230289+0000","last_fullsized":"2024-09-19T06:46:37.230289+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5431,"log_dups_size":0,"ondisk_log_size":5431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272648619,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":79011,"num_write_kb":992273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:32.293121+0000","last_change":"2024-09-19T06:37:09.449701+0000","last_active":"2024-09-19T06:46:32.293121+0000","last_peered":"2024-09-19T06:46:32.293121+0000","last_clean":"2024-09-19T06:46:32.293121+0000","last_became_active":"2024-09-19T06:37:09.448899+0000","last_became_peered":"2024-09-19T06:37:09.448899+0000","last_unstale":"2024-09-19T06:46:32.293121+0000","last_undegraded":"2024-09-19T06:46:32.293121+0000","last_fullsized":"2024-09-19T06:46:32.293121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:17.448251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"34'198","reported_seq":243,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.603626+0000","last_change":"2024-09-19T06:37:08.434263+0000","last_active":"2024-09-19T06:46:05.603626+0000","last_peered":"2024-09-19T06:46:05.603626+0000","last_clean":"2024-09-19T06:46:05.603626+0000","last_became_active":"2024-09-19T06:37:08.433984+0000","last_became_peered":"2024-09-19T06:37:08.433984+0000","last_unstale":"2024-09-19T06:46:05.603626+0000","last_undegraded":"2024-09-19T06:46:05.603626+0000","last_fullsized":"2024-09-19T06:46:05.603626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:05.599054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":190,"num_write_kb":4204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"34'4497","reported_seq":4571,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:37.117374+0000","last_change":"2024-09-19T06:37:13.464527+0000","last_active":"2024-09-19T06:46:37.117374+0000","last_peered":"2024-09-19T06:46:37.117374+0000","last_clean":"2024-09-19T06:46:37.117374+0000","last_became_active":"2024-09-19T06:37:13.461685+0000","last_became_peered":"2024-09-19T06:37:13.461685+0000","last_unstale":"2024-09-19T06:46:37.117374+0000","last_undegraded":"2024-09-19T06:46:37.117374+0000","last_fullsized":"2024-09-19T06:46:37.117374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4497,"log_dups_size":0,"ondisk_log_size":4497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193014931,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":65388,"num_write_kb":836807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'11","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.408182+0000","last_change":"2024-09-19T06:37:09.434421+0000","last_active":"2024-09-19T06:46:01.408182+0000","last_peered":"2024-09-19T06:46:01.408182+0000","last_clean":"2024-09-19T06:46:01.408182+0000","last_became_active":"2024-09-19T06:37:09.434119+0000","last_became_peered":"2024-09-19T06:37:09.434119+0000","last_unstale":"2024-09-19T06:46:01.408182+0000","last_undegraded":"2024-09-19T06:46:01.408182+0000","last_fullsized":"2024-09-19T06:46:01.408182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"34'27","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:31.168388+0000","last_change":"2024-09-19T06:37:08.436856+0000","last_active":"2024-09-19T06:46:31.168388+0000","last_peered":"2024-09-19T06:46:31.168388+0000","last_clean":"2024-09-19T06:46:31.168388+0000","last_became_active":"2024-09-19T06:37:08.435718+0000","last_became_peered":"2024-09-19T06:37:08.435718+0000","last_unstale":"2024-09-19T06:46:31.168388+0000","last_undegraded":"2024-09-19T06:46:31.168388+0000","last_fullsized":"2024-09-19T06:46:31.168388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94269,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":146,"num_write":23,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'5200","reported_seq":5277,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:36.796234+0000","last_change":"2024-09-19T06:37:13.466081+0000","last_active":"2024-09-19T06:46:36.796234+0000","last_peered":"2024-09-19T06:46:36.796234+0000","last_clean":"2024-09-19T06:46:36.796234+0000","last_became_active":"2024-09-19T06:37:13.465348+0000","last_became_peered":"2024-09-19T06:37:13.465348+0000","last_unstale":"2024-09-19T06:46:36.796234+0000","last_undegraded":"2024-09-19T06:46:36.796234+0000","last_fullsized":"2024-09-19T06:46:36.796234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5200,"log_dups_size":0,"ondisk_log_size":5200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251711431,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":75882,"num_write_kb":952671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"34'5","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:34.430309+0000","last_change":"2024-09-19T06:37:09.444888+0000","last_active":"2024-09-19T06:46:34.430309+0000","last_peered":"2024-09-19T06:46:34.430309+0000","last_clean":"2024-09-19T06:46:34.430309+0000","last_became_active":"2024-09-19T06:37:09.444605+0000","last_became_peered":"2024-09-19T06:37:09.444605+0000","last_unstale":"2024-09-19T06:46:34.430309+0000","last_undegraded":"2024-09-19T06:46:34.430309+0000","last_fullsized":"2024-09-19T06:46:34.430309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'43","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.589711+0000","last_change":"2024-09-19T06:37:08.446760+0000","last_active":"2024-09-19T06:46:05.589711+0000","last_peered":"2024-09-19T06:46:05.589711+0000","last_clean":"2024-09-19T06:46:05.589711+0000","last_became_active":"2024-09-19T06:37:08.446474+0000","last_became_peered":"2024-09-19T06:37:08.446474+0000","last_unstale":"2024-09-19T06:46:05.589711+0000","last_undegraded":"2024-09-19T06:46:05.589711+0000","last_fullsized":"2024-09-19T06:46:05.589711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:12.597952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":38,"num_write_kb":8207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"34'4342","reported_seq":4419,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:36.229001+0000","last_change":"2024-09-19T06:37:13.471220+0000","last_active":"2024-09-19T06:46:36.229001+0000","last_peered":"2024-09-19T06:46:36.229001+0000","last_clean":"2024-09-19T06:46:36.229001+0000","last_became_active":"2024-09-19T06:37:13.470860+0000","last_became_peered":"2024-09-19T06:37:13.470860+0000","last_unstale":"2024-09-19T06:46:36.229001+0000","last_undegraded":"2024-09-19T06:46:36.229001+0000","last_fullsized":"2024-09-19T06:46:36.229001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4342,"log_dups_size":0,"ondisk_log_size":4342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226925378,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":62646,"num_write_kb":794606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562847+0000","last_change":"2024-09-19T06:37:09.440366+0000","last_active":"2024-09-19T06:46:00.562847+0000","last_peered":"2024-09-19T06:46:00.562847+0000","last_clean":"2024-09-19T06:46:00.562847+0000","last_became_active":"2024-09-19T06:37:09.439478+0000","last_became_peered":"2024-09-19T06:37:09.439478+0000","last_unstale":"2024-09-19T06:46:00.562847+0000","last_undegraded":"2024-09-19T06:46:00.562847+0000","last_fullsized":"2024-09-19T06:46:00.562847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:21.837351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564567+0000","last_change":"2024-09-19T06:37:08.435473+0000","last_active":"2024-09-19T06:46:00.564567+0000","last_peered":"2024-09-19T06:46:00.564567+0000","last_clean":"2024-09-19T06:46:00.564567+0000","last_became_active":"2024-09-19T06:37:08.435183+0000","last_became_peered":"2024-09-19T06:37:08.435183+0000","last_unstale":"2024-09-19T06:46:00.564567+0000","last_undegraded":"2024-09-19T06:46:00.564567+0000","last_fullsized":"2024-09-19T06:46:00.564567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:53.115010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":198,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564274+0000","last_change":"2024-09-19T06:36:58.829099+0000","last_active":"2024-09-19T06:46:00.564274+0000","last_peered":"2024-09-19T06:46:00.564274+0000","last_clean":"2024-09-19T06:46:00.564274+0000","last_became_active":"2024-09-19T06:36:58.828079+0000","last_became_peered":"2024-09-19T06:36:58.828079+0000","last_unstale":"2024-09-19T06:46:00.564274+0000","last_undegraded":"2024-09-19T06:46:00.564274+0000","last_fullsized":"2024-09-19T06:46:00.564274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:36:57.771085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:36:57.771085+0000","last_clean_scrub_stamp":"2024-09-19T06:36:57.771085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:14.663925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"34'4771","reported_seq":4833,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:36.077235+0000","last_change":"2024-09-19T06:37:13.464435+0000","last_active":"2024-09-19T06:46:36.077235+0000","last_peered":"2024-09-19T06:46:36.077235+0000","last_clean":"2024-09-19T06:46:36.077235+0000","last_became_active":"2024-09-19T06:37:13.464101+0000","last_became_peered":"2024-09-19T06:37:13.464101+0000","last_unstale":"2024-09-19T06:46:36.077235+0000","last_undegraded":"2024-09-19T06:46:36.077235+0000","last_fullsized":"2024-09-19T06:46:36.077235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4771,"log_dups_size":0,"ondisk_log_size":4771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:30.073937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218113540,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":68959,"num_write_kb":870393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:30.321805+0000","last_change":"2024-09-19T06:37:09.442774+0000","last_active":"2024-09-19T06:46:30.321805+0000","last_peered":"2024-09-19T06:46:30.321805+0000","last_clean":"2024-09-19T06:46:30.321805+0000","last_became_active":"2024-09-19T06:37:09.442515+0000","last_became_peered":"2024-09-19T06:37:09.442515+0000","last_unstale":"2024-09-19T06:46:30.321805+0000","last_undegraded":"2024-09-19T06:46:30.321805+0000","last_fullsized":"2024-09-19T06:46:30.321805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:57.376059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'1","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:11.843431+0000","last_change":"2024-09-19T06:37:08.438038+0000","last_active":"2024-09-19T06:46:11.843431+0000","last_peered":"2024-09-19T06:46:11.843431+0000","last_clean":"2024-09-19T06:46:11.843431+0000","last_became_active":"2024-09-19T06:37:08.437771+0000","last_became_peered":"2024-09-19T06:37:08.437771+0000","last_unstale":"2024-09-19T06:46:11.843431+0000","last_undegraded":"2024-09-19T06:46:11.843431+0000","last_fullsized":"2024-09-19T06:46:11.843431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"34'4828","reported_seq":4903,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:35.925337+0000","last_change":"2024-09-19T06:37:51.782418+0000","last_active":"2024-09-19T06:46:35.925337+0000","last_peered":"2024-09-19T06:46:35.925337+0000","last_clean":"2024-09-19T06:46:35.925337+0000","last_became_active":"2024-09-19T06:37:51.781963+0000","last_became_peered":"2024-09-19T06:37:51.781963+0000","last_unstale":"2024-09-19T06:46:35.925337+0000","last_undegraded":"2024-09-19T06:46:35.925337+0000","last_fullsized":"2024-09-19T06:46:35.925337+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4828,"log_dups_size":0,"ondisk_log_size":4828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:12:05.227644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197134249,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":69513,"num_write_kb":883742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565121+0000","last_change":"2024-09-19T06:37:09.442213+0000","last_active":"2024-09-19T06:46:00.565121+0000","last_peered":"2024-09-19T06:46:00.565121+0000","last_clean":"2024-09-19T06:46:00.565121+0000","last_became_active":"2024-09-19T06:37:09.441850+0000","last_became_peered":"2024-09-19T06:37:09.441850+0000","last_unstale":"2024-09-19T06:46:00.565121+0000","last_undegraded":"2024-09-19T06:46:00.565121+0000","last_fullsized":"2024-09-19T06:46:00.565121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:43.728914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"34'164","reported_seq":215,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:34.099859+0000","last_change":"2024-09-19T06:37:08.431703+0000","last_active":"2024-09-19T06:46:34.099859+0000","last_peered":"2024-09-19T06:46:34.099859+0000","last_clean":"2024-09-19T06:46:34.099859+0000","last_became_active":"2024-09-19T06:37:08.431443+0000","last_became_peered":"2024-09-19T06:37:08.431443+0000","last_unstale":"2024-09-19T06:46:34.099859+0000","last_undegraded":"2024-09-19T06:46:34.099859+0000","last_fullsized":"2024-09-19T06:46:34.099859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2533108,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":2297,"num_write":159,"num_write_kb":2550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'4517","reported_seq":4594,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:36.318470+0000","last_change":"2024-09-19T06:37:13.469295+0000","last_active":"2024-09-19T06:46:36.318470+0000","last_peered":"2024-09-19T06:46:36.318470+0000","last_clean":"2024-09-19T06:46:36.318470+0000","last_became_active":"2024-09-19T06:37:13.468879+0000","last_became_peered":"2024-09-19T06:37:13.468879+0000","last_unstale":"2024-09-19T06:46:36.318470+0000","last_undegraded":"2024-09-19T06:46:36.318470+0000","last_fullsized":"2024-09-19T06:46:36.318470+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4517,"log_dups_size":0,"ondisk_log_size":4517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197158196,"num_objects":56,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":65567,"num_write_kb":822050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.566185+0000","last_change":"2024-09-19T06:37:09.439264+0000","last_active":"2024-09-19T06:46:00.566185+0000","last_peered":"2024-09-19T06:46:00.566185+0000","last_clean":"2024-09-19T06:46:00.566185+0000","last_became_active":"2024-09-19T06:37:09.438954+0000","last_became_peered":"2024-09-19T06:37:09.438954+0000","last_unstale":"2024-09-19T06:46:00.566185+0000","last_undegraded":"2024-09-19T06:46:00.566185+0000","last_fullsized":"2024-09-19T06:46:00.566185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:55.094093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"34'7","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.218324+0000","last_change":"2024-09-19T06:37:08.437406+0000","last_active":"2024-09-19T06:46:23.218324+0000","last_peered":"2024-09-19T06:46:23.218324+0000","last_clean":"2024-09-19T06:46:23.218324+0000","last_became_active":"2024-09-19T06:37:08.437093+0000","last_became_peered":"2024-09-19T06:37:08.437093+0000","last_unstale":"2024-09-19T06:46:23.218324+0000","last_undegraded":"2024-09-19T06:46:23.218324+0000","last_fullsized":"2024-09-19T06:46:23.218324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"34'4703","reported_seq":4775,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:35.394265+0000","last_change":"2024-09-19T06:37:13.460116+0000","last_active":"2024-09-19T06:46:35.394265+0000","last_peered":"2024-09-19T06:46:35.394265+0000","last_clean":"2024-09-19T06:46:35.394265+0000","last_became_active":"2024-09-19T06:37:13.459707+0000","last_became_peered":"2024-09-19T06:37:13.459707+0000","last_unstale":"2024-09-19T06:46:35.394265+0000","last_undegraded":"2024-09-19T06:46:35.394265+0000","last_fullsized":"2024-09-19T06:46:35.394265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4703,"log_dups_size":0,"ondisk_log_size":4703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:02.657115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247484026,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":38,"num_read_kb":0,"num_write":68484,"num_write_kb":859940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565428+0000","last_change":"2024-09-19T06:37:09.442670+0000","last_active":"2024-09-19T06:46:00.565428+0000","last_peered":"2024-09-19T06:46:00.565428+0000","last_clean":"2024-09-19T06:46:00.565428+0000","last_became_active":"2024-09-19T06:37:09.442390+0000","last_became_peered":"2024-09-19T06:37:09.442390+0000","last_unstale":"2024-09-19T06:46:00.565428+0000","last_undegraded":"2024-09-19T06:46:00.565428+0000","last_fullsized":"2024-09-19T06:46:00.565428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:02:26.726663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.577499+0000","last_change":"2024-09-19T06:37:08.437263+0000","last_active":"2024-09-19T06:46:05.577499+0000","last_peered":"2024-09-19T06:46:05.577499+0000","last_clean":"2024-09-19T06:46:05.577499+0000","last_became_active":"2024-09-19T06:37:08.436982+0000","last_became_peered":"2024-09-19T06:37:08.436982+0000","last_unstale":"2024-09-19T06:46:05.577499+0000","last_undegraded":"2024-09-19T06:46:05.577499+0000","last_fullsized":"2024-09-19T06:46:05.577499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:14.895925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"34'4742","reported_seq":4822,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:33.347524+0000","last_change":"2024-09-19T06:37:51.782712+0000","last_active":"2024-09-19T06:46:33.347524+0000","last_peered":"2024-09-19T06:46:33.347524+0000","last_clean":"2024-09-19T06:46:33.347524+0000","last_became_active":"2024-09-19T06:37:51.781602+0000","last_became_peered":"2024-09-19T06:37:51.781602+0000","last_unstale":"2024-09-19T06:46:33.347524+0000","last_undegraded":"2024-09-19T06:46:33.347524+0000","last_fullsized":"2024-09-19T06:46:33.347524+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4742,"log_dups_size":0,"ondisk_log_size":4742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:24.142942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272709069,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":68458,"num_write_kb":854704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3,6],"acting":[4,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'10","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565660+0000","last_change":"2024-09-19T06:37:09.439142+0000","last_active":"2024-09-19T06:46:00.565660+0000","last_peered":"2024-09-19T06:46:00.565660+0000","last_clean":"2024-09-19T06:46:00.565660+0000","last_became_active":"2024-09-19T06:37:09.437717+0000","last_became_peered":"2024-09-19T06:37:09.437717+0000","last_unstale":"2024-09-19T06:46:00.565660+0000","last_undegraded":"2024-09-19T06:46:00.565660+0000","last_fullsized":"2024-09-19T06:46:00.565660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:32.934290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:31.851881+0000","last_change":"2024-09-19T06:37:08.430649+0000","last_active":"2024-09-19T06:46:31.851881+0000","last_peered":"2024-09-19T06:46:31.851881+0000","last_clean":"2024-09-19T06:46:31.851881+0000","last_became_active":"2024-09-19T06:37:08.430324+0000","last_became_peered":"2024-09-19T06:37:08.430324+0000","last_unstale":"2024-09-19T06:46:31.851881+0000","last_undegraded":"2024-09-19T06:46:31.851881+0000","last_fullsized":"2024-09-19T06:46:31.851881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"34'5213","reported_seq":5283,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:36.211865+0000","last_change":"2024-09-19T06:37:13.463695+0000","last_active":"2024-09-19T06:46:36.211865+0000","last_peered":"2024-09-19T06:46:36.211865+0000","last_clean":"2024-09-19T06:46:36.211865+0000","last_became_active":"2024-09-19T06:37:13.463334+0000","last_became_peered":"2024-09-19T06:37:13.463334+0000","last_unstale":"2024-09-19T06:46:36.211865+0000","last_undegraded":"2024-09-19T06:46:36.211865+0000","last_fullsized":"2024-09-19T06:46:36.211865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5213,"log_dups_size":0,"ondisk_log_size":5213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218357537,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":75208,"num_write_kb":939459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.379327+0000","last_change":"2024-09-19T06:37:09.450168+0000","last_active":"2024-09-19T06:46:23.379327+0000","last_peered":"2024-09-19T06:46:23.379327+0000","last_clean":"2024-09-19T06:46:23.379327+0000","last_became_active":"2024-09-19T06:37:09.449872+0000","last_became_peered":"2024-09-19T06:37:09.449872+0000","last_unstale":"2024-09-19T06:46:23.379327+0000","last_undegraded":"2024-09-19T06:46:23.379327+0000","last_fullsized":"2024-09-19T06:46:23.379327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:02:28.282840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.941787+0000","last_change":"2024-09-19T06:37:08.442428+0000","last_active":"2024-09-19T06:46:01.941787+0000","last_peered":"2024-09-19T06:46:01.941787+0000","last_clean":"2024-09-19T06:46:01.941787+0000","last_became_active":"2024-09-19T06:37:08.442120+0000","last_became_peered":"2024-09-19T06:37:08.442120+0000","last_unstale":"2024-09-19T06:46:01.941787+0000","last_undegraded":"2024-09-19T06:46:01.941787+0000","last_fullsized":"2024-09-19T06:46:01.941787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:48.816822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"34'4897","reported_seq":4978,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:35.455598+0000","last_change":"2024-09-19T06:37:13.471319+0000","last_active":"2024-09-19T06:46:35.455598+0000","last_peered":"2024-09-19T06:46:35.455598+0000","last_clean":"2024-09-19T06:46:35.455598+0000","last_became_active":"2024-09-19T06:37:13.470887+0000","last_became_peered":"2024-09-19T06:37:13.470887+0000","last_unstale":"2024-09-19T06:46:35.455598+0000","last_undegraded":"2024-09-19T06:46:35.455598+0000","last_fullsized":"2024-09-19T06:46:35.455598+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4897,"log_dups_size":0,"ondisk_log_size":4897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:21.884985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239134950,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":70518,"num_write_kb":907517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'10","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565998+0000","last_change":"2024-09-19T06:37:09.439142+0000","last_active":"2024-09-19T06:46:00.565998+0000","last_peered":"2024-09-19T06:46:00.565998+0000","last_clean":"2024-09-19T06:46:00.565998+0000","last_became_active":"2024-09-19T06:37:09.437635+0000","last_became_peered":"2024-09-19T06:37:09.437635+0000","last_unstale":"2024-09-19T06:46:00.565998+0000","last_undegraded":"2024-09-19T06:46:00.565998+0000","last_fullsized":"2024-09-19T06:46:00.565998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:46.773889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564725+0000","last_change":"2024-09-19T06:37:08.438932+0000","last_active":"2024-09-19T06:46:00.564725+0000","last_peered":"2024-09-19T06:46:00.564725+0000","last_clean":"2024-09-19T06:46:00.564725+0000","last_became_active":"2024-09-19T06:37:08.438405+0000","last_became_peered":"2024-09-19T06:37:08.438405+0000","last_unstale":"2024-09-19T06:46:00.564725+0000","last_undegraded":"2024-09-19T06:46:00.564725+0000","last_fullsized":"2024-09-19T06:46:00.564725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:59.606628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'5193","reported_seq":5273,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:35.376547+0000","last_change":"2024-09-19T06:37:13.459370+0000","last_active":"2024-09-19T06:46:35.376547+0000","last_peered":"2024-09-19T06:46:35.376547+0000","last_clean":"2024-09-19T06:46:35.376547+0000","last_became_active":"2024-09-19T06:37:13.458928+0000","last_became_peered":"2024-09-19T06:37:13.458928+0000","last_unstale":"2024-09-19T06:46:35.376547+0000","last_undegraded":"2024-09-19T06:46:35.376547+0000","last_fullsized":"2024-09-19T06:46:35.376547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5193,"log_dups_size":0,"ondisk_log_size":5193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:00.179404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243501771,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":47,"num_read_kb":0,"num_write":75234,"num_write_kb":949879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'11","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:34.431077+0000","last_change":"2024-09-19T06:37:09.448958+0000","last_active":"2024-09-19T06:46:34.431077+0000","last_peered":"2024-09-19T06:46:34.431077+0000","last_clean":"2024-09-19T06:46:34.431077+0000","last_became_active":"2024-09-19T06:37:09.448697+0000","last_became_peered":"2024-09-19T06:37:09.448697+0000","last_unstale":"2024-09-19T06:46:34.431077+0000","last_undegraded":"2024-09-19T06:46:34.431077+0000","last_fullsized":"2024-09-19T06:46:34.431077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"34'66","reported_seq":137,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:35.850622+0000","last_change":"2024-09-19T06:46:35.850675+0000","last_active":"2024-09-19T06:46:35.850622+0000","last_peered":"2024-09-19T06:46:35.850622+0000","last_clean":"2024-09-19T06:46:35.850622+0000","last_became_active":"2024-09-19T06:37:08.442436+0000","last_became_peered":"2024-09-19T06:37:08.442436+0000","last_unstale":"2024-09-19T06:46:35.850622+0000","last_undegraded":"2024-09-19T06:46:35.850622+0000","last_fullsized":"2024-09-19T06:46:35.850622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'66","last_scrub_stamp":"2024-09-19T06:46:35.850521+0000","last_deep_scrub":"34'66","last_deep_scrub_stamp":"2024-09-19T06:46:35.850521+0000","last_clean_scrub_stamp":"2024-09-19T06:46:35.850521+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:54.947910+0000","scrub_duration":70,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":32451,"num_write":58,"num_write_kb":8225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"34'4572","reported_seq":4633,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:35.420752+0000","last_change":"2024-09-19T06:37:13.457651+0000","last_active":"2024-09-19T06:46:35.420752+0000","last_peered":"2024-09-19T06:46:35.420752+0000","last_clean":"2024-09-19T06:46:35.420752+0000","last_became_active":"2024-09-19T06:37:13.457246+0000","last_became_peered":"2024-09-19T06:37:13.457246+0000","last_unstale":"2024-09-19T06:46:35.420752+0000","last_undegraded":"2024-09-19T06:46:35.420752+0000","last_fullsized":"2024-09-19T06:46:35.420752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4572,"log_dups_size":0,"ondisk_log_size":4572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:18.553158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222298112,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":66033,"num_write_kb":826143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"34'10","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:33.498988+0000","last_change":"2024-09-19T06:37:09.441212+0000","last_active":"2024-09-19T06:46:33.498988+0000","last_peered":"2024-09-19T06:46:33.498988+0000","last_clean":"2024-09-19T06:46:33.498988+0000","last_became_active":"2024-09-19T06:37:09.440209+0000","last_became_peered":"2024-09-19T06:37:09.440209+0000","last_unstale":"2024-09-19T06:46:33.498988+0000","last_undegraded":"2024-09-19T06:46:33.498988+0000","last_fullsized":"2024-09-19T06:46:33.498988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:52.173784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"34'220","reported_seq":291,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:34.263944+0000","last_change":"2024-09-19T06:37:08.442615+0000","last_active":"2024-09-19T06:46:34.263944+0000","last_peered":"2024-09-19T06:46:34.263944+0000","last_clean":"2024-09-19T06:46:34.263944+0000","last_became_active":"2024-09-19T06:37:08.442242+0000","last_became_peered":"2024-09-19T06:37:08.442242+0000","last_unstale":"2024-09-19T06:46:34.263944+0000","last_undegraded":"2024-09-19T06:46:34.263944+0000","last_fullsized":"2024-09-19T06:46:34.263944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:23.813400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":49,"num_read_kb":24618,"num_write":216,"num_write_kb":4204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"34'4688","reported_seq":4763,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:37.028773+0000","last_change":"2024-09-19T06:37:13.464688+0000","last_active":"2024-09-19T06:46:37.028773+0000","last_peered":"2024-09-19T06:46:37.028773+0000","last_clean":"2024-09-19T06:46:37.028773+0000","last_became_active":"2024-09-19T06:37:13.461620+0000","last_became_peered":"2024-09-19T06:37:13.461620+0000","last_unstale":"2024-09-19T06:46:37.028773+0000","last_undegraded":"2024-09-19T06:46:37.028773+0000","last_fullsized":"2024-09-19T06:46:37.028773+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4688,"log_dups_size":0,"ondisk_log_size":4688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213992290,"num_objects":56,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":67724,"num_write_kb":859195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"34'5","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.951316+0000","last_change":"2024-09-19T06:37:09.440021+0000","last_active":"2024-09-19T06:46:01.951316+0000","last_peered":"2024-09-19T06:46:01.951316+0000","last_clean":"2024-09-19T06:46:01.951316+0000","last_became_active":"2024-09-19T06:37:09.437800+0000","last_became_peered":"2024-09-19T06:37:09.437800+0000","last_unstale":"2024-09-19T06:46:01.951316+0000","last_undegraded":"2024-09-19T06:46:01.951316+0000","last_fullsized":"2024-09-19T06:46:01.951316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:51.963097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"34'16","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.206122+0000","last_change":"2024-09-19T06:37:08.434422+0000","last_active":"2024-09-19T06:46:23.206122+0000","last_peered":"2024-09-19T06:46:23.206122+0000","last_clean":"2024-09-19T06:46:23.206122+0000","last_became_active":"2024-09-19T06:37:08.434151+0000","last_became_peered":"2024-09-19T06:37:08.434151+0000","last_unstale":"2024-09-19T06:46:23.206122+0000","last_undegraded":"2024-09-19T06:46:23.206122+0000","last_fullsized":"2024-09-19T06:46:23.206122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":17,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'4812","reported_seq":4894,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:32.471338+0000","last_change":"2024-09-19T06:37:13.459321+0000","last_active":"2024-09-19T06:46:32.471338+0000","last_peered":"2024-09-19T06:46:32.471338+0000","last_clean":"2024-09-19T06:46:32.471338+0000","last_became_active":"2024-09-19T06:37:13.458924+0000","last_became_peered":"2024-09-19T06:37:13.458924+0000","last_unstale":"2024-09-19T06:46:32.471338+0000","last_undegraded":"2024-09-19T06:46:32.471338+0000","last_fullsized":"2024-09-19T06:46:32.471338+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4812,"log_dups_size":0,"ondisk_log_size":4812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:11.428574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297903089,"num_objects":81,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":49,"num_read_kb":0,"num_write":69720,"num_write_kb":881574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"34'9","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:34.772456+0000","last_change":"2024-09-19T06:46:34.772498+0000","last_active":"2024-09-19T06:46:34.772456+0000","last_peered":"2024-09-19T06:46:34.772456+0000","last_clean":"2024-09-19T06:46:34.772456+0000","last_became_active":"2024-09-19T06:37:09.448173+0000","last_became_peered":"2024-09-19T06:37:09.448173+0000","last_unstale":"2024-09-19T06:46:34.772456+0000","last_undegraded":"2024-09-19T06:46:34.772456+0000","last_fullsized":"2024-09-19T06:46:34.772456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-19T06:46:34.772353+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-19T06:46:34.772353+0000","last_clean_scrub_stamp":"2024-09-19T06:46:34.772353+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:03.908737+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564938+0000","last_change":"2024-09-19T06:37:08.442796+0000","last_active":"2024-09-19T06:46:00.564938+0000","last_peered":"2024-09-19T06:46:00.564938+0000","last_clean":"2024-09-19T06:46:00.564938+0000","last_became_active":"2024-09-19T06:37:08.442126+0000","last_became_peered":"2024-09-19T06:37:08.442126+0000","last_unstale":"2024-09-19T06:46:00.564938+0000","last_undegraded":"2024-09-19T06:46:00.564938+0000","last_fullsized":"2024-09-19T06:46:00.564938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:27.716141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"34'4762","reported_seq":4823,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:35.559559+0000","last_change":"2024-09-19T06:37:13.464100+0000","last_active":"2024-09-19T06:46:35.559559+0000","last_peered":"2024-09-19T06:46:35.559559+0000","last_clean":"2024-09-19T06:46:35.559559+0000","last_became_active":"2024-09-19T06:37:13.462750+0000","last_became_peered":"2024-09-19T06:37:13.462750+0000","last_unstale":"2024-09-19T06:46:35.559559+0000","last_undegraded":"2024-09-19T06:46:35.559559+0000","last_fullsized":"2024-09-19T06:46:35.559559+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4762,"log_dups_size":0,"ondisk_log_size":4762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:49.139841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268503936,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":69402,"num_write_kb":873579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'5","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.877400+0000","last_change":"2024-09-19T06:37:51.593841+0000","last_active":"2024-09-19T06:46:01.877400+0000","last_peered":"2024-09-19T06:46:01.877400+0000","last_clean":"2024-09-19T06:46:01.877400+0000","last_became_active":"2024-09-19T06:37:51.593513+0000","last_became_peered":"2024-09-19T06:37:51.593513+0000","last_unstale":"2024-09-19T06:46:01.877400+0000","last_undegraded":"2024-09-19T06:46:01.877400+0000","last_fullsized":"2024-09-19T06:46:01.877400+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.942374+0000","last_change":"2024-09-19T06:37:08.439543+0000","last_active":"2024-09-19T06:46:01.942374+0000","last_peered":"2024-09-19T06:46:01.942374+0000","last_clean":"2024-09-19T06:46:01.942374+0000","last_became_active":"2024-09-19T06:37:08.438785+0000","last_became_peered":"2024-09-19T06:37:08.438785+0000","last_unstale":"2024-09-19T06:46:01.942374+0000","last_undegraded":"2024-09-19T06:46:01.942374+0000","last_fullsized":"2024-09-19T06:46:01.942374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:51.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"34'4833","reported_seq":4921,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:35.714541+0000","last_change":"2024-09-19T06:37:13.462327+0000","last_active":"2024-09-19T06:46:35.714541+0000","last_peered":"2024-09-19T06:46:35.714541+0000","last_clean":"2024-09-19T06:46:35.714541+0000","last_became_active":"2024-09-19T06:37:13.461762+0000","last_became_peered":"2024-09-19T06:37:13.461762+0000","last_unstale":"2024-09-19T06:46:35.714541+0000","last_undegraded":"2024-09-19T06:46:35.714541+0000","last_fullsized":"2024-09-19T06:46:35.714541+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4833,"log_dups_size":0,"ondisk_log_size":4833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:26.931537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276854417,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":71073,"num_write_kb":900045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'5636","reported_seq":5713,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:36.300664+0000","last_change":"2024-09-19T06:37:13.471309+0000","last_active":"2024-09-19T06:46:36.300664+0000","last_peered":"2024-09-19T06:46:36.300664+0000","last_clean":"2024-09-19T06:46:36.300664+0000","last_became_active":"2024-09-19T06:37:13.470969+0000","last_became_peered":"2024-09-19T06:37:13.470969+0000","last_unstale":"2024-09-19T06:46:36.300664+0000","last_undegraded":"2024-09-19T06:46:36.300664+0000","last_fullsized":"2024-09-19T06:46:36.300664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5636,"log_dups_size":0,"ondisk_log_size":5636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306195594,"num_objects":76,"num_object_clones":0,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":81907,"num_write_kb":1028288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'3","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:36.266008+0000","last_change":"2024-09-19T06:46:36.266057+0000","last_active":"2024-09-19T06:46:36.266008+0000","last_peered":"2024-09-19T06:46:36.266008+0000","last_clean":"2024-09-19T06:46:36.266008+0000","last_became_active":"2024-09-19T06:37:09.443069+0000","last_became_peered":"2024-09-19T06:37:09.443069+0000","last_unstale":"2024-09-19T06:46:36.266008+0000","last_undegraded":"2024-09-19T06:46:36.266008+0000","last_fullsized":"2024-09-19T06:46:36.266008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-19T06:46:36.265905+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-19T06:46:36.265905+0000","last_clean_scrub_stamp":"2024-09-19T06:46:36.265905+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:01.926106+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"34'28","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.952755+0000","last_change":"2024-09-19T06:37:08.441967+0000","last_active":"2024-09-19T06:46:05.952755+0000","last_peered":"2024-09-19T06:46:05.952755+0000","last_clean":"2024-09-19T06:46:05.952755+0000","last_became_active":"2024-09-19T06:37:08.441698+0000","last_became_peered":"2024-09-19T06:37:08.441698+0000","last_unstale":"2024-09-19T06:46:05.952755+0000","last_undegraded":"2024-09-19T06:46:05.952755+0000","last_fullsized":"2024-09-19T06:46:05.952755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:56.933775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":23,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4769","reported_seq":4842,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:36.036867+0000","last_change":"2024-09-19T06:37:13.470903+0000","last_active":"2024-09-19T06:46:36.036867+0000","last_peered":"2024-09-19T06:46:36.036867+0000","last_clean":"2024-09-19T06:46:36.036867+0000","last_became_active":"2024-09-19T06:37:13.470528+0000","last_became_peered":"2024-09-19T06:37:13.470528+0000","last_unstale":"2024-09-19T06:46:36.036867+0000","last_undegraded":"2024-09-19T06:46:36.036867+0000","last_fullsized":"2024-09-19T06:46:36.036867+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4769,"log_dups_size":0,"ondisk_log_size":4769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:45.999436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230769868,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":69175,"num_write_kb":882580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"34'15","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562535+0000","last_change":"2024-09-19T06:37:09.448953+0000","last_active":"2024-09-19T06:46:00.562535+0000","last_peered":"2024-09-19T06:46:00.562535+0000","last_clean":"2024-09-19T06:46:00.562535+0000","last_became_active":"2024-09-19T06:37:09.448658+0000","last_became_peered":"2024-09-19T06:37:09.448658+0000","last_unstale":"2024-09-19T06:46:00.562535+0000","last_undegraded":"2024-09-19T06:46:00.562535+0000","last_fullsized":"2024-09-19T06:46:00.562535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:07.333392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562651+0000","last_change":"2024-09-19T06:37:08.440800+0000","last_active":"2024-09-19T06:46:00.562651+0000","last_peered":"2024-09-19T06:46:00.562651+0000","last_clean":"2024-09-19T06:46:00.562651+0000","last_became_active":"2024-09-19T06:37:08.440591+0000","last_became_peered":"2024-09-19T06:37:08.440591+0000","last_unstale":"2024-09-19T06:46:00.562651+0000","last_undegraded":"2024-09-19T06:46:00.562651+0000","last_fullsized":"2024-09-19T06:46:00.562651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:05.540261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'20","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.942090+0000","last_change":"2024-09-19T06:37:08.441268+0000","last_active":"2024-09-19T06:46:01.942090+0000","last_peered":"2024-09-19T06:46:01.942090+0000","last_clean":"2024-09-19T06:46:01.942090+0000","last_became_active":"2024-09-19T06:37:08.440969+0000","last_became_peered":"2024-09-19T06:37:08.440969+0000","last_unstale":"2024-09-19T06:46:01.942090+0000","last_undegraded":"2024-09-19T06:46:01.942090+0000","last_fullsized":"2024-09-19T06:46:01.942090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:59.426336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":18,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.950829+0000","last_change":"2024-09-19T06:37:09.444857+0000","last_active":"2024-09-19T06:46:01.950829+0000","last_peered":"2024-09-19T06:46:01.950829+0000","last_clean":"2024-09-19T06:46:01.950829+0000","last_became_active":"2024-09-19T06:37:09.444562+0000","last_became_peered":"2024-09-19T06:37:09.444562+0000","last_unstale":"2024-09-19T06:46:01.950829+0000","last_undegraded":"2024-09-19T06:46:01.950829+0000","last_fullsized":"2024-09-19T06:46:01.950829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"34'3873","reported_seq":3936,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:36.787924+0000","last_change":"2024-09-19T06:37:13.467183+0000","last_active":"2024-09-19T06:46:36.787924+0000","last_peered":"2024-09-19T06:46:36.787924+0000","last_clean":"2024-09-19T06:46:36.787924+0000","last_became_active":"2024-09-19T06:37:13.466765+0000","last_became_peered":"2024-09-19T06:37:13.466765+0000","last_unstale":"2024-09-19T06:46:36.787924+0000","last_undegraded":"2024-09-19T06:46:36.787924+0000","last_fullsized":"2024-09-19T06:46:36.787924+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":3873,"log_dups_size":0,"ondisk_log_size":3873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150996671,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":56448,"num_write_kb":718624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'987","reported_seq":1040,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:05.590330+0000","last_change":"2024-09-19T06:37:08.443993+0000","last_active":"2024-09-19T06:46:05.590330+0000","last_peered":"2024-09-19T06:46:05.590330+0000","last_clean":"2024-09-19T06:46:05.590330+0000","last_became_active":"2024-09-19T06:37:08.443774+0000","last_became_peered":"2024-09-19T06:37:08.443774+0000","last_unstale":"2024-09-19T06:46:05.590330+0000","last_undegraded":"2024-09-19T06:46:05.590330+0000","last_fullsized":"2024-09-19T06:46:05.590330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:07.406818+0000","last_clean_scrub_stamp":"2024-09-19T06:37:07.406818+0000","objects_scrubbed":0,"log_size":987,"log_dups_size":0,"ondisk_log_size":987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:16.005073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":42342,"num_write":985,"num_write_kb":4941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.951295+0000","last_change":"2024-09-19T06:37:09.440258+0000","last_active":"2024-09-19T06:46:01.951295+0000","last_peered":"2024-09-19T06:46:01.951295+0000","last_clean":"2024-09-19T06:46:01.951295+0000","last_became_active":"2024-09-19T06:37:09.438457+0000","last_became_peered":"2024-09-19T06:37:09.438457+0000","last_unstale":"2024-09-19T06:46:01.951295+0000","last_undegraded":"2024-09-19T06:46:01.951295+0000","last_fullsized":"2024-09-19T06:46:01.951295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:24.636340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'5342","reported_seq":5411,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:35.418034+0000","last_change":"2024-09-19T06:37:13.462800+0000","last_active":"2024-09-19T06:46:35.418034+0000","last_peered":"2024-09-19T06:46:35.418034+0000","last_clean":"2024-09-19T06:46:35.418034+0000","last_became_active":"2024-09-19T06:37:13.462393+0000","last_became_peered":"2024-09-19T06:37:13.462393+0000","last_unstale":"2024-09-19T06:46:35.418034+0000","last_undegraded":"2024-09-19T06:46:35.418034+0000","last_fullsized":"2024-09-19T06:46:35.418034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":5342,"log_dups_size":0,"ondisk_log_size":5342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:35.901637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293706988,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":77300,"num_write_kb":974522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"34'9","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:32.163305+0000","last_change":"2024-09-19T06:37:09.450421+0000","last_active":"2024-09-19T06:46:32.163305+0000","last_peered":"2024-09-19T06:46:32.163305+0000","last_clean":"2024-09-19T06:46:32.163305+0000","last_became_active":"2024-09-19T06:37:09.450147+0000","last_became_peered":"2024-09-19T06:37:09.450147+0000","last_unstale":"2024-09-19T06:46:32.163305+0000","last_undegraded":"2024-09-19T06:46:32.163305+0000","last_fullsized":"2024-09-19T06:46:32.163305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:42.949759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"34'12","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:35.098193+0000","last_change":"2024-09-19T06:37:09.435131+0000","last_active":"2024-09-19T06:46:35.098193+0000","last_peered":"2024-09-19T06:46:35.098193+0000","last_clean":"2024-09-19T06:46:35.098193+0000","last_became_active":"2024-09-19T06:37:09.434840+0000","last_became_peered":"2024-09-19T06:37:09.434840+0000","last_unstale":"2024-09-19T06:46:35.098193+0000","last_undegraded":"2024-09-19T06:46:35.098193+0000","last_fullsized":"2024-09-19T06:46:35.098193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"34'10","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:30.120630+0000","last_change":"2024-09-19T06:37:09.445196+0000","last_active":"2024-09-19T06:46:30.120630+0000","last_peered":"2024-09-19T06:46:30.120630+0000","last_clean":"2024-09-19T06:46:30.120630+0000","last_became_active":"2024-09-19T06:37:09.444907+0000","last_became_peered":"2024-09-19T06:37:09.444907+0000","last_unstale":"2024-09-19T06:46:30.120630+0000","last_undegraded":"2024-09-19T06:46:30.120630+0000","last_fullsized":"2024-09-19T06:46:30.120630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:17.605675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"34'9","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:30.573315+0000","last_change":"2024-09-19T06:37:09.447966+0000","last_active":"2024-09-19T06:46:30.573315+0000","last_peered":"2024-09-19T06:46:30.573315+0000","last_clean":"2024-09-19T06:46:30.573315+0000","last_became_active":"2024-09-19T06:37:09.447692+0000","last_became_peered":"2024-09-19T06:37:09.447692+0000","last_unstale":"2024-09-19T06:46:30.573315+0000","last_undegraded":"2024-09-19T06:46:30.573315+0000","last_fullsized":"2024-09-19T06:46:30.573315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"34'8","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:29.509948+0000","last_change":"2024-09-19T06:37:51.596144+0000","last_active":"2024-09-19T06:46:29.509948+0000","last_peered":"2024-09-19T06:46:29.509948+0000","last_clean":"2024-09-19T06:46:29.509948+0000","last_became_active":"2024-09-19T06:37:51.595875+0000","last_became_peered":"2024-09-19T06:37:51.595875+0000","last_unstale":"2024-09-19T06:46:29.509948+0000","last_undegraded":"2024-09-19T06:46:29.509948+0000","last_fullsized":"2024-09-19T06:46:29.509948+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:37.277936+0000","last_change":"2024-09-19T06:46:37.282713+0000","last_active":"2024-09-19T06:46:37.277936+0000","last_peered":"2024-09-19T06:46:37.277936+0000","last_clean":"2024-09-19T06:46:37.277936+0000","last_became_active":"2024-09-19T06:37:09.441456+0000","last_became_peered":"2024-09-19T06:37:09.441456+0000","last_unstale":"2024-09-19T06:46:37.277936+0000","last_undegraded":"2024-09-19T06:46:37.277936+0000","last_fullsized":"2024-09-19T06:46:37.277936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-19T06:46:37.277831+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-19T06:46:37.277831+0000","last_clean_scrub_stamp":"2024-09-19T06:46:37.277831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:12.733243+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"34'5","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.942429+0000","last_change":"2024-09-19T06:37:09.449856+0000","last_active":"2024-09-19T06:46:01.942429+0000","last_peered":"2024-09-19T06:46:01.942429+0000","last_clean":"2024-09-19T06:46:01.942429+0000","last_became_active":"2024-09-19T06:37:09.449562+0000","last_became_peered":"2024-09-19T06:37:09.449562+0000","last_unstale":"2024-09-19T06:46:01.942429+0000","last_undegraded":"2024-09-19T06:46:01.942429+0000","last_fullsized":"2024-09-19T06:46:01.942429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:49.182126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"34'10","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.563697+0000","last_change":"2024-09-19T06:37:09.438551+0000","last_active":"2024-09-19T06:46:00.563697+0000","last_peered":"2024-09-19T06:46:00.563697+0000","last_clean":"2024-09-19T06:46:00.563697+0000","last_became_active":"2024-09-19T06:37:09.437624+0000","last_became_peered":"2024-09-19T06:37:09.437624+0000","last_unstale":"2024-09-19T06:46:00.563697+0000","last_undegraded":"2024-09-19T06:46:00.563697+0000","last_fullsized":"2024-09-19T06:46:00.563697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:46.565780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564917+0000","last_change":"2024-09-19T06:37:09.438737+0000","last_active":"2024-09-19T06:46:00.564917+0000","last_peered":"2024-09-19T06:46:00.564917+0000","last_clean":"2024-09-19T06:46:00.564917+0000","last_became_active":"2024-09-19T06:37:09.438453+0000","last_became_peered":"2024-09-19T06:37:09.438453+0000","last_unstale":"2024-09-19T06:46:00.564917+0000","last_undegraded":"2024-09-19T06:46:00.564917+0000","last_fullsized":"2024-09-19T06:46:00.564917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.982275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"34'13","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:32.274569+0000","last_change":"2024-09-19T06:37:09.442093+0000","last_active":"2024-09-19T06:46:32.274569+0000","last_peered":"2024-09-19T06:46:32.274569+0000","last_clean":"2024-09-19T06:46:32.274569+0000","last_became_active":"2024-09-19T06:37:09.439710+0000","last_became_peered":"2024-09-19T06:37:09.439710+0000","last_unstale":"2024-09-19T06:46:32.274569+0000","last_undegraded":"2024-09-19T06:46:32.274569+0000","last_fullsized":"2024-09-19T06:46:32.274569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:02.626854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"34'11","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:34.006982+0000","last_change":"2024-09-19T06:37:51.593282+0000","last_active":"2024-09-19T06:46:34.006982+0000","last_peered":"2024-09-19T06:46:34.006982+0000","last_clean":"2024-09-19T06:46:34.006982+0000","last_became_active":"2024-09-19T06:37:51.592846+0000","last_became_peered":"2024-09-19T06:37:51.592846+0000","last_unstale":"2024-09-19T06:46:34.006982+0000","last_undegraded":"2024-09-19T06:46:34.006982+0000","last_fullsized":"2024-09-19T06:46:34.006982+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"34'9","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:31.348292+0000","last_change":"2024-09-19T06:37:09.449633+0000","last_active":"2024-09-19T06:46:31.348292+0000","last_peered":"2024-09-19T06:46:31.348292+0000","last_clean":"2024-09-19T06:46:31.348292+0000","last_became_active":"2024-09-19T06:37:09.449379+0000","last_became_peered":"2024-09-19T06:37:09.449379+0000","last_unstale":"2024-09-19T06:46:31.348292+0000","last_undegraded":"2024-09-19T06:46:31.348292+0000","last_fullsized":"2024-09-19T06:46:31.348292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:16.123078+0000","last_change":"2024-09-19T06:37:09.447808+0000","last_active":"2024-09-19T06:46:16.123078+0000","last_peered":"2024-09-19T06:46:16.123078+0000","last_clean":"2024-09-19T06:46:16.123078+0000","last_became_active":"2024-09-19T06:37:09.447514+0000","last_became_peered":"2024-09-19T06:37:09.447514+0000","last_unstale":"2024-09-19T06:46:16.123078+0000","last_undegraded":"2024-09-19T06:46:16.123078+0000","last_fullsized":"2024-09-19T06:46:16.123078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:04.653997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"34'12","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:29.787259+0000","last_change":"2024-09-19T06:37:09.439605+0000","last_active":"2024-09-19T06:46:29.787259+0000","last_peered":"2024-09-19T06:46:29.787259+0000","last_clean":"2024-09-19T06:46:29.787259+0000","last_became_active":"2024-09-19T06:37:09.432601+0000","last_became_peered":"2024-09-19T06:37:09.432601+0000","last_unstale":"2024-09-19T06:46:29.787259+0000","last_undegraded":"2024-09-19T06:46:29.787259+0000","last_fullsized":"2024-09-19T06:46:29.787259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:50.640062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"34'10","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:31.851932+0000","last_change":"2024-09-19T06:37:09.440268+0000","last_active":"2024-09-19T06:46:31.851932+0000","last_peered":"2024-09-19T06:46:31.851932+0000","last_clean":"2024-09-19T06:46:31.851932+0000","last_became_active":"2024-09-19T06:37:09.439937+0000","last_became_peered":"2024-09-19T06:37:09.439937+0000","last_unstale":"2024-09-19T06:46:31.851932+0000","last_undegraded":"2024-09-19T06:46:31.851932+0000","last_fullsized":"2024-09-19T06:46:31.851932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:34.615070+0000","last_change":"2024-09-19T06:37:09.437080+0000","last_active":"2024-09-19T06:46:34.615070+0000","last_peered":"2024-09-19T06:46:34.615070+0000","last_clean":"2024-09-19T06:46:34.615070+0000","last_became_active":"2024-09-19T06:37:09.436752+0000","last_became_peered":"2024-09-19T06:37:09.436752+0000","last_unstale":"2024-09-19T06:46:34.615070+0000","last_undegraded":"2024-09-19T06:46:34.615070+0000","last_fullsized":"2024-09-19T06:46:34.615070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:31.423640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"34'11","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.248599+0000","last_change":"2024-09-19T06:37:09.448942+0000","last_active":"2024-09-19T06:46:23.248599+0000","last_peered":"2024-09-19T06:46:23.248599+0000","last_clean":"2024-09-19T06:46:23.248599+0000","last_became_active":"2024-09-19T06:37:09.448647+0000","last_became_peered":"2024-09-19T06:37:09.448647+0000","last_unstale":"2024-09-19T06:46:23.248599+0000","last_undegraded":"2024-09-19T06:46:23.248599+0000","last_fullsized":"2024-09-19T06:46:23.248599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:49.027909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"34'11","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:35.761827+0000","last_change":"2024-09-19T06:37:09.445015+0000","last_active":"2024-09-19T06:46:35.761827+0000","last_peered":"2024-09-19T06:46:35.761827+0000","last_clean":"2024-09-19T06:46:35.761827+0000","last_became_active":"2024-09-19T06:37:09.444737+0000","last_became_peered":"2024-09-19T06:37:09.444737+0000","last_unstale":"2024-09-19T06:46:35.761827+0000","last_undegraded":"2024-09-19T06:46:35.761827+0000","last_fullsized":"2024-09-19T06:46:35.761827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'10","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:34.431130+0000","last_change":"2024-09-19T06:37:09.446025+0000","last_active":"2024-09-19T06:46:34.431130+0000","last_peered":"2024-09-19T06:46:34.431130+0000","last_clean":"2024-09-19T06:46:34.431130+0000","last_became_active":"2024-09-19T06:37:09.445503+0000","last_became_peered":"2024-09-19T06:37:09.445503+0000","last_unstale":"2024-09-19T06:46:34.431130+0000","last_undegraded":"2024-09-19T06:46:34.431130+0000","last_fullsized":"2024-09-19T06:46:34.431130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"34'9","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.563097+0000","last_change":"2024-09-19T06:37:09.441302+0000","last_active":"2024-09-19T06:46:00.563097+0000","last_peered":"2024-09-19T06:46:00.563097+0000","last_clean":"2024-09-19T06:46:00.563097+0000","last_became_active":"2024-09-19T06:37:09.439767+0000","last_became_peered":"2024-09-19T06:37:09.439767+0000","last_unstale":"2024-09-19T06:46:00.563097+0000","last_undegraded":"2024-09-19T06:46:00.563097+0000","last_fullsized":"2024-09-19T06:46:00.563097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:01.038823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.951163+0000","last_change":"2024-09-19T06:37:09.440976+0000","last_active":"2024-09-19T06:46:01.951163+0000","last_peered":"2024-09-19T06:46:01.951163+0000","last_clean":"2024-09-19T06:46:01.951163+0000","last_became_active":"2024-09-19T06:37:09.440702+0000","last_became_peered":"2024-09-19T06:37:09.440702+0000","last_unstale":"2024-09-19T06:46:01.951163+0000","last_undegraded":"2024-09-19T06:46:01.951163+0000","last_fullsized":"2024-09-19T06:46:01.951163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:21.281400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"34'12","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.942205+0000","last_change":"2024-09-19T06:37:09.442301+0000","last_active":"2024-09-19T06:46:01.942205+0000","last_peered":"2024-09-19T06:46:01.942205+0000","last_clean":"2024-09-19T06:46:01.942205+0000","last_became_active":"2024-09-19T06:37:09.442053+0000","last_became_peered":"2024-09-19T06:37:09.442053+0000","last_unstale":"2024-09-19T06:46:01.942205+0000","last_undegraded":"2024-09-19T06:46:01.942205+0000","last_fullsized":"2024-09-19T06:46:01.942205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:26.189384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"34'10","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.942209+0000","last_change":"2024-09-19T06:37:09.441525+0000","last_active":"2024-09-19T06:46:01.942209+0000","last_peered":"2024-09-19T06:46:01.942209+0000","last_clean":"2024-09-19T06:46:01.942209+0000","last_became_active":"2024-09-19T06:37:09.441179+0000","last_became_peered":"2024-09-19T06:37:09.441179+0000","last_unstale":"2024-09-19T06:46:01.942209+0000","last_undegraded":"2024-09-19T06:46:01.942209+0000","last_fullsized":"2024-09-19T06:46:01.942209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:47.235113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"34'12","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:29.113276+0000","last_change":"2024-09-19T06:37:09.437163+0000","last_active":"2024-09-19T06:46:29.113276+0000","last_peered":"2024-09-19T06:46:29.113276+0000","last_clean":"2024-09-19T06:46:29.113276+0000","last_became_active":"2024-09-19T06:37:09.436892+0000","last_became_peered":"2024-09-19T06:37:09.436892+0000","last_unstale":"2024-09-19T06:46:29.113276+0000","last_undegraded":"2024-09-19T06:46:29.113276+0000","last_fullsized":"2024-09-19T06:46:29.113276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:47:58.347385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.562140+0000","last_change":"2024-09-19T06:37:09.437524+0000","last_active":"2024-09-19T06:46:00.562140+0000","last_peered":"2024-09-19T06:46:00.562140+0000","last_clean":"2024-09-19T06:46:00.562140+0000","last_became_active":"2024-09-19T06:37:09.437023+0000","last_became_peered":"2024-09-19T06:37:09.437023+0000","last_unstale":"2024-09-19T06:46:00.562140+0000","last_undegraded":"2024-09-19T06:46:00.562140+0000","last_fullsized":"2024-09-19T06:46:00.562140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:31.398914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565598+0000","last_change":"2024-09-19T06:37:09.448814+0000","last_active":"2024-09-19T06:46:00.565598+0000","last_peered":"2024-09-19T06:46:00.565598+0000","last_clean":"2024-09-19T06:46:00.565598+0000","last_became_active":"2024-09-19T06:37:09.448547+0000","last_became_peered":"2024-09-19T06:37:09.448547+0000","last_unstale":"2024-09-19T06:46:00.565598+0000","last_undegraded":"2024-09-19T06:46:00.565598+0000","last_fullsized":"2024-09-19T06:46:00.565598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:13.526300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'7","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.564426+0000","last_change":"2024-09-19T06:37:09.446910+0000","last_active":"2024-09-19T06:46:00.564426+0000","last_peered":"2024-09-19T06:46:00.564426+0000","last_clean":"2024-09-19T06:46:00.564426+0000","last_became_active":"2024-09-19T06:37:09.446603+0000","last_became_peered":"2024-09-19T06:37:09.446603+0000","last_unstale":"2024-09-19T06:46:00.564426+0000","last_undegraded":"2024-09-19T06:46:00.564426+0000","last_fullsized":"2024-09-19T06:46:00.564426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:47.006354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.565756+0000","last_change":"2024-09-19T06:37:09.430160+0000","last_active":"2024-09-19T06:46:00.565756+0000","last_peered":"2024-09-19T06:46:00.565756+0000","last_clean":"2024-09-19T06:46:00.565756+0000","last_became_active":"2024-09-19T06:37:09.429813+0000","last_became_peered":"2024-09-19T06:37:09.429813+0000","last_unstale":"2024-09-19T06:46:00.565756+0000","last_undegraded":"2024-09-19T06:46:00.565756+0000","last_fullsized":"2024-09-19T06:46:00.565756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:10.353834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"34'6","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:36.179265+0000","last_change":"2024-09-19T06:37:51.782148+0000","last_active":"2024-09-19T06:46:36.179265+0000","last_peered":"2024-09-19T06:46:36.179265+0000","last_clean":"2024-09-19T06:46:36.179265+0000","last_became_active":"2024-09-19T06:37:51.781695+0000","last_became_peered":"2024-09-19T06:37:51.781695+0000","last_unstale":"2024-09-19T06:46:36.179265+0000","last_undegraded":"2024-09-19T06:46:36.179265+0000","last_fullsized":"2024-09-19T06:46:36.179265+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"34'7","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:24.072687+0000","last_change":"2024-09-19T06:37:09.446789+0000","last_active":"2024-09-19T06:46:24.072687+0000","last_peered":"2024-09-19T06:46:24.072687+0000","last_clean":"2024-09-19T06:46:24.072687+0000","last_became_active":"2024-09-19T06:37:09.446557+0000","last_became_peered":"2024-09-19T06:37:09.446557+0000","last_unstale":"2024-09-19T06:46:24.072687+0000","last_undegraded":"2024-09-19T06:46:24.072687+0000","last_fullsized":"2024-09-19T06:46:24.072687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:01.408967+0000","last_change":"2024-09-19T06:37:09.448093+0000","last_active":"2024-09-19T06:46:01.408967+0000","last_peered":"2024-09-19T06:46:01.408967+0000","last_clean":"2024-09-19T06:46:01.408967+0000","last_became_active":"2024-09-19T06:37:09.447753+0000","last_became_peered":"2024-09-19T06:37:09.447753+0000","last_unstale":"2024-09-19T06:46:01.408967+0000","last_undegraded":"2024-09-19T06:46:01.408967+0000","last_fullsized":"2024-09-19T06:46:01.408967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:00.566032+0000","last_change":"2024-09-19T06:37:09.442798+0000","last_active":"2024-09-19T06:46:00.566032+0000","last_peered":"2024-09-19T06:46:00.566032+0000","last_clean":"2024-09-19T06:46:00.566032+0000","last_became_active":"2024-09-19T06:37:09.442047+0000","last_became_peered":"2024-09-19T06:37:09.442047+0000","last_unstale":"2024-09-19T06:46:00.566032+0000","last_undegraded":"2024-09-19T06:46:00.566032+0000","last_fullsized":"2024-09-19T06:46:00.566032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:08.416020+0000","last_clean_scrub_stamp":"2024-09-19T06:37:08.416020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:33.193185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":7963246409,"num_objects":2089,"num_object_clones":0,"num_object_copies":8356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2089,"num_whiteouts":0,"num_read":1242,"num_read_kb":0,"num_write":2245731,"num_write_kb":28311472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8874610688,"data_stored":15121104896,"data_compressed":833629897,"data_compressed_allocated":3308228608,"data_compressed_original":9554722816,"omap_allocated":0,"internal_metadata":0},"log_size":154952,"ondisk_log_size":154952,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":513,"ondisk_log_size":513,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65543337,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":467,"num_read_kb":289484,"num_write":3831,"num_write_kb":66950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33423360,"data_stored":131086075,"data_compressed":14183544,"data_compressed_allocated":17063936,"data_compressed_original":114794496,"omap_allocated":0,"internal_metadata":0},"log_size":3717,"ondisk_log_size":3717,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65040,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509559,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1552132,"kb_used_data":863540,"kb_used_omap":1,"kb_used_meta":688574,"kb_avail":92819708,"statfs":{"total":96636764160,"available":95047380992,"internally_reserved":0,"allocated":884264960,"data_stored":1520965601,"data_compressed":84305948,"data_compressed_allocated":333144064,"data_compressed_original":970051584,"omap_allocated":1595,"internal_metadata":705100229},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509558,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2374480,"kb_used_data":1409600,"kb_used_omap":1,"kb_used_meta":964862,"kb_avail":91997360,"statfs":{"total":96636764160,"available":94205296640,"internally_reserved":0,"allocated":1443430400,"data_stored":2478103644,"data_compressed":138199926,"data_compressed_allocated":540020736,"data_compressed_original":1574912000,"omap_allocated":1595,"internal_metadata":988019141},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509558,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1885828,"kb_used_data":1034100,"kb_used_omap":1,"kb_used_meta":851710,"kb_avail":92486012,"statfs":{"total":96636764160,"available":94705676288,"internally_reserved":0,"allocated":1058918400,"data_stored":1821944869,"data_compressed":101590049,"data_compressed_allocated":396070912,"data_compressed_original":1159315456,"omap_allocated":1595,"internal_metadata":872151493},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542263,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1813440,"kb_used_data":881136,"kb_used_omap":1,"kb_used_meta":932286,"kb_avail":92558400,"statfs":{"total":96636764160,"available":94779801600,"internally_reserved":0,"allocated":902283264,"data_stored":1557548013,"data_compressed":87407688,"data_compressed_allocated":337973248,"data_compressed_original":993447936,"omap_allocated":1590,"internal_metadata":954661322},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542261,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2142636,"kb_used_data":1198480,"kb_used_omap":1,"kb_used_meta":942910,"kb_avail":92229204,"statfs":{"total":96636764160,"available":94442704896,"internally_reserved":0,"allocated":1227243520,"data_stored":2110794279,"data_compressed":117499028,"data_compressed_allocated":460365824,"data_compressed_original":1344126976,"omap_allocated":1594,"internal_metadata":965540294},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542260,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2795932,"kb_used_data":1609868,"kb_used_omap":1,"kb_used_meta":1186046,"kb_avail":91575908,"statfs":{"total":96636764160,"available":93773729792,"internally_reserved":0,"allocated":1648504832,"data_stored":2813635172,"data_compressed":155399504,"data_compressed_allocated":613683200,"data_compressed_original":1779027968,"omap_allocated":1593,"internal_metadata":1214511559},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542260,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2553116,"kb_used_data":1316684,"kb_used_omap":1,"kb_used_meta":1233854,"kb_avail":91818724,"statfs":{"total":96636764160,"available":94022373376,"internally_reserved":0,"allocated":1348284416,"data_stored":2298273493,"data_compressed":127676241,"data_compressed_allocated":501948416,"data_compressed_original":1452150784,"omap_allocated":1595,"internal_metadata":1263466949},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,5,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574968,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1672056,"kb_used_data":866408,"kb_used_omap":1,"kb_used_meta":805630,"kb_avail":92699784,"statfs":{"total":96636764160,"available":94924578816,"internally_reserved":0,"allocated":887201792,"data_stored":1517459396,"data_compressed":83506772,"data_compressed_allocated":330522624,"data_compressed_original":960987136,"omap_allocated":1595,"internal_metadata":824965573},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4018176,"data_stored":20972158,"data_compressed":2327138,"data_compressed_allocated":2707456,"data_compressed_original":19673088,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3342336,"data_stored":15116110,"data_compressed":1678240,"data_compressed_allocated":2064384,"data_compressed_original":13848576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":94269,"data_compressed":5056,"data_compressed_allocated":8192,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5230592,"data_stored":12677853,"data_compressed":1395672,"data_compressed_allocated":1748992,"data_compressed_original":9207808,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5451776,"data_stored":23504085,"data_compressed":2577869,"data_compressed_allocated":3006464,"data_compressed_original":21073920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1662976,"data_stored":8388698,"data_compressed":865550,"data_compressed_allocated":1097728,"data_compressed_original":7827456,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3923968,"data_stored":16777888,"data_compressed":1995942,"data_compressed_allocated":2461696,"data_compressed_original":15323136,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9711616,"data_stored":33555014,"data_compressed":3338077,"data_compressed_allocated":3969024,"data_compressed_original":27815936,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":975716352,"data_stored":1665998848,"data_compressed":92003336,"data_compressed_allocated":364347392,"data_compressed_original":1054629888,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1311096832,"data_stored":2217979904,"data_compressed":122288084,"data_compressed_allocated":485093376,"data_compressed_original":1391976448,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":788066304,"data_stored":1336844288,"data_compressed":73372789,"data_compressed_allocated":291475456,"data_compressed_original":840253440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1528545280,"data_stored":2607853568,"data_compressed":143613202,"data_compressed_allocated":570064896,"data_compressed_original":1649373184,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1375895552,"data_stored":2349576192,"data_compressed":130012550,"data_compressed_allocated":514473984,"data_compressed_original":1488154624,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":878321664,"data_stored":1506119680,"data_compressed":83153760,"data_compressed_allocated":330813440,"data_compressed_original":958611456,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1161961472,"data_stored":1984798720,"data_compressed":109269767,"data_compressed_allocated":434434048,"data_compressed_original":1257271296,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":855007232,"data_stored":1451933696,"data_compressed":79916409,"data_compressed_allocated":317526016,"data_compressed_original":914452480,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:46:39.930 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.931 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.931 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.931 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.931 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.931 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.931 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.931 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.931 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.931 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.932 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.932 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.932 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.932 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.932 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.932 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.932 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.932 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.932 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.933 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.933 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.933 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.933 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.933 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.933 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.933 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.934 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.934 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.934 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.934 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.934 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.934 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.934 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.934 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.934 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.934 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.935 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.935 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.935 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.935 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.935 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.935 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.935 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.936 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.936 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.936 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.936 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.936 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-19T06:36:57.771085+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=36, tm_sec=57, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.936 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.936 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.936 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.937 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.937 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.937 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.937 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.937 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.937 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.937 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.937 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.937 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.938 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.938 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.938 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.938 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.938 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.938 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.938 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.938 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.938 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.939 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.939 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.939 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.939 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.939 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.939 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.940 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.940 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.940 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.940 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.940 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.940 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.940 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.940 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.941 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.941 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.941 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.941 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.941 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.941 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.941 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.941 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.942 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-09-19T06:37:07.406818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.942 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.942 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.942 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.942 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.942 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.942 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.942 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.942 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.943 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.943 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.943 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.943 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.943 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.943 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.943 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.943 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.943 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.944 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.944 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.944 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.944 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.944 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.944 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.944 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.944 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.944 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.945 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.945 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.945 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.945 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.945 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.945 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.945 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-19T06:37:08.416020+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:46:39.945 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-19T06:46:59.947 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:47:00.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.056+0000 7f01f40af640 1 Processor -- start 2024-09-19T06:47:00.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.056+0000 7f01f40af640 1 -- start start 2024-09-19T06:47:00.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.057+0000 7f01f40af640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01ec154ed0 0x7f01ec0c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:00.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.057+0000 7f01f40af640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01ec06ddb0 con 0x7f01ec15e560 2024-09-19T06:47:00.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.057+0000 7f01f40af640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01ec072da0 con 0x7f01ec06bbc0 2024-09-19T06:47:00.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.057+0000 7f01f40af640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f01ec06d210 con 0x7f01ec154ed0 2024-09-19T06:47:00.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.057+0000 7f01f264c640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f01ec15e560 0x7f01ec15ea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:59062/0 (socket says 172.21.15.86:59062) 2024-09-19T06:47:00.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.057+0000 7f01f264c640 1 -- 172.21.15.86:0/76680451 learned_addr learned my addr 172.21.15.86:0/76680451 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:47:00.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.057+0000 7f01f0e49640 1 -- 172.21.15.86:0/76680451 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2674261513 0 0) 0x7f01dc001490 con 0x7f01ec15e560 2024-09-19T06:47:00.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.057+0000 7f01f1e4b640 1 --2- 172.21.15.86:0/76680451 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01ec154ed0 0x7f01ec0c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:00.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.057+0000 7f01f0e49640 1 -- 172.21.15.86:0/76680451 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01d4003520 con 0x7f01ec15e560 2024-09-19T06:47:00.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.058+0000 7f01f0e49640 1 -- 172.21.15.86:0/76680451 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1579007264 0 0) 0x7f01d4003520 con 0x7f01ec15e560 2024-09-19T06:47:00.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.058+0000 7f01f0e49640 1 -- 172.21.15.86:0/76680451 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01ec154ed0 msgr2=0x7f01ec0c9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:00.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.058+0000 7f01f0e49640 1 --2- 172.21.15.86:0/76680451 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01ec154ed0 0x7f01ec0c9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:00.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.058+0000 7f01f0e49640 1 -- 172.21.15.86:0/76680451 >> v1:172.21.15.169:6789/0 conn(0x7f01ec06bbc0 legacy=0x7f01ec06d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:00.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.058+0000 7f01f0e49640 1 -- 172.21.15.86:0/76680451 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01ec073040 con 0x7f01ec15e560 2024-09-19T06:47:00.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.058+0000 7f01f0e49640 1 -- 172.21.15.86:0/76680451 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f01dc001bc0 con 0x7f01ec15e560 2024-09-19T06:47:00.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.058+0000 7f01f0e49640 1 -- 172.21.15.86:0/76680451 >> v1:172.21.15.86:6789/0 conn(0x7f01ec15e560 legacy=0x7f01ec15ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:00.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.058+0000 7f01f0e49640 1 --2- 172.21.15.86:0/76680451 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01ec154ed0 0x7f01d40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:00.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.058+0000 7f01f0e49640 1 --2- 172.21.15.86:0/76680451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01d4003f60 0x7f01d4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:00.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.058+0000 7f01f0e49640 1 --2- 172.21.15.86:0/76680451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01d4004d40 0x7f01d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:00.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.058+0000 7f01f0e49640 1 -- 172.21.15.86:0/76680451 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f01ec06d210 con 0x7f01d4003f60 2024-09-19T06:47:00.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.058+0000 7f01f0e49640 1 -- 172.21.15.86:0/76680451 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f01d400bb50 con 0x7f01d4004d40 2024-09-19T06:47:00.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.058+0000 7f01f0e49640 1 -- 172.21.15.86:0/76680451 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f01d400bd50 con 0x7f01ec154ed0 2024-09-19T06:47:00.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.058+0000 7f01f164a640 1 --2- 172.21.15.86:0/76680451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01d4003f60 0x7f01d4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:00.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.058+0000 7f01f1e4b640 1 --2- 172.21.15.86:0/76680451 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01ec154ed0 0x7f01d40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:00.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.058+0000 7f01f264c640 1 --2- 172.21.15.86:0/76680451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01d4004d40 0x7f01d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:00.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.058+0000 7f01f164a640 1 -- 172.21.15.86:0/76680451 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01ec154ed0 msgr2=0x7f01d40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:00.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.058+0000 7f01f164a640 1 --2- 172.21.15.86:0/76680451 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01ec154ed0 0x7f01d40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:00.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.058+0000 7f01f164a640 1 -- 172.21.15.86:0/76680451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01d4004d40 msgr2=0x7f01d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:00.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.058+0000 7f01f164a640 1 --2- 172.21.15.86:0/76680451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01d4004d40 0x7f01d40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:00.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.058+0000 7f01f164a640 1 -- 172.21.15.86:0/76680451 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01d4003520 con 0x7f01d4003f60 2024-09-19T06:47:00.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.059+0000 7f01f164a640 1 --2- 172.21.15.86:0/76680451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01d4003f60 0x7f01d4004800 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f01e0001750 tx=0x7f01d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f799bc883dee2912 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:00.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.059+0000 7f01f0e49640 1 -- 172.21.15.86:0/76680451 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e0001370 con 0x7f01d4003f60 2024-09-19T06:47:00.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.059+0000 7f01f0e49640 1 -- 172.21.15.86:0/76680451 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e00052d0 con 0x7f01d4003f60 2024-09-19T06:47:00.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.059+0000 7f01f0e49640 1 -- 172.21.15.86:0/76680451 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e002abe0 con 0x7f01d4003f60 2024-09-19T06:47:00.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.060+0000 7f01f40af640 1 -- 172.21.15.86:0/76680451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01d4003f60 msgr2=0x7f01d4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:00.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.060+0000 7f01f40af640 1 --2- 172.21.15.86:0/76680451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01d4003f60 0x7f01d4004800 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f01e0001750 tx=0x7f01d4005830 comp rx=0 tx=0).stop 2024-09-19T06:47:00.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.060+0000 7f01f264c640 1 -- 172.21.15.86:0/76680451 reap_dead start 2024-09-19T06:47:00.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.060+0000 7f01f40af640 1 -- 172.21.15.86:0/76680451 shutdown_connections 2024-09-19T06:47:00.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.060+0000 7f01f40af640 1 -- 172.21.15.86:0/76680451 >> 172.21.15.86:0/76680451 conn(0x7f01ec0ca320 msgr2=0x7f01ec0ca730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:00.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.060+0000 7f01f40af640 1 -- 172.21.15.86:0/76680451 shutdown_connections 2024-09-19T06:47:00.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.060+0000 7f01f40af640 1 -- 172.21.15.86:0/76680451 wait complete. 2024-09-19T06:47:00.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.061+0000 7f01f40af640 1 Processor -- start 2024-09-19T06:47:00.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.061+0000 7f01f40af640 1 -- start start 2024-09-19T06:47:00.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.062+0000 7f01f40af640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01d4003f60 0x7f01ec1581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:00.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.062+0000 7f01f40af640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01ec1e5e70 0x7f01ec14ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:00.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.062+0000 7f01f40af640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01ec15e160 0x7f01ec14f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:00.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.062+0000 7f01f40af640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f01ec0c8220 con 0x7f01ec15e160 2024-09-19T06:47:00.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.062+0000 7f01f40af640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f01ec072b40 con 0x7f01d4003f60 2024-09-19T06:47:00.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.062+0000 7f01f40af640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f01ec1552b0 con 0x7f01ec1e5e70 2024-09-19T06:47:00.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.062+0000 7f01f264c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01ec15e160 0x7f01ec14f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:00.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.062+0000 7f01f264c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01ec15e160 0x7f01ec14f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50700/0 (socket says 172.21.15.86:50700) 2024-09-19T06:47:00.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.062+0000 7f01f264c640 1 -- 172.21.15.86:0/179245229 learned_addr learned my addr 172.21.15.86:0/179245229 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:47:00.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.062+0000 7f01f164a640 1 --2- 172.21.15.86:0/179245229 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01ec1e5e70 0x7f01ec14ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:00.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.062+0000 7f01f1e4b640 1 --2- 172.21.15.86:0/179245229 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01d4003f60 0x7f01ec1581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:00.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.062+0000 7f01f264c640 1 -- 172.21.15.86:0/179245229 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01ec1e5e70 msgr2=0x7f01ec14ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:00.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.062+0000 7f01f264c640 1 --2- 172.21.15.86:0/179245229 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01ec1e5e70 0x7f01ec14ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:00.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.062+0000 7f01f264c640 1 -- 172.21.15.86:0/179245229 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01d4003f60 msgr2=0x7f01ec1581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:00.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.062+0000 7f01f264c640 1 --2- 172.21.15.86:0/179245229 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01d4003f60 0x7f01ec1581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:00.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.062+0000 7f01f264c640 1 -- 172.21.15.86:0/179245229 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01ec0c8d00 con 0x7f01ec15e160 2024-09-19T06:47:00.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.062+0000 7f01f264c640 1 --2- 172.21.15.86:0/179245229 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01ec15e160 0x7f01ec14f240 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f01ec15e940 tx=0x7f01dc00aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:00.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.062+0000 7f01ea7fc640 1 -- 172.21.15.86:0/179245229 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01dc007860 con 0x7f01ec15e160 2024-09-19T06:47:00.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.062+0000 7f01ea7fc640 1 -- 172.21.15.86:0/179245229 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01dc018070 con 0x7f01ec15e160 2024-09-19T06:47:00.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.062+0000 7f01f40af640 1 -- 172.21.15.86:0/179245229 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01ec1f08d0 con 0x7f01ec15e160 2024-09-19T06:47:00.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.062+0000 7f01ea7fc640 1 -- 172.21.15.86:0/179245229 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01dc0133f0 con 0x7f01ec15e160 2024-09-19T06:47:00.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.062+0000 7f01f40af640 1 -- 172.21.15.86:0/179245229 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01ec1f0e70 con 0x7f01ec15e160 2024-09-19T06:47:00.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.063+0000 7f01f40af640 1 -- 172.21.15.86:0/179245229 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01ec0caed0 con 0x7f01ec15e160 2024-09-19T06:47:00.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.064+0000 7f01ea7fc640 1 -- 172.21.15.86:0/179245229 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f01dc013590 con 0x7f01ec15e160 2024-09-19T06:47:00.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.064+0000 7f01ea7fc640 1 --2- 172.21.15.86:0/179245229 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f01d806c2b0 0x7f01d806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:00.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.064+0000 7f01ea7fc640 1 -- 172.21.15.86:0/179245229 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7f01dc08c060 con 0x7f01ec15e160 2024-09-19T06:47:00.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.064+0000 7f01f1e4b640 1 --2- 172.21.15.86:0/179245229 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f01d806c2b0 0x7f01d806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:00.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.065+0000 7f01f1e4b640 1 --2- 172.21.15.86:0/179245229 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f01d806c2b0 0x7f01d806e770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f01e4009bc0 tx=0x7f01e4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:00.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.069+0000 7f01ea7fc640 1 -- 172.21.15.86:0/179245229 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f01ec06ddb0 con 0x7f01ec15e160 2024-09-19T06:47:00.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.233+0000 7f01f40af640 1 -- 172.21.15.86:0/179245229 --> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f01ec0ccfb0 con 0x7f01d806c2b0 2024-09-19T06:47:00.242 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.241+0000 7f01ea7fc640 1 -- 172.21.15.86:0/179245229 <== mgr.4105 v2:172.21.15.86:6816/4165134248 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335002 (secure 0 0 0) 0x7f01ec0ccfb0 con 0x7f01d806c2b0 2024-09-19T06:47:00.246 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:47:00.247 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-09-19T06:47:00.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.244+0000 7f01f40af640 1 -- 172.21.15.86:0/179245229 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f01d806c2b0 msgr2=0x7f01d806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:00.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.244+0000 7f01f40af640 1 --2- 172.21.15.86:0/179245229 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f01d806c2b0 0x7f01d806e770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f01e4009bc0 tx=0x7f01e4009190 comp rx=0 tx=0).stop 2024-09-19T06:47:00.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.244+0000 7f01f40af640 1 -- 172.21.15.86:0/179245229 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01ec15e160 msgr2=0x7f01ec14f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:00.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.244+0000 7f01f40af640 1 --2- 172.21.15.86:0/179245229 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01ec15e160 0x7f01ec14f240 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f01ec15e940 tx=0x7f01dc00aea0 comp rx=0 tx=0).stop 2024-09-19T06:47:00.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.244+0000 7f01f40af640 1 -- 172.21.15.86:0/179245229 shutdown_connections 2024-09-19T06:47:00.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.244+0000 7f01f40af640 1 --2- 172.21.15.86:0/179245229 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f01d806c2b0 0x7f01d806e770 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:00.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.244+0000 7f01f40af640 1 --2- 172.21.15.86:0/179245229 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01ec15e160 0x7f01ec14f240 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:00.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.244+0000 7f01f40af640 1 --2- 172.21.15.86:0/179245229 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01ec1e5e70 0x7f01ec14ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:00.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.244+0000 7f01f40af640 1 --2- 172.21.15.86:0/179245229 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01d4003f60 0x7f01ec1581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:00.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.244+0000 7f01f40af640 1 -- 172.21.15.86:0/179245229 >> 172.21.15.86:0/179245229 conn(0x7f01ec0ca320 msgr2=0x7f01ec071eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:00.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.244+0000 7f01f40af640 1 -- 172.21.15.86:0/179245229 shutdown_connections 2024-09-19T06:47:00.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:00.244+0000 7f01f40af640 1 -- 172.21.15.86:0/179245229 wait complete. 2024-09-19T06:47:00.257 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-09-19T06:46:59.926616+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":66133705,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":1825,"num_read_kb":289584,"num_write":2251821,"num_write_kb":28380840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":80682,"num_omap_keys":138,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162016,"ondisk_log_size":162016,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7860736,"kb_used_data":35648,"kb_used_omap":12,"kb_used_meta":7824947,"kb_avail":747113984,"statfs":{"total":773094113280,"available":765044719616,"internally_reserved":0,"allocated":36503552,"data_stored":133593546,"data_compressed":14248584,"data_compressed_allocated":17154048,"data_compressed_original":115941376,"omap_allocated":12752,"internal_metadata":8012746288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1545961289,"num_objects":-568,"num_object_clones":0,"num_object_copies":-2254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-568,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":569,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003216"},"pg_stats":[{"pgid":"2.1f","version":"34'15","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:36.785679+0000","last_change":"2024-09-19T06:46:36.785730+0000","last_active":"2024-09-19T06:46:36.785679+0000","last_peered":"2024-09-19T06:46:36.785679+0000","last_clean":"2024-09-19T06:46:36.785679+0000","last_became_active":"2024-09-19T06:37:08.446044+0000","last_became_peered":"2024-09-19T06:37:08.446044+0000","last_unstale":"2024-09-19T06:46:36.785679+0000","last_undegraded":"2024-09-19T06:46:36.785679+0000","last_fullsized":"2024-09-19T06:46:36.785679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-19T06:46:36.785571+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-19T06:46:36.785571+0000","last_clean_scrub_stamp":"2024-09-19T06:46:36.785571+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:12:09.975071+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":20504,"num_write":9,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:38.201144+0000","last_change":"2024-09-19T06:46:38.201144+0000","last_active":"2024-09-19T06:46:38.201144+0000","last_peered":"2024-09-19T06:46:38.201144+0000","last_clean":"2024-09-19T06:46:38.201144+0000","last_became_active":"2024-09-19T06:37:09.440839+0000","last_became_peered":"2024-09-19T06:37:09.440839+0000","last_unstale":"2024-09-19T06:46:38.201144+0000","last_undegraded":"2024-09-19T06:46:38.201144+0000","last_fullsized":"2024-09-19T06:46:38.201144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-19T06:46:38.201034+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-19T06:46:38.201034+0000","last_clean_scrub_stamp":"2024-09-19T06:46:38.201034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:39.058818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'5214","reported_seq":5296,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:51.147650+0000","last_change":"2024-09-19T06:46:51.147698+0000","last_active":"2024-09-19T06:46:51.147650+0000","last_peered":"2024-09-19T06:46:51.147650+0000","last_clean":"2024-09-19T06:46:51.147650+0000","last_became_active":"2024-09-19T06:37:13.460936+0000","last_became_peered":"2024-09-19T06:37:13.460936+0000","last_unstale":"2024-09-19T06:46:51.147650+0000","last_undegraded":"2024-09-19T06:46:51.147650+0000","last_fullsized":"2024-09-19T06:46:51.147650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5214","last_scrub_stamp":"2024-09-19T06:46:51.147550+0000","last_deep_scrub":"34'5214","last_deep_scrub_stamp":"2024-09-19T06:46:51.147550+0000","last_clean_scrub_stamp":"2024-09-19T06:46:51.147550+0000","objects_scrubbed":0,"log_size":5214,"log_dups_size":0,"ondisk_log_size":5214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:17.662938+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":74780,"num_write_kb":941501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"34'31","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.261659+0000","last_change":"2024-09-19T06:46:41.272080+0000","last_active":"2024-09-19T06:46:48.261659+0000","last_peered":"2024-09-19T06:46:48.261659+0000","last_clean":"2024-09-19T06:46:48.261659+0000","last_became_active":"2024-09-19T06:37:08.437921+0000","last_became_peered":"2024-09-19T06:37:08.437921+0000","last_unstale":"2024-09-19T06:46:48.261659+0000","last_undegraded":"2024-09-19T06:46:48.261659+0000","last_fullsized":"2024-09-19T06:46:48.261659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'25","last_scrub_stamp":"2024-09-19T06:46:41.271976+0000","last_deep_scrub":"34'25","last_deep_scrub_stamp":"2024-09-19T06:46:41.271976+0000","last_clean_scrub_stamp":"2024-09-19T06:46:41.271976+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:03.734934+0000","scrub_duration":77,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":24576,"num_write":23,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7663,"num_omap_keys":13,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"34'15","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.114493+0000","last_change":"2024-09-19T06:46:45.749492+0000","last_active":"2024-09-19T06:46:48.114493+0000","last_peered":"2024-09-19T06:46:48.114493+0000","last_clean":"2024-09-19T06:46:48.114493+0000","last_became_active":"2024-09-19T06:37:09.450430+0000","last_became_peered":"2024-09-19T06:37:09.450430+0000","last_unstale":"2024-09-19T06:46:48.114493+0000","last_undegraded":"2024-09-19T06:46:48.114493+0000","last_fullsized":"2024-09-19T06:46:48.114493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-19T06:46:45.749353+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-19T06:46:45.749353+0000","last_clean_scrub_stamp":"2024-09-19T06:46:45.749353+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:04.391233+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"34'4911","reported_seq":5000,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.308505+0000","last_change":"2024-09-19T06:46:46.037111+0000","last_active":"2024-09-19T06:46:48.308505+0000","last_peered":"2024-09-19T06:46:48.308505+0000","last_clean":"2024-09-19T06:46:48.308505+0000","last_became_active":"2024-09-19T06:37:13.459040+0000","last_became_peered":"2024-09-19T06:37:13.459040+0000","last_unstale":"2024-09-19T06:46:48.308505+0000","last_undegraded":"2024-09-19T06:46:48.308505+0000","last_fullsized":"2024-09-19T06:46:48.308505+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4901","last_scrub_stamp":"2024-09-19T06:46:46.036984+0000","last_deep_scrub":"34'4901","last_deep_scrub_stamp":"2024-09-19T06:46:46.036984+0000","last_clean_scrub_stamp":"2024-09-19T06:46:46.036984+0000","objects_scrubbed":10,"log_size":4911,"log_dups_size":0,"ondisk_log_size":4911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:54.630970+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":70679,"num_write_kb":897029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"34'340","reported_seq":410,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.187346+0000","last_change":"2024-09-19T06:46:48.086072+0000","last_active":"2024-09-19T06:46:48.187346+0000","last_peered":"2024-09-19T06:46:48.187346+0000","last_clean":"2024-09-19T06:46:48.187346+0000","last_became_active":"2024-09-19T06:37:08.447559+0000","last_became_peered":"2024-09-19T06:37:08.447559+0000","last_unstale":"2024-09-19T06:46:48.187346+0000","last_undegraded":"2024-09-19T06:46:48.187346+0000","last_fullsized":"2024-09-19T06:46:48.187346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'337","last_scrub_stamp":"2024-09-19T06:46:48.085929+0000","last_deep_scrub":"34'337","last_deep_scrub_stamp":"2024-09-19T06:46:48.085929+0000","last_clean_scrub_stamp":"2024-09-19T06:46:48.085929+0000","objects_scrubbed":3,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:36.858379+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":35254,"num_write":321,"num_write_kb":8395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"34'8","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:49.593835+0000","last_change":"2024-09-19T06:46:49.593857+0000","last_active":"2024-09-19T06:46:49.593835+0000","last_peered":"2024-09-19T06:46:49.593835+0000","last_clean":"2024-09-19T06:46:49.593835+0000","last_became_active":"2024-09-19T06:37:09.444806+0000","last_became_peered":"2024-09-19T06:37:09.444806+0000","last_unstale":"2024-09-19T06:46:49.593835+0000","last_undegraded":"2024-09-19T06:46:49.593835+0000","last_fullsized":"2024-09-19T06:46:49.593835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-19T06:46:49.593766+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-19T06:46:49.593766+0000","last_clean_scrub_stamp":"2024-09-19T06:46:49.593766+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:35.262785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4844","reported_seq":4934,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.316267+0000","last_change":"2024-09-19T06:46:44.108462+0000","last_active":"2024-09-19T06:46:48.316267+0000","last_peered":"2024-09-19T06:46:48.316267+0000","last_clean":"2024-09-19T06:46:48.316267+0000","last_became_active":"2024-09-19T06:37:13.458588+0000","last_became_peered":"2024-09-19T06:37:13.458588+0000","last_unstale":"2024-09-19T06:46:48.316267+0000","last_undegraded":"2024-09-19T06:46:48.316267+0000","last_fullsized":"2024-09-19T06:46:48.316267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4811","last_scrub_stamp":"2024-09-19T06:46:44.108271+0000","last_deep_scrub":"34'4811","last_deep_scrub_stamp":"2024-09-19T06:46:44.108271+0000","last_clean_scrub_stamp":"2024-09-19T06:46:44.108271+0000","objects_scrubbed":32,"log_size":4844,"log_dups_size":0,"ondisk_log_size":4844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:29.008216+0000","scrub_duration":202,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":0,"num_write":68596,"num_write_kb":860659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:45.063400+0000","last_change":"2024-09-19T06:46:45.063400+0000","last_active":"2024-09-19T06:46:45.063400+0000","last_peered":"2024-09-19T06:46:45.063400+0000","last_clean":"2024-09-19T06:46:45.063400+0000","last_became_active":"2024-09-19T06:37:08.446053+0000","last_became_peered":"2024-09-19T06:37:08.446053+0000","last_unstale":"2024-09-19T06:46:45.063400+0000","last_undegraded":"2024-09-19T06:46:45.063400+0000","last_fullsized":"2024-09-19T06:46:45.063400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-19T06:46:45.063250+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-19T06:46:45.063250+0000","last_clean_scrub_stamp":"2024-09-19T06:46:45.063250+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:26.966590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"34'12","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.188179+0000","last_change":"2024-09-19T06:46:47.500639+0000","last_active":"2024-09-19T06:46:48.188179+0000","last_peered":"2024-09-19T06:46:48.188179+0000","last_clean":"2024-09-19T06:46:48.188179+0000","last_became_active":"2024-09-19T06:37:09.444824+0000","last_became_peered":"2024-09-19T06:37:09.444824+0000","last_unstale":"2024-09-19T06:46:48.188179+0000","last_undegraded":"2024-09-19T06:46:48.188179+0000","last_fullsized":"2024-09-19T06:46:48.188179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-19T06:46:47.500501+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-19T06:46:47.500501+0000","last_clean_scrub_stamp":"2024-09-19T06:46:47.500501+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:25.464380+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'4171","reported_seq":4241,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.227987+0000","last_change":"2024-09-19T06:46:47.635152+0000","last_active":"2024-09-19T06:46:48.227987+0000","last_peered":"2024-09-19T06:46:48.227987+0000","last_clean":"2024-09-19T06:46:48.227987+0000","last_became_active":"2024-09-19T06:37:13.459350+0000","last_became_peered":"2024-09-19T06:37:13.459350+0000","last_unstale":"2024-09-19T06:46:48.227987+0000","last_undegraded":"2024-09-19T06:46:48.227987+0000","last_fullsized":"2024-09-19T06:46:48.227987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4166","last_scrub_stamp":"2024-09-19T06:46:47.634616+0000","last_deep_scrub":"34'4166","last_deep_scrub_stamp":"2024-09-19T06:46:47.634616+0000","last_clean_scrub_stamp":"2024-09-19T06:46:47.634616+0000","objects_scrubbed":5,"log_size":4171,"log_dups_size":0,"ondisk_log_size":4171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:56.884358+0000","scrub_duration":633,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":59523,"num_write_kb":744923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"34'9","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:46.546972+0000","last_change":"2024-09-19T06:46:46.546972+0000","last_active":"2024-09-19T06:46:46.546972+0000","last_peered":"2024-09-19T06:46:46.546972+0000","last_clean":"2024-09-19T06:46:46.546972+0000","last_became_active":"2024-09-19T06:37:09.447502+0000","last_became_peered":"2024-09-19T06:37:09.447502+0000","last_unstale":"2024-09-19T06:46:46.546972+0000","last_undegraded":"2024-09-19T06:46:46.546972+0000","last_fullsized":"2024-09-19T06:46:46.546972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-19T06:46:46.546813+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-19T06:46:46.546813+0000","last_clean_scrub_stamp":"2024-09-19T06:46:46.546813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:57.988739+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"34'584","reported_seq":646,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.251275+0000","last_change":"2024-09-19T06:46:43.103359+0000","last_active":"2024-09-19T06:46:48.251275+0000","last_peered":"2024-09-19T06:46:48.251275+0000","last_clean":"2024-09-19T06:46:48.251275+0000","last_became_active":"2024-09-19T06:37:08.445834+0000","last_became_peered":"2024-09-19T06:37:08.445834+0000","last_unstale":"2024-09-19T06:46:48.251275+0000","last_undegraded":"2024-09-19T06:46:48.251275+0000","last_fullsized":"2024-09-19T06:46:48.251275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'580","last_scrub_stamp":"2024-09-19T06:46:43.103223+0000","last_deep_scrub":"34'580","last_deep_scrub_stamp":"2024-09-19T06:46:43.103223+0000","last_clean_scrub_stamp":"2024-09-19T06:46:43.103223+0000","objects_scrubbed":2,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:07.870431+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":20492,"num_write":569,"num_write_kb":4620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"34'4940","reported_seq":5011,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.351603+0000","last_change":"2024-09-19T06:46:48.351603+0000","last_active":"2024-09-19T06:46:48.351603+0000","last_peered":"2024-09-19T06:46:48.351603+0000","last_clean":"2024-09-19T06:46:48.351603+0000","last_became_active":"2024-09-19T06:37:13.459967+0000","last_became_peered":"2024-09-19T06:37:13.459967+0000","last_unstale":"2024-09-19T06:46:48.351603+0000","last_undegraded":"2024-09-19T06:46:48.351603+0000","last_fullsized":"2024-09-19T06:46:48.351603+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4940","last_scrub_stamp":"2024-09-19T06:46:48.351514+0000","last_deep_scrub":"34'4940","last_deep_scrub_stamp":"2024-09-19T06:46:48.351514+0000","last_clean_scrub_stamp":"2024-09-19T06:46:48.351514+0000","objects_scrubbed":1,"log_size":4940,"log_dups_size":0,"ondisk_log_size":4940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:03:27.133673+0000","scrub_duration":365,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":70172,"num_write_kb":882801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"34'9","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:49.119576+0000","last_change":"2024-09-19T06:46:49.119623+0000","last_active":"2024-09-19T06:46:49.119576+0000","last_peered":"2024-09-19T06:46:49.119576+0000","last_clean":"2024-09-19T06:46:49.119576+0000","last_became_active":"2024-09-19T06:37:09.449645+0000","last_became_peered":"2024-09-19T06:37:09.449645+0000","last_unstale":"2024-09-19T06:46:49.119576+0000","last_undegraded":"2024-09-19T06:46:49.119576+0000","last_fullsized":"2024-09-19T06:46:49.119576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-19T06:46:49.119479+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-19T06:46:49.119479+0000","last_clean_scrub_stamp":"2024-09-19T06:46:49.119479+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:12.924433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.178226+0000","last_change":"2024-09-19T06:46:40.544292+0000","last_active":"2024-09-19T06:46:48.178226+0000","last_peered":"2024-09-19T06:46:48.178226+0000","last_clean":"2024-09-19T06:46:48.178226+0000","last_became_active":"2024-09-19T06:37:08.436761+0000","last_became_peered":"2024-09-19T06:37:08.436761+0000","last_unstale":"2024-09-19T06:46:48.178226+0000","last_undegraded":"2024-09-19T06:46:48.178226+0000","last_fullsized":"2024-09-19T06:46:48.178226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:46:40.544137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:46:40.544137+0000","last_clean_scrub_stamp":"2024-09-19T06:46:40.544137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:59.708199+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'5125","reported_seq":5219,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:51.984832+0000","last_change":"2024-09-19T06:46:51.984858+0000","last_active":"2024-09-19T06:46:51.984832+0000","last_peered":"2024-09-19T06:46:51.984832+0000","last_clean":"2024-09-19T06:46:51.984832+0000","last_became_active":"2024-09-19T06:37:51.782257+0000","last_became_peered":"2024-09-19T06:37:51.782257+0000","last_unstale":"2024-09-19T06:46:51.984832+0000","last_undegraded":"2024-09-19T06:46:51.984832+0000","last_fullsized":"2024-09-19T06:46:51.984832+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5125","last_scrub_stamp":"2024-09-19T06:46:51.984726+0000","last_deep_scrub":"34'5125","last_deep_scrub_stamp":"2024-09-19T06:46:51.984726+0000","last_clean_scrub_stamp":"2024-09-19T06:46:51.984726+0000","objects_scrubbed":0,"log_size":5125,"log_dups_size":0,"ondisk_log_size":5125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:40.714720+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":0,"num_write":72356,"num_write_kb":909964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"34'9","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:44.196908+0000","last_change":"2024-09-19T06:46:44.196908+0000","last_active":"2024-09-19T06:46:44.196908+0000","last_peered":"2024-09-19T06:46:44.196908+0000","last_clean":"2024-09-19T06:46:44.196908+0000","last_became_active":"2024-09-19T06:37:09.432589+0000","last_became_peered":"2024-09-19T06:37:09.432589+0000","last_unstale":"2024-09-19T06:46:44.196908+0000","last_undegraded":"2024-09-19T06:46:44.196908+0000","last_fullsized":"2024-09-19T06:46:44.196908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-19T06:46:44.196818+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-19T06:46:44.196818+0000","last_clean_scrub_stamp":"2024-09-19T06:46:44.196818+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:04.814968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"34'3","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.203540+0000","last_change":"2024-09-19T06:46:43.673563+0000","last_active":"2024-09-19T06:46:48.203540+0000","last_peered":"2024-09-19T06:46:48.203540+0000","last_clean":"2024-09-19T06:46:48.203540+0000","last_became_active":"2024-09-19T06:37:08.444160+0000","last_became_peered":"2024-09-19T06:37:08.444160+0000","last_unstale":"2024-09-19T06:46:48.203540+0000","last_undegraded":"2024-09-19T06:46:48.203540+0000","last_fullsized":"2024-09-19T06:46:48.203540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:46:43.673440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:46:43.673440+0000","last_clean_scrub_stamp":"2024-09-19T06:46:43.673440+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:19.134164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"34'5699","reported_seq":5783,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:52.594978+0000","last_change":"2024-09-19T06:46:52.595002+0000","last_active":"2024-09-19T06:46:52.594978+0000","last_peered":"2024-09-19T06:46:52.594978+0000","last_clean":"2024-09-19T06:46:52.594978+0000","last_became_active":"2024-09-19T06:37:13.465731+0000","last_became_peered":"2024-09-19T06:37:13.465731+0000","last_unstale":"2024-09-19T06:46:52.594978+0000","last_undegraded":"2024-09-19T06:46:52.594978+0000","last_fullsized":"2024-09-19T06:46:52.594978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5699","last_scrub_stamp":"2024-09-19T06:46:52.594881+0000","last_deep_scrub":"34'5699","last_deep_scrub_stamp":"2024-09-19T06:46:52.594881+0000","last_clean_scrub_stamp":"2024-09-19T06:46:52.594881+0000","objects_scrubbed":0,"log_size":5699,"log_dups_size":0,"ondisk_log_size":5699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:02.906977+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":81279,"num_write_kb":1030279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"34'11","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.123734+0000","last_change":"2024-09-19T06:46:38.916752+0000","last_active":"2024-09-19T06:46:48.123734+0000","last_peered":"2024-09-19T06:46:48.123734+0000","last_clean":"2024-09-19T06:46:48.123734+0000","last_became_active":"2024-09-19T06:37:09.436512+0000","last_became_peered":"2024-09-19T06:37:09.436512+0000","last_unstale":"2024-09-19T06:46:48.123734+0000","last_undegraded":"2024-09-19T06:46:48.123734+0000","last_fullsized":"2024-09-19T06:46:48.123734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-19T06:46:38.916601+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-19T06:46:38.916601+0000","last_clean_scrub_stamp":"2024-09-19T06:46:38.916601+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:31.059568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"34'800","reported_seq":856,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.156026+0000","last_change":"2024-09-19T06:46:44.117366+0000","last_active":"2024-09-19T06:46:48.156026+0000","last_peered":"2024-09-19T06:46:48.156026+0000","last_clean":"2024-09-19T06:46:48.156026+0000","last_became_active":"2024-09-19T06:37:08.445845+0000","last_became_peered":"2024-09-19T06:37:08.445845+0000","last_unstale":"2024-09-19T06:46:48.156026+0000","last_undegraded":"2024-09-19T06:46:48.156026+0000","last_fullsized":"2024-09-19T06:46:48.156026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'798","last_scrub_stamp":"2024-09-19T06:46:44.117232+0000","last_deep_scrub":"34'798","last_deep_scrub_stamp":"2024-09-19T06:46:44.117232+0000","last_clean_scrub_stamp":"2024-09-19T06:46:44.117232+0000","objects_scrubbed":1,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:21.348712+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":8706,"num_write":792,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"34'4273","reported_seq":4349,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.966748+0000","last_change":"2024-09-19T06:46:48.966774+0000","last_active":"2024-09-19T06:46:48.966748+0000","last_peered":"2024-09-19T06:46:48.966748+0000","last_clean":"2024-09-19T06:46:48.966748+0000","last_became_active":"2024-09-19T06:37:13.460955+0000","last_became_peered":"2024-09-19T06:37:13.460955+0000","last_unstale":"2024-09-19T06:46:48.966748+0000","last_undegraded":"2024-09-19T06:46:48.966748+0000","last_fullsized":"2024-09-19T06:46:48.966748+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4273","last_scrub_stamp":"2024-09-19T06:46:48.966659+0000","last_deep_scrub":"34'4273","last_deep_scrub_stamp":"2024-09-19T06:46:48.966659+0000","last_clean_scrub_stamp":"2024-09-19T06:46:48.966659+0000","objects_scrubbed":0,"log_size":4273,"log_dups_size":0,"ondisk_log_size":4273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:16.391811+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":60620,"num_write_kb":751027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"34'19","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.043667+0000","last_change":"2024-09-19T06:46:39.785554+0000","last_active":"2024-09-19T06:46:48.043667+0000","last_peered":"2024-09-19T06:46:48.043667+0000","last_clean":"2024-09-19T06:46:48.043667+0000","last_became_active":"2024-09-19T06:37:09.445705+0000","last_became_peered":"2024-09-19T06:37:09.445705+0000","last_unstale":"2024-09-19T06:46:48.043667+0000","last_undegraded":"2024-09-19T06:46:48.043667+0000","last_fullsized":"2024-09-19T06:46:48.043667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-19T06:46:39.785445+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-19T06:46:39.785445+0000","last_clean_scrub_stamp":"2024-09-19T06:46:39.785445+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:29:49.070494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"34'7","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.187466+0000","last_change":"2024-09-19T06:46:43.522802+0000","last_active":"2024-09-19T06:46:48.187466+0000","last_peered":"2024-09-19T06:46:48.187466+0000","last_clean":"2024-09-19T06:46:48.187466+0000","last_became_active":"2024-09-19T06:37:08.445929+0000","last_became_peered":"2024-09-19T06:37:08.445929+0000","last_unstale":"2024-09-19T06:46:48.187466+0000","last_undegraded":"2024-09-19T06:46:48.187466+0000","last_fullsized":"2024-09-19T06:46:48.187466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-19T06:46:43.522665+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-19T06:46:43.522665+0000","last_clean_scrub_stamp":"2024-09-19T06:46:43.522665+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:26.318586+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"34'5020","reported_seq":5104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:50.006128+0000","last_change":"2024-09-19T06:46:50.006153+0000","last_active":"2024-09-19T06:46:50.006128+0000","last_peered":"2024-09-19T06:46:50.006128+0000","last_clean":"2024-09-19T06:46:50.006128+0000","last_became_active":"2024-09-19T06:37:13.462217+0000","last_became_peered":"2024-09-19T06:37:13.462217+0000","last_unstale":"2024-09-19T06:46:50.006128+0000","last_undegraded":"2024-09-19T06:46:50.006128+0000","last_fullsized":"2024-09-19T06:46:50.006128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5020","last_scrub_stamp":"2024-09-19T06:46:50.006033+0000","last_deep_scrub":"34'5020","last_deep_scrub_stamp":"2024-09-19T06:46:50.006033+0000","last_clean_scrub_stamp":"2024-09-19T06:46:50.006033+0000","objects_scrubbed":0,"log_size":5020,"log_dups_size":0,"ondisk_log_size":5020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:13.371194+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":71728,"num_write_kb":902613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"34'13","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.170703+0000","last_change":"2024-09-19T06:46:45.179424+0000","last_active":"2024-09-19T06:46:48.170703+0000","last_peered":"2024-09-19T06:46:48.170703+0000","last_clean":"2024-09-19T06:46:48.170703+0000","last_became_active":"2024-09-19T06:37:09.433897+0000","last_became_peered":"2024-09-19T06:37:09.433897+0000","last_unstale":"2024-09-19T06:46:48.170703+0000","last_undegraded":"2024-09-19T06:46:48.170703+0000","last_fullsized":"2024-09-19T06:46:48.170703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-19T06:46:45.179285+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-19T06:46:45.179285+0000","last_clean_scrub_stamp":"2024-09-19T06:46:45.179285+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:50.508306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"34'174","reported_seq":232,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.150419+0000","last_change":"2024-09-19T06:46:42.701938+0000","last_active":"2024-09-19T06:46:48.150419+0000","last_peered":"2024-09-19T06:46:48.150419+0000","last_clean":"2024-09-19T06:46:48.150419+0000","last_became_active":"2024-09-19T06:37:08.441245+0000","last_became_peered":"2024-09-19T06:37:08.441245+0000","last_unstale":"2024-09-19T06:46:48.150419+0000","last_undegraded":"2024-09-19T06:46:48.150419+0000","last_fullsized":"2024-09-19T06:46:48.150419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'168","last_scrub_stamp":"2024-09-19T06:46:42.701802+0000","last_deep_scrub":"34'168","last_deep_scrub_stamp":"2024-09-19T06:46:42.701802+0000","last_clean_scrub_stamp":"2024-09-19T06:46:42.701802+0000","objects_scrubbed":3,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:06.449359+0000","scrub_duration":115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":67,"num_write":361,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14264,"num_omap_keys":24,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"34'5440","reported_seq":5526,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:55.205959+0000","last_change":"2024-09-19T06:46:55.205983+0000","last_active":"2024-09-19T06:46:55.205959+0000","last_peered":"2024-09-19T06:46:55.205959+0000","last_clean":"2024-09-19T06:46:55.205959+0000","last_became_active":"2024-09-19T06:37:13.468074+0000","last_became_peered":"2024-09-19T06:37:13.468074+0000","last_unstale":"2024-09-19T06:46:55.205959+0000","last_undegraded":"2024-09-19T06:46:55.205959+0000","last_fullsized":"2024-09-19T06:46:55.205959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5440","last_scrub_stamp":"2024-09-19T06:46:55.205867+0000","last_deep_scrub":"34'5440","last_deep_scrub_stamp":"2024-09-19T06:46:55.205867+0000","last_clean_scrub_stamp":"2024-09-19T06:46:55.205867+0000","objects_scrubbed":0,"log_size":5440,"log_dups_size":0,"ondisk_log_size":5440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:29.940681+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":78291,"num_write_kb":979369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"34'9","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.115517+0000","last_change":"2024-09-19T06:46:45.755920+0000","last_active":"2024-09-19T06:46:48.115517+0000","last_peered":"2024-09-19T06:46:48.115517+0000","last_clean":"2024-09-19T06:46:48.115517+0000","last_became_active":"2024-09-19T06:37:09.435597+0000","last_became_peered":"2024-09-19T06:37:09.435597+0000","last_unstale":"2024-09-19T06:46:48.115517+0000","last_undegraded":"2024-09-19T06:46:48.115517+0000","last_fullsized":"2024-09-19T06:46:48.115517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-19T06:46:45.755767+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-19T06:46:45.755767+0000","last_clean_scrub_stamp":"2024-09-19T06:46:45.755767+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:34.412676+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.245055+0000","last_change":"2024-09-19T06:46:47.069562+0000","last_active":"2024-09-19T06:46:48.245055+0000","last_peered":"2024-09-19T06:46:48.245055+0000","last_clean":"2024-09-19T06:46:48.245055+0000","last_became_active":"2024-09-19T06:37:08.447630+0000","last_became_peered":"2024-09-19T06:37:08.447630+0000","last_unstale":"2024-09-19T06:46:48.245055+0000","last_undegraded":"2024-09-19T06:46:48.245055+0000","last_fullsized":"2024-09-19T06:46:48.245055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:46:47.069432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:46:47.069432+0000","last_clean_scrub_stamp":"2024-09-19T06:46:47.069432+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:48:26.722623+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"34'4543","reported_seq":4627,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.268310+0000","last_change":"2024-09-19T06:46:47.946516+0000","last_active":"2024-09-19T06:46:48.268310+0000","last_peered":"2024-09-19T06:46:48.268310+0000","last_clean":"2024-09-19T06:46:48.268310+0000","last_became_active":"2024-09-19T06:37:13.467926+0000","last_became_peered":"2024-09-19T06:37:13.467926+0000","last_unstale":"2024-09-19T06:46:48.268310+0000","last_undegraded":"2024-09-19T06:46:48.268310+0000","last_fullsized":"2024-09-19T06:46:48.268310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4539","last_scrub_stamp":"2024-09-19T06:46:47.946382+0000","last_deep_scrub":"34'4539","last_deep_scrub_stamp":"2024-09-19T06:46:47.946382+0000","last_clean_scrub_stamp":"2024-09-19T06:46:47.946382+0000","objects_scrubbed":4,"log_size":4543,"log_dups_size":0,"ondisk_log_size":4543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:33.804522+0000","scrub_duration":239,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":64826,"num_write_kb":802716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"34'15","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.205478+0000","last_change":"2024-09-19T06:46:45.532732+0000","last_active":"2024-09-19T06:46:48.205478+0000","last_peered":"2024-09-19T06:46:48.205478+0000","last_clean":"2024-09-19T06:46:48.205478+0000","last_became_active":"2024-09-19T06:37:09.441406+0000","last_became_peered":"2024-09-19T06:37:09.441406+0000","last_unstale":"2024-09-19T06:46:48.205478+0000","last_undegraded":"2024-09-19T06:46:48.205478+0000","last_fullsized":"2024-09-19T06:46:48.205478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-19T06:46:45.532589+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-19T06:46:45.532589+0000","last_clean_scrub_stamp":"2024-09-19T06:46:45.532589+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:17.163362+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.153005+0000","last_change":"2024-09-19T06:46:41.574351+0000","last_active":"2024-09-19T06:46:48.153005+0000","last_peered":"2024-09-19T06:46:48.153005+0000","last_clean":"2024-09-19T06:46:48.153005+0000","last_became_active":"2024-09-19T06:37:08.438528+0000","last_became_peered":"2024-09-19T06:37:08.438528+0000","last_unstale":"2024-09-19T06:46:48.153005+0000","last_undegraded":"2024-09-19T06:46:48.153005+0000","last_fullsized":"2024-09-19T06:46:48.153005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-19T06:46:41.574202+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-19T06:46:41.574202+0000","last_clean_scrub_stamp":"2024-09-19T06:46:41.574202+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:20.737719+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10508,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'5505","reported_seq":5579,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.629457+0000","last_change":"2024-09-19T06:46:48.629484+0000","last_active":"2024-09-19T06:46:48.629457+0000","last_peered":"2024-09-19T06:46:48.629457+0000","last_clean":"2024-09-19T06:46:48.629457+0000","last_became_active":"2024-09-19T06:37:13.459303+0000","last_became_peered":"2024-09-19T06:37:13.459303+0000","last_unstale":"2024-09-19T06:46:48.629457+0000","last_undegraded":"2024-09-19T06:46:48.629457+0000","last_fullsized":"2024-09-19T06:46:48.629457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5505","last_scrub_stamp":"2024-09-19T06:46:48.629362+0000","last_deep_scrub":"34'5505","last_deep_scrub_stamp":"2024-09-19T06:46:48.629362+0000","last_clean_scrub_stamp":"2024-09-19T06:46:48.629362+0000","objects_scrubbed":0,"log_size":5505,"log_dups_size":0,"ondisk_log_size":5505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:17:38.165941+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":79079,"num_write_kb":992273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.259906+0000","last_change":"2024-09-19T06:46:42.955440+0000","last_active":"2024-09-19T06:46:48.259906+0000","last_peered":"2024-09-19T06:46:48.259906+0000","last_clean":"2024-09-19T06:46:48.259906+0000","last_became_active":"2024-09-19T06:37:09.448899+0000","last_became_peered":"2024-09-19T06:37:09.448899+0000","last_unstale":"2024-09-19T06:46:48.259906+0000","last_undegraded":"2024-09-19T06:46:48.259906+0000","last_fullsized":"2024-09-19T06:46:48.259906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-19T06:46:42.955291+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-19T06:46:42.955291+0000","last_clean_scrub_stamp":"2024-09-19T06:46:42.955291+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:57.908393+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"34'203","reported_seq":257,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.236734+0000","last_change":"2024-09-19T06:46:38.505115+0000","last_active":"2024-09-19T06:46:48.236734+0000","last_peered":"2024-09-19T06:46:48.236734+0000","last_clean":"2024-09-19T06:46:48.236734+0000","last_became_active":"2024-09-19T06:37:08.433984+0000","last_became_peered":"2024-09-19T06:37:08.433984+0000","last_unstale":"2024-09-19T06:46:48.236734+0000","last_undegraded":"2024-09-19T06:46:48.236734+0000","last_fullsized":"2024-09-19T06:46:48.236734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'199","last_scrub_stamp":"2024-09-19T06:46:38.505011+0000","last_deep_scrub":"34'199","last_deep_scrub_stamp":"2024-09-19T06:46:38.505011+0000","last_clean_scrub_stamp":"2024-09-19T06:46:38.505011+0000","objects_scrubbed":1,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:40.981576+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":190,"num_write_kb":4204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"34'4556","reported_seq":4638,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:49.578876+0000","last_change":"2024-09-19T06:46:49.578912+0000","last_active":"2024-09-19T06:46:49.578876+0000","last_peered":"2024-09-19T06:46:49.578876+0000","last_clean":"2024-09-19T06:46:49.578876+0000","last_became_active":"2024-09-19T06:37:13.461685+0000","last_became_peered":"2024-09-19T06:37:13.461685+0000","last_unstale":"2024-09-19T06:46:49.578876+0000","last_undegraded":"2024-09-19T06:46:49.578876+0000","last_fullsized":"2024-09-19T06:46:49.578876+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4556","last_scrub_stamp":"2024-09-19T06:46:49.578765+0000","last_deep_scrub":"34'4556","last_deep_scrub_stamp":"2024-09-19T06:46:49.578765+0000","last_clean_scrub_stamp":"2024-09-19T06:46:49.578765+0000","objects_scrubbed":0,"log_size":4556,"log_dups_size":0,"ondisk_log_size":4556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:51.488017+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":65440,"num_write_kb":836807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"34'15","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.228982+0000","last_change":"2024-09-19T06:46:44.714651+0000","last_active":"2024-09-19T06:46:48.228982+0000","last_peered":"2024-09-19T06:46:48.228982+0000","last_clean":"2024-09-19T06:46:48.228982+0000","last_became_active":"2024-09-19T06:37:09.434119+0000","last_became_peered":"2024-09-19T06:37:09.434119+0000","last_unstale":"2024-09-19T06:46:48.228982+0000","last_undegraded":"2024-09-19T06:46:48.228982+0000","last_fullsized":"2024-09-19T06:46:48.228982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-09-19T06:46:44.709417+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-09-19T06:46:44.709417+0000","last_clean_scrub_stamp":"2024-09-19T06:46:44.709417+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:32.031449+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"34'28","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:37.997467+0000","last_change":"2024-09-19T06:46:37.997467+0000","last_active":"2024-09-19T06:46:37.997467+0000","last_peered":"2024-09-19T06:46:37.997467+0000","last_clean":"2024-09-19T06:46:37.997467+0000","last_became_active":"2024-09-19T06:37:08.435718+0000","last_became_peered":"2024-09-19T06:37:08.435718+0000","last_unstale":"2024-09-19T06:46:37.997467+0000","last_undegraded":"2024-09-19T06:46:37.997467+0000","last_fullsized":"2024-09-19T06:46:37.997467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'27","last_scrub_stamp":"2024-09-19T06:46:37.997332+0000","last_deep_scrub":"34'27","last_deep_scrub_stamp":"2024-09-19T06:46:37.997332+0000","last_clean_scrub_stamp":"2024-09-19T06:46:37.997332+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:32.405940+0000","scrub_duration":77,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94269,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":146,"num_write":23,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'5276","reported_seq":5361,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:51.578652+0000","last_change":"2024-09-19T06:46:51.578692+0000","last_active":"2024-09-19T06:46:51.578652+0000","last_peered":"2024-09-19T06:46:51.578652+0000","last_clean":"2024-09-19T06:46:51.578652+0000","last_became_active":"2024-09-19T06:37:13.465348+0000","last_became_peered":"2024-09-19T06:37:13.465348+0000","last_unstale":"2024-09-19T06:46:51.578652+0000","last_undegraded":"2024-09-19T06:46:51.578652+0000","last_fullsized":"2024-09-19T06:46:51.578652+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5276","last_scrub_stamp":"2024-09-19T06:46:51.578550+0000","last_deep_scrub":"34'5276","last_deep_scrub_stamp":"2024-09-19T06:46:51.578550+0000","last_clean_scrub_stamp":"2024-09-19T06:46:51.578550+0000","objects_scrubbed":0,"log_size":5276,"log_dups_size":0,"ondisk_log_size":5276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:00.490512+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":75949,"num_write_kb":952671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.151080+0000","last_change":"2024-09-19T06:46:38.781688+0000","last_active":"2024-09-19T06:46:48.151080+0000","last_peered":"2024-09-19T06:46:48.151080+0000","last_clean":"2024-09-19T06:46:48.151080+0000","last_became_active":"2024-09-19T06:37:09.444605+0000","last_became_peered":"2024-09-19T06:37:09.444605+0000","last_unstale":"2024-09-19T06:46:48.151080+0000","last_undegraded":"2024-09-19T06:46:48.151080+0000","last_fullsized":"2024-09-19T06:46:48.151080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-19T06:46:38.781388+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-19T06:46:38.781388+0000","last_clean_scrub_stamp":"2024-09-19T06:46:38.781388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:47:06.367133+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"34'49","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.184160+0000","last_change":"2024-09-19T06:46:46.112849+0000","last_active":"2024-09-19T06:46:48.184160+0000","last_peered":"2024-09-19T06:46:48.184160+0000","last_clean":"2024-09-19T06:46:48.184160+0000","last_became_active":"2024-09-19T06:37:08.446474+0000","last_became_peered":"2024-09-19T06:37:08.446474+0000","last_unstale":"2024-09-19T06:46:48.184160+0000","last_undegraded":"2024-09-19T06:46:48.184160+0000","last_fullsized":"2024-09-19T06:46:48.184160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-09-19T06:46:46.112710+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-09-19T06:46:46.112710+0000","last_clean_scrub_stamp":"2024-09-19T06:46:46.112710+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:49.492139+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":38,"num_write_kb":8207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"34'4406","reported_seq":4491,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:49.715848+0000","last_change":"2024-09-19T06:46:49.715878+0000","last_active":"2024-09-19T06:46:49.715848+0000","last_peered":"2024-09-19T06:46:49.715848+0000","last_clean":"2024-09-19T06:46:49.715848+0000","last_became_active":"2024-09-19T06:37:13.470860+0000","last_became_peered":"2024-09-19T06:37:13.470860+0000","last_unstale":"2024-09-19T06:46:49.715848+0000","last_undegraded":"2024-09-19T06:46:49.715848+0000","last_fullsized":"2024-09-19T06:46:49.715848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4406","last_scrub_stamp":"2024-09-19T06:46:49.715735+0000","last_deep_scrub":"34'4406","last_deep_scrub_stamp":"2024-09-19T06:46:49.715735+0000","last_clean_scrub_stamp":"2024-09-19T06:46:49.715735+0000","objects_scrubbed":0,"log_size":4406,"log_dups_size":0,"ondisk_log_size":4406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:17:57.479249+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":62706,"num_write_kb":794606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.138933+0000","last_change":"2024-09-19T06:46:48.138970+0000","last_active":"2024-09-19T06:46:48.138933+0000","last_peered":"2024-09-19T06:46:48.138933+0000","last_clean":"2024-09-19T06:46:48.138933+0000","last_became_active":"2024-09-19T06:37:09.439478+0000","last_became_peered":"2024-09-19T06:37:09.439478+0000","last_unstale":"2024-09-19T06:46:48.138933+0000","last_undegraded":"2024-09-19T06:46:48.138933+0000","last_fullsized":"2024-09-19T06:46:48.138933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-19T06:46:48.138848+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-19T06:46:48.138848+0000","last_clean_scrub_stamp":"2024-09-19T06:46:48.138848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:43.125977+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:39.541891+0000","last_change":"2024-09-19T06:46:39.541916+0000","last_active":"2024-09-19T06:46:39.541891+0000","last_peered":"2024-09-19T06:46:39.541891+0000","last_clean":"2024-09-19T06:46:39.541891+0000","last_became_active":"2024-09-19T06:37:08.435183+0000","last_became_peered":"2024-09-19T06:37:08.435183+0000","last_unstale":"2024-09-19T06:46:39.541891+0000","last_undegraded":"2024-09-19T06:46:39.541891+0000","last_fullsized":"2024-09-19T06:46:39.541891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-09-19T06:46:39.541805+0000","last_deep_scrub":"28'1","last_deep_scrub_stamp":"2024-09-19T06:46:39.541805+0000","last_clean_scrub_stamp":"2024-09-19T06:46:39.541805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:15.508524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"34'119","reported_seq":209,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:42.095919+0000","last_change":"2024-09-19T06:46:42.096518+0000","last_active":"2024-09-19T06:46:42.095919+0000","last_peered":"2024-09-19T06:46:42.095919+0000","last_clean":"2024-09-19T06:46:42.095919+0000","last_became_active":"2024-09-19T06:36:58.828079+0000","last_became_peered":"2024-09-19T06:36:58.828079+0000","last_unstale":"2024-09-19T06:46:42.095919+0000","last_undegraded":"2024-09-19T06:46:42.095919+0000","last_fullsized":"2024-09-19T06:46:42.095919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2024-09-19T06:46:42.095809+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2024-09-19T06:46:42.095809+0000","last_clean_scrub_stamp":"2024-09-19T06:46:42.095809+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:27.675491+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"34'4834","reported_seq":4905,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:51.647528+0000","last_change":"2024-09-19T06:46:51.647558+0000","last_active":"2024-09-19T06:46:51.647528+0000","last_peered":"2024-09-19T06:46:51.647528+0000","last_clean":"2024-09-19T06:46:51.647528+0000","last_became_active":"2024-09-19T06:37:13.464101+0000","last_became_peered":"2024-09-19T06:37:13.464101+0000","last_unstale":"2024-09-19T06:46:51.647528+0000","last_undegraded":"2024-09-19T06:46:51.647528+0000","last_fullsized":"2024-09-19T06:46:51.647528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4834","last_scrub_stamp":"2024-09-19T06:46:51.647423+0000","last_deep_scrub":"34'4834","last_deep_scrub_stamp":"2024-09-19T06:46:51.647423+0000","last_clean_scrub_stamp":"2024-09-19T06:46:51.647423+0000","objects_scrubbed":0,"log_size":4834,"log_dups_size":0,"ondisk_log_size":4834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:38.189992+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":69016,"num_write_kb":870393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"34'15","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:55.037510+0000","last_change":"2024-09-19T06:46:55.037539+0000","last_active":"2024-09-19T06:46:55.037510+0000","last_peered":"2024-09-19T06:46:55.037510+0000","last_clean":"2024-09-19T06:46:55.037510+0000","last_became_active":"2024-09-19T06:37:09.442515+0000","last_became_peered":"2024-09-19T06:37:09.442515+0000","last_unstale":"2024-09-19T06:46:55.037510+0000","last_undegraded":"2024-09-19T06:46:55.037510+0000","last_fullsized":"2024-09-19T06:46:55.037510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-19T06:46:55.037401+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-19T06:46:55.037401+0000","last_clean_scrub_stamp":"2024-09-19T06:46:55.037401+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:17.777911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:39.921083+0000","last_change":"2024-09-19T06:46:39.921083+0000","last_active":"2024-09-19T06:46:39.921083+0000","last_peered":"2024-09-19T06:46:39.921083+0000","last_clean":"2024-09-19T06:46:39.921083+0000","last_became_active":"2024-09-19T06:37:08.437771+0000","last_became_peered":"2024-09-19T06:37:08.437771+0000","last_unstale":"2024-09-19T06:46:39.921083+0000","last_undegraded":"2024-09-19T06:46:39.921083+0000","last_fullsized":"2024-09-19T06:46:39.921083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-09-19T06:46:39.920926+0000","last_deep_scrub":"28'1","last_deep_scrub_stamp":"2024-09-19T06:46:39.920926+0000","last_clean_scrub_stamp":"2024-09-19T06:46:39.920926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:19.244102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"34'4884","reported_seq":4968,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:53.652799+0000","last_change":"2024-09-19T06:46:53.652844+0000","last_active":"2024-09-19T06:46:53.652799+0000","last_peered":"2024-09-19T06:46:53.652799+0000","last_clean":"2024-09-19T06:46:53.652799+0000","last_became_active":"2024-09-19T06:37:51.781963+0000","last_became_peered":"2024-09-19T06:37:51.781963+0000","last_unstale":"2024-09-19T06:46:53.652799+0000","last_undegraded":"2024-09-19T06:46:53.652799+0000","last_fullsized":"2024-09-19T06:46:53.652799+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4884","last_scrub_stamp":"2024-09-19T06:46:53.652684+0000","last_deep_scrub":"34'4884","last_deep_scrub_stamp":"2024-09-19T06:46:53.652684+0000","last_clean_scrub_stamp":"2024-09-19T06:46:53.652684+0000","objects_scrubbed":0,"log_size":4884,"log_dups_size":0,"ondisk_log_size":4884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:14.592212+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":69562,"num_write_kb":883742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"34'14","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.161558+0000","last_change":"2024-09-19T06:46:46.468892+0000","last_active":"2024-09-19T06:46:48.161558+0000","last_peered":"2024-09-19T06:46:48.161558+0000","last_clean":"2024-09-19T06:46:48.161558+0000","last_became_active":"2024-09-19T06:37:09.441850+0000","last_became_peered":"2024-09-19T06:37:09.441850+0000","last_unstale":"2024-09-19T06:46:48.161558+0000","last_undegraded":"2024-09-19T06:46:48.161558+0000","last_fullsized":"2024-09-19T06:46:48.161558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-19T06:46:46.468726+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-19T06:46:46.468726+0000","last_clean_scrub_stamp":"2024-09-19T06:46:46.468726+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:06:22.859204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"34'166","reported_seq":225,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:38.483391+0000","last_change":"2024-09-19T06:46:38.483391+0000","last_active":"2024-09-19T06:46:38.483391+0000","last_peered":"2024-09-19T06:46:38.483391+0000","last_clean":"2024-09-19T06:46:38.483391+0000","last_became_active":"2024-09-19T06:37:08.431443+0000","last_became_peered":"2024-09-19T06:37:08.431443+0000","last_unstale":"2024-09-19T06:46:38.483391+0000","last_undegraded":"2024-09-19T06:46:38.483391+0000","last_fullsized":"2024-09-19T06:46:38.483391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'165","last_scrub_stamp":"2024-09-19T06:46:38.483292+0000","last_deep_scrub":"34'165","last_deep_scrub_stamp":"2024-09-19T06:46:38.483292+0000","last_clean_scrub_stamp":"2024-09-19T06:46:38.483292+0000","objects_scrubbed":2,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:42.663273+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2533108,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":2297,"num_write":159,"num_write_kb":2550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'4583","reported_seq":4668,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.757516+0000","last_change":"2024-09-19T06:46:48.757557+0000","last_active":"2024-09-19T06:46:48.757516+0000","last_peered":"2024-09-19T06:46:48.757516+0000","last_clean":"2024-09-19T06:46:48.757516+0000","last_became_active":"2024-09-19T06:37:13.468879+0000","last_became_peered":"2024-09-19T06:37:13.468879+0000","last_unstale":"2024-09-19T06:46:48.757516+0000","last_undegraded":"2024-09-19T06:46:48.757516+0000","last_fullsized":"2024-09-19T06:46:48.757516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4583","last_scrub_stamp":"2024-09-19T06:46:48.757418+0000","last_deep_scrub":"34'4583","last_deep_scrub_stamp":"2024-09-19T06:46:48.757418+0000","last_clean_scrub_stamp":"2024-09-19T06:46:48.757418+0000","objects_scrubbed":0,"log_size":4583,"log_dups_size":0,"ondisk_log_size":4583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:10.775451+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":65623,"num_write_kb":822050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"34'12","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:49.987054+0000","last_change":"2024-09-19T06:46:49.987091+0000","last_active":"2024-09-19T06:46:49.987054+0000","last_peered":"2024-09-19T06:46:49.987054+0000","last_clean":"2024-09-19T06:46:49.987054+0000","last_became_active":"2024-09-19T06:37:09.438954+0000","last_became_peered":"2024-09-19T06:37:09.438954+0000","last_unstale":"2024-09-19T06:46:49.987054+0000","last_undegraded":"2024-09-19T06:46:49.987054+0000","last_fullsized":"2024-09-19T06:46:49.987054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-19T06:46:49.986949+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-19T06:46:49.986949+0000","last_clean_scrub_stamp":"2024-09-19T06:46:49.986949+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:20:28.963753+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"34'11","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.201483+0000","last_change":"2024-09-19T06:46:38.981752+0000","last_active":"2024-09-19T06:46:48.201483+0000","last_peered":"2024-09-19T06:46:48.201483+0000","last_clean":"2024-09-19T06:46:48.201483+0000","last_became_active":"2024-09-19T06:37:08.437093+0000","last_became_peered":"2024-09-19T06:37:08.437093+0000","last_unstale":"2024-09-19T06:46:48.201483+0000","last_undegraded":"2024-09-19T06:46:48.201483+0000","last_fullsized":"2024-09-19T06:46:48.201483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-19T06:46:38.981588+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-19T06:46:38.981588+0000","last_clean_scrub_stamp":"2024-09-19T06:46:38.981588+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:31.864208+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"34'4768","reported_seq":4849,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:53.565944+0000","last_change":"2024-09-19T06:46:53.565997+0000","last_active":"2024-09-19T06:46:53.565944+0000","last_peered":"2024-09-19T06:46:53.565944+0000","last_clean":"2024-09-19T06:46:53.565944+0000","last_became_active":"2024-09-19T06:37:13.459707+0000","last_became_peered":"2024-09-19T06:37:13.459707+0000","last_unstale":"2024-09-19T06:46:53.565944+0000","last_undegraded":"2024-09-19T06:46:53.565944+0000","last_fullsized":"2024-09-19T06:46:53.565944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4768","last_scrub_stamp":"2024-09-19T06:46:53.565827+0000","last_deep_scrub":"34'4768","last_deep_scrub_stamp":"2024-09-19T06:46:53.565827+0000","last_clean_scrub_stamp":"2024-09-19T06:46:53.565827+0000","objects_scrubbed":0,"log_size":4768,"log_dups_size":0,"ondisk_log_size":4768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:08.525096+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":0,"num_write":68547,"num_write_kb":859940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"34'7","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:54.082622+0000","last_change":"2024-09-19T06:46:54.082651+0000","last_active":"2024-09-19T06:46:54.082622+0000","last_peered":"2024-09-19T06:46:54.082622+0000","last_clean":"2024-09-19T06:46:54.082622+0000","last_became_active":"2024-09-19T06:37:09.442390+0000","last_became_peered":"2024-09-19T06:37:09.442390+0000","last_unstale":"2024-09-19T06:46:54.082622+0000","last_undegraded":"2024-09-19T06:46:54.082622+0000","last_fullsized":"2024-09-19T06:46:54.082622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-19T06:46:54.082537+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-19T06:46:54.082537+0000","last_clean_scrub_stamp":"2024-09-19T06:46:54.082537+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:07.873898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"34'7","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.104281+0000","last_change":"2024-09-19T06:46:37.969714+0000","last_active":"2024-09-19T06:46:48.104281+0000","last_peered":"2024-09-19T06:46:48.104281+0000","last_clean":"2024-09-19T06:46:48.104281+0000","last_became_active":"2024-09-19T06:37:08.436982+0000","last_became_peered":"2024-09-19T06:37:08.436982+0000","last_unstale":"2024-09-19T06:46:48.104281+0000","last_undegraded":"2024-09-19T06:46:48.104281+0000","last_fullsized":"2024-09-19T06:46:48.104281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-19T06:46:37.969569+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-19T06:46:37.969569+0000","last_clean_scrub_stamp":"2024-09-19T06:46:37.969569+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:17:41.559498+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7739,"num_omap_keys":13,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"34'4824","reported_seq":4913,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:51.024532+0000","last_change":"2024-09-19T06:46:51.024560+0000","last_active":"2024-09-19T06:46:51.024532+0000","last_peered":"2024-09-19T06:46:51.024532+0000","last_clean":"2024-09-19T06:46:51.024532+0000","last_became_active":"2024-09-19T06:37:51.781602+0000","last_became_peered":"2024-09-19T06:37:51.781602+0000","last_unstale":"2024-09-19T06:46:51.024532+0000","last_undegraded":"2024-09-19T06:46:51.024532+0000","last_fullsized":"2024-09-19T06:46:51.024532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4824","last_scrub_stamp":"2024-09-19T06:46:51.024424+0000","last_deep_scrub":"34'4824","last_deep_scrub_stamp":"2024-09-19T06:46:51.024424+0000","last_clean_scrub_stamp":"2024-09-19T06:46:51.024424+0000","objects_scrubbed":0,"log_size":4824,"log_dups_size":0,"ondisk_log_size":4824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:03.982514+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":68527,"num_write_kb":854704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3,6],"acting":[4,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"34'14","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:51.003157+0000","last_change":"2024-09-19T06:46:51.003181+0000","last_active":"2024-09-19T06:46:51.003157+0000","last_peered":"2024-09-19T06:46:51.003157+0000","last_clean":"2024-09-19T06:46:51.003157+0000","last_became_active":"2024-09-19T06:37:09.437717+0000","last_became_peered":"2024-09-19T06:37:09.437717+0000","last_unstale":"2024-09-19T06:46:51.003157+0000","last_undegraded":"2024-09-19T06:46:51.003157+0000","last_fullsized":"2024-09-19T06:46:51.003157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-19T06:46:51.003072+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-19T06:46:51.003072+0000","last_clean_scrub_stamp":"2024-09-19T06:46:51.003072+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:55.664575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"34'16","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.206089+0000","last_change":"2024-09-19T06:46:36.962258+0000","last_active":"2024-09-19T06:46:48.206089+0000","last_peered":"2024-09-19T06:46:48.206089+0000","last_clean":"2024-09-19T06:46:48.206089+0000","last_became_active":"2024-09-19T06:37:08.430324+0000","last_became_peered":"2024-09-19T06:37:08.430324+0000","last_unstale":"2024-09-19T06:46:48.206089+0000","last_undegraded":"2024-09-19T06:46:48.206089+0000","last_fullsized":"2024-09-19T06:46:48.206089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-19T06:46:36.962090+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-19T06:46:36.962090+0000","last_clean_scrub_stamp":"2024-09-19T06:46:36.962090+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:09:30.330268+0000","scrub_duration":69,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"34'5284","reported_seq":5366,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.339488+0000","last_change":"2024-09-19T06:46:47.365996+0000","last_active":"2024-09-19T06:46:48.339488+0000","last_peered":"2024-09-19T06:46:48.339488+0000","last_clean":"2024-09-19T06:46:48.339488+0000","last_became_active":"2024-09-19T06:37:13.463334+0000","last_became_peered":"2024-09-19T06:37:13.463334+0000","last_unstale":"2024-09-19T06:46:48.339488+0000","last_undegraded":"2024-09-19T06:46:48.339488+0000","last_fullsized":"2024-09-19T06:46:48.339488+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5273","last_scrub_stamp":"2024-09-19T06:46:47.365658+0000","last_deep_scrub":"34'5273","last_deep_scrub_stamp":"2024-09-19T06:46:47.365658+0000","last_clean_scrub_stamp":"2024-09-19T06:46:47.365658+0000","objects_scrubbed":11,"log_size":5284,"log_dups_size":0,"ondisk_log_size":5284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:42.488071+0000","scrub_duration":625,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":75271,"num_write_kb":939459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'14","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:49.643269+0000","last_change":"2024-09-19T06:46:49.643290+0000","last_active":"2024-09-19T06:46:49.643269+0000","last_peered":"2024-09-19T06:46:49.643269+0000","last_clean":"2024-09-19T06:46:49.643269+0000","last_became_active":"2024-09-19T06:37:09.449872+0000","last_became_peered":"2024-09-19T06:37:09.449872+0000","last_unstale":"2024-09-19T06:46:49.643269+0000","last_undegraded":"2024-09-19T06:46:49.643269+0000","last_fullsized":"2024-09-19T06:46:49.643269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-19T06:46:49.643200+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-19T06:46:49.643200+0000","last_clean_scrub_stamp":"2024-09-19T06:46:49.643200+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:52.325464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"34'7","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.173301+0000","last_change":"2024-09-19T06:46:41.552816+0000","last_active":"2024-09-19T06:46:48.173301+0000","last_peered":"2024-09-19T06:46:48.173301+0000","last_clean":"2024-09-19T06:46:48.173301+0000","last_became_active":"2024-09-19T06:37:08.442120+0000","last_became_peered":"2024-09-19T06:37:08.442120+0000","last_unstale":"2024-09-19T06:46:48.173301+0000","last_undegraded":"2024-09-19T06:46:48.173301+0000","last_fullsized":"2024-09-19T06:46:48.173301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-19T06:46:41.552716+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-19T06:46:41.552716+0000","last_clean_scrub_stamp":"2024-09-19T06:46:41.552716+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:12.673318+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"34'4967","reported_seq":5050,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.507409+0000","last_change":"2024-09-19T06:37:13.471319+0000","last_active":"2024-09-19T06:46:48.507409+0000","last_peered":"2024-09-19T06:46:48.507409+0000","last_clean":"2024-09-19T06:46:48.507409+0000","last_became_active":"2024-09-19T06:37:13.470887+0000","last_became_peered":"2024-09-19T06:37:13.470887+0000","last_unstale":"2024-09-19T06:46:48.507409+0000","last_undegraded":"2024-09-19T06:46:48.507409+0000","last_fullsized":"2024-09-19T06:46:48.507409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:37:12.437618+0000","last_clean_scrub_stamp":"2024-09-19T06:37:12.437618+0000","objects_scrubbed":0,"log_size":4967,"log_dups_size":0,"ondisk_log_size":4967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":70581,"num_write_kb":907517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'14","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.231200+0000","last_change":"2024-09-19T06:46:40.126375+0000","last_active":"2024-09-19T06:46:48.231200+0000","last_peered":"2024-09-19T06:46:48.231200+0000","last_clean":"2024-09-19T06:46:48.231200+0000","last_became_active":"2024-09-19T06:37:09.437635+0000","last_became_peered":"2024-09-19T06:37:09.437635+0000","last_unstale":"2024-09-19T06:46:48.231200+0000","last_undegraded":"2024-09-19T06:46:48.231200+0000","last_fullsized":"2024-09-19T06:46:48.231200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-09-19T06:46:40.126226+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-09-19T06:46:40.126226+0000","last_clean_scrub_stamp":"2024-09-19T06:46:40.126226+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:47.876184+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.284387+0000","last_change":"2024-09-19T06:46:40.510358+0000","last_active":"2024-09-19T06:46:48.284387+0000","last_peered":"2024-09-19T06:46:48.284387+0000","last_clean":"2024-09-19T06:46:48.284387+0000","last_became_active":"2024-09-19T06:37:08.438405+0000","last_became_peered":"2024-09-19T06:37:08.438405+0000","last_unstale":"2024-09-19T06:46:48.284387+0000","last_undegraded":"2024-09-19T06:46:48.284387+0000","last_fullsized":"2024-09-19T06:46:48.284387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-19T06:46:40.510196+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-19T06:46:40.510196+0000","last_clean_scrub_stamp":"2024-09-19T06:46:40.510196+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:05.876464+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16616,"num_omap_keys":28,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'5265","reported_seq":5355,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:50.167060+0000","last_change":"2024-09-19T06:46:50.167088+0000","last_active":"2024-09-19T06:46:50.167060+0000","last_peered":"2024-09-19T06:46:50.167060+0000","last_clean":"2024-09-19T06:46:50.167060+0000","last_became_active":"2024-09-19T06:37:13.458928+0000","last_became_peered":"2024-09-19T06:37:13.458928+0000","last_unstale":"2024-09-19T06:46:50.167060+0000","last_undegraded":"2024-09-19T06:46:50.167060+0000","last_fullsized":"2024-09-19T06:46:50.167060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5265","last_scrub_stamp":"2024-09-19T06:46:50.166939+0000","last_deep_scrub":"34'5265","last_deep_scrub_stamp":"2024-09-19T06:46:50.166939+0000","last_clean_scrub_stamp":"2024-09-19T06:46:50.166939+0000","objects_scrubbed":0,"log_size":5265,"log_dups_size":0,"ondisk_log_size":5265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:57.783333+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":0,"num_write":75298,"num_write_kb":949879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'15","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:45.788578+0000","last_change":"2024-09-19T06:46:43.782488+0000","last_active":"2024-09-19T06:46:45.788578+0000","last_peered":"2024-09-19T06:46:45.788578+0000","last_clean":"2024-09-19T06:46:45.788578+0000","last_became_active":"2024-09-19T06:37:09.448697+0000","last_became_peered":"2024-09-19T06:37:09.448697+0000","last_unstale":"2024-09-19T06:46:45.788578+0000","last_undegraded":"2024-09-19T06:46:45.788578+0000","last_fullsized":"2024-09-19T06:46:45.788578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-09-19T06:46:43.782368+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-09-19T06:46:43.782368+0000","last_clean_scrub_stamp":"2024-09-19T06:46:43.782368+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:15.787590+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"34'71","reported_seq":142,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.232665+0000","last_change":"2024-09-19T06:46:35.850675+0000","last_active":"2024-09-19T06:46:48.232665+0000","last_peered":"2024-09-19T06:46:48.232665+0000","last_clean":"2024-09-19T06:46:48.232665+0000","last_became_active":"2024-09-19T06:37:08.442436+0000","last_became_peered":"2024-09-19T06:37:08.442436+0000","last_unstale":"2024-09-19T06:46:48.232665+0000","last_undegraded":"2024-09-19T06:46:48.232665+0000","last_fullsized":"2024-09-19T06:46:48.232665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'66","last_scrub_stamp":"2024-09-19T06:46:35.850521+0000","last_deep_scrub":"34'66","last_deep_scrub_stamp":"2024-09-19T06:46:35.850521+0000","last_clean_scrub_stamp":"2024-09-19T06:46:35.850521+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:54.947910+0000","scrub_duration":70,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":32451,"num_write":58,"num_write_kb":8225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"34'4629","reported_seq":4700,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:52.567104+0000","last_change":"2024-09-19T06:46:52.567134+0000","last_active":"2024-09-19T06:46:52.567104+0000","last_peered":"2024-09-19T06:46:52.567104+0000","last_clean":"2024-09-19T06:46:52.567104+0000","last_became_active":"2024-09-19T06:37:13.457246+0000","last_became_peered":"2024-09-19T06:37:13.457246+0000","last_unstale":"2024-09-19T06:46:52.567104+0000","last_undegraded":"2024-09-19T06:46:52.567104+0000","last_fullsized":"2024-09-19T06:46:52.567104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4629","last_scrub_stamp":"2024-09-19T06:46:52.566992+0000","last_deep_scrub":"34'4629","last_deep_scrub_stamp":"2024-09-19T06:46:52.566992+0000","last_clean_scrub_stamp":"2024-09-19T06:46:52.566992+0000","objects_scrubbed":0,"log_size":4629,"log_dups_size":0,"ondisk_log_size":4629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:53.723546+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":66086,"num_write_kb":826143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"34'11","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:53.062057+0000","last_change":"2024-09-19T06:46:53.062099+0000","last_active":"2024-09-19T06:46:53.062057+0000","last_peered":"2024-09-19T06:46:53.062057+0000","last_clean":"2024-09-19T06:46:53.062057+0000","last_became_active":"2024-09-19T06:37:09.440209+0000","last_became_peered":"2024-09-19T06:37:09.440209+0000","last_unstale":"2024-09-19T06:46:53.062057+0000","last_undegraded":"2024-09-19T06:46:53.062057+0000","last_fullsized":"2024-09-19T06:46:53.062057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-19T06:46:53.061940+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-19T06:46:53.061940+0000","last_clean_scrub_stamp":"2024-09-19T06:46:53.061940+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:57.562767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"34'226","reported_seq":306,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.203017+0000","last_change":"2024-09-19T06:46:42.619309+0000","last_active":"2024-09-19T06:46:48.203017+0000","last_peered":"2024-09-19T06:46:48.203017+0000","last_clean":"2024-09-19T06:46:48.203017+0000","last_became_active":"2024-09-19T06:37:08.442242+0000","last_became_peered":"2024-09-19T06:37:08.442242+0000","last_unstale":"2024-09-19T06:46:48.203017+0000","last_undegraded":"2024-09-19T06:46:48.203017+0000","last_fullsized":"2024-09-19T06:46:48.203017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'223","last_scrub_stamp":"2024-09-19T06:46:42.619177+0000","last_deep_scrub":"34'223","last_deep_scrub_stamp":"2024-09-19T06:46:42.619177+0000","last_clean_scrub_stamp":"2024-09-19T06:46:42.619177+0000","objects_scrubbed":4,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:50.539272+0000","scrub_duration":68,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":49,"num_read_kb":24618,"num_write":216,"num_write_kb":4204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"34'4750","reported_seq":4834,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:50.551212+0000","last_change":"2024-09-19T06:46:50.551243+0000","last_active":"2024-09-19T06:46:50.551212+0000","last_peered":"2024-09-19T06:46:50.551212+0000","last_clean":"2024-09-19T06:46:50.551212+0000","last_became_active":"2024-09-19T06:37:13.461620+0000","last_became_peered":"2024-09-19T06:37:13.461620+0000","last_unstale":"2024-09-19T06:46:50.551212+0000","last_undegraded":"2024-09-19T06:46:50.551212+0000","last_fullsized":"2024-09-19T06:46:50.551212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4750","last_scrub_stamp":"2024-09-19T06:46:50.551100+0000","last_deep_scrub":"34'4750","last_deep_scrub_stamp":"2024-09-19T06:46:50.551100+0000","last_clean_scrub_stamp":"2024-09-19T06:46:50.551100+0000","objects_scrubbed":0,"log_size":4750,"log_dups_size":0,"ondisk_log_size":4750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:22.403757+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":67780,"num_write_kb":859195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.062850+0000","last_change":"2024-09-19T06:46:39.973013+0000","last_active":"2024-09-19T06:46:48.062850+0000","last_peered":"2024-09-19T06:46:48.062850+0000","last_clean":"2024-09-19T06:46:48.062850+0000","last_became_active":"2024-09-19T06:37:09.437800+0000","last_became_peered":"2024-09-19T06:37:09.437800+0000","last_unstale":"2024-09-19T06:46:48.062850+0000","last_undegraded":"2024-09-19T06:46:48.062850+0000","last_fullsized":"2024-09-19T06:46:48.062850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-19T06:46:39.972854+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-19T06:46:39.972854+0000","last_clean_scrub_stamp":"2024-09-19T06:46:39.972854+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:07.737876+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"34'21","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.260502+0000","last_change":"2024-09-19T06:46:39.494670+0000","last_active":"2024-09-19T06:46:48.260502+0000","last_peered":"2024-09-19T06:46:48.260502+0000","last_clean":"2024-09-19T06:46:48.260502+0000","last_became_active":"2024-09-19T06:37:08.434151+0000","last_became_peered":"2024-09-19T06:37:08.434151+0000","last_unstale":"2024-09-19T06:46:48.260502+0000","last_undegraded":"2024-09-19T06:46:48.260502+0000","last_fullsized":"2024-09-19T06:46:48.260502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-19T06:46:39.494581+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-19T06:46:39.494581+0000","last_clean_scrub_stamp":"2024-09-19T06:46:39.494581+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:00.034294+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":19,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'4900","reported_seq":4993,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.303790+0000","last_change":"2024-09-19T06:46:45.177621+0000","last_active":"2024-09-19T06:46:48.303790+0000","last_peered":"2024-09-19T06:46:48.303790+0000","last_clean":"2024-09-19T06:46:48.303790+0000","last_became_active":"2024-09-19T06:37:13.458924+0000","last_became_peered":"2024-09-19T06:37:13.458924+0000","last_unstale":"2024-09-19T06:46:48.303790+0000","last_undegraded":"2024-09-19T06:46:48.303790+0000","last_fullsized":"2024-09-19T06:46:48.303790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4879","last_scrub_stamp":"2024-09-19T06:46:45.177482+0000","last_deep_scrub":"34'4879","last_deep_scrub_stamp":"2024-09-19T06:46:45.177482+0000","last_clean_scrub_stamp":"2024-09-19T06:46:45.177482+0000","objects_scrubbed":21,"log_size":4900,"log_dups_size":0,"ondisk_log_size":4900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:20.783848+0000","scrub_duration":257,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":0,"num_write":69801,"num_write_kb":881574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"34'16","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.184309+0000","last_change":"2024-09-19T06:46:34.772498+0000","last_active":"2024-09-19T06:46:48.184309+0000","last_peered":"2024-09-19T06:46:48.184309+0000","last_clean":"2024-09-19T06:46:48.184309+0000","last_became_active":"2024-09-19T06:37:09.448173+0000","last_became_peered":"2024-09-19T06:37:09.448173+0000","last_unstale":"2024-09-19T06:46:48.184309+0000","last_undegraded":"2024-09-19T06:46:48.184309+0000","last_fullsized":"2024-09-19T06:46:48.184309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-19T06:46:34.772353+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-19T06:46:34.772353+0000","last_clean_scrub_stamp":"2024-09-19T06:46:34.772353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:03.908737+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.206935+0000","last_change":"2024-09-19T06:46:42.500666+0000","last_active":"2024-09-19T06:46:48.206935+0000","last_peered":"2024-09-19T06:46:48.206935+0000","last_clean":"2024-09-19T06:46:48.206935+0000","last_became_active":"2024-09-19T06:37:08.442126+0000","last_became_peered":"2024-09-19T06:37:08.442126+0000","last_unstale":"2024-09-19T06:46:48.206935+0000","last_undegraded":"2024-09-19T06:46:48.206935+0000","last_fullsized":"2024-09-19T06:46:48.206935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:46:42.500523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:46:42.500523+0000","last_clean_scrub_stamp":"2024-09-19T06:46:42.500523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:55.366948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"34'4842","reported_seq":4912,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:54.169639+0000","last_change":"2024-09-19T06:46:54.169686+0000","last_active":"2024-09-19T06:46:54.169639+0000","last_peered":"2024-09-19T06:46:54.169639+0000","last_clean":"2024-09-19T06:46:54.169639+0000","last_became_active":"2024-09-19T06:37:13.462750+0000","last_became_peered":"2024-09-19T06:37:13.462750+0000","last_unstale":"2024-09-19T06:46:54.169639+0000","last_undegraded":"2024-09-19T06:46:54.169639+0000","last_fullsized":"2024-09-19T06:46:54.169639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4842","last_scrub_stamp":"2024-09-19T06:46:54.169511+0000","last_deep_scrub":"34'4842","last_deep_scrub_stamp":"2024-09-19T06:46:54.169511+0000","last_clean_scrub_stamp":"2024-09-19T06:46:54.169511+0000","objects_scrubbed":0,"log_size":4842,"log_dups_size":0,"ondisk_log_size":4842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:08.131508+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":69473,"num_write_kb":873579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"34'15","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.281075+0000","last_change":"2024-09-19T06:46:44.962342+0000","last_active":"2024-09-19T06:46:48.281075+0000","last_peered":"2024-09-19T06:46:48.281075+0000","last_clean":"2024-09-19T06:46:48.281075+0000","last_became_active":"2024-09-19T06:37:51.593513+0000","last_became_peered":"2024-09-19T06:37:51.593513+0000","last_unstale":"2024-09-19T06:46:48.281075+0000","last_undegraded":"2024-09-19T06:46:48.281075+0000","last_fullsized":"2024-09-19T06:46:48.281075+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-19T06:46:44.962196+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-19T06:46:44.962196+0000","last_clean_scrub_stamp":"2024-09-19T06:46:44.962196+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:49.336176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"34'5","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.136080+0000","last_change":"2024-09-19T06:46:39.509681+0000","last_active":"2024-09-19T06:46:48.136080+0000","last_peered":"2024-09-19T06:46:48.136080+0000","last_clean":"2024-09-19T06:46:48.136080+0000","last_became_active":"2024-09-19T06:37:08.438785+0000","last_became_peered":"2024-09-19T06:37:08.438785+0000","last_unstale":"2024-09-19T06:46:48.136080+0000","last_undegraded":"2024-09-19T06:46:48.136080+0000","last_fullsized":"2024-09-19T06:46:48.136080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-19T06:46:39.509595+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-19T06:46:39.509595+0000","last_clean_scrub_stamp":"2024-09-19T06:46:39.509595+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:45.666499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"34'4915","reported_seq":5012,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:52.165034+0000","last_change":"2024-09-19T06:46:52.165069+0000","last_active":"2024-09-19T06:46:52.165034+0000","last_peered":"2024-09-19T06:46:52.165034+0000","last_clean":"2024-09-19T06:46:52.165034+0000","last_became_active":"2024-09-19T06:37:13.461762+0000","last_became_peered":"2024-09-19T06:37:13.461762+0000","last_unstale":"2024-09-19T06:46:52.165034+0000","last_undegraded":"2024-09-19T06:46:52.165034+0000","last_fullsized":"2024-09-19T06:46:52.165034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4915","last_scrub_stamp":"2024-09-19T06:46:52.164949+0000","last_deep_scrub":"34'4915","last_deep_scrub_stamp":"2024-09-19T06:46:52.164949+0000","last_clean_scrub_stamp":"2024-09-19T06:46:52.164949+0000","objects_scrubbed":0,"log_size":4915,"log_dups_size":0,"ondisk_log_size":4915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:54:55.640742+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":71145,"num_write_kb":900045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'5717","reported_seq":5802,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:50.724683+0000","last_change":"2024-09-19T06:46:50.724713+0000","last_active":"2024-09-19T06:46:50.724683+0000","last_peered":"2024-09-19T06:46:50.724683+0000","last_clean":"2024-09-19T06:46:50.724683+0000","last_became_active":"2024-09-19T06:37:13.470969+0000","last_became_peered":"2024-09-19T06:37:13.470969+0000","last_unstale":"2024-09-19T06:46:50.724683+0000","last_undegraded":"2024-09-19T06:46:50.724683+0000","last_fullsized":"2024-09-19T06:46:50.724683+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5717","last_scrub_stamp":"2024-09-19T06:46:50.724575+0000","last_deep_scrub":"34'5717","last_deep_scrub_stamp":"2024-09-19T06:46:50.724575+0000","last_clean_scrub_stamp":"2024-09-19T06:46:50.724575+0000","objects_scrubbed":0,"log_size":5717,"log_dups_size":0,"ondisk_log_size":5717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:02.207429+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":81983,"num_write_kb":1028288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'9","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.506950+0000","last_change":"2024-09-19T06:46:36.266057+0000","last_active":"2024-09-19T06:46:48.506950+0000","last_peered":"2024-09-19T06:46:48.506950+0000","last_clean":"2024-09-19T06:46:48.506950+0000","last_became_active":"2024-09-19T06:37:09.443069+0000","last_became_peered":"2024-09-19T06:37:09.443069+0000","last_unstale":"2024-09-19T06:46:48.506950+0000","last_undegraded":"2024-09-19T06:46:48.506950+0000","last_fullsized":"2024-09-19T06:46:48.506950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-19T06:46:36.265905+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-19T06:46:36.265905+0000","last_clean_scrub_stamp":"2024-09-19T06:46:36.265905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:01.926106+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"34'32","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.221700+0000","last_change":"2024-09-19T06:46:41.496675+0000","last_active":"2024-09-19T06:46:48.221700+0000","last_peered":"2024-09-19T06:46:48.221700+0000","last_clean":"2024-09-19T06:46:48.221700+0000","last_became_active":"2024-09-19T06:37:08.441698+0000","last_became_peered":"2024-09-19T06:37:08.441698+0000","last_unstale":"2024-09-19T06:46:48.221700+0000","last_undegraded":"2024-09-19T06:46:48.221700+0000","last_fullsized":"2024-09-19T06:46:48.221700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'30","last_scrub_stamp":"2024-09-19T06:46:41.496571+0000","last_deep_scrub":"34'30","last_deep_scrub_stamp":"2024-09-19T06:46:41.496571+0000","last_clean_scrub_stamp":"2024-09-19T06:46:41.496571+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:30.011383+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":24,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11722,"num_omap_keys":20,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4843","reported_seq":4925,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:52.623969+0000","last_change":"2024-09-19T06:46:52.623997+0000","last_active":"2024-09-19T06:46:52.623969+0000","last_peered":"2024-09-19T06:46:52.623969+0000","last_clean":"2024-09-19T06:46:52.623969+0000","last_became_active":"2024-09-19T06:37:13.470528+0000","last_became_peered":"2024-09-19T06:37:13.470528+0000","last_unstale":"2024-09-19T06:46:52.623969+0000","last_undegraded":"2024-09-19T06:46:52.623969+0000","last_fullsized":"2024-09-19T06:46:52.623969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4843","last_scrub_stamp":"2024-09-19T06:46:52.623851+0000","last_deep_scrub":"34'4843","last_deep_scrub_stamp":"2024-09-19T06:46:52.623851+0000","last_clean_scrub_stamp":"2024-09-19T06:46:52.623851+0000","objects_scrubbed":0,"log_size":4843,"log_dups_size":0,"ondisk_log_size":4843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:48:17.189862+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":69241,"num_write_kb":882580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"34'19","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.316533+0000","last_change":"2024-09-19T06:46:39.231272+0000","last_active":"2024-09-19T06:46:48.316533+0000","last_peered":"2024-09-19T06:46:48.316533+0000","last_clean":"2024-09-19T06:46:48.316533+0000","last_became_active":"2024-09-19T06:37:09.448658+0000","last_became_peered":"2024-09-19T06:37:09.448658+0000","last_unstale":"2024-09-19T06:46:48.316533+0000","last_undegraded":"2024-09-19T06:46:48.316533+0000","last_fullsized":"2024-09-19T06:46:48.316533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-19T06:46:39.231031+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-19T06:46:39.231031+0000","last_clean_scrub_stamp":"2024-09-19T06:46:39.231031+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:51.865175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"34'3","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:42.234702+0000","last_change":"2024-09-19T06:46:42.234702+0000","last_active":"2024-09-19T06:46:42.234702+0000","last_peered":"2024-09-19T06:46:42.234702+0000","last_clean":"2024-09-19T06:46:42.234702+0000","last_became_active":"2024-09-19T06:37:08.440591+0000","last_became_peered":"2024-09-19T06:37:08.440591+0000","last_unstale":"2024-09-19T06:46:42.234702+0000","last_undegraded":"2024-09-19T06:46:42.234702+0000","last_fullsized":"2024-09-19T06:46:42.234702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-09-19T06:46:42.234578+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-09-19T06:46:42.234578+0000","last_clean_scrub_stamp":"2024-09-19T06:46:42.234578+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:19.889418+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"34'26","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.132896+0000","last_change":"2024-09-19T06:46:40.607503+0000","last_active":"2024-09-19T06:46:48.132896+0000","last_peered":"2024-09-19T06:46:48.132896+0000","last_clean":"2024-09-19T06:46:48.132896+0000","last_became_active":"2024-09-19T06:37:08.440969+0000","last_became_peered":"2024-09-19T06:37:08.440969+0000","last_unstale":"2024-09-19T06:46:48.132896+0000","last_undegraded":"2024-09-19T06:46:48.132896+0000","last_fullsized":"2024-09-19T06:46:48.132896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-19T06:46:40.607341+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-19T06:46:40.607341+0000","last_clean_scrub_stamp":"2024-09-19T06:46:40.607341+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:39.811687+0000","scrub_duration":100,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":19,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7170,"num_omap_keys":12,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"34'11","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.251641+0000","last_change":"2024-09-19T06:46:37.753309+0000","last_active":"2024-09-19T06:46:48.251641+0000","last_peered":"2024-09-19T06:46:48.251641+0000","last_clean":"2024-09-19T06:46:48.251641+0000","last_became_active":"2024-09-19T06:37:09.444562+0000","last_became_peered":"2024-09-19T06:37:09.444562+0000","last_unstale":"2024-09-19T06:46:48.251641+0000","last_undegraded":"2024-09-19T06:46:48.251641+0000","last_fullsized":"2024-09-19T06:46:48.251641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-19T06:46:37.753174+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-19T06:46:37.753174+0000","last_clean_scrub_stamp":"2024-09-19T06:46:37.753174+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:39.990037+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"34'3917","reported_seq":3989,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:47.847695+0000","last_change":"2024-09-19T06:46:43.960323+0000","last_active":"2024-09-19T06:46:47.847695+0000","last_peered":"2024-09-19T06:46:47.847695+0000","last_clean":"2024-09-19T06:46:47.847695+0000","last_became_active":"2024-09-19T06:37:13.466765+0000","last_became_peered":"2024-09-19T06:37:13.466765+0000","last_unstale":"2024-09-19T06:46:47.847695+0000","last_undegraded":"2024-09-19T06:46:47.847695+0000","last_fullsized":"2024-09-19T06:46:47.847695+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3901","last_scrub_stamp":"2024-09-19T06:46:43.960123+0000","last_deep_scrub":"34'3901","last_deep_scrub_stamp":"2024-09-19T06:46:43.960123+0000","last_clean_scrub_stamp":"2024-09-19T06:46:43.960123+0000","objects_scrubbed":13,"log_size":3917,"log_dups_size":0,"ondisk_log_size":3917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:38.844744+0000","scrub_duration":1026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":56485,"num_write_kb":718624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"34'989","reported_seq":1051,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:43.245589+0000","last_change":"2024-09-19T06:46:43.245589+0000","last_active":"2024-09-19T06:46:43.245589+0000","last_peered":"2024-09-19T06:46:43.245589+0000","last_clean":"2024-09-19T06:46:43.245589+0000","last_became_active":"2024-09-19T06:37:08.443774+0000","last_became_peered":"2024-09-19T06:37:08.443774+0000","last_unstale":"2024-09-19T06:46:43.245589+0000","last_undegraded":"2024-09-19T06:46:43.245589+0000","last_fullsized":"2024-09-19T06:46:43.245589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'988","last_scrub_stamp":"2024-09-19T06:46:43.245417+0000","last_deep_scrub":"34'988","last_deep_scrub_stamp":"2024-09-19T06:46:43.245417+0000","last_clean_scrub_stamp":"2024-09-19T06:46:43.245417+0000","objects_scrubbed":1,"log_size":989,"log_dups_size":0,"ondisk_log_size":989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:10:46.597817+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":42342,"num_write":985,"num_write_kb":4941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'13","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.216710+0000","last_change":"2024-09-19T06:46:40.996125+0000","last_active":"2024-09-19T06:46:48.216710+0000","last_peered":"2024-09-19T06:46:48.216710+0000","last_clean":"2024-09-19T06:46:48.216710+0000","last_became_active":"2024-09-19T06:37:09.438457+0000","last_became_peered":"2024-09-19T06:37:09.438457+0000","last_unstale":"2024-09-19T06:46:48.216710+0000","last_undegraded":"2024-09-19T06:46:48.216710+0000","last_fullsized":"2024-09-19T06:46:48.216710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-19T06:46:40.996041+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-19T06:46:40.996041+0000","last_clean_scrub_stamp":"2024-09-19T06:46:40.996041+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:00.279522+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'5428","reported_seq":5506,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:53.197031+0000","last_change":"2024-09-19T06:46:53.197082+0000","last_active":"2024-09-19T06:46:53.197031+0000","last_peered":"2024-09-19T06:46:53.197031+0000","last_clean":"2024-09-19T06:46:53.197031+0000","last_became_active":"2024-09-19T06:37:13.462393+0000","last_became_peered":"2024-09-19T06:37:13.462393+0000","last_unstale":"2024-09-19T06:46:53.197031+0000","last_undegraded":"2024-09-19T06:46:53.197031+0000","last_fullsized":"2024-09-19T06:46:53.197031+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5428","last_scrub_stamp":"2024-09-19T06:46:53.196905+0000","last_deep_scrub":"34'5428","last_deep_scrub_stamp":"2024-09-19T06:46:53.196905+0000","last_clean_scrub_stamp":"2024-09-19T06:46:53.196905+0000","objects_scrubbed":0,"log_size":5428,"log_dups_size":0,"ondisk_log_size":5428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:34.297162+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":77377,"num_write_kb":974522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"34'15","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:50.644751+0000","last_change":"2024-09-19T06:46:50.644792+0000","last_active":"2024-09-19T06:46:50.644751+0000","last_peered":"2024-09-19T06:46:50.644751+0000","last_clean":"2024-09-19T06:46:50.644751+0000","last_became_active":"2024-09-19T06:37:09.450147+0000","last_became_peered":"2024-09-19T06:37:09.450147+0000","last_unstale":"2024-09-19T06:46:50.644751+0000","last_undegraded":"2024-09-19T06:46:50.644751+0000","last_fullsized":"2024-09-19T06:46:50.644751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-19T06:46:50.644630+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-19T06:46:50.644630+0000","last_clean_scrub_stamp":"2024-09-19T06:46:50.644630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:15.006761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"34'13","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:40.897936+0000","last_change":"2024-09-19T06:46:40.897936+0000","last_active":"2024-09-19T06:46:40.897936+0000","last_peered":"2024-09-19T06:46:40.897936+0000","last_clean":"2024-09-19T06:46:40.897936+0000","last_became_active":"2024-09-19T06:37:09.434840+0000","last_became_peered":"2024-09-19T06:37:09.434840+0000","last_unstale":"2024-09-19T06:46:40.897936+0000","last_undegraded":"2024-09-19T06:46:40.897936+0000","last_fullsized":"2024-09-19T06:46:40.897936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-19T06:46:40.897840+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-19T06:46:40.897840+0000","last_clean_scrub_stamp":"2024-09-19T06:46:40.897840+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:28.243892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"34'15","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.544273+0000","last_change":"2024-09-19T06:46:48.544293+0000","last_active":"2024-09-19T06:46:48.544273+0000","last_peered":"2024-09-19T06:46:48.544273+0000","last_clean":"2024-09-19T06:46:48.544273+0000","last_became_active":"2024-09-19T06:37:09.444907+0000","last_became_peered":"2024-09-19T06:37:09.444907+0000","last_unstale":"2024-09-19T06:46:48.544273+0000","last_undegraded":"2024-09-19T06:46:48.544273+0000","last_fullsized":"2024-09-19T06:46:48.544273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-19T06:46:48.544210+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-19T06:46:48.544210+0000","last_clean_scrub_stamp":"2024-09-19T06:46:48.544210+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:20.470939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"34'11","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.110781+0000","last_change":"2024-09-19T06:46:42.735411+0000","last_active":"2024-09-19T06:46:48.110781+0000","last_peered":"2024-09-19T06:46:48.110781+0000","last_clean":"2024-09-19T06:46:48.110781+0000","last_became_active":"2024-09-19T06:37:09.447692+0000","last_became_peered":"2024-09-19T06:37:09.447692+0000","last_unstale":"2024-09-19T06:46:48.110781+0000","last_undegraded":"2024-09-19T06:46:48.110781+0000","last_fullsized":"2024-09-19T06:46:48.110781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-19T06:46:42.735258+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-19T06:46:42.735258+0000","last_clean_scrub_stamp":"2024-09-19T06:46:42.735258+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:35.555749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"34'10","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:53.562010+0000","last_change":"2024-09-19T06:46:53.562059+0000","last_active":"2024-09-19T06:46:53.562010+0000","last_peered":"2024-09-19T06:46:53.562010+0000","last_clean":"2024-09-19T06:46:53.562010+0000","last_became_active":"2024-09-19T06:37:51.595875+0000","last_became_peered":"2024-09-19T06:37:51.595875+0000","last_unstale":"2024-09-19T06:46:53.562010+0000","last_undegraded":"2024-09-19T06:46:53.562010+0000","last_fullsized":"2024-09-19T06:46:53.562010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-19T06:46:53.561907+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-19T06:46:53.561907+0000","last_clean_scrub_stamp":"2024-09-19T06:46:53.561907+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:02.945889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'9","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:37.282713+0000","last_change":"2024-09-19T06:46:37.282713+0000","last_active":"2024-09-19T06:46:37.282713+0000","last_peered":"2024-09-19T06:46:37.282713+0000","last_clean":"2024-09-19T06:46:37.282713+0000","last_became_active":"2024-09-19T06:37:09.441456+0000","last_became_peered":"2024-09-19T06:37:09.441456+0000","last_unstale":"2024-09-19T06:46:37.282713+0000","last_undegraded":"2024-09-19T06:46:37.282713+0000","last_fullsized":"2024-09-19T06:46:37.282713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-19T06:46:37.277831+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-19T06:46:37.277831+0000","last_clean_scrub_stamp":"2024-09-19T06:46:37.277831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:12.733243+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"34'9","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.605842+0000","last_change":"2024-09-19T06:46:48.605888+0000","last_active":"2024-09-19T06:46:48.605842+0000","last_peered":"2024-09-19T06:46:48.605842+0000","last_clean":"2024-09-19T06:46:48.605842+0000","last_became_active":"2024-09-19T06:37:09.449562+0000","last_became_peered":"2024-09-19T06:37:09.449562+0000","last_unstale":"2024-09-19T06:46:48.605842+0000","last_undegraded":"2024-09-19T06:46:48.605842+0000","last_fullsized":"2024-09-19T06:46:48.605842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-19T06:46:48.605748+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-19T06:46:48.605748+0000","last_clean_scrub_stamp":"2024-09-19T06:46:48.605748+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:07.434452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"34'15","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.250622+0000","last_change":"2024-09-19T06:46:47.170985+0000","last_active":"2024-09-19T06:46:48.250622+0000","last_peered":"2024-09-19T06:46:48.250622+0000","last_clean":"2024-09-19T06:46:48.250622+0000","last_became_active":"2024-09-19T06:37:09.437624+0000","last_became_peered":"2024-09-19T06:37:09.437624+0000","last_unstale":"2024-09-19T06:46:48.250622+0000","last_undegraded":"2024-09-19T06:46:48.250622+0000","last_fullsized":"2024-09-19T06:46:48.250622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-19T06:46:47.170836+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-19T06:46:47.170836+0000","last_clean_scrub_stamp":"2024-09-19T06:46:47.170836+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:32.556789+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"34'12","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.154718+0000","last_change":"2024-09-19T06:46:44.519778+0000","last_active":"2024-09-19T06:46:48.154718+0000","last_peered":"2024-09-19T06:46:48.154718+0000","last_clean":"2024-09-19T06:46:48.154718+0000","last_became_active":"2024-09-19T06:37:09.438453+0000","last_became_peered":"2024-09-19T06:37:09.438453+0000","last_unstale":"2024-09-19T06:46:48.154718+0000","last_undegraded":"2024-09-19T06:46:48.154718+0000","last_fullsized":"2024-09-19T06:46:48.154718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-19T06:46:44.519668+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-19T06:46:44.519668+0000","last_clean_scrub_stamp":"2024-09-19T06:46:44.519668+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:57.569088+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"34'15","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:41.708745+0000","last_change":"2024-09-19T06:46:37.370909+0000","last_active":"2024-09-19T06:46:41.708745+0000","last_peered":"2024-09-19T06:46:41.708745+0000","last_clean":"2024-09-19T06:46:41.708745+0000","last_became_active":"2024-09-19T06:37:09.439710+0000","last_became_peered":"2024-09-19T06:37:09.439710+0000","last_unstale":"2024-09-19T06:46:41.708745+0000","last_undegraded":"2024-09-19T06:46:41.708745+0000","last_fullsized":"2024-09-19T06:46:41.708745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-09-19T06:46:37.370765+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-09-19T06:46:37.370765+0000","last_clean_scrub_stamp":"2024-09-19T06:46:37.370765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:06.900951+0000","scrub_duration":174,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"34'13","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.205716+0000","last_change":"2024-09-19T06:46:43.916617+0000","last_active":"2024-09-19T06:46:48.205716+0000","last_peered":"2024-09-19T06:46:48.205716+0000","last_clean":"2024-09-19T06:46:48.205716+0000","last_became_active":"2024-09-19T06:37:51.592846+0000","last_became_peered":"2024-09-19T06:37:51.592846+0000","last_unstale":"2024-09-19T06:46:48.205716+0000","last_undegraded":"2024-09-19T06:46:48.205716+0000","last_fullsized":"2024-09-19T06:46:48.205716+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-19T06:46:43.916473+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-19T06:46:43.916473+0000","last_clean_scrub_stamp":"2024-09-19T06:46:43.916473+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:02.872146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"34'17","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.237795+0000","last_change":"2024-09-19T06:46:44.746381+0000","last_active":"2024-09-19T06:46:48.237795+0000","last_peered":"2024-09-19T06:46:48.237795+0000","last_clean":"2024-09-19T06:46:48.237795+0000","last_became_active":"2024-09-19T06:37:09.449379+0000","last_became_peered":"2024-09-19T06:37:09.449379+0000","last_unstale":"2024-09-19T06:46:48.237795+0000","last_undegraded":"2024-09-19T06:46:48.237795+0000","last_fullsized":"2024-09-19T06:46:48.237795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-19T06:46:44.746237+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-19T06:46:44.746237+0000","last_clean_scrub_stamp":"2024-09-19T06:46:44.746237+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:47.533712+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"34'11","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.224839+0000","last_change":"2024-09-19T06:46:47.583096+0000","last_active":"2024-09-19T06:46:48.224839+0000","last_peered":"2024-09-19T06:46:48.224839+0000","last_clean":"2024-09-19T06:46:48.224839+0000","last_became_active":"2024-09-19T06:37:09.447514+0000","last_became_peered":"2024-09-19T06:37:09.447514+0000","last_unstale":"2024-09-19T06:46:48.224839+0000","last_undegraded":"2024-09-19T06:46:48.224839+0000","last_fullsized":"2024-09-19T06:46:48.224839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-19T06:46:47.582949+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-19T06:46:47.582949+0000","last_clean_scrub_stamp":"2024-09-19T06:46:47.582949+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:06:06.455900+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"34'15","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:52.042385+0000","last_change":"2024-09-19T06:46:52.042443+0000","last_active":"2024-09-19T06:46:52.042385+0000","last_peered":"2024-09-19T06:46:52.042385+0000","last_clean":"2024-09-19T06:46:52.042385+0000","last_became_active":"2024-09-19T06:37:09.432601+0000","last_became_peered":"2024-09-19T06:37:09.432601+0000","last_unstale":"2024-09-19T06:46:52.042385+0000","last_undegraded":"2024-09-19T06:46:52.042385+0000","last_fullsized":"2024-09-19T06:46:52.042385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-19T06:46:52.042265+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-19T06:46:52.042265+0000","last_clean_scrub_stamp":"2024-09-19T06:46:52.042265+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:30.290675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"34'19","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.281207+0000","last_change":"2024-09-19T06:46:41.945622+0000","last_active":"2024-09-19T06:46:48.281207+0000","last_peered":"2024-09-19T06:46:48.281207+0000","last_clean":"2024-09-19T06:46:48.281207+0000","last_became_active":"2024-09-19T06:37:09.439937+0000","last_became_peered":"2024-09-19T06:37:09.439937+0000","last_unstale":"2024-09-19T06:46:48.281207+0000","last_undegraded":"2024-09-19T06:46:48.281207+0000","last_fullsized":"2024-09-19T06:46:48.281207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-19T06:46:41.945494+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-19T06:46:41.945494+0000","last_clean_scrub_stamp":"2024-09-19T06:46:41.945494+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:28.164585+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"34'13","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.067206+0000","last_change":"2024-09-19T06:46:43.482146+0000","last_active":"2024-09-19T06:46:48.067206+0000","last_peered":"2024-09-19T06:46:48.067206+0000","last_clean":"2024-09-19T06:46:48.067206+0000","last_became_active":"2024-09-19T06:37:09.436752+0000","last_became_peered":"2024-09-19T06:37:09.436752+0000","last_unstale":"2024-09-19T06:46:48.067206+0000","last_undegraded":"2024-09-19T06:46:48.067206+0000","last_fullsized":"2024-09-19T06:46:48.067206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-19T06:46:43.481998+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-19T06:46:43.481998+0000","last_clean_scrub_stamp":"2024-09-19T06:46:43.481998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:04.929989+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"34'13","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:51.580618+0000","last_change":"2024-09-19T06:46:51.580643+0000","last_active":"2024-09-19T06:46:51.580618+0000","last_peered":"2024-09-19T06:46:51.580618+0000","last_clean":"2024-09-19T06:46:51.580618+0000","last_became_active":"2024-09-19T06:37:09.448647+0000","last_became_peered":"2024-09-19T06:37:09.448647+0000","last_unstale":"2024-09-19T06:46:51.580618+0000","last_undegraded":"2024-09-19T06:46:51.580618+0000","last_fullsized":"2024-09-19T06:46:51.580618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-09-19T06:46:51.580537+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-09-19T06:46:51.580537+0000","last_clean_scrub_stamp":"2024-09-19T06:46:51.580537+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:47.482163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"34'14","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.158367+0000","last_change":"2024-09-19T06:46:46.661899+0000","last_active":"2024-09-19T06:46:48.158367+0000","last_peered":"2024-09-19T06:46:48.158367+0000","last_clean":"2024-09-19T06:46:48.158367+0000","last_became_active":"2024-09-19T06:37:09.444737+0000","last_became_peered":"2024-09-19T06:37:09.444737+0000","last_unstale":"2024-09-19T06:46:48.158367+0000","last_undegraded":"2024-09-19T06:46:48.158367+0000","last_fullsized":"2024-09-19T06:46:48.158367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-19T06:46:46.661766+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-19T06:46:46.661766+0000","last_clean_scrub_stamp":"2024-09-19T06:46:46.661766+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:50.160646+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'17","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.076420+0000","last_change":"2024-09-19T06:46:40.741626+0000","last_active":"2024-09-19T06:46:48.076420+0000","last_peered":"2024-09-19T06:46:48.076420+0000","last_clean":"2024-09-19T06:46:48.076420+0000","last_became_active":"2024-09-19T06:37:09.445503+0000","last_became_peered":"2024-09-19T06:37:09.445503+0000","last_unstale":"2024-09-19T06:46:48.076420+0000","last_undegraded":"2024-09-19T06:46:48.076420+0000","last_fullsized":"2024-09-19T06:46:48.076420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-19T06:46:40.741535+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-19T06:46:40.741535+0000","last_clean_scrub_stamp":"2024-09-19T06:46:40.741535+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:16.327341+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"34'15","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.259683+0000","last_change":"2024-09-19T06:46:40.220940+0000","last_active":"2024-09-19T06:46:48.259683+0000","last_peered":"2024-09-19T06:46:48.259683+0000","last_clean":"2024-09-19T06:46:48.259683+0000","last_became_active":"2024-09-19T06:37:09.439767+0000","last_became_peered":"2024-09-19T06:37:09.439767+0000","last_unstale":"2024-09-19T06:46:48.259683+0000","last_undegraded":"2024-09-19T06:46:48.259683+0000","last_fullsized":"2024-09-19T06:46:48.259683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-19T06:46:40.220796+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-19T06:46:40.220796+0000","last_clean_scrub_stamp":"2024-09-19T06:46:40.220796+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:25.385356+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.313137+0000","last_change":"2024-09-19T06:46:41.974822+0000","last_active":"2024-09-19T06:46:48.313137+0000","last_peered":"2024-09-19T06:46:48.313137+0000","last_clean":"2024-09-19T06:46:48.313137+0000","last_became_active":"2024-09-19T06:37:09.440702+0000","last_became_peered":"2024-09-19T06:37:09.440702+0000","last_unstale":"2024-09-19T06:46:48.313137+0000","last_undegraded":"2024-09-19T06:46:48.313137+0000","last_fullsized":"2024-09-19T06:46:48.313137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-19T06:46:41.974707+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-19T06:46:41.974707+0000","last_clean_scrub_stamp":"2024-09-19T06:46:41.974707+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:39:24.201459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"34'12","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:45.579991+0000","last_change":"2024-09-19T06:46:45.579991+0000","last_active":"2024-09-19T06:46:45.579991+0000","last_peered":"2024-09-19T06:46:45.579991+0000","last_clean":"2024-09-19T06:46:45.579991+0000","last_became_active":"2024-09-19T06:37:09.442053+0000","last_became_peered":"2024-09-19T06:37:09.442053+0000","last_unstale":"2024-09-19T06:46:45.579991+0000","last_undegraded":"2024-09-19T06:46:45.579991+0000","last_fullsized":"2024-09-19T06:46:45.579991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-19T06:46:45.579855+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-19T06:46:45.579855+0000","last_clean_scrub_stamp":"2024-09-19T06:46:45.579855+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:16.214018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"34'13","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.255726+0000","last_change":"2024-09-19T06:46:44.570136+0000","last_active":"2024-09-19T06:46:48.255726+0000","last_peered":"2024-09-19T06:46:48.255726+0000","last_clean":"2024-09-19T06:46:48.255726+0000","last_became_active":"2024-09-19T06:37:09.441179+0000","last_became_peered":"2024-09-19T06:37:09.441179+0000","last_unstale":"2024-09-19T06:46:48.255726+0000","last_undegraded":"2024-09-19T06:46:48.255726+0000","last_fullsized":"2024-09-19T06:46:48.255726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-19T06:46:44.570038+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-19T06:46:44.570038+0000","last_clean_scrub_stamp":"2024-09-19T06:46:44.570038+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:36.119372+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"34'16","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.322797+0000","last_change":"2024-09-19T06:46:41.122655+0000","last_active":"2024-09-19T06:46:48.322797+0000","last_peered":"2024-09-19T06:46:48.322797+0000","last_clean":"2024-09-19T06:46:48.322797+0000","last_became_active":"2024-09-19T06:37:09.436892+0000","last_became_peered":"2024-09-19T06:37:09.436892+0000","last_unstale":"2024-09-19T06:46:48.322797+0000","last_undegraded":"2024-09-19T06:46:48.322797+0000","last_fullsized":"2024-09-19T06:46:48.322797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-19T06:46:41.122460+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-19T06:46:41.122460+0000","last_clean_scrub_stamp":"2024-09-19T06:46:41.122460+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:36.064341+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"34'5","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:46.153977+0000","last_change":"2024-09-19T06:46:46.153977+0000","last_active":"2024-09-19T06:46:46.153977+0000","last_peered":"2024-09-19T06:46:46.153977+0000","last_clean":"2024-09-19T06:46:46.153977+0000","last_became_active":"2024-09-19T06:37:09.437023+0000","last_became_peered":"2024-09-19T06:37:09.437023+0000","last_unstale":"2024-09-19T06:46:46.153977+0000","last_undegraded":"2024-09-19T06:46:46.153977+0000","last_fullsized":"2024-09-19T06:46:46.153977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-19T06:46:46.153851+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-19T06:46:46.153851+0000","last_clean_scrub_stamp":"2024-09-19T06:46:46.153851+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:25.413920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'9","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:57.103438+0000","last_change":"2024-09-19T06:46:57.103482+0000","last_active":"2024-09-19T06:46:57.103438+0000","last_peered":"2024-09-19T06:46:57.103438+0000","last_clean":"2024-09-19T06:46:57.103438+0000","last_became_active":"2024-09-19T06:37:09.448547+0000","last_became_peered":"2024-09-19T06:37:09.448547+0000","last_unstale":"2024-09-19T06:46:57.103438+0000","last_undegraded":"2024-09-19T06:46:57.103438+0000","last_fullsized":"2024-09-19T06:46:57.103438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-19T06:46:57.103325+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-19T06:46:57.103325+0000","last_clean_scrub_stamp":"2024-09-19T06:46:57.103325+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:12.797607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"34'10","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:50.628123+0000","last_change":"2024-09-19T06:46:50.628163+0000","last_active":"2024-09-19T06:46:50.628123+0000","last_peered":"2024-09-19T06:46:50.628123+0000","last_clean":"2024-09-19T06:46:50.628123+0000","last_became_active":"2024-09-19T06:37:09.446603+0000","last_became_peered":"2024-09-19T06:37:09.446603+0000","last_unstale":"2024-09-19T06:46:50.628123+0000","last_undegraded":"2024-09-19T06:46:50.628123+0000","last_fullsized":"2024-09-19T06:46:50.628123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-19T06:46:50.628026+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-19T06:46:50.628026+0000","last_clean_scrub_stamp":"2024-09-19T06:46:50.628026+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:45.500017+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"34'15","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.990882+0000","last_change":"2024-09-19T06:46:48.990903+0000","last_active":"2024-09-19T06:46:48.990882+0000","last_peered":"2024-09-19T06:46:48.990882+0000","last_clean":"2024-09-19T06:46:48.990882+0000","last_became_active":"2024-09-19T06:37:09.429813+0000","last_became_peered":"2024-09-19T06:37:09.429813+0000","last_unstale":"2024-09-19T06:46:48.990882+0000","last_undegraded":"2024-09-19T06:46:48.990882+0000","last_fullsized":"2024-09-19T06:46:48.990882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-19T06:46:48.990811+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-19T06:46:48.990811+0000","last_clean_scrub_stamp":"2024-09-19T06:46:48.990811+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:57.859698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"34'7","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:46.011856+0000","last_change":"2024-09-19T06:46:46.011878+0000","last_active":"2024-09-19T06:46:46.011856+0000","last_peered":"2024-09-19T06:46:46.011856+0000","last_clean":"2024-09-19T06:46:46.011856+0000","last_became_active":"2024-09-19T06:37:51.781695+0000","last_became_peered":"2024-09-19T06:37:51.781695+0000","last_unstale":"2024-09-19T06:46:46.011856+0000","last_undegraded":"2024-09-19T06:46:46.011856+0000","last_fullsized":"2024-09-19T06:46:46.011856+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-19T06:46:46.011786+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-19T06:46:46.011786+0000","last_clean_scrub_stamp":"2024-09-19T06:46:46.011786+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:54:13.317705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"34'12","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.147785+0000","last_change":"2024-09-19T06:46:41.759058+0000","last_active":"2024-09-19T06:46:48.147785+0000","last_peered":"2024-09-19T06:46:48.147785+0000","last_clean":"2024-09-19T06:46:48.147785+0000","last_became_active":"2024-09-19T06:37:09.446557+0000","last_became_peered":"2024-09-19T06:37:09.446557+0000","last_unstale":"2024-09-19T06:46:48.147785+0000","last_undegraded":"2024-09-19T06:46:48.147785+0000","last_fullsized":"2024-09-19T06:46:48.147785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-19T06:46:41.758901+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-19T06:46:41.758901+0000","last_clean_scrub_stamp":"2024-09-19T06:46:41.758901+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:35.619104+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.316077+0000","last_change":"2024-09-19T06:46:47.640890+0000","last_active":"2024-09-19T06:46:48.316077+0000","last_peered":"2024-09-19T06:46:48.316077+0000","last_clean":"2024-09-19T06:46:48.316077+0000","last_became_active":"2024-09-19T06:37:09.447753+0000","last_became_peered":"2024-09-19T06:37:09.447753+0000","last_unstale":"2024-09-19T06:46:48.316077+0000","last_undegraded":"2024-09-19T06:46:48.316077+0000","last_fullsized":"2024-09-19T06:46:48.316077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-19T06:46:47.640558+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-19T06:46:47.640558+0000","last_clean_scrub_stamp":"2024-09-19T06:46:47.640558+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:09.389943+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:56.068153+0000","last_change":"2024-09-19T06:46:56.068183+0000","last_active":"2024-09-19T06:46:56.068153+0000","last_peered":"2024-09-19T06:46:56.068153+0000","last_clean":"2024-09-19T06:46:56.068153+0000","last_became_active":"2024-09-19T06:37:09.442047+0000","last_became_peered":"2024-09-19T06:37:09.442047+0000","last_unstale":"2024-09-19T06:46:56.068153+0000","last_undegraded":"2024-09-19T06:46:56.068153+0000","last_fullsized":"2024-09-19T06:46:56.068153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-19T06:46:56.068059+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-19T06:46:56.068059+0000","last_clean_scrub_stamp":"2024-09-19T06:46:56.068059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:54:05.128170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1242,"num_read_kb":0,"num_write":2247820,"num_write_kb":28311472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157273,"ondisk_log_size":157273,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":777,"ondisk_log_size":777,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65543337,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":467,"num_read_kb":289484,"num_write":3842,"num_write_kb":66952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":80682,"num_omap_keys":138,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33423360,"data_stored":131086674,"data_compressed":14183544,"data_compressed_allocated":17063936,"data_compressed_original":114794496,"omap_allocated":0,"internal_metadata":0},"log_size":3847,"ondisk_log_size":3847,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65040,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509563,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":712784,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":710782,"kb_avail":93659056,"statfs":{"total":96636764160,"available":95906873344,"internally_reserved":0,"allocated":2031616,"data_stored":8554465,"data_compressed":865550,"data_compressed_allocated":1097728,"data_compressed_original":7827456,"omap_allocated":1595,"internal_metadata":727841221},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509563,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1020548,"kb_used_data":5684,"kb_used_omap":1,"kb_used_meta":1014846,"kb_avail":93351292,"statfs":{"total":96636764160,"available":95591723008,"internally_reserved":0,"allocated":5820416,"data_stored":23670451,"data_compressed":2577869,"data_compressed_allocated":3006464,"data_compressed_original":21073920,"omap_allocated":1595,"internal_metadata":1039202757},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509562,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":914380,"kb_used_data":4348,"kb_used_omap":1,"kb_used_meta":910014,"kb_avail":93457460,"statfs":{"total":96636764160,"available":95700439040,"internally_reserved":0,"allocated":4452352,"data_stored":21728293,"data_compressed":2359658,"data_compressed_allocated":2752512,"data_compressed_original":20246528,"omap_allocated":1595,"internal_metadata":931854789},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542267,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":929732,"kb_used_data":9908,"kb_used_omap":1,"kb_used_meta":919806,"kb_avail":93442108,"statfs":{"total":96636764160,"available":95684718592,"internally_reserved":0,"allocated":10145792,"data_stored":34311149,"data_compressed":3370597,"data_compressed_allocated":4014080,"data_compressed_original":28389376,"omap_allocated":1590,"internal_metadata":941881802},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542265,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1005360,"kb_used_data":4192,"kb_used_omap":1,"kb_used_meta":1001150,"kb_avail":93366480,"statfs":{"total":96636764160,"available":95607275520,"internally_reserved":0,"allocated":4292608,"data_stored":16943655,"data_compressed":1995942,"data_compressed_allocated":2461696,"data_compressed_original":15323136,"omap_allocated":1594,"internal_metadata":1025178054},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542264,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1220460,"kb_used_data":5468,"kb_used_omap":1,"kb_used_meta":1214974,"kb_avail":93151380,"statfs":{"total":96636764160,"available":95387013120,"internally_reserved":0,"allocated":5599232,"data_stored":12843620,"data_compressed":1395672,"data_compressed_allocated":1748992,"data_compressed_original":9207808,"omap_allocated":1593,"internal_metadata":1244133831},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542264,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1263864,"kb_used_data":3624,"kb_used_omap":1,"kb_used_meta":1260222,"kb_avail":93107976,"statfs":{"total":96636764160,"available":95342567424,"internally_reserved":0,"allocated":3710976,"data_stored":15281877,"data_compressed":1678240,"data_compressed_allocated":2064384,"data_compressed_original":13848576,"omap_allocated":1595,"internal_metadata":1290467781},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574972,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":793608,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":793150,"kb_avail":93578232,"statfs":{"total":96636764160,"available":95824109568,"internally_reserved":0,"allocated":450560,"data_stored":260036,"data_compressed":5056,"data_compressed_allocated":8192,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":812186053},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4018176,"data_stored":20972158,"data_compressed":2327138,"data_compressed_allocated":2707456,"data_compressed_original":19673088,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3342336,"data_stored":15116110,"data_compressed":1678240,"data_compressed_allocated":2064384,"data_compressed_original":13848576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":94269,"data_compressed":5056,"data_compressed_allocated":8192,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5230592,"data_stored":12677853,"data_compressed":1395672,"data_compressed_allocated":1748992,"data_compressed_original":9207808,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5451776,"data_stored":23504684,"data_compressed":2577869,"data_compressed_allocated":3006464,"data_compressed_original":21073920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1662976,"data_stored":8388698,"data_compressed":865550,"data_compressed_allocated":1097728,"data_compressed_original":7827456,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3923968,"data_stored":16777888,"data_compressed":1995942,"data_compressed_allocated":2461696,"data_compressed_original":15323136,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9711616,"data_stored":33555014,"data_compressed":3338077,"data_compressed_allocated":3969024,"data_compressed_original":27815936,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:47:00.264 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-19T06:37:12.437618+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=37, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=6, tm_min=46, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T06:47:00.265 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-19T06:47:20.266 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:47:20.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.370+0000 7f7e25b9f640 1 Processor -- start 2024-09-19T06:47:20.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.370+0000 7f7e25b9f640 1 -- start start 2024-09-19T06:47:20.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.371+0000 7f7e25b9f640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7e2006c060 0x7f7e2015af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.371+0000 7f7e25b9f640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e2015e680 con 0x7f7e201550b0 2024-09-19T06:47:20.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.371+0000 7f7e25b9f640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e20072460 con 0x7f7e20155490 2024-09-19T06:47:20.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.371+0000 7f7e25b9f640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f7e20072fe0 con 0x7f7e2006c060 2024-09-19T06:47:20.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.371+0000 7f7e1ffff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7e2006c060 0x7f7e2015af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.371+0000 7f7e1f7fe640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f7e201550b0 0x7f7e2015eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48576/0 (socket says 172.21.15.86:48576) 2024-09-19T06:47:20.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.371+0000 7f7e1f7fe640 1 -- 172.21.15.86:0/3027949571 learned_addr learned my addr 172.21.15.86:0/3027949571 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:47:20.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.372+0000 7f7e1ffff640 1 -- 172.21.15.86:0/3027949571 >> v1:172.21.15.169:6789/0 conn(0x7f7e20155490 legacy=0x7f7e2006c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:20.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.372+0000 7f7e1ffff640 1 -- 172.21.15.86:0/3027949571 >> v1:172.21.15.86:6789/0 conn(0x7f7e201550b0 legacy=0x7f7e2015eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:20.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.372+0000 7f7e1ffff640 1 -- 172.21.15.86:0/3027949571 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e20072740 con 0x7f7e2006c060 2024-09-19T06:47:20.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.372+0000 7f7e1effd640 1 -- 172.21.15.86:0/3027949571 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2467027368 0 0) 0x7f7e2015e680 con 0x7f7e201550b0 2024-09-19T06:47:20.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.372+0000 7f7e1ffff640 1 --2- 172.21.15.86:0/3027949571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e2006c060 0x7f7e2015af30 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7e2015e850 tx=0x7f7e1802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5766bc36d62e7ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:20.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.373+0000 7f7e1effd640 1 -- 172.21.15.86:0/3027949571 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e18037070 con 0x7f7e2006c060 2024-09-19T06:47:20.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.373+0000 7f7e1effd640 1 -- 172.21.15.86:0/3027949571 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e18007740 con 0x7f7e2006c060 2024-09-19T06:47:20.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.373+0000 7f7e1effd640 1 -- 172.21.15.86:0/3027949571 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e18007b10 con 0x7f7e2006c060 2024-09-19T06:47:20.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.373+0000 7f7e25b9f640 1 -- 172.21.15.86:0/3027949571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e2006c060 msgr2=0x7f7e2015af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:20.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.373+0000 7f7e25b9f640 1 --2- 172.21.15.86:0/3027949571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e2006c060 0x7f7e2015af30 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7e2015e850 tx=0x7f7e1802a780 comp rx=0 tx=0).stop 2024-09-19T06:47:20.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.373+0000 7f7e25b9f640 1 -- 172.21.15.86:0/3027949571 shutdown_connections 2024-09-19T06:47:20.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.373+0000 7f7e25b9f640 1 --2- 172.21.15.86:0/3027949571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e2006c060 0x7f7e2015af30 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.373+0000 7f7e25b9f640 1 -- 172.21.15.86:0/3027949571 >> 172.21.15.86:0/3027949571 conn(0x7f7e200cdd80 msgr2=0x7f7e200ca220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:20.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.373+0000 7f7e25b9f640 1 -- 172.21.15.86:0/3027949571 shutdown_connections 2024-09-19T06:47:20.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.373+0000 7f7e25b9f640 1 -- 172.21.15.86:0/3027949571 wait complete. 2024-09-19T06:47:20.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.374+0000 7f7e25b9f640 1 Processor -- start 2024-09-19T06:47:20.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.374+0000 7f7e25b9f640 1 -- start start 2024-09-19T06:47:20.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.375+0000 7f7e25b9f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e2006c060 0x7f7e201562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.375+0000 7f7e25b9f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e201550b0 0x7f7e2015a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.375+0000 7f7e25b9f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e20155490 0x7f7e201f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.375+0000 7f7e25b9f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7e200cafa0 con 0x7f7e201550b0 2024-09-19T06:47:20.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.375+0000 7f7e25b9f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7e20072d00 con 0x7f7e20155490 2024-09-19T06:47:20.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.375+0000 7f7e25b9f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7e2015f270 con 0x7f7e2006c060 2024-09-19T06:47:20.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.375+0000 7f7e17fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e201550b0 0x7f7e2015a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.375+0000 7f7e17fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e201550b0 0x7f7e2015a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41934/0 (socket says 172.21.15.86:41934) 2024-09-19T06:47:20.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.375+0000 7f7e17fff640 1 -- 172.21.15.86:0/3547934416 learned_addr learned my addr 172.21.15.86:0/3547934416 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:47:20.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.375+0000 7f7e1ffff640 1 --2- 172.21.15.86:0/3547934416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e20155490 0x7f7e201f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.375+0000 7f7e1f7fe640 1 --2- 172.21.15.86:0/3547934416 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e2006c060 0x7f7e201562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.375+0000 7f7e17fff640 1 -- 172.21.15.86:0/3547934416 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e2006c060 msgr2=0x7f7e201562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:20.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.375+0000 7f7e17fff640 1 --2- 172.21.15.86:0/3547934416 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e2006c060 0x7f7e201562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.375+0000 7f7e17fff640 1 -- 172.21.15.86:0/3547934416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e20155490 msgr2=0x7f7e201f4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:20.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.375+0000 7f7e17fff640 1 --2- 172.21.15.86:0/3547934416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e20155490 0x7f7e201f4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.375+0000 7f7e17fff640 1 -- 172.21.15.86:0/3547934416 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2014f6e0 con 0x7f7e201550b0 2024-09-19T06:47:20.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.375+0000 7f7e1f7fe640 1 --2- 172.21.15.86:0/3547934416 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e2006c060 0x7f7e201562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:20.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.376+0000 7f7e17fff640 1 --2- 172.21.15.86:0/3547934416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e201550b0 0x7f7e2015a3f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800c400 tx=0x7f7e0800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:20.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.376+0000 7f7e1cff9640 1 -- 172.21.15.86:0/3547934416 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e08017070 con 0x7f7e201550b0 2024-09-19T06:47:20.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.376+0000 7f7e1cff9640 1 -- 172.21.15.86:0/3547934416 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e080052d0 con 0x7f7e201550b0 2024-09-19T06:47:20.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.376+0000 7f7e25b9f640 1 -- 172.21.15.86:0/3547934416 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e2014f980 con 0x7f7e201550b0 2024-09-19T06:47:20.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.376+0000 7f7e1cff9640 1 -- 172.21.15.86:0/3547934416 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e08003830 con 0x7f7e201550b0 2024-09-19T06:47:20.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.376+0000 7f7e25b9f640 1 -- 172.21.15.86:0/3547934416 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e2014ff40 con 0x7f7e201550b0 2024-09-19T06:47:20.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.377+0000 7f7e25b9f640 1 -- 172.21.15.86:0/3547934416 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e201f3ee0 con 0x7f7e201550b0 2024-09-19T06:47:20.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.377+0000 7f7e1cff9640 1 -- 172.21.15.86:0/3547934416 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7e0801a070 con 0x7f7e201550b0 2024-09-19T06:47:20.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.378+0000 7f7e1cff9640 1 --2- 172.21.15.86:0/3547934416 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7e0006c2b0 0x7f7e0006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.378+0000 7f7e1f7fe640 1 --2- 172.21.15.86:0/3547934416 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7e0006c2b0 0x7f7e0006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.378+0000 7f7e1cff9640 1 -- 172.21.15.86:0/3547934416 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7f7e0808ad90 con 0x7f7e201550b0 2024-09-19T06:47:20.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.378+0000 7f7e1f7fe640 1 --2- 172.21.15.86:0/3547934416 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7e0006c2b0 0x7f7e0006e770 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7e10000f60 tx=0x7f7e10007c50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:20.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.386+0000 7f7e1cff9640 1 -- 172.21.15.86:0/3547934416 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7e08058810 con 0x7f7e201550b0 2024-09-19T06:47:20.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.557+0000 7f7e25b9f640 1 -- 172.21.15.86:0/3547934416 --> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7e201f4160 con 0x7f7e0006c2b0 2024-09-19T06:47:20.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.565+0000 7f7e1cff9640 1 -- 172.21.15.86:0/3547934416 <== mgr.4105 v2:172.21.15.86:6816/4165134248 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335025 (secure 0 0 0) 0x7f7e201f4160 con 0x7f7e0006c2b0 2024-09-19T06:47:20.569 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:47:20.571 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-09-19T06:47:20.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.568+0000 7f7e25b9f640 1 -- 172.21.15.86:0/3547934416 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7e0006c2b0 msgr2=0x7f7e0006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:20.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.568+0000 7f7e25b9f640 1 --2- 172.21.15.86:0/3547934416 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7e0006c2b0 0x7f7e0006e770 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7e10000f60 tx=0x7f7e10007c50 comp rx=0 tx=0).stop 2024-09-19T06:47:20.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.568+0000 7f7e25b9f640 1 -- 172.21.15.86:0/3547934416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e201550b0 msgr2=0x7f7e2015a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:20.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.568+0000 7f7e25b9f640 1 --2- 172.21.15.86:0/3547934416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e201550b0 0x7f7e2015a3f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800c400 tx=0x7f7e0800c8c0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.568+0000 7f7e25b9f640 1 -- 172.21.15.86:0/3547934416 shutdown_connections 2024-09-19T06:47:20.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.568+0000 7f7e25b9f640 1 --2- 172.21.15.86:0/3547934416 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f7e0006c2b0 0x7f7e0006e770 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.568+0000 7f7e25b9f640 1 --2- 172.21.15.86:0/3547934416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e20155490 0x7f7e201f4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.568+0000 7f7e25b9f640 1 --2- 172.21.15.86:0/3547934416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e201550b0 0x7f7e2015a3f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.568+0000 7f7e25b9f640 1 --2- 172.21.15.86:0/3547934416 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e2006c060 0x7f7e201562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.568+0000 7f7e25b9f640 1 -- 172.21.15.86:0/3547934416 >> 172.21.15.86:0/3547934416 conn(0x7f7e200cdd80 msgr2=0x7f7e20152fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:20.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.568+0000 7f7e25b9f640 1 -- 172.21.15.86:0/3547934416 shutdown_connections 2024-09-19T06:47:20.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.568+0000 7f7e25b9f640 1 -- 172.21.15.86:0/3547934416 wait complete. 2024-09-19T06:47:20.580 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2024-09-19T06:47:19.930949+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":66133705,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":1825,"num_read_kb":289584,"num_write":2251821,"num_write_kb":28380840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":80682,"num_omap_keys":138,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162016,"ondisk_log_size":162016,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7860736,"kb_used_data":35648,"kb_used_omap":12,"kb_used_meta":7824947,"kb_avail":747113984,"statfs":{"total":773094113280,"available":765044719616,"internally_reserved":0,"allocated":36503552,"data_stored":133593546,"data_compressed":14248584,"data_compressed_allocated":17154048,"data_compressed_original":115941376,"omap_allocated":12752,"internal_metadata":8012746288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002492"},"pg_stats":[{"pgid":"2.1f","version":"34'15","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:36.785679+0000","last_change":"2024-09-19T06:46:36.785730+0000","last_active":"2024-09-19T06:46:36.785679+0000","last_peered":"2024-09-19T06:46:36.785679+0000","last_clean":"2024-09-19T06:46:36.785679+0000","last_became_active":"2024-09-19T06:37:08.446044+0000","last_became_peered":"2024-09-19T06:37:08.446044+0000","last_unstale":"2024-09-19T06:46:36.785679+0000","last_undegraded":"2024-09-19T06:46:36.785679+0000","last_fullsized":"2024-09-19T06:46:36.785679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-19T06:46:36.785571+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-19T06:46:36.785571+0000","last_clean_scrub_stamp":"2024-09-19T06:46:36.785571+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:12:09.975071+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":20504,"num_write":9,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:46.700434+0000","last_change":"2024-09-19T06:46:38.201144+0000","last_active":"2024-09-19T06:46:46.700434+0000","last_peered":"2024-09-19T06:46:46.700434+0000","last_clean":"2024-09-19T06:46:46.700434+0000","last_became_active":"2024-09-19T06:37:09.440839+0000","last_became_peered":"2024-09-19T06:37:09.440839+0000","last_unstale":"2024-09-19T06:46:46.700434+0000","last_undegraded":"2024-09-19T06:46:46.700434+0000","last_fullsized":"2024-09-19T06:46:46.700434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-19T06:46:38.201034+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-19T06:46:38.201034+0000","last_clean_scrub_stamp":"2024-09-19T06:46:38.201034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:39.058818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'5214","reported_seq":5297,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:51.147698+0000","last_change":"2024-09-19T06:46:51.147698+0000","last_active":"2024-09-19T06:46:51.147698+0000","last_peered":"2024-09-19T06:46:51.147698+0000","last_clean":"2024-09-19T06:46:51.147698+0000","last_became_active":"2024-09-19T06:37:13.460936+0000","last_became_peered":"2024-09-19T06:37:13.460936+0000","last_unstale":"2024-09-19T06:46:51.147698+0000","last_undegraded":"2024-09-19T06:46:51.147698+0000","last_fullsized":"2024-09-19T06:46:51.147698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5214","last_scrub_stamp":"2024-09-19T06:46:51.147550+0000","last_deep_scrub":"34'5214","last_deep_scrub_stamp":"2024-09-19T06:46:51.147550+0000","last_clean_scrub_stamp":"2024-09-19T06:46:51.147550+0000","objects_scrubbed":0,"log_size":5214,"log_dups_size":0,"ondisk_log_size":5214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:17.662938+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":74780,"num_write_kb":941501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"34'31","reported_seq":90,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.261732+0000","last_change":"2024-09-19T06:46:41.272080+0000","last_active":"2024-09-19T06:46:48.261732+0000","last_peered":"2024-09-19T06:46:48.261732+0000","last_clean":"2024-09-19T06:46:48.261732+0000","last_became_active":"2024-09-19T06:37:08.437921+0000","last_became_peered":"2024-09-19T06:37:08.437921+0000","last_unstale":"2024-09-19T06:46:48.261732+0000","last_undegraded":"2024-09-19T06:46:48.261732+0000","last_fullsized":"2024-09-19T06:46:48.261732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'25","last_scrub_stamp":"2024-09-19T06:46:41.271976+0000","last_deep_scrub":"34'25","last_deep_scrub_stamp":"2024-09-19T06:46:41.271976+0000","last_clean_scrub_stamp":"2024-09-19T06:46:41.271976+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:03.734934+0000","scrub_duration":77,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":24576,"num_write":23,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7663,"num_omap_keys":13,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"34'15","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.114493+0000","last_change":"2024-09-19T06:46:45.749492+0000","last_active":"2024-09-19T06:46:48.114493+0000","last_peered":"2024-09-19T06:46:48.114493+0000","last_clean":"2024-09-19T06:46:48.114493+0000","last_became_active":"2024-09-19T06:37:09.450430+0000","last_became_peered":"2024-09-19T06:37:09.450430+0000","last_unstale":"2024-09-19T06:46:48.114493+0000","last_undegraded":"2024-09-19T06:46:48.114493+0000","last_fullsized":"2024-09-19T06:46:48.114493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-19T06:46:45.749353+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-19T06:46:45.749353+0000","last_clean_scrub_stamp":"2024-09-19T06:46:45.749353+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:04.391233+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"34'4911","reported_seq":5000,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.308505+0000","last_change":"2024-09-19T06:46:46.037111+0000","last_active":"2024-09-19T06:46:48.308505+0000","last_peered":"2024-09-19T06:46:48.308505+0000","last_clean":"2024-09-19T06:46:48.308505+0000","last_became_active":"2024-09-19T06:37:13.459040+0000","last_became_peered":"2024-09-19T06:37:13.459040+0000","last_unstale":"2024-09-19T06:46:48.308505+0000","last_undegraded":"2024-09-19T06:46:48.308505+0000","last_fullsized":"2024-09-19T06:46:48.308505+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4901","last_scrub_stamp":"2024-09-19T06:46:46.036984+0000","last_deep_scrub":"34'4901","last_deep_scrub_stamp":"2024-09-19T06:46:46.036984+0000","last_clean_scrub_stamp":"2024-09-19T06:46:46.036984+0000","objects_scrubbed":10,"log_size":4911,"log_dups_size":0,"ondisk_log_size":4911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:54.630970+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":70679,"num_write_kb":897029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"34'340","reported_seq":411,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.244783+0000","last_change":"2024-09-19T06:46:48.086072+0000","last_active":"2024-09-19T06:46:48.244783+0000","last_peered":"2024-09-19T06:46:48.244783+0000","last_clean":"2024-09-19T06:46:48.244783+0000","last_became_active":"2024-09-19T06:37:08.447559+0000","last_became_peered":"2024-09-19T06:37:08.447559+0000","last_unstale":"2024-09-19T06:46:48.244783+0000","last_undegraded":"2024-09-19T06:46:48.244783+0000","last_fullsized":"2024-09-19T06:46:48.244783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'337","last_scrub_stamp":"2024-09-19T06:46:48.085929+0000","last_deep_scrub":"34'337","last_deep_scrub_stamp":"2024-09-19T06:46:48.085929+0000","last_clean_scrub_stamp":"2024-09-19T06:46:48.085929+0000","objects_scrubbed":3,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:36.858379+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":35254,"num_write":321,"num_write_kb":8395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:49.593857+0000","last_change":"2024-09-19T06:46:49.593857+0000","last_active":"2024-09-19T06:46:49.593857+0000","last_peered":"2024-09-19T06:46:49.593857+0000","last_clean":"2024-09-19T06:46:49.593857+0000","last_became_active":"2024-09-19T06:37:09.444806+0000","last_became_peered":"2024-09-19T06:37:09.444806+0000","last_unstale":"2024-09-19T06:46:49.593857+0000","last_undegraded":"2024-09-19T06:46:49.593857+0000","last_fullsized":"2024-09-19T06:46:49.593857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-19T06:46:49.593766+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-19T06:46:49.593766+0000","last_clean_scrub_stamp":"2024-09-19T06:46:49.593766+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:35.262785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4844","reported_seq":4935,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.316403+0000","last_change":"2024-09-19T06:46:44.108462+0000","last_active":"2024-09-19T06:46:48.316403+0000","last_peered":"2024-09-19T06:46:48.316403+0000","last_clean":"2024-09-19T06:46:48.316403+0000","last_became_active":"2024-09-19T06:37:13.458588+0000","last_became_peered":"2024-09-19T06:37:13.458588+0000","last_unstale":"2024-09-19T06:46:48.316403+0000","last_undegraded":"2024-09-19T06:46:48.316403+0000","last_fullsized":"2024-09-19T06:46:48.316403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4811","last_scrub_stamp":"2024-09-19T06:46:44.108271+0000","last_deep_scrub":"34'4811","last_deep_scrub_stamp":"2024-09-19T06:46:44.108271+0000","last_clean_scrub_stamp":"2024-09-19T06:46:44.108271+0000","objects_scrubbed":32,"log_size":4844,"log_dups_size":0,"ondisk_log_size":4844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:29.008216+0000","scrub_duration":202,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":0,"num_write":68596,"num_write_kb":860659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.239249+0000","last_change":"2024-09-19T06:46:45.063400+0000","last_active":"2024-09-19T06:46:48.239249+0000","last_peered":"2024-09-19T06:46:48.239249+0000","last_clean":"2024-09-19T06:46:48.239249+0000","last_became_active":"2024-09-19T06:37:08.446053+0000","last_became_peered":"2024-09-19T06:37:08.446053+0000","last_unstale":"2024-09-19T06:46:48.239249+0000","last_undegraded":"2024-09-19T06:46:48.239249+0000","last_fullsized":"2024-09-19T06:46:48.239249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-19T06:46:45.063250+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-19T06:46:45.063250+0000","last_clean_scrub_stamp":"2024-09-19T06:46:45.063250+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:26.966590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"34'12","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.327608+0000","last_change":"2024-09-19T06:46:47.500639+0000","last_active":"2024-09-19T06:46:48.327608+0000","last_peered":"2024-09-19T06:46:48.327608+0000","last_clean":"2024-09-19T06:46:48.327608+0000","last_became_active":"2024-09-19T06:37:09.444824+0000","last_became_peered":"2024-09-19T06:37:09.444824+0000","last_unstale":"2024-09-19T06:46:48.327608+0000","last_undegraded":"2024-09-19T06:46:48.327608+0000","last_fullsized":"2024-09-19T06:46:48.327608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-19T06:46:47.500501+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-19T06:46:47.500501+0000","last_clean_scrub_stamp":"2024-09-19T06:46:47.500501+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:25.464380+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'4171","reported_seq":4242,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.312142+0000","last_change":"2024-09-19T06:46:47.635152+0000","last_active":"2024-09-19T06:46:48.312142+0000","last_peered":"2024-09-19T06:46:48.312142+0000","last_clean":"2024-09-19T06:46:48.312142+0000","last_became_active":"2024-09-19T06:37:13.459350+0000","last_became_peered":"2024-09-19T06:37:13.459350+0000","last_unstale":"2024-09-19T06:46:48.312142+0000","last_undegraded":"2024-09-19T06:46:48.312142+0000","last_fullsized":"2024-09-19T06:46:48.312142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4166","last_scrub_stamp":"2024-09-19T06:46:47.634616+0000","last_deep_scrub":"34'4166","last_deep_scrub_stamp":"2024-09-19T06:46:47.634616+0000","last_clean_scrub_stamp":"2024-09-19T06:46:47.634616+0000","objects_scrubbed":5,"log_size":4171,"log_dups_size":0,"ondisk_log_size":4171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:56.884358+0000","scrub_duration":633,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":59523,"num_write_kb":744923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"34'9","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:46.546972+0000","last_change":"2024-09-19T06:46:46.546972+0000","last_active":"2024-09-19T06:46:46.546972+0000","last_peered":"2024-09-19T06:46:46.546972+0000","last_clean":"2024-09-19T06:46:46.546972+0000","last_became_active":"2024-09-19T06:37:09.447502+0000","last_became_peered":"2024-09-19T06:37:09.447502+0000","last_unstale":"2024-09-19T06:46:46.546972+0000","last_undegraded":"2024-09-19T06:46:46.546972+0000","last_fullsized":"2024-09-19T06:46:46.546972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-19T06:46:46.546813+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-19T06:46:46.546813+0000","last_clean_scrub_stamp":"2024-09-19T06:46:46.546813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:57.988739+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"34'584","reported_seq":646,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.251275+0000","last_change":"2024-09-19T06:46:43.103359+0000","last_active":"2024-09-19T06:46:48.251275+0000","last_peered":"2024-09-19T06:46:48.251275+0000","last_clean":"2024-09-19T06:46:48.251275+0000","last_became_active":"2024-09-19T06:37:08.445834+0000","last_became_peered":"2024-09-19T06:37:08.445834+0000","last_unstale":"2024-09-19T06:46:48.251275+0000","last_undegraded":"2024-09-19T06:46:48.251275+0000","last_fullsized":"2024-09-19T06:46:48.251275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'580","last_scrub_stamp":"2024-09-19T06:46:43.103223+0000","last_deep_scrub":"34'580","last_deep_scrub_stamp":"2024-09-19T06:46:43.103223+0000","last_clean_scrub_stamp":"2024-09-19T06:46:43.103223+0000","objects_scrubbed":2,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:07.870431+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":20492,"num_write":569,"num_write_kb":4620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"34'4940","reported_seq":5011,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.351603+0000","last_change":"2024-09-19T06:46:48.351603+0000","last_active":"2024-09-19T06:46:48.351603+0000","last_peered":"2024-09-19T06:46:48.351603+0000","last_clean":"2024-09-19T06:46:48.351603+0000","last_became_active":"2024-09-19T06:37:13.459967+0000","last_became_peered":"2024-09-19T06:37:13.459967+0000","last_unstale":"2024-09-19T06:46:48.351603+0000","last_undegraded":"2024-09-19T06:46:48.351603+0000","last_fullsized":"2024-09-19T06:46:48.351603+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4940","last_scrub_stamp":"2024-09-19T06:46:48.351514+0000","last_deep_scrub":"34'4940","last_deep_scrub_stamp":"2024-09-19T06:46:48.351514+0000","last_clean_scrub_stamp":"2024-09-19T06:46:48.351514+0000","objects_scrubbed":1,"log_size":4940,"log_dups_size":0,"ondisk_log_size":4940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:03:27.133673+0000","scrub_duration":365,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":70172,"num_write_kb":882801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"34'9","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:49.119576+0000","last_change":"2024-09-19T06:46:49.119623+0000","last_active":"2024-09-19T06:46:49.119576+0000","last_peered":"2024-09-19T06:46:49.119576+0000","last_clean":"2024-09-19T06:46:49.119576+0000","last_became_active":"2024-09-19T06:37:09.449645+0000","last_became_peered":"2024-09-19T06:37:09.449645+0000","last_unstale":"2024-09-19T06:46:49.119576+0000","last_undegraded":"2024-09-19T06:46:49.119576+0000","last_fullsized":"2024-09-19T06:46:49.119576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-19T06:46:49.119479+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-19T06:46:49.119479+0000","last_clean_scrub_stamp":"2024-09-19T06:46:49.119479+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:12.924433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.178226+0000","last_change":"2024-09-19T06:46:40.544292+0000","last_active":"2024-09-19T06:46:48.178226+0000","last_peered":"2024-09-19T06:46:48.178226+0000","last_clean":"2024-09-19T06:46:48.178226+0000","last_became_active":"2024-09-19T06:37:08.436761+0000","last_became_peered":"2024-09-19T06:37:08.436761+0000","last_unstale":"2024-09-19T06:46:48.178226+0000","last_undegraded":"2024-09-19T06:46:48.178226+0000","last_fullsized":"2024-09-19T06:46:48.178226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:46:40.544137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:46:40.544137+0000","last_clean_scrub_stamp":"2024-09-19T06:46:40.544137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:59.708199+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'5125","reported_seq":5219,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:51.984832+0000","last_change":"2024-09-19T06:46:51.984858+0000","last_active":"2024-09-19T06:46:51.984832+0000","last_peered":"2024-09-19T06:46:51.984832+0000","last_clean":"2024-09-19T06:46:51.984832+0000","last_became_active":"2024-09-19T06:37:51.782257+0000","last_became_peered":"2024-09-19T06:37:51.782257+0000","last_unstale":"2024-09-19T06:46:51.984832+0000","last_undegraded":"2024-09-19T06:46:51.984832+0000","last_fullsized":"2024-09-19T06:46:51.984832+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5125","last_scrub_stamp":"2024-09-19T06:46:51.984726+0000","last_deep_scrub":"34'5125","last_deep_scrub_stamp":"2024-09-19T06:46:51.984726+0000","last_clean_scrub_stamp":"2024-09-19T06:46:51.984726+0000","objects_scrubbed":0,"log_size":5125,"log_dups_size":0,"ondisk_log_size":5125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:40.714720+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":0,"num_write":72356,"num_write_kb":909964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"34'9","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:44.196908+0000","last_change":"2024-09-19T06:46:44.196908+0000","last_active":"2024-09-19T06:46:44.196908+0000","last_peered":"2024-09-19T06:46:44.196908+0000","last_clean":"2024-09-19T06:46:44.196908+0000","last_became_active":"2024-09-19T06:37:09.432589+0000","last_became_peered":"2024-09-19T06:37:09.432589+0000","last_unstale":"2024-09-19T06:46:44.196908+0000","last_undegraded":"2024-09-19T06:46:44.196908+0000","last_fullsized":"2024-09-19T06:46:44.196908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-19T06:46:44.196818+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-19T06:46:44.196818+0000","last_clean_scrub_stamp":"2024-09-19T06:46:44.196818+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:04.814968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"34'3","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.203540+0000","last_change":"2024-09-19T06:46:43.673563+0000","last_active":"2024-09-19T06:46:48.203540+0000","last_peered":"2024-09-19T06:46:48.203540+0000","last_clean":"2024-09-19T06:46:48.203540+0000","last_became_active":"2024-09-19T06:37:08.444160+0000","last_became_peered":"2024-09-19T06:37:08.444160+0000","last_unstale":"2024-09-19T06:46:48.203540+0000","last_undegraded":"2024-09-19T06:46:48.203540+0000","last_fullsized":"2024-09-19T06:46:48.203540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:46:43.673440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:46:43.673440+0000","last_clean_scrub_stamp":"2024-09-19T06:46:43.673440+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:19.134164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"34'5699","reported_seq":5783,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:52.594978+0000","last_change":"2024-09-19T06:46:52.595002+0000","last_active":"2024-09-19T06:46:52.594978+0000","last_peered":"2024-09-19T06:46:52.594978+0000","last_clean":"2024-09-19T06:46:52.594978+0000","last_became_active":"2024-09-19T06:37:13.465731+0000","last_became_peered":"2024-09-19T06:37:13.465731+0000","last_unstale":"2024-09-19T06:46:52.594978+0000","last_undegraded":"2024-09-19T06:46:52.594978+0000","last_fullsized":"2024-09-19T06:46:52.594978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5699","last_scrub_stamp":"2024-09-19T06:46:52.594881+0000","last_deep_scrub":"34'5699","last_deep_scrub_stamp":"2024-09-19T06:46:52.594881+0000","last_clean_scrub_stamp":"2024-09-19T06:46:52.594881+0000","objects_scrubbed":0,"log_size":5699,"log_dups_size":0,"ondisk_log_size":5699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:02.906977+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":81279,"num_write_kb":1030279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"34'11","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.123734+0000","last_change":"2024-09-19T06:46:38.916752+0000","last_active":"2024-09-19T06:46:48.123734+0000","last_peered":"2024-09-19T06:46:48.123734+0000","last_clean":"2024-09-19T06:46:48.123734+0000","last_became_active":"2024-09-19T06:37:09.436512+0000","last_became_peered":"2024-09-19T06:37:09.436512+0000","last_unstale":"2024-09-19T06:46:48.123734+0000","last_undegraded":"2024-09-19T06:46:48.123734+0000","last_fullsized":"2024-09-19T06:46:48.123734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-19T06:46:38.916601+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-19T06:46:38.916601+0000","last_clean_scrub_stamp":"2024-09-19T06:46:38.916601+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:31.059568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"34'800","reported_seq":856,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.156026+0000","last_change":"2024-09-19T06:46:44.117366+0000","last_active":"2024-09-19T06:46:48.156026+0000","last_peered":"2024-09-19T06:46:48.156026+0000","last_clean":"2024-09-19T06:46:48.156026+0000","last_became_active":"2024-09-19T06:37:08.445845+0000","last_became_peered":"2024-09-19T06:37:08.445845+0000","last_unstale":"2024-09-19T06:46:48.156026+0000","last_undegraded":"2024-09-19T06:46:48.156026+0000","last_fullsized":"2024-09-19T06:46:48.156026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'798","last_scrub_stamp":"2024-09-19T06:46:44.117232+0000","last_deep_scrub":"34'798","last_deep_scrub_stamp":"2024-09-19T06:46:44.117232+0000","last_clean_scrub_stamp":"2024-09-19T06:46:44.117232+0000","objects_scrubbed":1,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:21.348712+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":8706,"num_write":792,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"34'4273","reported_seq":4349,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.966748+0000","last_change":"2024-09-19T06:46:48.966774+0000","last_active":"2024-09-19T06:46:48.966748+0000","last_peered":"2024-09-19T06:46:48.966748+0000","last_clean":"2024-09-19T06:46:48.966748+0000","last_became_active":"2024-09-19T06:37:13.460955+0000","last_became_peered":"2024-09-19T06:37:13.460955+0000","last_unstale":"2024-09-19T06:46:48.966748+0000","last_undegraded":"2024-09-19T06:46:48.966748+0000","last_fullsized":"2024-09-19T06:46:48.966748+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4273","last_scrub_stamp":"2024-09-19T06:46:48.966659+0000","last_deep_scrub":"34'4273","last_deep_scrub_stamp":"2024-09-19T06:46:48.966659+0000","last_clean_scrub_stamp":"2024-09-19T06:46:48.966659+0000","objects_scrubbed":0,"log_size":4273,"log_dups_size":0,"ondisk_log_size":4273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:16.391811+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":60620,"num_write_kb":751027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"34'19","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.043667+0000","last_change":"2024-09-19T06:46:39.785554+0000","last_active":"2024-09-19T06:46:48.043667+0000","last_peered":"2024-09-19T06:46:48.043667+0000","last_clean":"2024-09-19T06:46:48.043667+0000","last_became_active":"2024-09-19T06:37:09.445705+0000","last_became_peered":"2024-09-19T06:37:09.445705+0000","last_unstale":"2024-09-19T06:46:48.043667+0000","last_undegraded":"2024-09-19T06:46:48.043667+0000","last_fullsized":"2024-09-19T06:46:48.043667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-19T06:46:39.785445+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-19T06:46:39.785445+0000","last_clean_scrub_stamp":"2024-09-19T06:46:39.785445+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:29:49.070494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"34'7","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.187466+0000","last_change":"2024-09-19T06:46:43.522802+0000","last_active":"2024-09-19T06:46:48.187466+0000","last_peered":"2024-09-19T06:46:48.187466+0000","last_clean":"2024-09-19T06:46:48.187466+0000","last_became_active":"2024-09-19T06:37:08.445929+0000","last_became_peered":"2024-09-19T06:37:08.445929+0000","last_unstale":"2024-09-19T06:46:48.187466+0000","last_undegraded":"2024-09-19T06:46:48.187466+0000","last_fullsized":"2024-09-19T06:46:48.187466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-19T06:46:43.522665+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-19T06:46:43.522665+0000","last_clean_scrub_stamp":"2024-09-19T06:46:43.522665+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:26.318586+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"34'5020","reported_seq":5104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:50.006128+0000","last_change":"2024-09-19T06:46:50.006153+0000","last_active":"2024-09-19T06:46:50.006128+0000","last_peered":"2024-09-19T06:46:50.006128+0000","last_clean":"2024-09-19T06:46:50.006128+0000","last_became_active":"2024-09-19T06:37:13.462217+0000","last_became_peered":"2024-09-19T06:37:13.462217+0000","last_unstale":"2024-09-19T06:46:50.006128+0000","last_undegraded":"2024-09-19T06:46:50.006128+0000","last_fullsized":"2024-09-19T06:46:50.006128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5020","last_scrub_stamp":"2024-09-19T06:46:50.006033+0000","last_deep_scrub":"34'5020","last_deep_scrub_stamp":"2024-09-19T06:46:50.006033+0000","last_clean_scrub_stamp":"2024-09-19T06:46:50.006033+0000","objects_scrubbed":0,"log_size":5020,"log_dups_size":0,"ondisk_log_size":5020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:13.371194+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":71728,"num_write_kb":902613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"34'13","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.170703+0000","last_change":"2024-09-19T06:46:45.179424+0000","last_active":"2024-09-19T06:46:48.170703+0000","last_peered":"2024-09-19T06:46:48.170703+0000","last_clean":"2024-09-19T06:46:48.170703+0000","last_became_active":"2024-09-19T06:37:09.433897+0000","last_became_peered":"2024-09-19T06:37:09.433897+0000","last_unstale":"2024-09-19T06:46:48.170703+0000","last_undegraded":"2024-09-19T06:46:48.170703+0000","last_fullsized":"2024-09-19T06:46:48.170703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-19T06:46:45.179285+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-19T06:46:45.179285+0000","last_clean_scrub_stamp":"2024-09-19T06:46:45.179285+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:50.508306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"34'174","reported_seq":232,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.150419+0000","last_change":"2024-09-19T06:46:42.701938+0000","last_active":"2024-09-19T06:46:48.150419+0000","last_peered":"2024-09-19T06:46:48.150419+0000","last_clean":"2024-09-19T06:46:48.150419+0000","last_became_active":"2024-09-19T06:37:08.441245+0000","last_became_peered":"2024-09-19T06:37:08.441245+0000","last_unstale":"2024-09-19T06:46:48.150419+0000","last_undegraded":"2024-09-19T06:46:48.150419+0000","last_fullsized":"2024-09-19T06:46:48.150419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'168","last_scrub_stamp":"2024-09-19T06:46:42.701802+0000","last_deep_scrub":"34'168","last_deep_scrub_stamp":"2024-09-19T06:46:42.701802+0000","last_clean_scrub_stamp":"2024-09-19T06:46:42.701802+0000","objects_scrubbed":3,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:06.449359+0000","scrub_duration":115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":67,"num_write":361,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14264,"num_omap_keys":24,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"34'5440","reported_seq":5526,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:55.205959+0000","last_change":"2024-09-19T06:46:55.205983+0000","last_active":"2024-09-19T06:46:55.205959+0000","last_peered":"2024-09-19T06:46:55.205959+0000","last_clean":"2024-09-19T06:46:55.205959+0000","last_became_active":"2024-09-19T06:37:13.468074+0000","last_became_peered":"2024-09-19T06:37:13.468074+0000","last_unstale":"2024-09-19T06:46:55.205959+0000","last_undegraded":"2024-09-19T06:46:55.205959+0000","last_fullsized":"2024-09-19T06:46:55.205959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5440","last_scrub_stamp":"2024-09-19T06:46:55.205867+0000","last_deep_scrub":"34'5440","last_deep_scrub_stamp":"2024-09-19T06:46:55.205867+0000","last_clean_scrub_stamp":"2024-09-19T06:46:55.205867+0000","objects_scrubbed":0,"log_size":5440,"log_dups_size":0,"ondisk_log_size":5440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:29.940681+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":78291,"num_write_kb":979369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"34'9","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.115517+0000","last_change":"2024-09-19T06:46:45.755920+0000","last_active":"2024-09-19T06:46:48.115517+0000","last_peered":"2024-09-19T06:46:48.115517+0000","last_clean":"2024-09-19T06:46:48.115517+0000","last_became_active":"2024-09-19T06:37:09.435597+0000","last_became_peered":"2024-09-19T06:37:09.435597+0000","last_unstale":"2024-09-19T06:46:48.115517+0000","last_undegraded":"2024-09-19T06:46:48.115517+0000","last_fullsized":"2024-09-19T06:46:48.115517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-19T06:46:45.755767+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-19T06:46:45.755767+0000","last_clean_scrub_stamp":"2024-09-19T06:46:45.755767+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:34.412676+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.245055+0000","last_change":"2024-09-19T06:46:47.069562+0000","last_active":"2024-09-19T06:46:48.245055+0000","last_peered":"2024-09-19T06:46:48.245055+0000","last_clean":"2024-09-19T06:46:48.245055+0000","last_became_active":"2024-09-19T06:37:08.447630+0000","last_became_peered":"2024-09-19T06:37:08.447630+0000","last_unstale":"2024-09-19T06:46:48.245055+0000","last_undegraded":"2024-09-19T06:46:48.245055+0000","last_fullsized":"2024-09-19T06:46:48.245055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:46:47.069432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:46:47.069432+0000","last_clean_scrub_stamp":"2024-09-19T06:46:47.069432+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:48:26.722623+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"34'4543","reported_seq":4627,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.268310+0000","last_change":"2024-09-19T06:46:47.946516+0000","last_active":"2024-09-19T06:46:48.268310+0000","last_peered":"2024-09-19T06:46:48.268310+0000","last_clean":"2024-09-19T06:46:48.268310+0000","last_became_active":"2024-09-19T06:37:13.467926+0000","last_became_peered":"2024-09-19T06:37:13.467926+0000","last_unstale":"2024-09-19T06:46:48.268310+0000","last_undegraded":"2024-09-19T06:46:48.268310+0000","last_fullsized":"2024-09-19T06:46:48.268310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4539","last_scrub_stamp":"2024-09-19T06:46:47.946382+0000","last_deep_scrub":"34'4539","last_deep_scrub_stamp":"2024-09-19T06:46:47.946382+0000","last_clean_scrub_stamp":"2024-09-19T06:46:47.946382+0000","objects_scrubbed":4,"log_size":4543,"log_dups_size":0,"ondisk_log_size":4543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:33.804522+0000","scrub_duration":239,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":64826,"num_write_kb":802716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"34'15","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.205478+0000","last_change":"2024-09-19T06:46:45.532732+0000","last_active":"2024-09-19T06:46:48.205478+0000","last_peered":"2024-09-19T06:46:48.205478+0000","last_clean":"2024-09-19T06:46:48.205478+0000","last_became_active":"2024-09-19T06:37:09.441406+0000","last_became_peered":"2024-09-19T06:37:09.441406+0000","last_unstale":"2024-09-19T06:46:48.205478+0000","last_undegraded":"2024-09-19T06:46:48.205478+0000","last_fullsized":"2024-09-19T06:46:48.205478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-19T06:46:45.532589+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-19T06:46:45.532589+0000","last_clean_scrub_stamp":"2024-09-19T06:46:45.532589+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:17.163362+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.153005+0000","last_change":"2024-09-19T06:46:41.574351+0000","last_active":"2024-09-19T06:46:48.153005+0000","last_peered":"2024-09-19T06:46:48.153005+0000","last_clean":"2024-09-19T06:46:48.153005+0000","last_became_active":"2024-09-19T06:37:08.438528+0000","last_became_peered":"2024-09-19T06:37:08.438528+0000","last_unstale":"2024-09-19T06:46:48.153005+0000","last_undegraded":"2024-09-19T06:46:48.153005+0000","last_fullsized":"2024-09-19T06:46:48.153005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-19T06:46:41.574202+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-19T06:46:41.574202+0000","last_clean_scrub_stamp":"2024-09-19T06:46:41.574202+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:20.737719+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10508,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'5505","reported_seq":5579,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.629457+0000","last_change":"2024-09-19T06:46:48.629484+0000","last_active":"2024-09-19T06:46:48.629457+0000","last_peered":"2024-09-19T06:46:48.629457+0000","last_clean":"2024-09-19T06:46:48.629457+0000","last_became_active":"2024-09-19T06:37:13.459303+0000","last_became_peered":"2024-09-19T06:37:13.459303+0000","last_unstale":"2024-09-19T06:46:48.629457+0000","last_undegraded":"2024-09-19T06:46:48.629457+0000","last_fullsized":"2024-09-19T06:46:48.629457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5505","last_scrub_stamp":"2024-09-19T06:46:48.629362+0000","last_deep_scrub":"34'5505","last_deep_scrub_stamp":"2024-09-19T06:46:48.629362+0000","last_clean_scrub_stamp":"2024-09-19T06:46:48.629362+0000","objects_scrubbed":0,"log_size":5505,"log_dups_size":0,"ondisk_log_size":5505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:17:38.165941+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":79079,"num_write_kb":992273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.259906+0000","last_change":"2024-09-19T06:46:42.955440+0000","last_active":"2024-09-19T06:46:48.259906+0000","last_peered":"2024-09-19T06:46:48.259906+0000","last_clean":"2024-09-19T06:46:48.259906+0000","last_became_active":"2024-09-19T06:37:09.448899+0000","last_became_peered":"2024-09-19T06:37:09.448899+0000","last_unstale":"2024-09-19T06:46:48.259906+0000","last_undegraded":"2024-09-19T06:46:48.259906+0000","last_fullsized":"2024-09-19T06:46:48.259906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-19T06:46:42.955291+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-19T06:46:42.955291+0000","last_clean_scrub_stamp":"2024-09-19T06:46:42.955291+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:57.908393+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"34'203","reported_seq":257,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.236734+0000","last_change":"2024-09-19T06:46:38.505115+0000","last_active":"2024-09-19T06:46:48.236734+0000","last_peered":"2024-09-19T06:46:48.236734+0000","last_clean":"2024-09-19T06:46:48.236734+0000","last_became_active":"2024-09-19T06:37:08.433984+0000","last_became_peered":"2024-09-19T06:37:08.433984+0000","last_unstale":"2024-09-19T06:46:48.236734+0000","last_undegraded":"2024-09-19T06:46:48.236734+0000","last_fullsized":"2024-09-19T06:46:48.236734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'199","last_scrub_stamp":"2024-09-19T06:46:38.505011+0000","last_deep_scrub":"34'199","last_deep_scrub_stamp":"2024-09-19T06:46:38.505011+0000","last_clean_scrub_stamp":"2024-09-19T06:46:38.505011+0000","objects_scrubbed":1,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:40.981576+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":190,"num_write_kb":4204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"34'4556","reported_seq":4638,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:49.578876+0000","last_change":"2024-09-19T06:46:49.578912+0000","last_active":"2024-09-19T06:46:49.578876+0000","last_peered":"2024-09-19T06:46:49.578876+0000","last_clean":"2024-09-19T06:46:49.578876+0000","last_became_active":"2024-09-19T06:37:13.461685+0000","last_became_peered":"2024-09-19T06:37:13.461685+0000","last_unstale":"2024-09-19T06:46:49.578876+0000","last_undegraded":"2024-09-19T06:46:49.578876+0000","last_fullsized":"2024-09-19T06:46:49.578876+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4556","last_scrub_stamp":"2024-09-19T06:46:49.578765+0000","last_deep_scrub":"34'4556","last_deep_scrub_stamp":"2024-09-19T06:46:49.578765+0000","last_clean_scrub_stamp":"2024-09-19T06:46:49.578765+0000","objects_scrubbed":0,"log_size":4556,"log_dups_size":0,"ondisk_log_size":4556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:51.488017+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":65440,"num_write_kb":836807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"34'15","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.248847+0000","last_change":"2024-09-19T06:46:44.714651+0000","last_active":"2024-09-19T06:46:48.248847+0000","last_peered":"2024-09-19T06:46:48.248847+0000","last_clean":"2024-09-19T06:46:48.248847+0000","last_became_active":"2024-09-19T06:37:09.434119+0000","last_became_peered":"2024-09-19T06:37:09.434119+0000","last_unstale":"2024-09-19T06:46:48.248847+0000","last_undegraded":"2024-09-19T06:46:48.248847+0000","last_fullsized":"2024-09-19T06:46:48.248847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-09-19T06:46:44.709417+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-09-19T06:46:44.709417+0000","last_clean_scrub_stamp":"2024-09-19T06:46:44.709417+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:32.031449+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"34'28","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:37.997467+0000","last_change":"2024-09-19T06:46:37.997467+0000","last_active":"2024-09-19T06:46:37.997467+0000","last_peered":"2024-09-19T06:46:37.997467+0000","last_clean":"2024-09-19T06:46:37.997467+0000","last_became_active":"2024-09-19T06:37:08.435718+0000","last_became_peered":"2024-09-19T06:37:08.435718+0000","last_unstale":"2024-09-19T06:46:37.997467+0000","last_undegraded":"2024-09-19T06:46:37.997467+0000","last_fullsized":"2024-09-19T06:46:37.997467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'27","last_scrub_stamp":"2024-09-19T06:46:37.997332+0000","last_deep_scrub":"34'27","last_deep_scrub_stamp":"2024-09-19T06:46:37.997332+0000","last_clean_scrub_stamp":"2024-09-19T06:46:37.997332+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:32.405940+0000","scrub_duration":77,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94269,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":146,"num_write":23,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'5276","reported_seq":5361,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:51.578652+0000","last_change":"2024-09-19T06:46:51.578692+0000","last_active":"2024-09-19T06:46:51.578652+0000","last_peered":"2024-09-19T06:46:51.578652+0000","last_clean":"2024-09-19T06:46:51.578652+0000","last_became_active":"2024-09-19T06:37:13.465348+0000","last_became_peered":"2024-09-19T06:37:13.465348+0000","last_unstale":"2024-09-19T06:46:51.578652+0000","last_undegraded":"2024-09-19T06:46:51.578652+0000","last_fullsized":"2024-09-19T06:46:51.578652+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5276","last_scrub_stamp":"2024-09-19T06:46:51.578550+0000","last_deep_scrub":"34'5276","last_deep_scrub_stamp":"2024-09-19T06:46:51.578550+0000","last_clean_scrub_stamp":"2024-09-19T06:46:51.578550+0000","objects_scrubbed":0,"log_size":5276,"log_dups_size":0,"ondisk_log_size":5276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:00.490512+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":75949,"num_write_kb":952671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.151080+0000","last_change":"2024-09-19T06:46:38.781688+0000","last_active":"2024-09-19T06:46:48.151080+0000","last_peered":"2024-09-19T06:46:48.151080+0000","last_clean":"2024-09-19T06:46:48.151080+0000","last_became_active":"2024-09-19T06:37:09.444605+0000","last_became_peered":"2024-09-19T06:37:09.444605+0000","last_unstale":"2024-09-19T06:46:48.151080+0000","last_undegraded":"2024-09-19T06:46:48.151080+0000","last_fullsized":"2024-09-19T06:46:48.151080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-19T06:46:38.781388+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-19T06:46:38.781388+0000","last_clean_scrub_stamp":"2024-09-19T06:46:38.781388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:47:06.367133+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"34'49","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.247677+0000","last_change":"2024-09-19T06:46:46.112849+0000","last_active":"2024-09-19T06:46:48.247677+0000","last_peered":"2024-09-19T06:46:48.247677+0000","last_clean":"2024-09-19T06:46:48.247677+0000","last_became_active":"2024-09-19T06:37:08.446474+0000","last_became_peered":"2024-09-19T06:37:08.446474+0000","last_unstale":"2024-09-19T06:46:48.247677+0000","last_undegraded":"2024-09-19T06:46:48.247677+0000","last_fullsized":"2024-09-19T06:46:48.247677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-09-19T06:46:46.112710+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-09-19T06:46:46.112710+0000","last_clean_scrub_stamp":"2024-09-19T06:46:46.112710+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:49.492139+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":38,"num_write_kb":8207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"34'4406","reported_seq":4491,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:49.715848+0000","last_change":"2024-09-19T06:46:49.715878+0000","last_active":"2024-09-19T06:46:49.715848+0000","last_peered":"2024-09-19T06:46:49.715848+0000","last_clean":"2024-09-19T06:46:49.715848+0000","last_became_active":"2024-09-19T06:37:13.470860+0000","last_became_peered":"2024-09-19T06:37:13.470860+0000","last_unstale":"2024-09-19T06:46:49.715848+0000","last_undegraded":"2024-09-19T06:46:49.715848+0000","last_fullsized":"2024-09-19T06:46:49.715848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4406","last_scrub_stamp":"2024-09-19T06:46:49.715735+0000","last_deep_scrub":"34'4406","last_deep_scrub_stamp":"2024-09-19T06:46:49.715735+0000","last_clean_scrub_stamp":"2024-09-19T06:46:49.715735+0000","objects_scrubbed":0,"log_size":4406,"log_dups_size":0,"ondisk_log_size":4406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:17:57.479249+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":62706,"num_write_kb":794606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.138933+0000","last_change":"2024-09-19T06:46:48.138970+0000","last_active":"2024-09-19T06:46:48.138933+0000","last_peered":"2024-09-19T06:46:48.138933+0000","last_clean":"2024-09-19T06:46:48.138933+0000","last_became_active":"2024-09-19T06:37:09.439478+0000","last_became_peered":"2024-09-19T06:37:09.439478+0000","last_unstale":"2024-09-19T06:46:48.138933+0000","last_undegraded":"2024-09-19T06:46:48.138933+0000","last_fullsized":"2024-09-19T06:46:48.138933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-19T06:46:48.138848+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-19T06:46:48.138848+0000","last_clean_scrub_stamp":"2024-09-19T06:46:48.138848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:43.125977+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:39.541891+0000","last_change":"2024-09-19T06:46:39.541916+0000","last_active":"2024-09-19T06:46:39.541891+0000","last_peered":"2024-09-19T06:46:39.541891+0000","last_clean":"2024-09-19T06:46:39.541891+0000","last_became_active":"2024-09-19T06:37:08.435183+0000","last_became_peered":"2024-09-19T06:37:08.435183+0000","last_unstale":"2024-09-19T06:46:39.541891+0000","last_undegraded":"2024-09-19T06:46:39.541891+0000","last_fullsized":"2024-09-19T06:46:39.541891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-09-19T06:46:39.541805+0000","last_deep_scrub":"28'1","last_deep_scrub_stamp":"2024-09-19T06:46:39.541805+0000","last_clean_scrub_stamp":"2024-09-19T06:46:39.541805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:15.508524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"34'119","reported_seq":210,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:42.096518+0000","last_change":"2024-09-19T06:46:42.096518+0000","last_active":"2024-09-19T06:46:42.096518+0000","last_peered":"2024-09-19T06:46:42.096518+0000","last_clean":"2024-09-19T06:46:42.096518+0000","last_became_active":"2024-09-19T06:36:58.828079+0000","last_became_peered":"2024-09-19T06:36:58.828079+0000","last_unstale":"2024-09-19T06:46:42.096518+0000","last_undegraded":"2024-09-19T06:46:42.096518+0000","last_fullsized":"2024-09-19T06:46:42.096518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2024-09-19T06:46:42.095809+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2024-09-19T06:46:42.095809+0000","last_clean_scrub_stamp":"2024-09-19T06:46:42.095809+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:27.675491+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"34'4834","reported_seq":4905,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:51.647528+0000","last_change":"2024-09-19T06:46:51.647558+0000","last_active":"2024-09-19T06:46:51.647528+0000","last_peered":"2024-09-19T06:46:51.647528+0000","last_clean":"2024-09-19T06:46:51.647528+0000","last_became_active":"2024-09-19T06:37:13.464101+0000","last_became_peered":"2024-09-19T06:37:13.464101+0000","last_unstale":"2024-09-19T06:46:51.647528+0000","last_undegraded":"2024-09-19T06:46:51.647528+0000","last_fullsized":"2024-09-19T06:46:51.647528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4834","last_scrub_stamp":"2024-09-19T06:46:51.647423+0000","last_deep_scrub":"34'4834","last_deep_scrub_stamp":"2024-09-19T06:46:51.647423+0000","last_clean_scrub_stamp":"2024-09-19T06:46:51.647423+0000","objects_scrubbed":0,"log_size":4834,"log_dups_size":0,"ondisk_log_size":4834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:38.189992+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":69016,"num_write_kb":870393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"34'15","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:55.037510+0000","last_change":"2024-09-19T06:46:55.037539+0000","last_active":"2024-09-19T06:46:55.037510+0000","last_peered":"2024-09-19T06:46:55.037510+0000","last_clean":"2024-09-19T06:46:55.037510+0000","last_became_active":"2024-09-19T06:37:09.442515+0000","last_became_peered":"2024-09-19T06:37:09.442515+0000","last_unstale":"2024-09-19T06:46:55.037510+0000","last_undegraded":"2024-09-19T06:46:55.037510+0000","last_fullsized":"2024-09-19T06:46:55.037510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-19T06:46:55.037401+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-19T06:46:55.037401+0000","last_clean_scrub_stamp":"2024-09-19T06:46:55.037401+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:17.777911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:39.921083+0000","last_change":"2024-09-19T06:46:39.921083+0000","last_active":"2024-09-19T06:46:39.921083+0000","last_peered":"2024-09-19T06:46:39.921083+0000","last_clean":"2024-09-19T06:46:39.921083+0000","last_became_active":"2024-09-19T06:37:08.437771+0000","last_became_peered":"2024-09-19T06:37:08.437771+0000","last_unstale":"2024-09-19T06:46:39.921083+0000","last_undegraded":"2024-09-19T06:46:39.921083+0000","last_fullsized":"2024-09-19T06:46:39.921083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-09-19T06:46:39.920926+0000","last_deep_scrub":"28'1","last_deep_scrub_stamp":"2024-09-19T06:46:39.920926+0000","last_clean_scrub_stamp":"2024-09-19T06:46:39.920926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:19.244102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"34'4884","reported_seq":4968,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:53.652799+0000","last_change":"2024-09-19T06:46:53.652844+0000","last_active":"2024-09-19T06:46:53.652799+0000","last_peered":"2024-09-19T06:46:53.652799+0000","last_clean":"2024-09-19T06:46:53.652799+0000","last_became_active":"2024-09-19T06:37:51.781963+0000","last_became_peered":"2024-09-19T06:37:51.781963+0000","last_unstale":"2024-09-19T06:46:53.652799+0000","last_undegraded":"2024-09-19T06:46:53.652799+0000","last_fullsized":"2024-09-19T06:46:53.652799+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4884","last_scrub_stamp":"2024-09-19T06:46:53.652684+0000","last_deep_scrub":"34'4884","last_deep_scrub_stamp":"2024-09-19T06:46:53.652684+0000","last_clean_scrub_stamp":"2024-09-19T06:46:53.652684+0000","objects_scrubbed":0,"log_size":4884,"log_dups_size":0,"ondisk_log_size":4884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:14.592212+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":69562,"num_write_kb":883742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"34'14","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.161558+0000","last_change":"2024-09-19T06:46:46.468892+0000","last_active":"2024-09-19T06:46:48.161558+0000","last_peered":"2024-09-19T06:46:48.161558+0000","last_clean":"2024-09-19T06:46:48.161558+0000","last_became_active":"2024-09-19T06:37:09.441850+0000","last_became_peered":"2024-09-19T06:37:09.441850+0000","last_unstale":"2024-09-19T06:46:48.161558+0000","last_undegraded":"2024-09-19T06:46:48.161558+0000","last_fullsized":"2024-09-19T06:46:48.161558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-19T06:46:46.468726+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-19T06:46:46.468726+0000","last_clean_scrub_stamp":"2024-09-19T06:46:46.468726+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:06:22.859204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"34'166","reported_seq":225,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:38.483391+0000","last_change":"2024-09-19T06:46:38.483391+0000","last_active":"2024-09-19T06:46:38.483391+0000","last_peered":"2024-09-19T06:46:38.483391+0000","last_clean":"2024-09-19T06:46:38.483391+0000","last_became_active":"2024-09-19T06:37:08.431443+0000","last_became_peered":"2024-09-19T06:37:08.431443+0000","last_unstale":"2024-09-19T06:46:38.483391+0000","last_undegraded":"2024-09-19T06:46:38.483391+0000","last_fullsized":"2024-09-19T06:46:38.483391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'165","last_scrub_stamp":"2024-09-19T06:46:38.483292+0000","last_deep_scrub":"34'165","last_deep_scrub_stamp":"2024-09-19T06:46:38.483292+0000","last_clean_scrub_stamp":"2024-09-19T06:46:38.483292+0000","objects_scrubbed":2,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:42.663273+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2533108,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":2297,"num_write":159,"num_write_kb":2550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'4583","reported_seq":4668,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.757516+0000","last_change":"2024-09-19T06:46:48.757557+0000","last_active":"2024-09-19T06:46:48.757516+0000","last_peered":"2024-09-19T06:46:48.757516+0000","last_clean":"2024-09-19T06:46:48.757516+0000","last_became_active":"2024-09-19T06:37:13.468879+0000","last_became_peered":"2024-09-19T06:37:13.468879+0000","last_unstale":"2024-09-19T06:46:48.757516+0000","last_undegraded":"2024-09-19T06:46:48.757516+0000","last_fullsized":"2024-09-19T06:46:48.757516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4583","last_scrub_stamp":"2024-09-19T06:46:48.757418+0000","last_deep_scrub":"34'4583","last_deep_scrub_stamp":"2024-09-19T06:46:48.757418+0000","last_clean_scrub_stamp":"2024-09-19T06:46:48.757418+0000","objects_scrubbed":0,"log_size":4583,"log_dups_size":0,"ondisk_log_size":4583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:10.775451+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":65623,"num_write_kb":822050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"34'12","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:49.987054+0000","last_change":"2024-09-19T06:46:49.987091+0000","last_active":"2024-09-19T06:46:49.987054+0000","last_peered":"2024-09-19T06:46:49.987054+0000","last_clean":"2024-09-19T06:46:49.987054+0000","last_became_active":"2024-09-19T06:37:09.438954+0000","last_became_peered":"2024-09-19T06:37:09.438954+0000","last_unstale":"2024-09-19T06:46:49.987054+0000","last_undegraded":"2024-09-19T06:46:49.987054+0000","last_fullsized":"2024-09-19T06:46:49.987054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-19T06:46:49.986949+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-19T06:46:49.986949+0000","last_clean_scrub_stamp":"2024-09-19T06:46:49.986949+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:20:28.963753+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"34'11","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.201483+0000","last_change":"2024-09-19T06:46:38.981752+0000","last_active":"2024-09-19T06:46:48.201483+0000","last_peered":"2024-09-19T06:46:48.201483+0000","last_clean":"2024-09-19T06:46:48.201483+0000","last_became_active":"2024-09-19T06:37:08.437093+0000","last_became_peered":"2024-09-19T06:37:08.437093+0000","last_unstale":"2024-09-19T06:46:48.201483+0000","last_undegraded":"2024-09-19T06:46:48.201483+0000","last_fullsized":"2024-09-19T06:46:48.201483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-19T06:46:38.981588+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-19T06:46:38.981588+0000","last_clean_scrub_stamp":"2024-09-19T06:46:38.981588+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:31.864208+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"34'4768","reported_seq":4849,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:53.565944+0000","last_change":"2024-09-19T06:46:53.565997+0000","last_active":"2024-09-19T06:46:53.565944+0000","last_peered":"2024-09-19T06:46:53.565944+0000","last_clean":"2024-09-19T06:46:53.565944+0000","last_became_active":"2024-09-19T06:37:13.459707+0000","last_became_peered":"2024-09-19T06:37:13.459707+0000","last_unstale":"2024-09-19T06:46:53.565944+0000","last_undegraded":"2024-09-19T06:46:53.565944+0000","last_fullsized":"2024-09-19T06:46:53.565944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4768","last_scrub_stamp":"2024-09-19T06:46:53.565827+0000","last_deep_scrub":"34'4768","last_deep_scrub_stamp":"2024-09-19T06:46:53.565827+0000","last_clean_scrub_stamp":"2024-09-19T06:46:53.565827+0000","objects_scrubbed":0,"log_size":4768,"log_dups_size":0,"ondisk_log_size":4768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:08.525096+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":0,"num_write":68547,"num_write_kb":859940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"34'7","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:54.082622+0000","last_change":"2024-09-19T06:46:54.082651+0000","last_active":"2024-09-19T06:46:54.082622+0000","last_peered":"2024-09-19T06:46:54.082622+0000","last_clean":"2024-09-19T06:46:54.082622+0000","last_became_active":"2024-09-19T06:37:09.442390+0000","last_became_peered":"2024-09-19T06:37:09.442390+0000","last_unstale":"2024-09-19T06:46:54.082622+0000","last_undegraded":"2024-09-19T06:46:54.082622+0000","last_fullsized":"2024-09-19T06:46:54.082622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-19T06:46:54.082537+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-19T06:46:54.082537+0000","last_clean_scrub_stamp":"2024-09-19T06:46:54.082537+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:07.873898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"34'7","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.104281+0000","last_change":"2024-09-19T06:46:37.969714+0000","last_active":"2024-09-19T06:46:48.104281+0000","last_peered":"2024-09-19T06:46:48.104281+0000","last_clean":"2024-09-19T06:46:48.104281+0000","last_became_active":"2024-09-19T06:37:08.436982+0000","last_became_peered":"2024-09-19T06:37:08.436982+0000","last_unstale":"2024-09-19T06:46:48.104281+0000","last_undegraded":"2024-09-19T06:46:48.104281+0000","last_fullsized":"2024-09-19T06:46:48.104281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-19T06:46:37.969569+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-19T06:46:37.969569+0000","last_clean_scrub_stamp":"2024-09-19T06:46:37.969569+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:17:41.559498+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7739,"num_omap_keys":13,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"34'4824","reported_seq":4913,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:51.024532+0000","last_change":"2024-09-19T06:46:51.024560+0000","last_active":"2024-09-19T06:46:51.024532+0000","last_peered":"2024-09-19T06:46:51.024532+0000","last_clean":"2024-09-19T06:46:51.024532+0000","last_became_active":"2024-09-19T06:37:51.781602+0000","last_became_peered":"2024-09-19T06:37:51.781602+0000","last_unstale":"2024-09-19T06:46:51.024532+0000","last_undegraded":"2024-09-19T06:46:51.024532+0000","last_fullsized":"2024-09-19T06:46:51.024532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4824","last_scrub_stamp":"2024-09-19T06:46:51.024424+0000","last_deep_scrub":"34'4824","last_deep_scrub_stamp":"2024-09-19T06:46:51.024424+0000","last_clean_scrub_stamp":"2024-09-19T06:46:51.024424+0000","objects_scrubbed":0,"log_size":4824,"log_dups_size":0,"ondisk_log_size":4824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:03.982514+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":68527,"num_write_kb":854704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3,6],"acting":[4,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"34'14","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:51.003157+0000","last_change":"2024-09-19T06:46:51.003181+0000","last_active":"2024-09-19T06:46:51.003157+0000","last_peered":"2024-09-19T06:46:51.003157+0000","last_clean":"2024-09-19T06:46:51.003157+0000","last_became_active":"2024-09-19T06:37:09.437717+0000","last_became_peered":"2024-09-19T06:37:09.437717+0000","last_unstale":"2024-09-19T06:46:51.003157+0000","last_undegraded":"2024-09-19T06:46:51.003157+0000","last_fullsized":"2024-09-19T06:46:51.003157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-19T06:46:51.003072+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-19T06:46:51.003072+0000","last_clean_scrub_stamp":"2024-09-19T06:46:51.003072+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:55.664575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"34'16","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.206089+0000","last_change":"2024-09-19T06:46:36.962258+0000","last_active":"2024-09-19T06:46:48.206089+0000","last_peered":"2024-09-19T06:46:48.206089+0000","last_clean":"2024-09-19T06:46:48.206089+0000","last_became_active":"2024-09-19T06:37:08.430324+0000","last_became_peered":"2024-09-19T06:37:08.430324+0000","last_unstale":"2024-09-19T06:46:48.206089+0000","last_undegraded":"2024-09-19T06:46:48.206089+0000","last_fullsized":"2024-09-19T06:46:48.206089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-19T06:46:36.962090+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-19T06:46:36.962090+0000","last_clean_scrub_stamp":"2024-09-19T06:46:36.962090+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:09:30.330268+0000","scrub_duration":69,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"34'5284","reported_seq":5366,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.339488+0000","last_change":"2024-09-19T06:46:47.365996+0000","last_active":"2024-09-19T06:46:48.339488+0000","last_peered":"2024-09-19T06:46:48.339488+0000","last_clean":"2024-09-19T06:46:48.339488+0000","last_became_active":"2024-09-19T06:37:13.463334+0000","last_became_peered":"2024-09-19T06:37:13.463334+0000","last_unstale":"2024-09-19T06:46:48.339488+0000","last_undegraded":"2024-09-19T06:46:48.339488+0000","last_fullsized":"2024-09-19T06:46:48.339488+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5273","last_scrub_stamp":"2024-09-19T06:46:47.365658+0000","last_deep_scrub":"34'5273","last_deep_scrub_stamp":"2024-09-19T06:46:47.365658+0000","last_clean_scrub_stamp":"2024-09-19T06:46:47.365658+0000","objects_scrubbed":11,"log_size":5284,"log_dups_size":0,"ondisk_log_size":5284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:42.488071+0000","scrub_duration":625,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":75271,"num_write_kb":939459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'14","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:49.643269+0000","last_change":"2024-09-19T06:46:49.643290+0000","last_active":"2024-09-19T06:46:49.643269+0000","last_peered":"2024-09-19T06:46:49.643269+0000","last_clean":"2024-09-19T06:46:49.643269+0000","last_became_active":"2024-09-19T06:37:09.449872+0000","last_became_peered":"2024-09-19T06:37:09.449872+0000","last_unstale":"2024-09-19T06:46:49.643269+0000","last_undegraded":"2024-09-19T06:46:49.643269+0000","last_fullsized":"2024-09-19T06:46:49.643269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-19T06:46:49.643200+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-19T06:46:49.643200+0000","last_clean_scrub_stamp":"2024-09-19T06:46:49.643200+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:52.325464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"34'7","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.173301+0000","last_change":"2024-09-19T06:46:41.552816+0000","last_active":"2024-09-19T06:46:48.173301+0000","last_peered":"2024-09-19T06:46:48.173301+0000","last_clean":"2024-09-19T06:46:48.173301+0000","last_became_active":"2024-09-19T06:37:08.442120+0000","last_became_peered":"2024-09-19T06:37:08.442120+0000","last_unstale":"2024-09-19T06:46:48.173301+0000","last_undegraded":"2024-09-19T06:46:48.173301+0000","last_fullsized":"2024-09-19T06:46:48.173301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-19T06:46:41.552716+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-19T06:46:41.552716+0000","last_clean_scrub_stamp":"2024-09-19T06:46:41.552716+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:12.673318+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"34'4967","reported_seq":5058,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:56.200756+0000","last_change":"2024-09-19T06:46:56.200804+0000","last_active":"2024-09-19T06:46:56.200756+0000","last_peered":"2024-09-19T06:46:56.200756+0000","last_clean":"2024-09-19T06:46:56.200756+0000","last_became_active":"2024-09-19T06:37:13.470887+0000","last_became_peered":"2024-09-19T06:37:13.470887+0000","last_unstale":"2024-09-19T06:46:56.200756+0000","last_undegraded":"2024-09-19T06:46:56.200756+0000","last_fullsized":"2024-09-19T06:46:56.200756+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4967","last_scrub_stamp":"2024-09-19T06:46:56.200594+0000","last_deep_scrub":"34'4967","last_deep_scrub_stamp":"2024-09-19T06:46:56.200594+0000","last_clean_scrub_stamp":"2024-09-19T06:46:56.200594+0000","objects_scrubbed":0,"log_size":4967,"log_dups_size":0,"ondisk_log_size":4967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:06.973503+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":70581,"num_write_kb":907517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'14","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.231200+0000","last_change":"2024-09-19T06:46:40.126375+0000","last_active":"2024-09-19T06:46:48.231200+0000","last_peered":"2024-09-19T06:46:48.231200+0000","last_clean":"2024-09-19T06:46:48.231200+0000","last_became_active":"2024-09-19T06:37:09.437635+0000","last_became_peered":"2024-09-19T06:37:09.437635+0000","last_unstale":"2024-09-19T06:46:48.231200+0000","last_undegraded":"2024-09-19T06:46:48.231200+0000","last_fullsized":"2024-09-19T06:46:48.231200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-09-19T06:46:40.126226+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-09-19T06:46:40.126226+0000","last_clean_scrub_stamp":"2024-09-19T06:46:40.126226+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:47.876184+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.284387+0000","last_change":"2024-09-19T06:46:40.510358+0000","last_active":"2024-09-19T06:46:48.284387+0000","last_peered":"2024-09-19T06:46:48.284387+0000","last_clean":"2024-09-19T06:46:48.284387+0000","last_became_active":"2024-09-19T06:37:08.438405+0000","last_became_peered":"2024-09-19T06:37:08.438405+0000","last_unstale":"2024-09-19T06:46:48.284387+0000","last_undegraded":"2024-09-19T06:46:48.284387+0000","last_fullsized":"2024-09-19T06:46:48.284387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-19T06:46:40.510196+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-19T06:46:40.510196+0000","last_clean_scrub_stamp":"2024-09-19T06:46:40.510196+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:05.876464+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16616,"num_omap_keys":28,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'5265","reported_seq":5355,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:50.167060+0000","last_change":"2024-09-19T06:46:50.167088+0000","last_active":"2024-09-19T06:46:50.167060+0000","last_peered":"2024-09-19T06:46:50.167060+0000","last_clean":"2024-09-19T06:46:50.167060+0000","last_became_active":"2024-09-19T06:37:13.458928+0000","last_became_peered":"2024-09-19T06:37:13.458928+0000","last_unstale":"2024-09-19T06:46:50.167060+0000","last_undegraded":"2024-09-19T06:46:50.167060+0000","last_fullsized":"2024-09-19T06:46:50.167060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5265","last_scrub_stamp":"2024-09-19T06:46:50.166939+0000","last_deep_scrub":"34'5265","last_deep_scrub_stamp":"2024-09-19T06:46:50.166939+0000","last_clean_scrub_stamp":"2024-09-19T06:46:50.166939+0000","objects_scrubbed":0,"log_size":5265,"log_dups_size":0,"ondisk_log_size":5265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:57.783333+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":0,"num_write":75298,"num_write_kb":949879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'15","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:45.788578+0000","last_change":"2024-09-19T06:46:43.782488+0000","last_active":"2024-09-19T06:46:45.788578+0000","last_peered":"2024-09-19T06:46:45.788578+0000","last_clean":"2024-09-19T06:46:45.788578+0000","last_became_active":"2024-09-19T06:37:09.448697+0000","last_became_peered":"2024-09-19T06:37:09.448697+0000","last_unstale":"2024-09-19T06:46:45.788578+0000","last_undegraded":"2024-09-19T06:46:45.788578+0000","last_fullsized":"2024-09-19T06:46:45.788578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-09-19T06:46:43.782368+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-09-19T06:46:43.782368+0000","last_clean_scrub_stamp":"2024-09-19T06:46:43.782368+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:15.787590+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"34'71","reported_seq":142,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.232665+0000","last_change":"2024-09-19T06:46:35.850675+0000","last_active":"2024-09-19T06:46:48.232665+0000","last_peered":"2024-09-19T06:46:48.232665+0000","last_clean":"2024-09-19T06:46:48.232665+0000","last_became_active":"2024-09-19T06:37:08.442436+0000","last_became_peered":"2024-09-19T06:37:08.442436+0000","last_unstale":"2024-09-19T06:46:48.232665+0000","last_undegraded":"2024-09-19T06:46:48.232665+0000","last_fullsized":"2024-09-19T06:46:48.232665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'66","last_scrub_stamp":"2024-09-19T06:46:35.850521+0000","last_deep_scrub":"34'66","last_deep_scrub_stamp":"2024-09-19T06:46:35.850521+0000","last_clean_scrub_stamp":"2024-09-19T06:46:35.850521+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:54.947910+0000","scrub_duration":70,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":32451,"num_write":58,"num_write_kb":8225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"34'4629","reported_seq":4700,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:52.567104+0000","last_change":"2024-09-19T06:46:52.567134+0000","last_active":"2024-09-19T06:46:52.567104+0000","last_peered":"2024-09-19T06:46:52.567104+0000","last_clean":"2024-09-19T06:46:52.567104+0000","last_became_active":"2024-09-19T06:37:13.457246+0000","last_became_peered":"2024-09-19T06:37:13.457246+0000","last_unstale":"2024-09-19T06:46:52.567104+0000","last_undegraded":"2024-09-19T06:46:52.567104+0000","last_fullsized":"2024-09-19T06:46:52.567104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4629","last_scrub_stamp":"2024-09-19T06:46:52.566992+0000","last_deep_scrub":"34'4629","last_deep_scrub_stamp":"2024-09-19T06:46:52.566992+0000","last_clean_scrub_stamp":"2024-09-19T06:46:52.566992+0000","objects_scrubbed":0,"log_size":4629,"log_dups_size":0,"ondisk_log_size":4629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:53.723546+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":66086,"num_write_kb":826143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"34'11","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:53.062057+0000","last_change":"2024-09-19T06:46:53.062099+0000","last_active":"2024-09-19T06:46:53.062057+0000","last_peered":"2024-09-19T06:46:53.062057+0000","last_clean":"2024-09-19T06:46:53.062057+0000","last_became_active":"2024-09-19T06:37:09.440209+0000","last_became_peered":"2024-09-19T06:37:09.440209+0000","last_unstale":"2024-09-19T06:46:53.062057+0000","last_undegraded":"2024-09-19T06:46:53.062057+0000","last_fullsized":"2024-09-19T06:46:53.062057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-19T06:46:53.061940+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-19T06:46:53.061940+0000","last_clean_scrub_stamp":"2024-09-19T06:46:53.061940+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:57.562767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"34'226","reported_seq":306,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.203017+0000","last_change":"2024-09-19T06:46:42.619309+0000","last_active":"2024-09-19T06:46:48.203017+0000","last_peered":"2024-09-19T06:46:48.203017+0000","last_clean":"2024-09-19T06:46:48.203017+0000","last_became_active":"2024-09-19T06:37:08.442242+0000","last_became_peered":"2024-09-19T06:37:08.442242+0000","last_unstale":"2024-09-19T06:46:48.203017+0000","last_undegraded":"2024-09-19T06:46:48.203017+0000","last_fullsized":"2024-09-19T06:46:48.203017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'223","last_scrub_stamp":"2024-09-19T06:46:42.619177+0000","last_deep_scrub":"34'223","last_deep_scrub_stamp":"2024-09-19T06:46:42.619177+0000","last_clean_scrub_stamp":"2024-09-19T06:46:42.619177+0000","objects_scrubbed":4,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:50.539272+0000","scrub_duration":68,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":49,"num_read_kb":24618,"num_write":216,"num_write_kb":4204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"34'4750","reported_seq":4834,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:50.551212+0000","last_change":"2024-09-19T06:46:50.551243+0000","last_active":"2024-09-19T06:46:50.551212+0000","last_peered":"2024-09-19T06:46:50.551212+0000","last_clean":"2024-09-19T06:46:50.551212+0000","last_became_active":"2024-09-19T06:37:13.461620+0000","last_became_peered":"2024-09-19T06:37:13.461620+0000","last_unstale":"2024-09-19T06:46:50.551212+0000","last_undegraded":"2024-09-19T06:46:50.551212+0000","last_fullsized":"2024-09-19T06:46:50.551212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4750","last_scrub_stamp":"2024-09-19T06:46:50.551100+0000","last_deep_scrub":"34'4750","last_deep_scrub_stamp":"2024-09-19T06:46:50.551100+0000","last_clean_scrub_stamp":"2024-09-19T06:46:50.551100+0000","objects_scrubbed":0,"log_size":4750,"log_dups_size":0,"ondisk_log_size":4750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:22.403757+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":67780,"num_write_kb":859195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.062850+0000","last_change":"2024-09-19T06:46:39.973013+0000","last_active":"2024-09-19T06:46:48.062850+0000","last_peered":"2024-09-19T06:46:48.062850+0000","last_clean":"2024-09-19T06:46:48.062850+0000","last_became_active":"2024-09-19T06:37:09.437800+0000","last_became_peered":"2024-09-19T06:37:09.437800+0000","last_unstale":"2024-09-19T06:46:48.062850+0000","last_undegraded":"2024-09-19T06:46:48.062850+0000","last_fullsized":"2024-09-19T06:46:48.062850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-19T06:46:39.972854+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-19T06:46:39.972854+0000","last_clean_scrub_stamp":"2024-09-19T06:46:39.972854+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:07.737876+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"34'21","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.260502+0000","last_change":"2024-09-19T06:46:39.494670+0000","last_active":"2024-09-19T06:46:48.260502+0000","last_peered":"2024-09-19T06:46:48.260502+0000","last_clean":"2024-09-19T06:46:48.260502+0000","last_became_active":"2024-09-19T06:37:08.434151+0000","last_became_peered":"2024-09-19T06:37:08.434151+0000","last_unstale":"2024-09-19T06:46:48.260502+0000","last_undegraded":"2024-09-19T06:46:48.260502+0000","last_fullsized":"2024-09-19T06:46:48.260502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-19T06:46:39.494581+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-19T06:46:39.494581+0000","last_clean_scrub_stamp":"2024-09-19T06:46:39.494581+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:00.034294+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":19,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'4900","reported_seq":4993,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.303790+0000","last_change":"2024-09-19T06:46:45.177621+0000","last_active":"2024-09-19T06:46:48.303790+0000","last_peered":"2024-09-19T06:46:48.303790+0000","last_clean":"2024-09-19T06:46:48.303790+0000","last_became_active":"2024-09-19T06:37:13.458924+0000","last_became_peered":"2024-09-19T06:37:13.458924+0000","last_unstale":"2024-09-19T06:46:48.303790+0000","last_undegraded":"2024-09-19T06:46:48.303790+0000","last_fullsized":"2024-09-19T06:46:48.303790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4879","last_scrub_stamp":"2024-09-19T06:46:45.177482+0000","last_deep_scrub":"34'4879","last_deep_scrub_stamp":"2024-09-19T06:46:45.177482+0000","last_clean_scrub_stamp":"2024-09-19T06:46:45.177482+0000","objects_scrubbed":21,"log_size":4900,"log_dups_size":0,"ondisk_log_size":4900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:20.783848+0000","scrub_duration":257,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":0,"num_write":69801,"num_write_kb":881574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"34'16","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.184309+0000","last_change":"2024-09-19T06:46:34.772498+0000","last_active":"2024-09-19T06:46:48.184309+0000","last_peered":"2024-09-19T06:46:48.184309+0000","last_clean":"2024-09-19T06:46:48.184309+0000","last_became_active":"2024-09-19T06:37:09.448173+0000","last_became_peered":"2024-09-19T06:37:09.448173+0000","last_unstale":"2024-09-19T06:46:48.184309+0000","last_undegraded":"2024-09-19T06:46:48.184309+0000","last_fullsized":"2024-09-19T06:46:48.184309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-19T06:46:34.772353+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-19T06:46:34.772353+0000","last_clean_scrub_stamp":"2024-09-19T06:46:34.772353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:03.908737+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.206935+0000","last_change":"2024-09-19T06:46:42.500666+0000","last_active":"2024-09-19T06:46:48.206935+0000","last_peered":"2024-09-19T06:46:48.206935+0000","last_clean":"2024-09-19T06:46:48.206935+0000","last_became_active":"2024-09-19T06:37:08.442126+0000","last_became_peered":"2024-09-19T06:37:08.442126+0000","last_unstale":"2024-09-19T06:46:48.206935+0000","last_undegraded":"2024-09-19T06:46:48.206935+0000","last_fullsized":"2024-09-19T06:46:48.206935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:46:42.500523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:46:42.500523+0000","last_clean_scrub_stamp":"2024-09-19T06:46:42.500523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:55.366948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"34'4842","reported_seq":4912,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:54.169639+0000","last_change":"2024-09-19T06:46:54.169686+0000","last_active":"2024-09-19T06:46:54.169639+0000","last_peered":"2024-09-19T06:46:54.169639+0000","last_clean":"2024-09-19T06:46:54.169639+0000","last_became_active":"2024-09-19T06:37:13.462750+0000","last_became_peered":"2024-09-19T06:37:13.462750+0000","last_unstale":"2024-09-19T06:46:54.169639+0000","last_undegraded":"2024-09-19T06:46:54.169639+0000","last_fullsized":"2024-09-19T06:46:54.169639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4842","last_scrub_stamp":"2024-09-19T06:46:54.169511+0000","last_deep_scrub":"34'4842","last_deep_scrub_stamp":"2024-09-19T06:46:54.169511+0000","last_clean_scrub_stamp":"2024-09-19T06:46:54.169511+0000","objects_scrubbed":0,"log_size":4842,"log_dups_size":0,"ondisk_log_size":4842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:08.131508+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":69473,"num_write_kb":873579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"34'15","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.281075+0000","last_change":"2024-09-19T06:46:44.962342+0000","last_active":"2024-09-19T06:46:48.281075+0000","last_peered":"2024-09-19T06:46:48.281075+0000","last_clean":"2024-09-19T06:46:48.281075+0000","last_became_active":"2024-09-19T06:37:51.593513+0000","last_became_peered":"2024-09-19T06:37:51.593513+0000","last_unstale":"2024-09-19T06:46:48.281075+0000","last_undegraded":"2024-09-19T06:46:48.281075+0000","last_fullsized":"2024-09-19T06:46:48.281075+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-19T06:46:44.962196+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-19T06:46:44.962196+0000","last_clean_scrub_stamp":"2024-09-19T06:46:44.962196+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:49.336176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"34'5","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.136080+0000","last_change":"2024-09-19T06:46:39.509681+0000","last_active":"2024-09-19T06:46:48.136080+0000","last_peered":"2024-09-19T06:46:48.136080+0000","last_clean":"2024-09-19T06:46:48.136080+0000","last_became_active":"2024-09-19T06:37:08.438785+0000","last_became_peered":"2024-09-19T06:37:08.438785+0000","last_unstale":"2024-09-19T06:46:48.136080+0000","last_undegraded":"2024-09-19T06:46:48.136080+0000","last_fullsized":"2024-09-19T06:46:48.136080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-19T06:46:39.509595+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-19T06:46:39.509595+0000","last_clean_scrub_stamp":"2024-09-19T06:46:39.509595+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:45.666499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"34'4915","reported_seq":5012,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:52.165034+0000","last_change":"2024-09-19T06:46:52.165069+0000","last_active":"2024-09-19T06:46:52.165034+0000","last_peered":"2024-09-19T06:46:52.165034+0000","last_clean":"2024-09-19T06:46:52.165034+0000","last_became_active":"2024-09-19T06:37:13.461762+0000","last_became_peered":"2024-09-19T06:37:13.461762+0000","last_unstale":"2024-09-19T06:46:52.165034+0000","last_undegraded":"2024-09-19T06:46:52.165034+0000","last_fullsized":"2024-09-19T06:46:52.165034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4915","last_scrub_stamp":"2024-09-19T06:46:52.164949+0000","last_deep_scrub":"34'4915","last_deep_scrub_stamp":"2024-09-19T06:46:52.164949+0000","last_clean_scrub_stamp":"2024-09-19T06:46:52.164949+0000","objects_scrubbed":0,"log_size":4915,"log_dups_size":0,"ondisk_log_size":4915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:54:55.640742+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":71145,"num_write_kb":900045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'5717","reported_seq":5803,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:50.724713+0000","last_change":"2024-09-19T06:46:50.724713+0000","last_active":"2024-09-19T06:46:50.724713+0000","last_peered":"2024-09-19T06:46:50.724713+0000","last_clean":"2024-09-19T06:46:50.724713+0000","last_became_active":"2024-09-19T06:37:13.470969+0000","last_became_peered":"2024-09-19T06:37:13.470969+0000","last_unstale":"2024-09-19T06:46:50.724713+0000","last_undegraded":"2024-09-19T06:46:50.724713+0000","last_fullsized":"2024-09-19T06:46:50.724713+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5717","last_scrub_stamp":"2024-09-19T06:46:50.724575+0000","last_deep_scrub":"34'5717","last_deep_scrub_stamp":"2024-09-19T06:46:50.724575+0000","last_clean_scrub_stamp":"2024-09-19T06:46:50.724575+0000","objects_scrubbed":0,"log_size":5717,"log_dups_size":0,"ondisk_log_size":5717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:02.207429+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":81983,"num_write_kb":1028288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'9","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.506950+0000","last_change":"2024-09-19T06:46:36.266057+0000","last_active":"2024-09-19T06:46:48.506950+0000","last_peered":"2024-09-19T06:46:48.506950+0000","last_clean":"2024-09-19T06:46:48.506950+0000","last_became_active":"2024-09-19T06:37:09.443069+0000","last_became_peered":"2024-09-19T06:37:09.443069+0000","last_unstale":"2024-09-19T06:46:48.506950+0000","last_undegraded":"2024-09-19T06:46:48.506950+0000","last_fullsized":"2024-09-19T06:46:48.506950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-19T06:46:36.265905+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-19T06:46:36.265905+0000","last_clean_scrub_stamp":"2024-09-19T06:46:36.265905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:01.926106+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"34'32","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.221700+0000","last_change":"2024-09-19T06:46:41.496675+0000","last_active":"2024-09-19T06:46:48.221700+0000","last_peered":"2024-09-19T06:46:48.221700+0000","last_clean":"2024-09-19T06:46:48.221700+0000","last_became_active":"2024-09-19T06:37:08.441698+0000","last_became_peered":"2024-09-19T06:37:08.441698+0000","last_unstale":"2024-09-19T06:46:48.221700+0000","last_undegraded":"2024-09-19T06:46:48.221700+0000","last_fullsized":"2024-09-19T06:46:48.221700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'30","last_scrub_stamp":"2024-09-19T06:46:41.496571+0000","last_deep_scrub":"34'30","last_deep_scrub_stamp":"2024-09-19T06:46:41.496571+0000","last_clean_scrub_stamp":"2024-09-19T06:46:41.496571+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:30.011383+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":24,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11722,"num_omap_keys":20,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4843","reported_seq":4925,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:52.623969+0000","last_change":"2024-09-19T06:46:52.623997+0000","last_active":"2024-09-19T06:46:52.623969+0000","last_peered":"2024-09-19T06:46:52.623969+0000","last_clean":"2024-09-19T06:46:52.623969+0000","last_became_active":"2024-09-19T06:37:13.470528+0000","last_became_peered":"2024-09-19T06:37:13.470528+0000","last_unstale":"2024-09-19T06:46:52.623969+0000","last_undegraded":"2024-09-19T06:46:52.623969+0000","last_fullsized":"2024-09-19T06:46:52.623969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4843","last_scrub_stamp":"2024-09-19T06:46:52.623851+0000","last_deep_scrub":"34'4843","last_deep_scrub_stamp":"2024-09-19T06:46:52.623851+0000","last_clean_scrub_stamp":"2024-09-19T06:46:52.623851+0000","objects_scrubbed":0,"log_size":4843,"log_dups_size":0,"ondisk_log_size":4843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:48:17.189862+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":69241,"num_write_kb":882580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"34'19","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.316533+0000","last_change":"2024-09-19T06:46:39.231272+0000","last_active":"2024-09-19T06:46:48.316533+0000","last_peered":"2024-09-19T06:46:48.316533+0000","last_clean":"2024-09-19T06:46:48.316533+0000","last_became_active":"2024-09-19T06:37:09.448658+0000","last_became_peered":"2024-09-19T06:37:09.448658+0000","last_unstale":"2024-09-19T06:46:48.316533+0000","last_undegraded":"2024-09-19T06:46:48.316533+0000","last_fullsized":"2024-09-19T06:46:48.316533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-19T06:46:39.231031+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-19T06:46:39.231031+0000","last_clean_scrub_stamp":"2024-09-19T06:46:39.231031+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:51.865175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"34'3","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.172026+0000","last_change":"2024-09-19T06:46:42.234702+0000","last_active":"2024-09-19T06:46:48.172026+0000","last_peered":"2024-09-19T06:46:48.172026+0000","last_clean":"2024-09-19T06:46:48.172026+0000","last_became_active":"2024-09-19T06:37:08.440591+0000","last_became_peered":"2024-09-19T06:37:08.440591+0000","last_unstale":"2024-09-19T06:46:48.172026+0000","last_undegraded":"2024-09-19T06:46:48.172026+0000","last_fullsized":"2024-09-19T06:46:48.172026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-09-19T06:46:42.234578+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-09-19T06:46:42.234578+0000","last_clean_scrub_stamp":"2024-09-19T06:46:42.234578+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:19.889418+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"34'26","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.136709+0000","last_change":"2024-09-19T06:46:40.607503+0000","last_active":"2024-09-19T06:46:48.136709+0000","last_peered":"2024-09-19T06:46:48.136709+0000","last_clean":"2024-09-19T06:46:48.136709+0000","last_became_active":"2024-09-19T06:37:08.440969+0000","last_became_peered":"2024-09-19T06:37:08.440969+0000","last_unstale":"2024-09-19T06:46:48.136709+0000","last_undegraded":"2024-09-19T06:46:48.136709+0000","last_fullsized":"2024-09-19T06:46:48.136709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-19T06:46:40.607341+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-19T06:46:40.607341+0000","last_clean_scrub_stamp":"2024-09-19T06:46:40.607341+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:39.811687+0000","scrub_duration":100,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":19,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7170,"num_omap_keys":12,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"34'11","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.312608+0000","last_change":"2024-09-19T06:46:37.753309+0000","last_active":"2024-09-19T06:46:48.312608+0000","last_peered":"2024-09-19T06:46:48.312608+0000","last_clean":"2024-09-19T06:46:48.312608+0000","last_became_active":"2024-09-19T06:37:09.444562+0000","last_became_peered":"2024-09-19T06:37:09.444562+0000","last_unstale":"2024-09-19T06:46:48.312608+0000","last_undegraded":"2024-09-19T06:46:48.312608+0000","last_fullsized":"2024-09-19T06:46:48.312608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-19T06:46:37.753174+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-19T06:46:37.753174+0000","last_clean_scrub_stamp":"2024-09-19T06:46:37.753174+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:39.990037+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"34'3917","reported_seq":3990,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.338887+0000","last_change":"2024-09-19T06:46:43.960323+0000","last_active":"2024-09-19T06:46:48.338887+0000","last_peered":"2024-09-19T06:46:48.338887+0000","last_clean":"2024-09-19T06:46:48.338887+0000","last_became_active":"2024-09-19T06:37:13.466765+0000","last_became_peered":"2024-09-19T06:37:13.466765+0000","last_unstale":"2024-09-19T06:46:48.338887+0000","last_undegraded":"2024-09-19T06:46:48.338887+0000","last_fullsized":"2024-09-19T06:46:48.338887+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3901","last_scrub_stamp":"2024-09-19T06:46:43.960123+0000","last_deep_scrub":"34'3901","last_deep_scrub_stamp":"2024-09-19T06:46:43.960123+0000","last_clean_scrub_stamp":"2024-09-19T06:46:43.960123+0000","objects_scrubbed":13,"log_size":3917,"log_dups_size":0,"ondisk_log_size":3917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:38.844744+0000","scrub_duration":1026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":56485,"num_write_kb":718624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"34'989","reported_seq":1052,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.083417+0000","last_change":"2024-09-19T06:46:43.245589+0000","last_active":"2024-09-19T06:46:48.083417+0000","last_peered":"2024-09-19T06:46:48.083417+0000","last_clean":"2024-09-19T06:46:48.083417+0000","last_became_active":"2024-09-19T06:37:08.443774+0000","last_became_peered":"2024-09-19T06:37:08.443774+0000","last_unstale":"2024-09-19T06:46:48.083417+0000","last_undegraded":"2024-09-19T06:46:48.083417+0000","last_fullsized":"2024-09-19T06:46:48.083417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'988","last_scrub_stamp":"2024-09-19T06:46:43.245417+0000","last_deep_scrub":"34'988","last_deep_scrub_stamp":"2024-09-19T06:46:43.245417+0000","last_clean_scrub_stamp":"2024-09-19T06:46:43.245417+0000","objects_scrubbed":1,"log_size":989,"log_dups_size":0,"ondisk_log_size":989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:10:46.597817+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":42342,"num_write":985,"num_write_kb":4941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'13","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.223885+0000","last_change":"2024-09-19T06:46:40.996125+0000","last_active":"2024-09-19T06:46:48.223885+0000","last_peered":"2024-09-19T06:46:48.223885+0000","last_clean":"2024-09-19T06:46:48.223885+0000","last_became_active":"2024-09-19T06:37:09.438457+0000","last_became_peered":"2024-09-19T06:37:09.438457+0000","last_unstale":"2024-09-19T06:46:48.223885+0000","last_undegraded":"2024-09-19T06:46:48.223885+0000","last_fullsized":"2024-09-19T06:46:48.223885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-19T06:46:40.996041+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-19T06:46:40.996041+0000","last_clean_scrub_stamp":"2024-09-19T06:46:40.996041+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:00.279522+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'5428","reported_seq":5506,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:53.197031+0000","last_change":"2024-09-19T06:46:53.197082+0000","last_active":"2024-09-19T06:46:53.197031+0000","last_peered":"2024-09-19T06:46:53.197031+0000","last_clean":"2024-09-19T06:46:53.197031+0000","last_became_active":"2024-09-19T06:37:13.462393+0000","last_became_peered":"2024-09-19T06:37:13.462393+0000","last_unstale":"2024-09-19T06:46:53.197031+0000","last_undegraded":"2024-09-19T06:46:53.197031+0000","last_fullsized":"2024-09-19T06:46:53.197031+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5428","last_scrub_stamp":"2024-09-19T06:46:53.196905+0000","last_deep_scrub":"34'5428","last_deep_scrub_stamp":"2024-09-19T06:46:53.196905+0000","last_clean_scrub_stamp":"2024-09-19T06:46:53.196905+0000","objects_scrubbed":0,"log_size":5428,"log_dups_size":0,"ondisk_log_size":5428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:34.297162+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":77377,"num_write_kb":974522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"34'15","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:50.644751+0000","last_change":"2024-09-19T06:46:50.644792+0000","last_active":"2024-09-19T06:46:50.644751+0000","last_peered":"2024-09-19T06:46:50.644751+0000","last_clean":"2024-09-19T06:46:50.644751+0000","last_became_active":"2024-09-19T06:37:09.450147+0000","last_became_peered":"2024-09-19T06:37:09.450147+0000","last_unstale":"2024-09-19T06:46:50.644751+0000","last_undegraded":"2024-09-19T06:46:50.644751+0000","last_fullsized":"2024-09-19T06:46:50.644751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-19T06:46:50.644630+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-19T06:46:50.644630+0000","last_clean_scrub_stamp":"2024-09-19T06:46:50.644630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:15.006761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"34'13","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:40.897936+0000","last_change":"2024-09-19T06:46:40.897936+0000","last_active":"2024-09-19T06:46:40.897936+0000","last_peered":"2024-09-19T06:46:40.897936+0000","last_clean":"2024-09-19T06:46:40.897936+0000","last_became_active":"2024-09-19T06:37:09.434840+0000","last_became_peered":"2024-09-19T06:37:09.434840+0000","last_unstale":"2024-09-19T06:46:40.897936+0000","last_undegraded":"2024-09-19T06:46:40.897936+0000","last_fullsized":"2024-09-19T06:46:40.897936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-19T06:46:40.897840+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-19T06:46:40.897840+0000","last_clean_scrub_stamp":"2024-09-19T06:46:40.897840+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:28.243892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"34'15","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.544273+0000","last_change":"2024-09-19T06:46:48.544293+0000","last_active":"2024-09-19T06:46:48.544273+0000","last_peered":"2024-09-19T06:46:48.544273+0000","last_clean":"2024-09-19T06:46:48.544273+0000","last_became_active":"2024-09-19T06:37:09.444907+0000","last_became_peered":"2024-09-19T06:37:09.444907+0000","last_unstale":"2024-09-19T06:46:48.544273+0000","last_undegraded":"2024-09-19T06:46:48.544273+0000","last_fullsized":"2024-09-19T06:46:48.544273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-19T06:46:48.544210+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-19T06:46:48.544210+0000","last_clean_scrub_stamp":"2024-09-19T06:46:48.544210+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:20.470939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"34'11","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.110781+0000","last_change":"2024-09-19T06:46:42.735411+0000","last_active":"2024-09-19T06:46:48.110781+0000","last_peered":"2024-09-19T06:46:48.110781+0000","last_clean":"2024-09-19T06:46:48.110781+0000","last_became_active":"2024-09-19T06:37:09.447692+0000","last_became_peered":"2024-09-19T06:37:09.447692+0000","last_unstale":"2024-09-19T06:46:48.110781+0000","last_undegraded":"2024-09-19T06:46:48.110781+0000","last_fullsized":"2024-09-19T06:46:48.110781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-19T06:46:42.735258+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-19T06:46:42.735258+0000","last_clean_scrub_stamp":"2024-09-19T06:46:42.735258+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:35.555749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"34'10","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:53.562010+0000","last_change":"2024-09-19T06:46:53.562059+0000","last_active":"2024-09-19T06:46:53.562010+0000","last_peered":"2024-09-19T06:46:53.562010+0000","last_clean":"2024-09-19T06:46:53.562010+0000","last_became_active":"2024-09-19T06:37:51.595875+0000","last_became_peered":"2024-09-19T06:37:51.595875+0000","last_unstale":"2024-09-19T06:46:53.562010+0000","last_undegraded":"2024-09-19T06:46:53.562010+0000","last_fullsized":"2024-09-19T06:46:53.562010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-19T06:46:53.561907+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-19T06:46:53.561907+0000","last_clean_scrub_stamp":"2024-09-19T06:46:53.561907+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:02.945889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'9","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:37.282713+0000","last_change":"2024-09-19T06:46:37.282713+0000","last_active":"2024-09-19T06:46:37.282713+0000","last_peered":"2024-09-19T06:46:37.282713+0000","last_clean":"2024-09-19T06:46:37.282713+0000","last_became_active":"2024-09-19T06:37:09.441456+0000","last_became_peered":"2024-09-19T06:37:09.441456+0000","last_unstale":"2024-09-19T06:46:37.282713+0000","last_undegraded":"2024-09-19T06:46:37.282713+0000","last_fullsized":"2024-09-19T06:46:37.282713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-19T06:46:37.277831+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-19T06:46:37.277831+0000","last_clean_scrub_stamp":"2024-09-19T06:46:37.277831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:12.733243+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"34'9","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.605842+0000","last_change":"2024-09-19T06:46:48.605888+0000","last_active":"2024-09-19T06:46:48.605842+0000","last_peered":"2024-09-19T06:46:48.605842+0000","last_clean":"2024-09-19T06:46:48.605842+0000","last_became_active":"2024-09-19T06:37:09.449562+0000","last_became_peered":"2024-09-19T06:37:09.449562+0000","last_unstale":"2024-09-19T06:46:48.605842+0000","last_undegraded":"2024-09-19T06:46:48.605842+0000","last_fullsized":"2024-09-19T06:46:48.605842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-19T06:46:48.605748+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-19T06:46:48.605748+0000","last_clean_scrub_stamp":"2024-09-19T06:46:48.605748+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:07.434452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"34'15","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.250622+0000","last_change":"2024-09-19T06:46:47.170985+0000","last_active":"2024-09-19T06:46:48.250622+0000","last_peered":"2024-09-19T06:46:48.250622+0000","last_clean":"2024-09-19T06:46:48.250622+0000","last_became_active":"2024-09-19T06:37:09.437624+0000","last_became_peered":"2024-09-19T06:37:09.437624+0000","last_unstale":"2024-09-19T06:46:48.250622+0000","last_undegraded":"2024-09-19T06:46:48.250622+0000","last_fullsized":"2024-09-19T06:46:48.250622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-19T06:46:47.170836+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-19T06:46:47.170836+0000","last_clean_scrub_stamp":"2024-09-19T06:46:47.170836+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:32.556789+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"34'12","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.154718+0000","last_change":"2024-09-19T06:46:44.519778+0000","last_active":"2024-09-19T06:46:48.154718+0000","last_peered":"2024-09-19T06:46:48.154718+0000","last_clean":"2024-09-19T06:46:48.154718+0000","last_became_active":"2024-09-19T06:37:09.438453+0000","last_became_peered":"2024-09-19T06:37:09.438453+0000","last_unstale":"2024-09-19T06:46:48.154718+0000","last_undegraded":"2024-09-19T06:46:48.154718+0000","last_fullsized":"2024-09-19T06:46:48.154718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-19T06:46:44.519668+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-19T06:46:44.519668+0000","last_clean_scrub_stamp":"2024-09-19T06:46:44.519668+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:57.569088+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"34'15","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:41.708745+0000","last_change":"2024-09-19T06:46:37.370909+0000","last_active":"2024-09-19T06:46:41.708745+0000","last_peered":"2024-09-19T06:46:41.708745+0000","last_clean":"2024-09-19T06:46:41.708745+0000","last_became_active":"2024-09-19T06:37:09.439710+0000","last_became_peered":"2024-09-19T06:37:09.439710+0000","last_unstale":"2024-09-19T06:46:41.708745+0000","last_undegraded":"2024-09-19T06:46:41.708745+0000","last_fullsized":"2024-09-19T06:46:41.708745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-09-19T06:46:37.370765+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-09-19T06:46:37.370765+0000","last_clean_scrub_stamp":"2024-09-19T06:46:37.370765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:06.900951+0000","scrub_duration":174,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"34'13","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.205716+0000","last_change":"2024-09-19T06:46:43.916617+0000","last_active":"2024-09-19T06:46:48.205716+0000","last_peered":"2024-09-19T06:46:48.205716+0000","last_clean":"2024-09-19T06:46:48.205716+0000","last_became_active":"2024-09-19T06:37:51.592846+0000","last_became_peered":"2024-09-19T06:37:51.592846+0000","last_unstale":"2024-09-19T06:46:48.205716+0000","last_undegraded":"2024-09-19T06:46:48.205716+0000","last_fullsized":"2024-09-19T06:46:48.205716+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-19T06:46:43.916473+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-19T06:46:43.916473+0000","last_clean_scrub_stamp":"2024-09-19T06:46:43.916473+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:02.872146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"34'17","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.237795+0000","last_change":"2024-09-19T06:46:44.746381+0000","last_active":"2024-09-19T06:46:48.237795+0000","last_peered":"2024-09-19T06:46:48.237795+0000","last_clean":"2024-09-19T06:46:48.237795+0000","last_became_active":"2024-09-19T06:37:09.449379+0000","last_became_peered":"2024-09-19T06:37:09.449379+0000","last_unstale":"2024-09-19T06:46:48.237795+0000","last_undegraded":"2024-09-19T06:46:48.237795+0000","last_fullsized":"2024-09-19T06:46:48.237795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-19T06:46:44.746237+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-19T06:46:44.746237+0000","last_clean_scrub_stamp":"2024-09-19T06:46:44.746237+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:47.533712+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"34'11","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.224839+0000","last_change":"2024-09-19T06:46:47.583096+0000","last_active":"2024-09-19T06:46:48.224839+0000","last_peered":"2024-09-19T06:46:48.224839+0000","last_clean":"2024-09-19T06:46:48.224839+0000","last_became_active":"2024-09-19T06:37:09.447514+0000","last_became_peered":"2024-09-19T06:37:09.447514+0000","last_unstale":"2024-09-19T06:46:48.224839+0000","last_undegraded":"2024-09-19T06:46:48.224839+0000","last_fullsized":"2024-09-19T06:46:48.224839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-19T06:46:47.582949+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-19T06:46:47.582949+0000","last_clean_scrub_stamp":"2024-09-19T06:46:47.582949+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:06:06.455900+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"34'15","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:52.042385+0000","last_change":"2024-09-19T06:46:52.042443+0000","last_active":"2024-09-19T06:46:52.042385+0000","last_peered":"2024-09-19T06:46:52.042385+0000","last_clean":"2024-09-19T06:46:52.042385+0000","last_became_active":"2024-09-19T06:37:09.432601+0000","last_became_peered":"2024-09-19T06:37:09.432601+0000","last_unstale":"2024-09-19T06:46:52.042385+0000","last_undegraded":"2024-09-19T06:46:52.042385+0000","last_fullsized":"2024-09-19T06:46:52.042385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-19T06:46:52.042265+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-19T06:46:52.042265+0000","last_clean_scrub_stamp":"2024-09-19T06:46:52.042265+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:30.290675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"34'19","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.281207+0000","last_change":"2024-09-19T06:46:41.945622+0000","last_active":"2024-09-19T06:46:48.281207+0000","last_peered":"2024-09-19T06:46:48.281207+0000","last_clean":"2024-09-19T06:46:48.281207+0000","last_became_active":"2024-09-19T06:37:09.439937+0000","last_became_peered":"2024-09-19T06:37:09.439937+0000","last_unstale":"2024-09-19T06:46:48.281207+0000","last_undegraded":"2024-09-19T06:46:48.281207+0000","last_fullsized":"2024-09-19T06:46:48.281207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-19T06:46:41.945494+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-19T06:46:41.945494+0000","last_clean_scrub_stamp":"2024-09-19T06:46:41.945494+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:28.164585+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"34'13","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.067206+0000","last_change":"2024-09-19T06:46:43.482146+0000","last_active":"2024-09-19T06:46:48.067206+0000","last_peered":"2024-09-19T06:46:48.067206+0000","last_clean":"2024-09-19T06:46:48.067206+0000","last_became_active":"2024-09-19T06:37:09.436752+0000","last_became_peered":"2024-09-19T06:37:09.436752+0000","last_unstale":"2024-09-19T06:46:48.067206+0000","last_undegraded":"2024-09-19T06:46:48.067206+0000","last_fullsized":"2024-09-19T06:46:48.067206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-19T06:46:43.481998+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-19T06:46:43.481998+0000","last_clean_scrub_stamp":"2024-09-19T06:46:43.481998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:04.929989+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"34'13","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:51.580618+0000","last_change":"2024-09-19T06:46:51.580643+0000","last_active":"2024-09-19T06:46:51.580618+0000","last_peered":"2024-09-19T06:46:51.580618+0000","last_clean":"2024-09-19T06:46:51.580618+0000","last_became_active":"2024-09-19T06:37:09.448647+0000","last_became_peered":"2024-09-19T06:37:09.448647+0000","last_unstale":"2024-09-19T06:46:51.580618+0000","last_undegraded":"2024-09-19T06:46:51.580618+0000","last_fullsized":"2024-09-19T06:46:51.580618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-09-19T06:46:51.580537+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-09-19T06:46:51.580537+0000","last_clean_scrub_stamp":"2024-09-19T06:46:51.580537+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:47.482163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"34'14","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.158367+0000","last_change":"2024-09-19T06:46:46.661899+0000","last_active":"2024-09-19T06:46:48.158367+0000","last_peered":"2024-09-19T06:46:48.158367+0000","last_clean":"2024-09-19T06:46:48.158367+0000","last_became_active":"2024-09-19T06:37:09.444737+0000","last_became_peered":"2024-09-19T06:37:09.444737+0000","last_unstale":"2024-09-19T06:46:48.158367+0000","last_undegraded":"2024-09-19T06:46:48.158367+0000","last_fullsized":"2024-09-19T06:46:48.158367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-19T06:46:46.661766+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-19T06:46:46.661766+0000","last_clean_scrub_stamp":"2024-09-19T06:46:46.661766+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:50.160646+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'17","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.076420+0000","last_change":"2024-09-19T06:46:40.741626+0000","last_active":"2024-09-19T06:46:48.076420+0000","last_peered":"2024-09-19T06:46:48.076420+0000","last_clean":"2024-09-19T06:46:48.076420+0000","last_became_active":"2024-09-19T06:37:09.445503+0000","last_became_peered":"2024-09-19T06:37:09.445503+0000","last_unstale":"2024-09-19T06:46:48.076420+0000","last_undegraded":"2024-09-19T06:46:48.076420+0000","last_fullsized":"2024-09-19T06:46:48.076420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-19T06:46:40.741535+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-19T06:46:40.741535+0000","last_clean_scrub_stamp":"2024-09-19T06:46:40.741535+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:16.327341+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"34'15","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.259683+0000","last_change":"2024-09-19T06:46:40.220940+0000","last_active":"2024-09-19T06:46:48.259683+0000","last_peered":"2024-09-19T06:46:48.259683+0000","last_clean":"2024-09-19T06:46:48.259683+0000","last_became_active":"2024-09-19T06:37:09.439767+0000","last_became_peered":"2024-09-19T06:37:09.439767+0000","last_unstale":"2024-09-19T06:46:48.259683+0000","last_undegraded":"2024-09-19T06:46:48.259683+0000","last_fullsized":"2024-09-19T06:46:48.259683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-19T06:46:40.220796+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-19T06:46:40.220796+0000","last_clean_scrub_stamp":"2024-09-19T06:46:40.220796+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:25.385356+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.313137+0000","last_change":"2024-09-19T06:46:41.974822+0000","last_active":"2024-09-19T06:46:48.313137+0000","last_peered":"2024-09-19T06:46:48.313137+0000","last_clean":"2024-09-19T06:46:48.313137+0000","last_became_active":"2024-09-19T06:37:09.440702+0000","last_became_peered":"2024-09-19T06:37:09.440702+0000","last_unstale":"2024-09-19T06:46:48.313137+0000","last_undegraded":"2024-09-19T06:46:48.313137+0000","last_fullsized":"2024-09-19T06:46:48.313137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-19T06:46:41.974707+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-19T06:46:41.974707+0000","last_clean_scrub_stamp":"2024-09-19T06:46:41.974707+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:39:24.201459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"34'12","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:45.579991+0000","last_change":"2024-09-19T06:46:45.579991+0000","last_active":"2024-09-19T06:46:45.579991+0000","last_peered":"2024-09-19T06:46:45.579991+0000","last_clean":"2024-09-19T06:46:45.579991+0000","last_became_active":"2024-09-19T06:37:09.442053+0000","last_became_peered":"2024-09-19T06:37:09.442053+0000","last_unstale":"2024-09-19T06:46:45.579991+0000","last_undegraded":"2024-09-19T06:46:45.579991+0000","last_fullsized":"2024-09-19T06:46:45.579991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-19T06:46:45.579855+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-19T06:46:45.579855+0000","last_clean_scrub_stamp":"2024-09-19T06:46:45.579855+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:16.214018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"34'13","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.255726+0000","last_change":"2024-09-19T06:46:44.570136+0000","last_active":"2024-09-19T06:46:48.255726+0000","last_peered":"2024-09-19T06:46:48.255726+0000","last_clean":"2024-09-19T06:46:48.255726+0000","last_became_active":"2024-09-19T06:37:09.441179+0000","last_became_peered":"2024-09-19T06:37:09.441179+0000","last_unstale":"2024-09-19T06:46:48.255726+0000","last_undegraded":"2024-09-19T06:46:48.255726+0000","last_fullsized":"2024-09-19T06:46:48.255726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-19T06:46:44.570038+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-19T06:46:44.570038+0000","last_clean_scrub_stamp":"2024-09-19T06:46:44.570038+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:36.119372+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"34'16","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.322797+0000","last_change":"2024-09-19T06:46:41.122655+0000","last_active":"2024-09-19T06:46:48.322797+0000","last_peered":"2024-09-19T06:46:48.322797+0000","last_clean":"2024-09-19T06:46:48.322797+0000","last_became_active":"2024-09-19T06:37:09.436892+0000","last_became_peered":"2024-09-19T06:37:09.436892+0000","last_unstale":"2024-09-19T06:46:48.322797+0000","last_undegraded":"2024-09-19T06:46:48.322797+0000","last_fullsized":"2024-09-19T06:46:48.322797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-19T06:46:41.122460+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-19T06:46:41.122460+0000","last_clean_scrub_stamp":"2024-09-19T06:46:41.122460+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:36.064341+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"34'5","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.012191+0000","last_change":"2024-09-19T06:46:46.153977+0000","last_active":"2024-09-19T06:46:48.012191+0000","last_peered":"2024-09-19T06:46:48.012191+0000","last_clean":"2024-09-19T06:46:48.012191+0000","last_became_active":"2024-09-19T06:37:09.437023+0000","last_became_peered":"2024-09-19T06:37:09.437023+0000","last_unstale":"2024-09-19T06:46:48.012191+0000","last_undegraded":"2024-09-19T06:46:48.012191+0000","last_fullsized":"2024-09-19T06:46:48.012191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-19T06:46:46.153851+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-19T06:46:46.153851+0000","last_clean_scrub_stamp":"2024-09-19T06:46:46.153851+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:25.413920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'9","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:57.103482+0000","last_change":"2024-09-19T06:46:57.103482+0000","last_active":"2024-09-19T06:46:57.103482+0000","last_peered":"2024-09-19T06:46:57.103482+0000","last_clean":"2024-09-19T06:46:57.103482+0000","last_became_active":"2024-09-19T06:37:09.448547+0000","last_became_peered":"2024-09-19T06:37:09.448547+0000","last_unstale":"2024-09-19T06:46:57.103482+0000","last_undegraded":"2024-09-19T06:46:57.103482+0000","last_fullsized":"2024-09-19T06:46:57.103482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-19T06:46:57.103325+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-19T06:46:57.103325+0000","last_clean_scrub_stamp":"2024-09-19T06:46:57.103325+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:12.797607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:50.628163+0000","last_change":"2024-09-19T06:46:50.628163+0000","last_active":"2024-09-19T06:46:50.628163+0000","last_peered":"2024-09-19T06:46:50.628163+0000","last_clean":"2024-09-19T06:46:50.628163+0000","last_became_active":"2024-09-19T06:37:09.446603+0000","last_became_peered":"2024-09-19T06:37:09.446603+0000","last_unstale":"2024-09-19T06:46:50.628163+0000","last_undegraded":"2024-09-19T06:46:50.628163+0000","last_fullsized":"2024-09-19T06:46:50.628163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-19T06:46:50.628026+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-19T06:46:50.628026+0000","last_clean_scrub_stamp":"2024-09-19T06:46:50.628026+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:45.500017+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"34'15","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.990903+0000","last_change":"2024-09-19T06:46:48.990903+0000","last_active":"2024-09-19T06:46:48.990903+0000","last_peered":"2024-09-19T06:46:48.990903+0000","last_clean":"2024-09-19T06:46:48.990903+0000","last_became_active":"2024-09-19T06:37:09.429813+0000","last_became_peered":"2024-09-19T06:37:09.429813+0000","last_unstale":"2024-09-19T06:46:48.990903+0000","last_undegraded":"2024-09-19T06:46:48.990903+0000","last_fullsized":"2024-09-19T06:46:48.990903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-19T06:46:48.990811+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-19T06:46:48.990811+0000","last_clean_scrub_stamp":"2024-09-19T06:46:48.990811+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:57.859698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"34'7","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:46.011856+0000","last_change":"2024-09-19T06:46:46.011878+0000","last_active":"2024-09-19T06:46:46.011856+0000","last_peered":"2024-09-19T06:46:46.011856+0000","last_clean":"2024-09-19T06:46:46.011856+0000","last_became_active":"2024-09-19T06:37:51.781695+0000","last_became_peered":"2024-09-19T06:37:51.781695+0000","last_unstale":"2024-09-19T06:46:46.011856+0000","last_undegraded":"2024-09-19T06:46:46.011856+0000","last_fullsized":"2024-09-19T06:46:46.011856+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-19T06:46:46.011786+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-19T06:46:46.011786+0000","last_clean_scrub_stamp":"2024-09-19T06:46:46.011786+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:54:13.317705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"34'12","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.147785+0000","last_change":"2024-09-19T06:46:41.759058+0000","last_active":"2024-09-19T06:46:48.147785+0000","last_peered":"2024-09-19T06:46:48.147785+0000","last_clean":"2024-09-19T06:46:48.147785+0000","last_became_active":"2024-09-19T06:37:09.446557+0000","last_became_peered":"2024-09-19T06:37:09.446557+0000","last_unstale":"2024-09-19T06:46:48.147785+0000","last_undegraded":"2024-09-19T06:46:48.147785+0000","last_fullsized":"2024-09-19T06:46:48.147785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-19T06:46:41.758901+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-19T06:46:41.758901+0000","last_clean_scrub_stamp":"2024-09-19T06:46:41.758901+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:35.619104+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:48.316077+0000","last_change":"2024-09-19T06:46:47.640890+0000","last_active":"2024-09-19T06:46:48.316077+0000","last_peered":"2024-09-19T06:46:48.316077+0000","last_clean":"2024-09-19T06:46:48.316077+0000","last_became_active":"2024-09-19T06:37:09.447753+0000","last_became_peered":"2024-09-19T06:37:09.447753+0000","last_unstale":"2024-09-19T06:46:48.316077+0000","last_undegraded":"2024-09-19T06:46:48.316077+0000","last_fullsized":"2024-09-19T06:46:48.316077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-19T06:46:47.640558+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-19T06:46:47.640558+0000","last_clean_scrub_stamp":"2024-09-19T06:46:47.640558+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:09.389943+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-19T06:46:56.068153+0000","last_change":"2024-09-19T06:46:56.068183+0000","last_active":"2024-09-19T06:46:56.068153+0000","last_peered":"2024-09-19T06:46:56.068153+0000","last_clean":"2024-09-19T06:46:56.068153+0000","last_became_active":"2024-09-19T06:37:09.442047+0000","last_became_peered":"2024-09-19T06:37:09.442047+0000","last_unstale":"2024-09-19T06:46:56.068153+0000","last_undegraded":"2024-09-19T06:46:56.068153+0000","last_fullsized":"2024-09-19T06:46:56.068153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-19T06:46:56.068059+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-19T06:46:56.068059+0000","last_clean_scrub_stamp":"2024-09-19T06:46:56.068059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:54:05.128170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1242,"num_read_kb":0,"num_write":2247820,"num_write_kb":28311472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157273,"ondisk_log_size":157273,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":777,"ondisk_log_size":777,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65543337,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":467,"num_read_kb":289484,"num_write":3842,"num_write_kb":66952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":80682,"num_omap_keys":138,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33423360,"data_stored":131086674,"data_compressed":14183544,"data_compressed_allocated":17063936,"data_compressed_original":114794496,"omap_allocated":0,"internal_metadata":0},"log_size":3847,"ondisk_log_size":3847,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65040,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509567,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":712784,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":710782,"kb_avail":93659056,"statfs":{"total":96636764160,"available":95906873344,"internally_reserved":0,"allocated":2031616,"data_stored":8554465,"data_compressed":865550,"data_compressed_allocated":1097728,"data_compressed_original":7827456,"omap_allocated":1595,"internal_metadata":727841221},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509567,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1020548,"kb_used_data":5684,"kb_used_omap":1,"kb_used_meta":1014846,"kb_avail":93351292,"statfs":{"total":96636764160,"available":95591723008,"internally_reserved":0,"allocated":5820416,"data_stored":23670451,"data_compressed":2577869,"data_compressed_allocated":3006464,"data_compressed_original":21073920,"omap_allocated":1595,"internal_metadata":1039202757},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509566,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":914380,"kb_used_data":4348,"kb_used_omap":1,"kb_used_meta":910014,"kb_avail":93457460,"statfs":{"total":96636764160,"available":95700439040,"internally_reserved":0,"allocated":4452352,"data_stored":21728293,"data_compressed":2359658,"data_compressed_allocated":2752512,"data_compressed_original":20246528,"omap_allocated":1595,"internal_metadata":931854789},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542271,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":929732,"kb_used_data":9908,"kb_used_omap":1,"kb_used_meta":919806,"kb_avail":93442108,"statfs":{"total":96636764160,"available":95684718592,"internally_reserved":0,"allocated":10145792,"data_stored":34311149,"data_compressed":3370597,"data_compressed_allocated":4014080,"data_compressed_original":28389376,"omap_allocated":1590,"internal_metadata":941881802},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542269,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1005360,"kb_used_data":4192,"kb_used_omap":1,"kb_used_meta":1001150,"kb_avail":93366480,"statfs":{"total":96636764160,"available":95607275520,"internally_reserved":0,"allocated":4292608,"data_stored":16943655,"data_compressed":1995942,"data_compressed_allocated":2461696,"data_compressed_original":15323136,"omap_allocated":1594,"internal_metadata":1025178054},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542268,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1220460,"kb_used_data":5468,"kb_used_omap":1,"kb_used_meta":1214974,"kb_avail":93151380,"statfs":{"total":96636764160,"available":95387013120,"internally_reserved":0,"allocated":5599232,"data_stored":12843620,"data_compressed":1395672,"data_compressed_allocated":1748992,"data_compressed_original":9207808,"omap_allocated":1593,"internal_metadata":1244133831},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542268,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1263864,"kb_used_data":3624,"kb_used_omap":1,"kb_used_meta":1260222,"kb_avail":93107976,"statfs":{"total":96636764160,"available":95342567424,"internally_reserved":0,"allocated":3710976,"data_stored":15281877,"data_compressed":1678240,"data_compressed_allocated":2064384,"data_compressed_original":13848576,"omap_allocated":1595,"internal_metadata":1290467781},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574976,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":793608,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":793150,"kb_avail":93578232,"statfs":{"total":96636764160,"available":95824109568,"internally_reserved":0,"allocated":450560,"data_stored":260036,"data_compressed":5056,"data_compressed_allocated":8192,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":812186053},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32520,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4018176,"data_stored":20972158,"data_compressed":2327138,"data_compressed_allocated":2707456,"data_compressed_original":19673088,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3342336,"data_stored":15116110,"data_compressed":1678240,"data_compressed_allocated":2064384,"data_compressed_original":13848576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":94269,"data_compressed":5056,"data_compressed_allocated":8192,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5230592,"data_stored":12677853,"data_compressed":1395672,"data_compressed_allocated":1748992,"data_compressed_original":9207808,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5451776,"data_stored":23504684,"data_compressed":2577869,"data_compressed_allocated":3006464,"data_compressed_original":21073920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1662976,"data_stored":8388698,"data_compressed":865550,"data_compressed_allocated":1097728,"data_compressed_original":7827456,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3923968,"data_stored":16777888,"data_compressed":1995942,"data_compressed_allocated":2461696,"data_compressed_original":15323136,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9711616,"data_stored":33555014,"data_compressed":3338077,"data_compressed_allocated":3969024,"data_compressed_original":27815936,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:47:20.590 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-19T06:47:20.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.720+0000 7fa535cc0640 1 Processor -- start 2024-09-19T06:47:20.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.720+0000 7fa535cc0640 1 -- start start 2024-09-19T06:47:20.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.720+0000 7fa535cc0640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5300c83a0 0x7fa530071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.720+0000 7fa535cc0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5300c5da0 0x7fa530152f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.720+0000 7fa535cc0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa530070980 con 0x7fa5300c8780 2024-09-19T06:47:20.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.720+0000 7fa535cc0640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fa530159940 con 0x7fa5300c83a0 2024-09-19T06:47:20.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.720+0000 7fa535cc0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa530159c20 con 0x7fa5300c5da0 2024-09-19T06:47:20.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.721+0000 7fa52f7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5300c83a0 0x7fa530071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.721+0000 7fa52f7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5300c83a0 0x7fa530071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41936/0 (socket says 172.21.15.86:41936) 2024-09-19T06:47:20.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.721+0000 7fa52f7fe640 1 -- 172.21.15.86:0/1439581124 learned_addr learned my addr 172.21.15.86:0/1439581124 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:47:20.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.721+0000 7fa52ffff640 1 --2- 172.21.15.86:0/1439581124 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5300c5da0 0x7fa530152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.721+0000 7fa52f7fe640 1 -- 172.21.15.86:0/1439581124 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5300c5da0 msgr2=0x7fa530152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:20.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.721+0000 7fa52f7fe640 1 --2- 172.21.15.86:0/1439581124 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5300c5da0 0x7fa530152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.721+0000 7fa52f7fe640 1 -- 172.21.15.86:0/1439581124 >> v1:172.21.15.169:6789/0 conn(0x7fa5300c8780 legacy=0x7fa530159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:20.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.721+0000 7fa52f7fe640 1 -- 172.21.15.86:0/1439581124 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa530070c20 con 0x7fa5300c83a0 2024-09-19T06:47:20.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.722+0000 7fa52f7fe640 1 --2- 172.21.15.86:0/1439581124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5300c83a0 0x7fa530071420 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa520009870 tx=0x7fa52002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce23d24aeafa8e9e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:20.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.722+0000 7fa52e7fc640 1 -- 172.21.15.86:0/1439581124 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa520037070 con 0x7fa5300c83a0 2024-09-19T06:47:20.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.722+0000 7fa52e7fc640 1 -- 172.21.15.86:0/1439581124 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa52002ae50 con 0x7fa5300c83a0 2024-09-19T06:47:20.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.722+0000 7fa52e7fc640 1 -- 172.21.15.86:0/1439581124 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa520032860 con 0x7fa5300c83a0 2024-09-19T06:47:20.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.722+0000 7fa535cc0640 1 -- 172.21.15.86:0/1439581124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5300c83a0 msgr2=0x7fa530071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:20.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.722+0000 7fa535cc0640 1 --2- 172.21.15.86:0/1439581124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5300c83a0 0x7fa530071420 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa520009870 tx=0x7fa52002a300 comp rx=0 tx=0).stop 2024-09-19T06:47:20.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.722+0000 7fa535cc0640 1 -- 172.21.15.86:0/1439581124 shutdown_connections 2024-09-19T06:47:20.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.722+0000 7fa535cc0640 1 --2- 172.21.15.86:0/1439581124 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5300c5da0 0x7fa530152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.722+0000 7fa535cc0640 1 --2- 172.21.15.86:0/1439581124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5300c83a0 0x7fa530071420 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.722+0000 7fa535cc0640 1 -- 172.21.15.86:0/1439581124 >> 172.21.15.86:0/1439581124 conn(0x7fa530073160 msgr2=0x7fa530073570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:20.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.722+0000 7fa535cc0640 1 -- 172.21.15.86:0/1439581124 shutdown_connections 2024-09-19T06:47:20.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.722+0000 7fa535cc0640 1 -- 172.21.15.86:0/1439581124 wait complete. 2024-09-19T06:47:20.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.723+0000 7fa535cc0640 1 Processor -- start 2024-09-19T06:47:20.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.723+0000 7fa535cc0640 1 -- start start 2024-09-19T06:47:20.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.724+0000 7fa535cc0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5300c5da0 0x7fa53014edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.724+0000 7fa535cc0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5300c83a0 0x7fa53015b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.724+0000 7fa535cc0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5300c8780 0x7fa5301f2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.724+0000 7fa535cc0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa530071960 con 0x7fa5300c8780 2024-09-19T06:47:20.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.724+0000 7fa535cc0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa530159f00 con 0x7fa5300c5da0 2024-09-19T06:47:20.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.724+0000 7fa535cc0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa530073dd0 con 0x7fa5300c83a0 2024-09-19T06:47:20.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.725+0000 7fa52ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5300c8780 0x7fa5301f2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.725+0000 7fa52ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5300c8780 0x7fa5301f2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41946/0 (socket says 172.21.15.86:41946) 2024-09-19T06:47:20.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.725+0000 7fa52ffff640 1 -- 172.21.15.86:0/3156489278 learned_addr learned my addr 172.21.15.86:0/3156489278 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:47:20.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.725+0000 7fa52f7fe640 1 --2- 172.21.15.86:0/3156489278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5300c5da0 0x7fa53014edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.725+0000 7fa52effd640 1 --2- 172.21.15.86:0/3156489278 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5300c83a0 0x7fa53015b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.725+0000 7fa52ffff640 1 -- 172.21.15.86:0/3156489278 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5300c83a0 msgr2=0x7fa53015b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:20.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.725+0000 7fa52ffff640 1 --2- 172.21.15.86:0/3156489278 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5300c83a0 0x7fa53015b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.725+0000 7fa52ffff640 1 -- 172.21.15.86:0/3156489278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5300c5da0 msgr2=0x7fa53014edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:20.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.725+0000 7fa52ffff640 1 --2- 172.21.15.86:0/3156489278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5300c5da0 0x7fa53014edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.725+0000 7fa52ffff640 1 -- 172.21.15.86:0/3156489278 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa530157d20 con 0x7fa5300c8780 2024-09-19T06:47:20.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.725+0000 7fa52ffff640 1 --2- 172.21.15.86:0/3156489278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5300c8780 0x7fa5301f2a50 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa528007e70 tx=0x7fa52800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:20.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.725+0000 7fa517fff640 1 -- 172.21.15.86:0/3156489278 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa528014620 con 0x7fa5300c8780 2024-09-19T06:47:20.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.725+0000 7fa517fff640 1 -- 172.21.15.86:0/3156489278 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa528019070 con 0x7fa5300c8780 2024-09-19T06:47:20.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.725+0000 7fa535cc0640 1 -- 172.21.15.86:0/3156489278 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5301571a0 con 0x7fa5300c8780 2024-09-19T06:47:20.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.725+0000 7fa517fff640 1 -- 172.21.15.86:0/3156489278 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa528014a20 con 0x7fa5300c8780 2024-09-19T06:47:20.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.725+0000 7fa535cc0640 1 -- 172.21.15.86:0/3156489278 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa530157760 con 0x7fa5300c8780 2024-09-19T06:47:20.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.726+0000 7fa535cc0640 1 -- 172.21.15.86:0/3156489278 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa53015a490 con 0x7fa5300c8780 2024-09-19T06:47:20.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.727+0000 7fa517fff640 1 -- 172.21.15.86:0/3156489278 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa528014bc0 con 0x7fa5300c8780 2024-09-19T06:47:20.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.727+0000 7fa517fff640 1 --2- 172.21.15.86:0/3156489278 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa51c06c2b0 0x7fa51c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.728+0000 7fa52f7fe640 1 --2- 172.21.15.86:0/3156489278 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa51c06c2b0 0x7fa51c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.728+0000 7fa517fff640 1 -- 172.21.15.86:0/3156489278 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7fa52808c280 con 0x7fa5300c8780 2024-09-19T06:47:20.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.728+0000 7fa52f7fe640 1 --2- 172.21.15.86:0/3156489278 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa51c06c2b0 0x7fa51c06e770 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa520034000 tx=0x7fa52002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:20.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.732+0000 7fa517fff640 1 -- 172.21.15.86:0/3156489278 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa528059d00 con 0x7fa5300c8780 2024-09-19T06:47:20.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.903+0000 7fa535cc0640 1 -- 172.21.15.86:0/3156489278 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fa5300c6d10 con 0x7fa5300c8780 2024-09-19T06:47:20.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.906+0000 7fa517fff640 1 -- 172.21.15.86:0/3156489278 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7fa52805e000 con 0x7fa5300c8780 2024-09-19T06:47:20.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.907+0000 7fa517fff640 1 -- 172.21.15.86:0/3156489278 <== mon.0 v2:172.21.15.86:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa5280628c0 con 0x7fa5300c8780 2024-09-19T06:47:20.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.910+0000 7fa535cc0640 1 -- 172.21.15.86:0/3156489278 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa51c06c2b0 msgr2=0x7fa51c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:20.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.910+0000 7fa535cc0640 1 --2- 172.21.15.86:0/3156489278 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa51c06c2b0 0x7fa51c06e770 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa520034000 tx=0x7fa52002e000 comp rx=0 tx=0).stop 2024-09-19T06:47:20.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.910+0000 7fa535cc0640 1 -- 172.21.15.86:0/3156489278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5300c8780 msgr2=0x7fa5301f2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:20.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.910+0000 7fa535cc0640 1 --2- 172.21.15.86:0/3156489278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5300c8780 0x7fa5301f2a50 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa528007e70 tx=0x7fa52800e4b0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.910+0000 7fa535cc0640 1 -- 172.21.15.86:0/3156489278 shutdown_connections 2024-09-19T06:47:20.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.910+0000 7fa535cc0640 1 --2- 172.21.15.86:0/3156489278 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fa51c06c2b0 0x7fa51c06e770 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.910+0000 7fa535cc0640 1 --2- 172.21.15.86:0/3156489278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5300c8780 0x7fa5301f2a50 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.910+0000 7fa535cc0640 1 --2- 172.21.15.86:0/3156489278 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5300c83a0 0x7fa53015b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.910+0000 7fa535cc0640 1 --2- 172.21.15.86:0/3156489278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5300c5da0 0x7fa53014edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.910+0000 7fa535cc0640 1 -- 172.21.15.86:0/3156489278 >> 172.21.15.86:0/3156489278 conn(0x7fa530073160 msgr2=0x7fa5300c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:20.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.911+0000 7fa535cc0640 1 -- 172.21.15.86:0/3156489278 shutdown_connections 2024-09-19T06:47:20.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:20.911+0000 7fa535cc0640 1 -- 172.21.15.86:0/3156489278 wait complete. 2024-09-19T06:47:20.923 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T06:47:20.923 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:47:21.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.021+0000 7feb6223c640 1 Processor -- start 2024-09-19T06:47:21.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.021+0000 7feb6223c640 1 -- start start 2024-09-19T06:47:21.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.022+0000 7feb6223c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7feb5c154e20 0x7feb5c15afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:21.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.022+0000 7feb6223c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb5c155200 0x7feb5c0ca020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:21.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.022+0000 7feb6223c640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb5c15ec10 con 0x7feb5c15e5b0 2024-09-19T06:47:21.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.022+0000 7feb6223c640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7feb5c15eed0 con 0x7feb5c154e20 2024-09-19T06:47:21.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.022+0000 7feb6223c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7feb5c15f1b0 con 0x7feb5c155200 2024-09-19T06:47:21.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.022+0000 7feb5b7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7feb5c154e20 0x7feb5c15afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:21.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.022+0000 7feb5bfff640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7feb5c15e5b0 0x7feb5c073840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48578/0 (socket says 172.21.15.86:48578) 2024-09-19T06:47:21.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.022+0000 7feb5bfff640 1 -- 172.21.15.86:0/4189373005 learned_addr learned my addr 172.21.15.86:0/4189373005 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:47:21.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.022+0000 7feb5affd640 1 --2- 172.21.15.86:0/4189373005 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb5c155200 0x7feb5c0ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:21.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.022+0000 7feb5b7fe640 1 -- 172.21.15.86:0/4189373005 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb5c155200 msgr2=0x7feb5c0ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:21.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.022+0000 7feb5b7fe640 1 --2- 172.21.15.86:0/4189373005 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb5c155200 0x7feb5c0ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.022+0000 7feb5b7fe640 1 -- 172.21.15.86:0/4189373005 >> v1:172.21.15.86:6789/0 conn(0x7feb5c15e5b0 legacy=0x7feb5c073840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:21.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.022+0000 7feb5b7fe640 1 -- 172.21.15.86:0/4189373005 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5c15f490 con 0x7feb5c154e20 2024-09-19T06:47:21.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.023+0000 7feb5b7fe640 1 --2- 172.21.15.86:0/4189373005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb5c154e20 0x7feb5c15afc0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0097a0 tx=0x7feb4c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880a003bf1051c6e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:21.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.023+0000 7feb5a7fc640 1 -- 172.21.15.86:0/4189373005 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c037070 con 0x7feb5c154e20 2024-09-19T06:47:21.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.023+0000 7feb5a7fc640 1 -- 172.21.15.86:0/4189373005 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7feb4c032440 con 0x7feb5c154e20 2024-09-19T06:47:21.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.023+0000 7feb5a7fc640 1 -- 172.21.15.86:0/4189373005 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c032830 con 0x7feb5c154e20 2024-09-19T06:47:21.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.023+0000 7feb6223c640 1 -- 172.21.15.86:0/4189373005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb5c154e20 msgr2=0x7feb5c15afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:21.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.023+0000 7feb6223c640 1 --2- 172.21.15.86:0/4189373005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb5c154e20 0x7feb5c15afc0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0097a0 tx=0x7feb4c02a210 comp rx=0 tx=0).stop 2024-09-19T06:47:21.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.024+0000 7feb6223c640 1 -- 172.21.15.86:0/4189373005 shutdown_connections 2024-09-19T06:47:21.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.024+0000 7feb6223c640 1 --2- 172.21.15.86:0/4189373005 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb5c155200 0x7feb5c0ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.024+0000 7feb6223c640 1 --2- 172.21.15.86:0/4189373005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb5c154e20 0x7feb5c15afc0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.024+0000 7feb6223c640 1 -- 172.21.15.86:0/4189373005 >> 172.21.15.86:0/4189373005 conn(0x7feb5c067890 msgr2=0x7feb5c067c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:21.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.024+0000 7feb6223c640 1 -- 172.21.15.86:0/4189373005 shutdown_connections 2024-09-19T06:47:21.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.024+0000 7feb6223c640 1 -- 172.21.15.86:0/4189373005 wait complete. 2024-09-19T06:47:21.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.025+0000 7feb6223c640 1 Processor -- start 2024-09-19T06:47:21.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.025+0000 7feb6223c640 1 -- start start 2024-09-19T06:47:21.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.026+0000 7feb6223c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb5c154e20 0x7feb5c1e7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:21.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.026+0000 7feb6223c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb5c155200 0x7feb5c1e6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:21.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.026+0000 7feb6223c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb5c15e5b0 0x7feb5c1558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:21.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.026+0000 7feb6223c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c070f10 con 0x7feb5c15e5b0 2024-09-19T06:47:21.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.026+0000 7feb6223c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c070c30 con 0x7feb5c155200 2024-09-19T06:47:21.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.026+0000 7feb6223c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7feb5c0c9460 con 0x7feb5c154e20 2024-09-19T06:47:21.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.026+0000 7feb5bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb5c15e5b0 0x7feb5c1558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:21.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.026+0000 7feb5bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb5c15e5b0 0x7feb5c1558b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41966/0 (socket says 172.21.15.86:41966) 2024-09-19T06:47:21.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.026+0000 7feb5bfff640 1 -- 172.21.15.86:0/1989731658 learned_addr learned my addr 172.21.15.86:0/1989731658 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:47:21.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.026+0000 7feb5b7fe640 1 --2- 172.21.15.86:0/1989731658 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb5c154e20 0x7feb5c1e7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:21.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.026+0000 7feb5affd640 1 --2- 172.21.15.86:0/1989731658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb5c155200 0x7feb5c1e6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:21.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.026+0000 7feb5bfff640 1 -- 172.21.15.86:0/1989731658 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb5c154e20 msgr2=0x7feb5c1e7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:21.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.026+0000 7feb5bfff640 1 --2- 172.21.15.86:0/1989731658 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb5c154e20 0x7feb5c1e7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.026+0000 7feb5bfff640 1 -- 172.21.15.86:0/1989731658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb5c155200 msgr2=0x7feb5c1e6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:21.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.026+0000 7feb5bfff640 1 --2- 172.21.15.86:0/1989731658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb5c155200 0x7feb5c1e6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.026+0000 7feb5bfff640 1 -- 172.21.15.86:0/1989731658 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5c1582f0 con 0x7feb5c15e5b0 2024-09-19T06:47:21.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.026+0000 7feb5b7fe640 1 --2- 172.21.15.86:0/1989731658 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb5c154e20 0x7feb5c1e7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:21.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.026+0000 7feb5bfff640 1 --2- 172.21.15.86:0/1989731658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb5c15e5b0 0x7feb5c1558b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7feb5400cbf0 tx=0x7feb5400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:21.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.026+0000 7feb43fff640 1 -- 172.21.15.86:0/1989731658 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb54017070 con 0x7feb5c15e5b0 2024-09-19T06:47:21.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.026+0000 7feb43fff640 1 -- 172.21.15.86:0/1989731658 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7feb5400ad40 con 0x7feb5c15e5b0 2024-09-19T06:47:21.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.026+0000 7feb43fff640 1 -- 172.21.15.86:0/1989731658 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb54012620 con 0x7feb5c15e5b0 2024-09-19T06:47:21.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.026+0000 7feb6223c640 1 -- 172.21.15.86:0/1989731658 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb5c1f3850 con 0x7feb5c15e5b0 2024-09-19T06:47:21.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.026+0000 7feb6223c640 1 -- 172.21.15.86:0/1989731658 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb5c1f3e10 con 0x7feb5c15e5b0 2024-09-19T06:47:21.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.027+0000 7feb6223c640 1 -- 172.21.15.86:0/1989731658 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb5c0ca020 con 0x7feb5c15e5b0 2024-09-19T06:47:21.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.028+0000 7feb43fff640 1 -- 172.21.15.86:0/1989731658 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7feb5401a070 con 0x7feb5c15e5b0 2024-09-19T06:47:21.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.028+0000 7feb43fff640 1 --2- 172.21.15.86:0/1989731658 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7feb4806c2b0 0x7feb4806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:21.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.029+0000 7feb43fff640 1 -- 172.21.15.86:0/1989731658 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7feb5408b8a0 con 0x7feb5c15e5b0 2024-09-19T06:47:21.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.029+0000 7feb5b7fe640 1 --2- 172.21.15.86:0/1989731658 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7feb4806c2b0 0x7feb4806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:21.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.029+0000 7feb5b7fe640 1 --2- 172.21.15.86:0/1989731658 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7feb4806c2b0 0x7feb4806e770 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feb4c034000 tx=0x7feb4c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:21.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.036+0000 7feb43fff640 1 -- 172.21.15.86:0/1989731658 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7feb54059a00 con 0x7feb5c15e5b0 2024-09-19T06:47:21.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.238+0000 7feb6223c640 1 -- 172.21.15.86:0/1989731658 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb5c06c8c0 con 0x7feb5c15e5b0 2024-09-19T06:47:21.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.239+0000 7feb43fff640 1 -- 172.21.15.86:0/1989731658 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+6055 (secure 0 0 0) 0x7feb54059300 con 0x7feb5c15e5b0 2024-09-19T06:47:21.241 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:47:21.241 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":39,"btime":"2024-09-19T06:46:24:081910+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:46:24.081904+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5092},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5092":{"gid":5092,"name":"d","rank":0,"incarnation":35,"state":"up:active","state_seq":21,"addr":"172.21.15.169:6837/1148622307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1148622307},{"type":"v1","addr":"172.21.15.169:6837","nonce":1148622307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5092,"qdb_cluster":[5092]},"id":1}]} 2024-09-19T06:47:21.241 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 39 2024-09-19T06:47:21.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.241+0000 7feb6223c640 1 -- 172.21.15.86:0/1989731658 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7feb4806c2b0 msgr2=0x7feb4806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:21.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.241+0000 7feb6223c640 1 --2- 172.21.15.86:0/1989731658 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7feb4806c2b0 0x7feb4806e770 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feb4c034000 tx=0x7feb4c02e000 comp rx=0 tx=0).stop 2024-09-19T06:47:21.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.241+0000 7feb6223c640 1 -- 172.21.15.86:0/1989731658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb5c15e5b0 msgr2=0x7feb5c1558b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:21.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.241+0000 7feb6223c640 1 --2- 172.21.15.86:0/1989731658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb5c15e5b0 0x7feb5c1558b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7feb5400cbf0 tx=0x7feb5400a430 comp rx=0 tx=0).stop 2024-09-19T06:47:21.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.241+0000 7feb6223c640 1 -- 172.21.15.86:0/1989731658 shutdown_connections 2024-09-19T06:47:21.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.241+0000 7feb6223c640 1 --2- 172.21.15.86:0/1989731658 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7feb4806c2b0 0x7feb4806e770 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.241+0000 7feb6223c640 1 --2- 172.21.15.86:0/1989731658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb5c15e5b0 0x7feb5c1558b0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.241+0000 7feb6223c640 1 --2- 172.21.15.86:0/1989731658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb5c155200 0x7feb5c1e6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.241+0000 7feb6223c640 1 --2- 172.21.15.86:0/1989731658 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb5c154e20 0x7feb5c1e7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.241+0000 7feb6223c640 1 -- 172.21.15.86:0/1989731658 >> 172.21.15.86:0/1989731658 conn(0x7feb5c067890 msgr2=0x7feb5c0cded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:21.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.241+0000 7feb6223c640 1 -- 172.21.15.86:0/1989731658 shutdown_connections 2024-09-19T06:47:21.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.241+0000 7feb6223c640 1 -- 172.21.15.86:0/1989731658 wait complete. 2024-09-19T06:47:21.254 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T06:47:21.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.353+0000 7fcb1f0af640 1 Processor -- start 2024-09-19T06:47:21.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.353+0000 7fcb1f0af640 1 -- start start 2024-09-19T06:47:21.356 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.354+0000 7fcb1f0af640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcb18152fe0 0x7fcb1815c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:21.356 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.354+0000 7fcb1f0af640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb18159c20 0x7fcb18073840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:21.356 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.354+0000 7fcb1f0af640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb180c9e20 con 0x7fcb181597f0 2024-09-19T06:47:21.356 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.354+0000 7fcb1f0af640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fcb1815d390 con 0x7fcb18152fe0 2024-09-19T06:47:21.356 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.354+0000 7fcb1f0af640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcb1815caf0 con 0x7fcb18159c20 2024-09-19T06:47:21.356 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.354+0000 7fcb1ce4b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcb18152fe0 0x7fcb1815c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:21.356 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.354+0000 7fcb1ce4b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcb18152fe0 0x7fcb1815c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41976/0 (socket says 172.21.15.86:41976) 2024-09-19T06:47:21.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.354+0000 7fcb1ce4b640 1 -- 172.21.15.86:0/2024139910 learned_addr learned my addr 172.21.15.86:0/2024139910 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:47:21.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.354+0000 7fcb1d64c640 1 --2- 172.21.15.86:0/2024139910 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb18159c20 0x7fcb18073840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:21.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.354+0000 7fcb1ce4b640 1 -- 172.21.15.86:0/2024139910 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb18159c20 msgr2=0x7fcb18073840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:21.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.354+0000 7fcb1ce4b640 1 --2- 172.21.15.86:0/2024139910 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb18159c20 0x7fcb18073840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.354+0000 7fcb1ce4b640 1 -- 172.21.15.86:0/2024139910 >> v1:172.21.15.169:6789/0 conn(0x7fcb181597f0 legacy=0x7fcb180c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:21.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.354+0000 7fcb1ce4b640 1 -- 172.21.15.86:0/2024139910 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb1815cdd0 con 0x7fcb18152fe0 2024-09-19T06:47:21.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.355+0000 7fcb1ce4b640 1 --2- 172.21.15.86:0/2024139910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb18152fe0 0x7fcb1815c440 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fcb1815d510 tx=0x7fcb0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca52b470ce411a0a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:21.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.355+0000 7fcb177fe640 1 -- 172.21.15.86:0/2024139910 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c037070 con 0x7fcb18152fe0 2024-09-19T06:47:21.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.355+0000 7fcb177fe640 1 -- 172.21.15.86:0/2024139910 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fcb0c032440 con 0x7fcb18152fe0 2024-09-19T06:47:21.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.355+0000 7fcb177fe640 1 -- 172.21.15.86:0/2024139910 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c032830 con 0x7fcb18152fe0 2024-09-19T06:47:21.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.356+0000 7fcb1f0af640 1 -- 172.21.15.86:0/2024139910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb18152fe0 msgr2=0x7fcb1815c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:21.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.356+0000 7fcb1f0af640 1 --2- 172.21.15.86:0/2024139910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb18152fe0 0x7fcb1815c440 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fcb1815d510 tx=0x7fcb0c02a270 comp rx=0 tx=0).stop 2024-09-19T06:47:21.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.356+0000 7fcb1f0af640 1 -- 172.21.15.86:0/2024139910 shutdown_connections 2024-09-19T06:47:21.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.356+0000 7fcb1f0af640 1 --2- 172.21.15.86:0/2024139910 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb18159c20 0x7fcb18073840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.356+0000 7fcb1f0af640 1 --2- 172.21.15.86:0/2024139910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb18152fe0 0x7fcb1815c440 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.356+0000 7fcb1f0af640 1 -- 172.21.15.86:0/2024139910 >> 172.21.15.86:0/2024139910 conn(0x7fcb18067890 msgr2=0x7fcb18067c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:21.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.356+0000 7fcb1f0af640 1 -- 172.21.15.86:0/2024139910 shutdown_connections 2024-09-19T06:47:21.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.356+0000 7fcb1f0af640 1 -- 172.21.15.86:0/2024139910 wait complete. 2024-09-19T06:47:21.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.357+0000 7fcb1f0af640 1 Processor -- start 2024-09-19T06:47:21.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.357+0000 7fcb1f0af640 1 -- start start 2024-09-19T06:47:21.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.358+0000 7fcb1f0af640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb18152fe0 0x7fcb18150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:21.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.358+0000 7fcb1f0af640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb181597f0 0x7fcb181e2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:21.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.358+0000 7fcb1f0af640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb1814f180 0x7fcb181f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:21.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.358+0000 7fcb1f0af640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcb181533c0 con 0x7fcb18152fe0 2024-09-19T06:47:21.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.358+0000 7fcb1f0af640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcb18158ff0 con 0x7fcb1814f180 2024-09-19T06:47:21.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.358+0000 7fcb1f0af640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcb18153540 con 0x7fcb181597f0 2024-09-19T06:47:21.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.358+0000 7fcb1ce4b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb18152fe0 0x7fcb18150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:21.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.358+0000 7fcb1ce4b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb18152fe0 0x7fcb18150a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41978/0 (socket says 172.21.15.86:41978) 2024-09-19T06:47:21.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.358+0000 7fcb1ce4b640 1 -- 172.21.15.86:0/2282619781 learned_addr learned my addr 172.21.15.86:0/2282619781 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:47:21.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.358+0000 7fcb17fff640 1 --2- 172.21.15.86:0/2282619781 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb181597f0 0x7fcb181e2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:21.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.358+0000 7fcb1d64c640 1 --2- 172.21.15.86:0/2282619781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb1814f180 0x7fcb181f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:21.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.358+0000 7fcb1ce4b640 1 -- 172.21.15.86:0/2282619781 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb181597f0 msgr2=0x7fcb181e2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:21.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.358+0000 7fcb1ce4b640 1 --2- 172.21.15.86:0/2282619781 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb181597f0 0x7fcb181e2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.358+0000 7fcb1ce4b640 1 -- 172.21.15.86:0/2282619781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb1814f180 msgr2=0x7fcb181f1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:21.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.358+0000 7fcb1ce4b640 1 --2- 172.21.15.86:0/2282619781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb1814f180 0x7fcb181f1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.358+0000 7fcb1ce4b640 1 -- 172.21.15.86:0/2282619781 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb181e29b0 con 0x7fcb18152fe0 2024-09-19T06:47:21.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.358+0000 7fcb1ce4b640 1 --2- 172.21.15.86:0/2282619781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb18152fe0 0x7fcb18150a70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c000c00 tx=0x7fcb0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:21.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.358+0000 7fcb157fa640 1 -- 172.21.15.86:0/2282619781 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c037040 con 0x7fcb18152fe0 2024-09-19T06:47:21.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.359+0000 7fcb157fa640 1 -- 172.21.15.86:0/2282619781 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fcb0c042070 con 0x7fcb18152fe0 2024-09-19T06:47:21.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.359+0000 7fcb157fa640 1 -- 172.21.15.86:0/2282619781 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c030bf0 con 0x7fcb18152fe0 2024-09-19T06:47:21.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.359+0000 7fcb1f0af640 1 -- 172.21.15.86:0/2282619781 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb1814c310 con 0x7fcb18152fe0 2024-09-19T06:47:21.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.359+0000 7fcb1f0af640 1 -- 172.21.15.86:0/2282619781 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb1814c5b0 con 0x7fcb18152fe0 2024-09-19T06:47:21.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.360+0000 7fcb1f0af640 1 -- 172.21.15.86:0/2282619781 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb180708b0 con 0x7fcb18152fe0 2024-09-19T06:47:21.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.360+0000 7fcb157fa640 1 -- 172.21.15.86:0/2282619781 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcb0c047460 con 0x7fcb18152fe0 2024-09-19T06:47:21.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.360+0000 7fcb157fa640 1 --2- 172.21.15.86:0/2282619781 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fcafc06c2e0 0x7fcafc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:21.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.361+0000 7fcb157fa640 1 -- 172.21.15.86:0/2282619781 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7fcb0c0ac540 con 0x7fcb18152fe0 2024-09-19T06:47:21.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.361+0000 7fcb17fff640 1 --2- 172.21.15.86:0/2282619781 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fcafc06c2e0 0x7fcafc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:21.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.361+0000 7fcb17fff640 1 --2- 172.21.15.86:0/2282619781 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fcafc06c2e0 0x7fcafc06e7a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcb18158db0 tx=0x7fcb04009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.365+0000 7fcb157fa640 1 -- 172.21.15.86:0/2282619781 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fcb0c032e20 con 0x7fcb18152fe0 2024-09-19T06:47:21.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.590+0000 7fcb1f0af640 1 -- 172.21.15.86:0/2282619781 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb180c94f0 con 0x7fcb18152fe0 2024-09-19T06:47:21.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.591+0000 7fcb157fa640 1 -- 172.21.15.86:0/2282619781 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+6055 (secure 0 0 0) 0x7fcb0c079fc0 con 0x7fcb18152fe0 2024-09-19T06:47:21.592 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:47:21.592 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":39,"btime":"2024-09-19T06:46:24:081910+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/728803297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":728803297},{"type":"v1","addr":"172.21.15.86:6837","nonce":728803297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2537509253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":2537509253},{"type":"v1","addr":"172.21.15.169:6835","nonce":2537509253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1723647527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1723647527},{"type":"v1","addr":"172.21.15.169:6834","nonce":1723647527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4135959816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4135959816},{"type":"v1","addr":"172.21.15.86:6836","nonce":4135959816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:08.763572+0000","modified":"2024-09-19T06:46:24.081904+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5092},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5092":{"gid":5092,"name":"d","rank":0,"incarnation":35,"state":"up:active","state_seq":21,"addr":"172.21.15.169:6837/1148622307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1148622307},{"type":"v1","addr":"172.21.15.169:6837","nonce":1148622307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5092,"qdb_cluster":[5092]},"id":1}]} 2024-09-19T06:47:21.592 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 39 2024-09-19T06:47:21.594 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.593+0000 7fcb1f0af640 1 -- 172.21.15.86:0/2282619781 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fcafc06c2e0 msgr2=0x7fcafc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:21.594 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.593+0000 7fcb1f0af640 1 --2- 172.21.15.86:0/2282619781 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fcafc06c2e0 0x7fcafc06e7a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcb18158db0 tx=0x7fcb04009040 comp rx=0 tx=0).stop 2024-09-19T06:47:21.594 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.593+0000 7fcb1f0af640 1 -- 172.21.15.86:0/2282619781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb18152fe0 msgr2=0x7fcb18150a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:21.594 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.593+0000 7fcb1f0af640 1 --2- 172.21.15.86:0/2282619781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb18152fe0 0x7fcb18150a70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c000c00 tx=0x7fcb0c0046c0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.594 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.593+0000 7fcb1f0af640 1 -- 172.21.15.86:0/2282619781 shutdown_connections 2024-09-19T06:47:21.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.593+0000 7fcb1f0af640 1 --2- 172.21.15.86:0/2282619781 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fcafc06c2e0 0x7fcafc06e7a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.593+0000 7fcb1f0af640 1 --2- 172.21.15.86:0/2282619781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb1814f180 0x7fcb181f1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.593+0000 7fcb1f0af640 1 --2- 172.21.15.86:0/2282619781 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb181597f0 0x7fcb181e2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.593+0000 7fcb1f0af640 1 --2- 172.21.15.86:0/2282619781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb18152fe0 0x7fcb18150a70 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.593+0000 7fcb1f0af640 1 -- 172.21.15.86:0/2282619781 >> 172.21.15.86:0/2282619781 conn(0x7fcb18067890 msgr2=0x7fcb18151b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:21.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.593+0000 7fcb1f0af640 1 -- 172.21.15.86:0/2282619781 shutdown_connections 2024-09-19T06:47:21.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.593+0000 7fcb1f0af640 1 -- 172.21.15.86:0/2282619781 wait complete. 2024-09-19T06:47:21.605 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T06:47:21.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.703+0000 7f9806bc0640 1 Processor -- start 2024-09-19T06:47:21.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.703+0000 7f9806bc0640 1 -- start start 2024-09-19T06:47:21.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.704+0000 7f9806bc0640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f98000d1120 0x7f980015da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:21.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.704+0000 7f9806bc0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f980015dfa0 0x7f98000b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:21.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.704+0000 7f9806bc0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f980015c9c0 con 0x7f98000d0d40 2024-09-19T06:47:21.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.704+0000 7f9806bc0640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f980015c770 con 0x7f98000d1120 2024-09-19T06:47:21.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.704+0000 7f9806bc0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f980015e450 con 0x7f980015dfa0 2024-09-19T06:47:21.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.704+0000 7f97fffff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f98000d1120 0x7f980015da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:21.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.704+0000 7f97fffff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f98000d1120 0x7f980015da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41992/0 (socket says 172.21.15.86:41992) 2024-09-19T06:47:21.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.704+0000 7f97fffff640 1 -- 172.21.15.86:0/2907409846 learned_addr learned my addr 172.21.15.86:0/2907409846 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:47:21.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.704+0000 7f980515d640 1 --2- 172.21.15.86:0/2907409846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f980015dfa0 0x7f98000b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:21.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.704+0000 7f97fffff640 1 -- 172.21.15.86:0/2907409846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f980015dfa0 msgr2=0x7f98000b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:21.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.704+0000 7f97fffff640 1 --2- 172.21.15.86:0/2907409846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f980015dfa0 0x7f98000b4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.704+0000 7f97fffff640 1 -- 172.21.15.86:0/2907409846 >> v1:172.21.15.169:6789/0 conn(0x7f98000d0d40 legacy=0x7f98000ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:21.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.704+0000 7f97fffff640 1 -- 172.21.15.86:0/2907409846 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f980015cca0 con 0x7f98000d1120 2024-09-19T06:47:21.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.705+0000 7f97fffff640 1 --2- 172.21.15.86:0/2907409846 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98000d1120 0x7f980015da60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f980015c8f0 tx=0x7f97ec02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33aef04c758953ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:21.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.705+0000 7f97ff7fe640 1 -- 172.21.15.86:0/2907409846 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec037070 con 0x7f98000d1120 2024-09-19T06:47:21.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.705+0000 7f97ff7fe640 1 -- 172.21.15.86:0/2907409846 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f97ec032440 con 0x7f98000d1120 2024-09-19T06:47:21.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.705+0000 7f97ff7fe640 1 -- 172.21.15.86:0/2907409846 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec032830 con 0x7f98000d1120 2024-09-19T06:47:21.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.705+0000 7f9806bc0640 1 -- 172.21.15.86:0/2907409846 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98000d1120 msgr2=0x7f980015da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:21.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.706+0000 7f9806bc0640 1 --2- 172.21.15.86:0/2907409846 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98000d1120 0x7f980015da60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f980015c8f0 tx=0x7f97ec02a250 comp rx=0 tx=0).stop 2024-09-19T06:47:21.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.706+0000 7f9806bc0640 1 -- 172.21.15.86:0/2907409846 shutdown_connections 2024-09-19T06:47:21.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.706+0000 7f9806bc0640 1 --2- 172.21.15.86:0/2907409846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f980015dfa0 0x7f98000b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.706+0000 7f9806bc0640 1 --2- 172.21.15.86:0/2907409846 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98000d1120 0x7f980015da60 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.706+0000 7f9806bc0640 1 -- 172.21.15.86:0/2907409846 >> 172.21.15.86:0/2907409846 conn(0x7f980006d910 msgr2=0x7f980006dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:21.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.706+0000 7f9806bc0640 1 -- 172.21.15.86:0/2907409846 shutdown_connections 2024-09-19T06:47:21.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.706+0000 7f9806bc0640 1 -- 172.21.15.86:0/2907409846 wait complete. 2024-09-19T06:47:21.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.707+0000 7f9806bc0640 1 Processor -- start 2024-09-19T06:47:21.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.707+0000 7f9806bc0640 1 -- start start 2024-09-19T06:47:21.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.708+0000 7f9806bc0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98000d0d40 0x7f98000b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:21.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.708+0000 7f9806bc0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98000d1120 0x7f980014eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:21.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.708+0000 7f9806bc0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f980015dfa0 0x7f980014d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:21.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.708+0000 7f9806bc0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f980015d260 con 0x7f98000d0d40 2024-09-19T06:47:21.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.708+0000 7f9806bc0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f98000b3f20 con 0x7f98000d1120 2024-09-19T06:47:21.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.708+0000 7f9806bc0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f98000cadd0 con 0x7f980015dfa0 2024-09-19T06:47:21.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.708+0000 7f980495c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98000d0d40 0x7f98000b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:21.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.708+0000 7f980495c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98000d0d40 0x7f98000b50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42002/0 (socket says 172.21.15.86:42002) 2024-09-19T06:47:21.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.708+0000 7f980495c640 1 -- 172.21.15.86:0/323421093 learned_addr learned my addr 172.21.15.86:0/323421093 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:47:21.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.708+0000 7f97fffff640 1 --2- 172.21.15.86:0/323421093 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98000d1120 0x7f980014eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:21.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.708+0000 7f980515d640 1 --2- 172.21.15.86:0/323421093 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f980015dfa0 0x7f980014d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:21.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.708+0000 7f980495c640 1 -- 172.21.15.86:0/323421093 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f980015dfa0 msgr2=0x7f980014d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:21.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.708+0000 7f980495c640 1 --2- 172.21.15.86:0/323421093 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f980015dfa0 0x7f980014d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.708+0000 7f980495c640 1 -- 172.21.15.86:0/323421093 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98000d1120 msgr2=0x7f980014eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:21.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.708+0000 7f980495c640 1 --2- 172.21.15.86:0/323421093 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98000d1120 0x7f980014eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.708+0000 7f980495c640 1 -- 172.21.15.86:0/323421093 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98001f4d10 con 0x7f98000d0d40 2024-09-19T06:47:21.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.708+0000 7f980495c640 1 --2- 172.21.15.86:0/323421093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98000d0d40 0x7f98000b50b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f97f400c400 tx=0x7f97f400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:21.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.708+0000 7f97fd7fa640 1 -- 172.21.15.86:0/323421093 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f40052d0 con 0x7f98000d0d40 2024-09-19T06:47:21.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.708+0000 7f97fd7fa640 1 -- 172.21.15.86:0/323421093 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f97f4005490 con 0x7f98000d0d40 2024-09-19T06:47:21.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.708+0000 7f9806bc0640 1 -- 172.21.15.86:0/323421093 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98001f4fb0 con 0x7f98000d0d40 2024-09-19T06:47:21.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.708+0000 7f97fd7fa640 1 -- 172.21.15.86:0/323421093 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f4007280 con 0x7f98000d0d40 2024-09-19T06:47:21.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.709+0000 7f9806bc0640 1 -- 172.21.15.86:0/323421093 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98000c5570 con 0x7f98000d0d40 2024-09-19T06:47:21.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.709+0000 7f9806bc0640 1 -- 172.21.15.86:0/323421093 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f980015da60 con 0x7f98000d0d40 2024-09-19T06:47:21.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.710+0000 7f97fd7fa640 1 -- 172.21.15.86:0/323421093 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f97f4007420 con 0x7f98000d0d40 2024-09-19T06:47:21.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.711+0000 7f97fd7fa640 1 --2- 172.21.15.86:0/323421093 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f97e406c2b0 0x7f97e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:21.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.711+0000 7f97fd7fa640 1 -- 172.21.15.86:0/323421093 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7f97f408b2b0 con 0x7f98000d0d40 2024-09-19T06:47:21.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.711+0000 7f97fffff640 1 --2- 172.21.15.86:0/323421093 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f97e406c2b0 0x7f97e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:21.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.711+0000 7f97fffff640 1 --2- 172.21.15.86:0/323421093 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f97e406c2b0 0x7f97e406e770 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f97ec034000 tx=0x7f97ec02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:21.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.715+0000 7f97fd7fa640 1 -- 172.21.15.86:0/323421093 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f97f4058f30 con 0x7f98000d0d40 2024-09-19T06:47:21.884 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.883+0000 7f9806bc0640 1 -- 172.21.15.86:0/323421093 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9800155080 con 0x7f98000d0d40 2024-09-19T06:47:21.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.884+0000 7f97fd7fa640 1 -- 172.21.15.86:0/323421093 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+19753 (secure 0 0 0) 0x7f97f405d230 con 0x7f98000d0d40 2024-09-19T06:47:21.886 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T06:47:21.887 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":34,"fsid":"1785f09f-0959-457d-8c4a-6cce2e655a37","created":"2024-09-19T06:36:45.671544+0000","modified":"2024-09-19T06:46:00.558378+0000","last_up_change":"2024-09-19T06:36:56.765680+0000","last_in_change":"2024-09-19T06:36:47.816681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:36:57.770634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:37:06.588120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:37:07.739726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T06:37:11.457476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bd3ce3f2-2a37-40ec-8dc3-69246437277c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6827","nonce":1588074611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6829","nonce":1588074611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6833","nonce":1588074611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":1588074611},{"type":"v1","addr":"172.21.15.86:6831","nonce":1588074611}]},"public_addr":"172.21.15.86:6827/1588074611","cluster_addr":"172.21.15.86:6829/1588074611","heartbeat_back_addr":"172.21.15.86:6833/1588074611","heartbeat_front_addr":"172.21.15.86:6831/1588074611","state":["exists","up"]},{"osd":1,"uuid":"871d7d23-ed03-4629-bca9-5b71ad0d926a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6819","nonce":1785682938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6821","nonce":1785682938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6825","nonce":1785682938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":1785682938},{"type":"v1","addr":"172.21.15.86:6823","nonce":1785682938}]},"public_addr":"172.21.15.86:6819/1785682938","cluster_addr":"172.21.15.86:6821/1785682938","heartbeat_back_addr":"172.21.15.86:6825/1785682938","heartbeat_front_addr":"172.21.15.86:6823/1785682938","state":["exists","up"]},{"osd":2,"uuid":"39d3562d-8c52-4af9-935a-2d90abb8b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6801","nonce":3306127846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6803","nonce":3306127846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6807","nonce":3306127846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":3306127846},{"type":"v1","addr":"172.21.15.86:6805","nonce":3306127846}]},"public_addr":"172.21.15.86:6801/3306127846","cluster_addr":"172.21.15.86:6803/3306127846","heartbeat_back_addr":"172.21.15.86:6807/3306127846","heartbeat_front_addr":"172.21.15.86:6805/3306127846","state":["exists","up"]},{"osd":3,"uuid":"7f88c5b1-042c-4a9f-a674-32456e0644a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6809","nonce":694275178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6811","nonce":694275178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6815","nonce":694275178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":694275178},{"type":"v1","addr":"172.21.15.86:6813","nonce":694275178}]},"public_addr":"172.21.15.86:6809/694275178","cluster_addr":"172.21.15.86:6811/694275178","heartbeat_back_addr":"172.21.15.86:6815/694275178","heartbeat_front_addr":"172.21.15.86:6813/694275178","state":["exists","up"]},{"osd":4,"uuid":"18aa391b-0863-48bf-bff6-107e22ee9752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6811","nonce":1326795640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6815","nonce":1326795640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6823","nonce":1326795640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":1326795640},{"type":"v1","addr":"172.21.15.169:6819","nonce":1326795640}]},"public_addr":"172.21.15.169:6811/1326795640","cluster_addr":"172.21.15.169:6815/1326795640","heartbeat_back_addr":"172.21.15.169:6823/1326795640","heartbeat_front_addr":"172.21.15.169:6819/1326795640","state":["exists","up"]},{"osd":5,"uuid":"90fa5ca6-1815-4af1-a664-b45a9e19dd56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6825","nonce":3538913242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6827","nonce":3538913242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6831","nonce":3538913242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3538913242},{"type":"v1","addr":"172.21.15.169:6829","nonce":3538913242}]},"public_addr":"172.21.15.169:6825/3538913242","cluster_addr":"172.21.15.169:6827/3538913242","heartbeat_back_addr":"172.21.15.169:6831/3538913242","heartbeat_front_addr":"172.21.15.169:6829/3538913242","state":["exists","up"]},{"osd":6,"uuid":"8b2019fc-6cc2-4394-9a7c-7951544f7cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6810","nonce":494424253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6814","nonce":494424253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6822","nonce":494424253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":494424253},{"type":"v1","addr":"172.21.15.169:6818","nonce":494424253}]},"public_addr":"172.21.15.169:6810/494424253","cluster_addr":"172.21.15.169:6814/494424253","heartbeat_back_addr":"172.21.15.169:6822/494424253","heartbeat_front_addr":"172.21.15.169:6818/494424253","state":["exists","up"]},{"osd":7,"uuid":"622e3b2c-5302-4b0a-b7f2-f4050801401e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6801","nonce":797235989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6803","nonce":797235989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6807","nonce":797235989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":797235989},{"type":"v1","addr":"172.21.15.169:6805","nonce":797235989}]},"public_addr":"172.21.15.169:6801/797235989","cluster_addr":"172.21.15.169:6803/797235989","heartbeat_back_addr":"172.21.15.169:6807/797235989","heartbeat_front_addr":"172.21.15.169:6805/797235989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.130643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.611572+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:53.419992+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.560112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:55.112065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.774642+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.341946+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:54.117884+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6839/22518982":"2024-09-20T06:46:00.558337+0000","172.21.15.86:6838/22518982":"2024-09-20T06:46:00.558337+0000","172.21.15.169:6837/3116130916":"2024-09-20T06:44:35.535883+0000","172.21.15.169:6837/2213887583":"2024-09-20T06:42:05.505758+0000","172.21.15.169:6836/3116130916":"2024-09-20T06:44:35.535883+0000","172.21.15.86:6839/1006149510":"2024-09-20T06:43:55.528921+0000","172.21.15.86:6838/1006149510":"2024-09-20T06:43:55.528921+0000","172.21.15.169:6836/2213887583":"2024-09-20T06:42:05.505758+0000","172.21.15.86:6838/1060607293":"2024-09-20T06:40:55.493588+0000","172.21.15.86:6839/1060607293":"2024-09-20T06:40:55.493588+0000","172.21.15.169:6837/201961024":"2024-09-20T06:39:15.476134+0000","172.21.15.169:6836/201961024":"2024-09-20T06:39:15.476134+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:47:21.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.887+0000 7f9806bc0640 1 -- 172.21.15.86:0/323421093 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f97e406c2b0 msgr2=0x7f97e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:21.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.887+0000 7f9806bc0640 1 --2- 172.21.15.86:0/323421093 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f97e406c2b0 0x7f97e406e770 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f97ec034000 tx=0x7f97ec02e000 comp rx=0 tx=0).stop 2024-09-19T06:47:21.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.887+0000 7f9806bc0640 1 -- 172.21.15.86:0/323421093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98000d0d40 msgr2=0x7f98000b50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:21.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.887+0000 7f9806bc0640 1 --2- 172.21.15.86:0/323421093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98000d0d40 0x7f98000b50b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f97f400c400 tx=0x7f97f400c8c0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.887+0000 7f9806bc0640 1 -- 172.21.15.86:0/323421093 shutdown_connections 2024-09-19T06:47:21.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.887+0000 7f9806bc0640 1 --2- 172.21.15.86:0/323421093 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f97e406c2b0 0x7f97e406e770 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.887+0000 7f9806bc0640 1 --2- 172.21.15.86:0/323421093 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f980015dfa0 0x7f980014d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.887+0000 7f9806bc0640 1 --2- 172.21.15.86:0/323421093 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98000d1120 0x7f980014eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.887+0000 7f9806bc0640 1 --2- 172.21.15.86:0/323421093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98000d0d40 0x7f98000b50b0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.887+0000 7f9806bc0640 1 -- 172.21.15.86:0/323421093 >> 172.21.15.86:0/323421093 conn(0x7f980006d910 msgr2=0x7f9800154270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:21.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.887+0000 7f9806bc0640 1 -- 172.21.15.86:0/323421093 shutdown_connections 2024-09-19T06:47:21.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.887+0000 7f9806bc0640 1 -- 172.21.15.86:0/323421093 wait complete. 2024-09-19T06:47:21.899 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T06:47:22.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.999+0000 7f5faa1ef640 1 Processor -- start 2024-09-19T06:47:22.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:21.999+0000 7f5faa1ef640 1 -- start start 2024-09-19T06:47:22.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.000+0000 7f5faa1ef640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5fa4155200 0x7f5fa415afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:22.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.000+0000 7f5faa1ef640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5fa40ca020 0x7f5fa415e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:22.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.000+0000 7f5faa1ef640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fa415ec10 con 0x7f5fa4154e20 2024-09-19T06:47:22.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.000+0000 7f5faa1ef640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f5fa415eed0 con 0x7f5fa4155200 2024-09-19T06:47:22.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.000+0000 7f5faa1ef640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f5fa415f1b0 con 0x7f5fa40ca020 2024-09-19T06:47:22.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.000+0000 7f5fa2ffd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5fa4155200 0x7f5fa415afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:22.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.000+0000 7f5fa2ffd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5fa4155200 0x7f5fa415afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42008/0 (socket says 172.21.15.86:42008) 2024-09-19T06:47:22.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.000+0000 7f5fa2ffd640 1 -- 172.21.15.86:0/1564106391 learned_addr learned my addr 172.21.15.86:0/1564106391 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:47:22.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.001+0000 7f5fa3fff640 1 --2- 172.21.15.86:0/1564106391 >> v2:172.21.15.169:3300/0 conn(0x7f5fa40ca020 0x7f5fa415e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:22.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.001+0000 7f5fa2ffd640 1 -- 172.21.15.86:0/1564106391 >> v2:172.21.15.169:3300/0 conn(0x7f5fa40ca020 msgr2=0x7f5fa415e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:22.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.001+0000 7f5fa2ffd640 1 --2- 172.21.15.86:0/1564106391 >> v2:172.21.15.169:3300/0 conn(0x7f5fa40ca020 0x7f5fa415e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:22.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.001+0000 7f5fa2ffd640 1 -- 172.21.15.86:0/1564106391 >> v1:172.21.15.169:6789/0 conn(0x7f5fa4154e20 legacy=0x7f5fa4073840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:22.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.001+0000 7f5fa2ffd640 1 -- 172.21.15.86:0/1564106391 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa415f490 con 0x7f5fa4155200 2024-09-19T06:47:22.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.001+0000 7f5fa3fff640 1 --2- 172.21.15.86:0/1564106391 >> v2:172.21.15.169:3300/0 conn(0x7f5fa40ca020 0x7f5fa415e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:22.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.001+0000 7f5fa2ffd640 1 --2- 172.21.15.86:0/1564106391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fa4155200 0x7f5fa415afc0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f5fa406e710 tx=0x7f5f8c02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384654f741cff311 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:22.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.001+0000 7f5fa27fc640 1 -- 172.21.15.86:0/1564106391 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c037070 con 0x7f5fa4155200 2024-09-19T06:47:22.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.002+0000 7f5fa27fc640 1 -- 172.21.15.86:0/1564106391 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5f8c032440 con 0x7f5fa4155200 2024-09-19T06:47:22.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.002+0000 7f5fa27fc640 1 -- 172.21.15.86:0/1564106391 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c032830 con 0x7f5fa4155200 2024-09-19T06:47:22.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.002+0000 7f5faa1ef640 1 -- 172.21.15.86:0/1564106391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fa4155200 msgr2=0x7f5fa415afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:22.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.002+0000 7f5faa1ef640 1 --2- 172.21.15.86:0/1564106391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fa4155200 0x7f5fa415afc0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f5fa406e710 tx=0x7f5f8c02a2c0 comp rx=0 tx=0).stop 2024-09-19T06:47:22.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.002+0000 7f5faa1ef640 1 -- 172.21.15.86:0/1564106391 shutdown_connections 2024-09-19T06:47:22.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.002+0000 7f5faa1ef640 1 --2- 172.21.15.86:0/1564106391 >> v2:172.21.15.169:3300/0 conn(0x7f5fa40ca020 0x7f5fa415e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:22.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.002+0000 7f5faa1ef640 1 --2- 172.21.15.86:0/1564106391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fa4155200 0x7f5fa415afc0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:22.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.002+0000 7f5faa1ef640 1 -- 172.21.15.86:0/1564106391 >> 172.21.15.86:0/1564106391 conn(0x7f5fa4067890 msgr2=0x7f5fa4067c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:22.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.002+0000 7f5faa1ef640 1 -- 172.21.15.86:0/1564106391 shutdown_connections 2024-09-19T06:47:22.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.002+0000 7f5faa1ef640 1 -- 172.21.15.86:0/1564106391 wait complete. 2024-09-19T06:47:22.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.003+0000 7f5faa1ef640 1 Processor -- start 2024-09-19T06:47:22.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.003+0000 7f5faa1ef640 1 -- start start 2024-09-19T06:47:22.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.004+0000 7f5faa1ef640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fa40ca020 0x7f5fa41e6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:22.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.004+0000 7f5faa1ef640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5fa4154e20 0x7f5fa415a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:22.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.004+0000 7f5faa1ef640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5fa4155200 0x7f5fa41f1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:22.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.004+0000 7f5faa1ef640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa4070f10 con 0x7f5fa40ca020 2024-09-19T06:47:22.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.004+0000 7f5faa1ef640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa4070c30 con 0x7f5fa4154e20 2024-09-19T06:47:22.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.004+0000 7f5faa1ef640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5fa40c9460 con 0x7f5fa4155200 2024-09-19T06:47:22.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.004+0000 7f5fa37fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fa40ca020 0x7f5fa41e6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:22.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.004+0000 7f5fa37fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fa40ca020 0x7f5fa41e6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42012/0 (socket says 172.21.15.86:42012) 2024-09-19T06:47:22.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.004+0000 7f5fa37fe640 1 -- 172.21.15.86:0/4050698986 learned_addr learned my addr 172.21.15.86:0/4050698986 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:47:22.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.004+0000 7f5fa2ffd640 1 --2- 172.21.15.86:0/4050698986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5fa4154e20 0x7f5fa415a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:22.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.004+0000 7f5fa3fff640 1 --2- 172.21.15.86:0/4050698986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5fa4155200 0x7f5fa41f1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:22.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.005+0000 7f5fa37fe640 1 -- 172.21.15.86:0/4050698986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5fa4155200 msgr2=0x7f5fa41f1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:22.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.005+0000 7f5fa37fe640 1 --2- 172.21.15.86:0/4050698986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5fa4155200 0x7f5fa41f1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:22.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.005+0000 7f5fa37fe640 1 -- 172.21.15.86:0/4050698986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5fa4154e20 msgr2=0x7f5fa415a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:22.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.005+0000 7f5fa37fe640 1 --2- 172.21.15.86:0/4050698986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5fa4154e20 0x7f5fa415a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:22.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.005+0000 7f5fa37fe640 1 -- 172.21.15.86:0/4050698986 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa41f0c70 con 0x7f5fa40ca020 2024-09-19T06:47:22.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.005+0000 7f5fa3fff640 1 --2- 172.21.15.86:0/4050698986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5fa4155200 0x7f5fa41f1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:22.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.005+0000 7f5fa37fe640 1 --2- 172.21.15.86:0/4050698986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fa40ca020 0x7f5fa41e6ca0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5f9400b3f0 tx=0x7f5f9400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:22.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.005+0000 7f5f9bfff640 1 -- 172.21.15.86:0/4050698986 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f94015020 con 0x7f5fa40ca020 2024-09-19T06:47:22.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.005+0000 7f5f9bfff640 1 -- 172.21.15.86:0/4050698986 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5f94011830 con 0x7f5fa40ca020 2024-09-19T06:47:22.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.005+0000 7f5f9bfff640 1 -- 172.21.15.86:0/4050698986 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f94011c40 con 0x7f5fa40ca020 2024-09-19T06:47:22.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.005+0000 7f5faa1ef640 1 -- 172.21.15.86:0/4050698986 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fa4157460 con 0x7f5fa40ca020 2024-09-19T06:47:22.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.005+0000 7f5faa1ef640 1 -- 172.21.15.86:0/4050698986 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fa4158a00 con 0x7f5fa40ca020 2024-09-19T06:47:22.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.006+0000 7f5faa1ef640 1 -- 172.21.15.86:0/4050698986 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fa415e5b0 con 0x7f5fa40ca020 2024-09-19T06:47:22.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.006+0000 7f5f9bfff640 1 -- 172.21.15.86:0/4050698986 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5f94018020 con 0x7f5fa40ca020 2024-09-19T06:47:22.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.007+0000 7f5f9bfff640 1 --2- 172.21.15.86:0/4050698986 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5f8406c2b0 0x7f5f8406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:22.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.007+0000 7f5f9bfff640 1 -- 172.21.15.86:0/4050698986 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7251+0+0 (secure 0 0 0) 0x7f5f9408b6a0 con 0x7f5fa40ca020 2024-09-19T06:47:22.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.007+0000 7f5fa2ffd640 1 --2- 172.21.15.86:0/4050698986 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5f8406c2b0 0x7f5f8406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:22.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.007+0000 7f5fa2ffd640 1 --2- 172.21.15.86:0/4050698986 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5f8406c2b0 0x7f5f8406e770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c034000 tx=0x7f5f8c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:22.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.011+0000 7f5f9bfff640 1 -- 172.21.15.86:0/4050698986 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5f9401f030 con 0x7f5fa40ca020 2024-09-19T06:47:22.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.213+0000 7f5faa1ef640 1 -- 172.21.15.86:0/4050698986 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5fa415c590 con 0x7f5fa40ca020 2024-09-19T06:47:22.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.215+0000 7f5f9bfff640 1 -- 172.21.15.86:0/4050698986 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) ==== 161+0+0 (secure 0 0 0) 0x7f5f940172c0 con 0x7f5fa40ca020 2024-09-19T06:47:22.216 INFO:teuthology.orchestra.run.smithi086.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T06:47:22.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.218+0000 7f5faa1ef640 1 -- 172.21.15.86:0/4050698986 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5f8406c2b0 msgr2=0x7f5f8406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:22.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.218+0000 7f5faa1ef640 1 --2- 172.21.15.86:0/4050698986 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5f8406c2b0 0x7f5f8406e770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c034000 tx=0x7f5f8c02e000 comp rx=0 tx=0).stop 2024-09-19T06:47:22.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.218+0000 7f5faa1ef640 1 -- 172.21.15.86:0/4050698986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fa40ca020 msgr2=0x7f5fa41e6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:22.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.218+0000 7f5faa1ef640 1 --2- 172.21.15.86:0/4050698986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fa40ca020 0x7f5fa41e6ca0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5f9400b3f0 tx=0x7f5f9400b8b0 comp rx=0 tx=0).stop 2024-09-19T06:47:22.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.218+0000 7f5faa1ef640 1 -- 172.21.15.86:0/4050698986 shutdown_connections 2024-09-19T06:47:22.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.218+0000 7f5faa1ef640 1 --2- 172.21.15.86:0/4050698986 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f5f8406c2b0 0x7f5f8406e770 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:22.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.218+0000 7f5faa1ef640 1 --2- 172.21.15.86:0/4050698986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5fa4155200 0x7f5fa41f1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:22.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.218+0000 7f5faa1ef640 1 --2- 172.21.15.86:0/4050698986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5fa4154e20 0x7f5fa415a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:22.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.218+0000 7f5faa1ef640 1 --2- 172.21.15.86:0/4050698986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fa40ca020 0x7f5fa41e6ca0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:22.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.218+0000 7f5faa1ef640 1 -- 172.21.15.86:0/4050698986 >> 172.21.15.86:0/4050698986 conn(0x7f5fa4067890 msgr2=0x7f5fa40735d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:22.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.218+0000 7f5faa1ef640 1 -- 172.21.15.86:0/4050698986 shutdown_connections 2024-09-19T06:47:22.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.218+0000 7f5faa1ef640 1 -- 172.21.15.86:0/4050698986 wait complete. 2024-09-19T06:47:22.231 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T06:47:22.262 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2024-09-19T06:47:22.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.335+0000 7fb864b82640 1 Processor -- start 2024-09-19T06:47:22.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.335+0000 7fb864b82640 1 -- start start 2024-09-19T06:47:22.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.336+0000 7fb864b82640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb860072120 0x7fb86015baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:22.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.336+0000 7fb864b82640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8600c4500 0x7fb860072500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:22.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.336+0000 7fb864b82640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8600ca180 con 0x7fb8601519a0 2024-09-19T06:47:22.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.336+0000 7fb864b82640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fb8600ca460 con 0x7fb860072120 2024-09-19T06:47:22.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.336+0000 7fb864b82640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb8600ca740 con 0x7fb8600c4500 2024-09-19T06:47:22.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.336+0000 7fb85f7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb860072120 0x7fb86015baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:22.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.336+0000 7fb85f7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb860072120 0x7fb86015baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38290/0 (socket says 172.21.15.86:38290) 2024-09-19T06:47:22.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.336+0000 7fb85f7fe640 1 -- 172.21.15.86:0/3351934233 learned_addr learned my addr 172.21.15.86:0/3351934233 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:47:22.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.336+0000 7fb85effd640 1 --2- 172.21.15.86:0/3351934233 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8600c4500 0x7fb860072500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:22.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.336+0000 7fb85f7fe640 1 -- 172.21.15.86:0/3351934233 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8600c4500 msgr2=0x7fb860072500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:22.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.336+0000 7fb85f7fe640 1 --2- 172.21.15.86:0/3351934233 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8600c4500 0x7fb860072500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:22.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.336+0000 7fb85f7fe640 1 -- 172.21.15.86:0/3351934233 >> v1:172.21.15.169:6789/0 conn(0x7fb8601519a0 legacy=0x7fb860072fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:22.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.336+0000 7fb85f7fe640 1 -- 172.21.15.86:0/3351934233 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8600caa20 con 0x7fb860072120 2024-09-19T06:47:22.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.336+0000 7fb85effd640 1 --2- 172.21.15.86:0/3351934233 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8600c4500 0x7fb860072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:22.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.337+0000 7fb85f7fe640 1 --2- 172.21.15.86:0/3351934233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb860072120 0x7fb86015baf0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb850009e50 tx=0x7fb85002a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d2813406f74d11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:22.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.337+0000 7fb85e7fc640 1 -- 172.21.15.86:0/3351934233 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850036070 con 0x7fb860072120 2024-09-19T06:47:22.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.337+0000 7fb85e7fc640 1 -- 172.21.15.86:0/3351934233 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb850031600 con 0x7fb860072120 2024-09-19T06:47:22.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.337+0000 7fb85e7fc640 1 -- 172.21.15.86:0/3351934233 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8500319f0 con 0x7fb860072120 2024-09-19T06:47:22.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.338+0000 7fb864b82640 1 -- 172.21.15.86:0/3351934233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb860072120 msgr2=0x7fb86015baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:22.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.338+0000 7fb864b82640 1 --2- 172.21.15.86:0/3351934233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb860072120 0x7fb86015baf0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb850009e50 tx=0x7fb85002a750 comp rx=0 tx=0).stop 2024-09-19T06:47:22.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.338+0000 7fb864b82640 1 -- 172.21.15.86:0/3351934233 shutdown_connections 2024-09-19T06:47:22.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.338+0000 7fb864b82640 1 --2- 172.21.15.86:0/3351934233 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8600c4500 0x7fb860072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:22.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.338+0000 7fb864b82640 1 --2- 172.21.15.86:0/3351934233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb860072120 0x7fb86015baf0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:22.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.338+0000 7fb864b82640 1 -- 172.21.15.86:0/3351934233 >> 172.21.15.86:0/3351934233 conn(0x7fb86006ccd0 msgr2=0x7fb86006d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:22.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.338+0000 7fb864b82640 1 -- 172.21.15.86:0/3351934233 shutdown_connections 2024-09-19T06:47:22.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.338+0000 7fb864b82640 1 -- 172.21.15.86:0/3351934233 wait complete. 2024-09-19T06:47:22.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.339+0000 7fb864b82640 1 Processor -- start 2024-09-19T06:47:22.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.339+0000 7fb864b82640 1 -- start start 2024-09-19T06:47:22.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.340+0000 7fb864b82640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb860072120 0x7fb860154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:22.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.340+0000 7fb864b82640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8600c4500 0x7fb8600cce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:22.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.340+0000 7fb864b82640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8601519a0 0x7fb8601e0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:22.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.340+0000 7fb864b82640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb860072a40 con 0x7fb8600c4500 2024-09-19T06:47:22.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.340+0000 7fb864b82640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb8600cafe0 con 0x7fb860072120 2024-09-19T06:47:22.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.340+0000 7fb864b82640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb860072bc0 con 0x7fb8601519a0 2024-09-19T06:47:22.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.340+0000 7fb85effd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8600c4500 0x7fb8600cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:22.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.340+0000 7fb85effd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8600c4500 0x7fb8600cce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38302/0 (socket says 172.21.15.86:38302) 2024-09-19T06:47:22.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.340+0000 7fb85effd640 1 -- 172.21.15.86:0/2921470546 learned_addr learned my addr 172.21.15.86:0/2921470546 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:47:22.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.340+0000 7fb85ffff640 1 --2- 172.21.15.86:0/2921470546 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8601519a0 0x7fb8601e0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:22.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.340+0000 7fb85f7fe640 1 --2- 172.21.15.86:0/2921470546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb860072120 0x7fb860154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:22.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.340+0000 7fb85effd640 1 -- 172.21.15.86:0/2921470546 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8601519a0 msgr2=0x7fb8601e0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:22.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.340+0000 7fb85effd640 1 --2- 172.21.15.86:0/2921470546 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8601519a0 0x7fb8601e0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:22.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.340+0000 7fb85effd640 1 -- 172.21.15.86:0/2921470546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb860072120 msgr2=0x7fb860154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:22.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.340+0000 7fb85effd640 1 --2- 172.21.15.86:0/2921470546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb860072120 0x7fb860154740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:22.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.340+0000 7fb85effd640 1 -- 172.21.15.86:0/2921470546 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8601e2590 con 0x7fb8600c4500 2024-09-19T06:47:22.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.340+0000 7fb85f7fe640 1 --2- 172.21.15.86:0/2921470546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb860072120 0x7fb860154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:22.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.340+0000 7fb85effd640 1 --2- 172.21.15.86:0/2921470546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8600c4500 0x7fb8600cce80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb84800c7f0 tx=0x7fb84800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:22.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.340+0000 7fb857fff640 1 -- 172.21.15.86:0/2921470546 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb848015070 con 0x7fb8600c4500 2024-09-19T06:47:22.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.340+0000 7fb857fff640 1 -- 172.21.15.86:0/2921470546 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb848007a30 con 0x7fb8600c4500 2024-09-19T06:47:22.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.341+0000 7fb864b82640 1 -- 172.21.15.86:0/2921470546 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8601e2870 con 0x7fb8600c4500 2024-09-19T06:47:22.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.341+0000 7fb857fff640 1 -- 172.21.15.86:0/2921470546 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb848007e20 con 0x7fb8600c4500 2024-09-19T06:47:22.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.341+0000 7fb864b82640 1 -- 172.21.15.86:0/2921470546 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8601e3110 con 0x7fb8600c4500 2024-09-19T06:47:22.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.342+0000 7fb864b82640 1 -- 172.21.15.86:0/2921470546 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8601e2a40 con 0x7fb8600c4500 2024-09-19T06:47:22.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.342+0000 7fb857fff640 1 -- 172.21.15.86:0/2921470546 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb848018070 con 0x7fb8600c4500 2024-09-19T06:47:22.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.342+0000 7fb857fff640 1 --2- 172.21.15.86:0/2921470546 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb84006c2b0 0x7fb84006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:22.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.343+0000 7fb857fff640 1 -- 172.21.15.86:0/2921470546 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7337+0+0 (secure 0 0 0) 0x7fb84808b9f0 con 0x7fb8600c4500 2024-09-19T06:47:22.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.343+0000 7fb85f7fe640 1 --2- 172.21.15.86:0/2921470546 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb84006c2b0 0x7fb84006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:22.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.343+0000 7fb85f7fe640 1 --2- 172.21.15.86:0/2921470546 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb84006c2b0 0x7fb84006e770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb850033000 tx=0x7fb850009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:22.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.347+0000 7fb857fff640 1 -- 172.21.15.86:0/2921470546 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb8480594b0 con 0x7fb8600c4500 2024-09-19T06:47:22.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:22.553+0000 7fb864b82640 1 -- 172.21.15.86:0/2921470546 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb86015baf0 con 0x7fb8600c4500 2024-09-19T06:47:23.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.216+0000 7fb857fff640 1 -- 172.21.15.86:0/2921470546 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v41) ==== 104+0+0 (secure 0 0 0) 0x7fb84805d7b0 con 0x7fb8600c4500 2024-09-19T06:47:23.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.219+0000 7fb864b82640 1 -- 172.21.15.86:0/2921470546 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb84006c2b0 msgr2=0x7fb84006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:23.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.219+0000 7fb864b82640 1 --2- 172.21.15.86:0/2921470546 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb84006c2b0 0x7fb84006e770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb850033000 tx=0x7fb850009000 comp rx=0 tx=0).stop 2024-09-19T06:47:23.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.219+0000 7fb864b82640 1 -- 172.21.15.86:0/2921470546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8600c4500 msgr2=0x7fb8600cce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:23.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.219+0000 7fb864b82640 1 --2- 172.21.15.86:0/2921470546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8600c4500 0x7fb8600cce80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb84800c7f0 tx=0x7fb84800cbf0 comp rx=0 tx=0).stop 2024-09-19T06:47:23.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.219+0000 7fb864b82640 1 -- 172.21.15.86:0/2921470546 shutdown_connections 2024-09-19T06:47:23.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.219+0000 7fb864b82640 1 --2- 172.21.15.86:0/2921470546 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7fb84006c2b0 0x7fb84006e770 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:23.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.219+0000 7fb864b82640 1 --2- 172.21.15.86:0/2921470546 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8601519a0 0x7fb8601e0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:23.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.219+0000 7fb864b82640 1 --2- 172.21.15.86:0/2921470546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8600c4500 0x7fb8600cce80 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:23.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.219+0000 7fb864b82640 1 --2- 172.21.15.86:0/2921470546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb860072120 0x7fb860154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:23.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.219+0000 7fb864b82640 1 -- 172.21.15.86:0/2921470546 >> 172.21.15.86:0/2921470546 conn(0x7fb86006ccd0 msgr2=0x7fb86014c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:23.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.219+0000 7fb864b82640 1 -- 172.21.15.86:0/2921470546 shutdown_connections 2024-09-19T06:47:23.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.219+0000 7fb864b82640 1 -- 172.21.15.86:0/2921470546 wait complete. 2024-09-19T06:47:23.232 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T06:47:23.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.335+0000 7f75b7a27640 1 Processor -- start 2024-09-19T06:47:23.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.335+0000 7f75b7a27640 1 -- start start 2024-09-19T06:47:23.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.336+0000 7f75b7a27640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75b0153430 0x7f75b00ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:23.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.336+0000 7f75b7a27640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f75b0159bb0 0x7f75b00c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:23.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.336+0000 7f75b7a27640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75b015ceb0 con 0x7f75b00730b0 2024-09-19T06:47:23.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.336+0000 7f75b7a27640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f75b015d190 con 0x7f75b0159bb0 2024-09-19T06:47:23.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.336+0000 7f75b7a27640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f75b015d470 con 0x7f75b0153430 2024-09-19T06:47:23.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.336+0000 7f75b4fc2640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f75b00730b0 0x7f75b015c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:45794/0 (socket says 172.21.15.86:45794) 2024-09-19T06:47:23.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.336+0000 7f75b4fc2640 1 -- 172.21.15.86:0/1054859641 learned_addr learned my addr 172.21.15.86:0/1054859641 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:47:23.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75a7fff640 1 -- 172.21.15.86:0/1054859641 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 259186967 0 0) 0x7f75b015ceb0 con 0x7f75b00730b0 2024-09-19T06:47:23.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75a7fff640 1 -- 172.21.15.86:0/1054859641 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f759c003520 con 0x7f75b00730b0 2024-09-19T06:47:23.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75b5fc4640 1 --2- 172.21.15.86:0/1054859641 >> v2:172.21.15.169:3300/0 conn(0x7f75b0159bb0 0x7f75b00c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:23.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75b57c3640 1 --2- 172.21.15.86:0/1054859641 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75b0153430 0x7f75b00ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:23.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75a7fff640 1 -- 172.21.15.86:0/1054859641 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 479387902 0 0) 0x7f759c003520 con 0x7f75b00730b0 2024-09-19T06:47:23.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75a7fff640 1 -- 172.21.15.86:0/1054859641 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75b0153430 msgr2=0x7f75b00ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:23.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75a7fff640 1 --2- 172.21.15.86:0/1054859641 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75b0153430 0x7f75b00ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:23.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75a7fff640 1 -- 172.21.15.86:0/1054859641 >> v2:172.21.15.169:3300/0 conn(0x7f75b0159bb0 msgr2=0x7f75b00c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:23.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75a7fff640 1 --2- 172.21.15.86:0/1054859641 >> v2:172.21.15.169:3300/0 conn(0x7f75b0159bb0 0x7f75b00c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:23.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75a7fff640 1 -- 172.21.15.86:0/1054859641 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b01590d0 con 0x7f75b00730b0 2024-09-19T06:47:23.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75a7fff640 1 -- 172.21.15.86:0/1054859641 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 932673611 0 0) 0x7f75a0001670 con 0x7f75b00730b0 2024-09-19T06:47:23.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75b57c3640 1 --2- 172.21.15.86:0/1054859641 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75b0153430 0x7f75b00ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:23.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75b5fc4640 1 --2- 172.21.15.86:0/1054859641 >> v2:172.21.15.169:3300/0 conn(0x7f75b0159bb0 0x7f75b00c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:23.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75a7fff640 1 -- 172.21.15.86:0/1054859641 >> v1:172.21.15.86:6789/0 conn(0x7f75b00730b0 legacy=0x7f75b015c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:23.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75a7fff640 1 --2- 172.21.15.86:0/1054859641 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f759c0039b0 0x7f759c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:23.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75a7fff640 1 --2- 172.21.15.86:0/1054859641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f759c004800 0x7f759c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:23.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75a7fff640 1 --2- 172.21.15.86:0/1054859641 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75b0153430 0x7f759c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:23.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75a7fff640 1 -- 172.21.15.86:0/1054859641 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f75b015d190 con 0x7f759c0039b0 2024-09-19T06:47:23.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75a7fff640 1 -- 172.21.15.86:0/1054859641 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f75b015d470 con 0x7f759c004800 2024-09-19T06:47:23.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75a7fff640 1 -- 172.21.15.86:0/1054859641 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f759c00baf0 con 0x7f75b0153430 2024-09-19T06:47:23.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75b57c3640 1 --2- 172.21.15.86:0/1054859641 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f759c0039b0 0x7f759c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:23.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75b5fc4640 1 --2- 172.21.15.86:0/1054859641 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75b0153430 0x7f759c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:23.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75b4fc2640 1 --2- 172.21.15.86:0/1054859641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f759c004800 0x7f759c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:23.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75b57c3640 1 -- 172.21.15.86:0/1054859641 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75b0153430 msgr2=0x7f759c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:23.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75b57c3640 1 --2- 172.21.15.86:0/1054859641 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75b0153430 0x7f759c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:23.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75b57c3640 1 -- 172.21.15.86:0/1054859641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f759c004800 msgr2=0x7f759c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:23.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75b57c3640 1 --2- 172.21.15.86:0/1054859641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f759c004800 0x7f759c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:23.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75b57c3640 1 -- 172.21.15.86:0/1054859641 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f759c003520 con 0x7f759c0039b0 2024-09-19T06:47:23.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75b5fc4640 1 --2- 172.21.15.86:0/1054859641 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75b0153430 0x7f759c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:23.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.337+0000 7f75b4fc2640 1 --2- 172.21.15.86:0/1054859641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f759c004800 0x7f759c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:23.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.338+0000 7f75b57c3640 1 --2- 172.21.15.86:0/1054859641 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f759c0039b0 0x7f759c003dd0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f75ac006fd0 tx=0x7f759c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fbe6b5c7dfdbd3a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:23.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.338+0000 7f75a7fff640 1 -- 172.21.15.86:0/1054859641 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ac00f040 con 0x7f759c0039b0 2024-09-19T06:47:23.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.338+0000 7f75a7fff640 1 -- 172.21.15.86:0/1054859641 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f75ac02ac70 con 0x7f759c0039b0 2024-09-19T06:47:23.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.338+0000 7f75a7fff640 1 -- 172.21.15.86:0/1054859641 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ac004270 con 0x7f759c0039b0 2024-09-19T06:47:23.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.339+0000 7f75b7a27640 1 -- 172.21.15.86:0/1054859641 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f759c0039b0 msgr2=0x7f759c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:23.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.339+0000 7f75b7a27640 1 --2- 172.21.15.86:0/1054859641 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f759c0039b0 0x7f759c003dd0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f75ac006fd0 tx=0x7f759c005830 comp rx=0 tx=0).stop 2024-09-19T06:47:23.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.339+0000 7f75b5fc4640 1 -- 172.21.15.86:0/1054859641 reap_dead start 2024-09-19T06:47:23.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.339+0000 7f75b7a27640 1 -- 172.21.15.86:0/1054859641 shutdown_connections 2024-09-19T06:47:23.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.339+0000 7f75b7a27640 1 -- 172.21.15.86:0/1054859641 >> 172.21.15.86:0/1054859641 conn(0x7f75b00cb3a0 msgr2=0x7f75b00cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:23.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.339+0000 7f75b7a27640 1 -- 172.21.15.86:0/1054859641 shutdown_connections 2024-09-19T06:47:23.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.339+0000 7f75b7a27640 1 -- 172.21.15.86:0/1054859641 wait complete. 2024-09-19T06:47:23.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.340+0000 7f75b7a27640 1 Processor -- start 2024-09-19T06:47:23.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.340+0000 7f75b7a27640 1 -- start start 2024-09-19T06:47:23.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.341+0000 7f75b7a27640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f759c0039b0 0x7f75b00ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:23.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.341+0000 7f75b7a27640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75b00cc8a0 0x7f75b00ceaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:23.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.341+0000 7f75b7a27640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75b00cd7e0 0x7f75b00cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:23.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.341+0000 7f75b7a27640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f75b00cc130 con 0x7f75b00cc8a0 2024-09-19T06:47:23.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.341+0000 7f75b7a27640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f75b0159690 con 0x7f75b00cd7e0 2024-09-19T06:47:23.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.341+0000 7f75b7a27640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f75b00ca0f0 con 0x7f759c0039b0 2024-09-19T06:47:23.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.341+0000 7f75b4fc2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75b00cc8a0 0x7f75b00ceaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:23.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.341+0000 7f75b4fc2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75b00cc8a0 0x7f75b00ceaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38320/0 (socket says 172.21.15.86:38320) 2024-09-19T06:47:23.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.341+0000 7f75b4fc2640 1 -- 172.21.15.86:0/3380702451 learned_addr learned my addr 172.21.15.86:0/3380702451 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:47:23.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.341+0000 7f75b57c3640 1 --2- 172.21.15.86:0/3380702451 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f759c0039b0 0x7f75b00ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:23.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.341+0000 7f75b5fc4640 1 --2- 172.21.15.86:0/3380702451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75b00cd7e0 0x7f75b00cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:23.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.341+0000 7f75b4fc2640 1 -- 172.21.15.86:0/3380702451 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f759c0039b0 msgr2=0x7f75b00ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:23.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.341+0000 7f75b4fc2640 1 --2- 172.21.15.86:0/3380702451 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f759c0039b0 0x7f75b00ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:23.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.341+0000 7f75b4fc2640 1 -- 172.21.15.86:0/3380702451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75b00cd7e0 msgr2=0x7f75b00cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:23.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.341+0000 7f75b4fc2640 1 --2- 172.21.15.86:0/3380702451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75b00cd7e0 0x7f75b00cdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:23.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.341+0000 7f75b4fc2640 1 -- 172.21.15.86:0/3380702451 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b00ce1a0 con 0x7f75b00cc8a0 2024-09-19T06:47:23.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.341+0000 7f75b4fc2640 1 --2- 172.21.15.86:0/3380702451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75b00cc8a0 0x7f75b00ceaf0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f75a000e700 tx=0x7f75a000ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:23.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.341+0000 7f75a5ffb640 1 -- 172.21.15.86:0/3380702451 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a000ee10 con 0x7f75b00cc8a0 2024-09-19T06:47:23.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.341+0000 7f75a5ffb640 1 -- 172.21.15.86:0/3380702451 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f75a0018070 con 0x7f75b00cc8a0 2024-09-19T06:47:23.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.341+0000 7f75b7a27640 1 -- 172.21.15.86:0/3380702451 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75b00cf6c0 con 0x7f75b00cc8a0 2024-09-19T06:47:23.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.341+0000 7f75a5ffb640 1 -- 172.21.15.86:0/3380702451 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a000cb30 con 0x7f75b00cc8a0 2024-09-19T06:47:23.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.342+0000 7f75b7a27640 1 -- 172.21.15.86:0/3380702451 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75b0155310 con 0x7f75b00cc8a0 2024-09-19T06:47:23.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.343+0000 7f75b7a27640 1 -- 172.21.15.86:0/3380702451 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75b00c9a20 con 0x7f75b00cc8a0 2024-09-19T06:47:23.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.343+0000 7f75a5ffb640 1 -- 172.21.15.86:0/3380702451 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f75a000ccd0 con 0x7f75b00cc8a0 2024-09-19T06:47:23.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.343+0000 7f75a5ffb640 1 --2- 172.21.15.86:0/3380702451 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f759406c2e0 0x7f759406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:23.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.343+0000 7f75a5ffb640 1 -- 172.21.15.86:0/3380702451 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7337+0+0 (secure 0 0 0) 0x7f75a008b5a0 con 0x7f75b00cc8a0 2024-09-19T06:47:23.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.343+0000 7f75b57c3640 1 --2- 172.21.15.86:0/3380702451 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f759406c2e0 0x7f759406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:23.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.344+0000 7f75b57c3640 1 --2- 172.21.15.86:0/3380702451 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f759406c2e0 0x7f759406e7a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f75ac033000 tx=0x7f75ac02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:23.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.348+0000 7f75a5ffb640 1 -- 172.21.15.86:0/3380702451 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f75b00c9a20 con 0x7f75b00cc8a0 2024-09-19T06:47:23.516 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:23.515+0000 7f75b7a27640 1 -- 172.21.15.86:0/3380702451 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f75b015c5b0 con 0x7f75b00cc8a0 2024-09-19T06:47:24.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.282+0000 7f75a5ffb640 1 -- 172.21.15.86:0/3380702451 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) ==== 181+0+0 (secure 0 0 0) 0x7f75b00ce1a0 con 0x7f75b00cc8a0 2024-09-19T06:47:24.284 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' removed 2024-09-19T06:47:24.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.285+0000 7f75b7a27640 1 -- 172.21.15.86:0/3380702451 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f759406c2e0 msgr2=0x7f759406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:24.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.285+0000 7f75b7a27640 1 --2- 172.21.15.86:0/3380702451 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f759406c2e0 0x7f759406e7a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f75ac033000 tx=0x7f75ac02e000 comp rx=0 tx=0).stop 2024-09-19T06:47:24.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.285+0000 7f75b7a27640 1 -- 172.21.15.86:0/3380702451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75b00cc8a0 msgr2=0x7f75b00ceaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:24.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.285+0000 7f75b7a27640 1 --2- 172.21.15.86:0/3380702451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75b00cc8a0 0x7f75b00ceaf0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f75a000e700 tx=0x7f75a000ebc0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.285+0000 7f75b7a27640 1 -- 172.21.15.86:0/3380702451 shutdown_connections 2024-09-19T06:47:24.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.285+0000 7f75b7a27640 1 --2- 172.21.15.86:0/3380702451 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f759406c2e0 0x7f759406e7a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.285+0000 7f75b7a27640 1 --2- 172.21.15.86:0/3380702451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75b00cd7e0 0x7f75b00cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.285+0000 7f75b7a27640 1 --2- 172.21.15.86:0/3380702451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75b00cc8a0 0x7f75b00ceaf0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.285+0000 7f75b7a27640 1 --2- 172.21.15.86:0/3380702451 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f759c0039b0 0x7f75b00ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.285+0000 7f75b7a27640 1 -- 172.21.15.86:0/3380702451 >> 172.21.15.86:0/3380702451 conn(0x7f75b00cb3a0 msgr2=0x7f75b015b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:24.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.285+0000 7f75b7a27640 1 -- 172.21.15.86:0/3380702451 shutdown_connections 2024-09-19T06:47:24.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.285+0000 7f75b7a27640 1 -- 172.21.15.86:0/3380702451 wait complete. 2024-09-19T06:47:24.298 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T06:47:24.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.399+0000 7f35b5331640 1 Processor -- start 2024-09-19T06:47:24.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.399+0000 7f35b5331640 1 -- start start 2024-09-19T06:47:24.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.400+0000 7f35b5331640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35b0152060 0x7f35b0072d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.400+0000 7f35b5331640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f35b006bd10 0x7f35b00732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.400+0000 7f35b5331640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f35b00c3680 0x7f35b00719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.400+0000 7f35b5331640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f35b00716c0 con 0x7f35b006bd10 2024-09-19T06:47:24.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.400+0000 7f35b5331640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f35b0152440 con 0x7f35b00c3680 2024-09-19T06:47:24.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.400+0000 7f35b5331640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f35b0158710 con 0x7f35b0152060 2024-09-19T06:47:24.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.400+0000 7f35ae7fc640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f35b006bd10 0x7f35b00732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.400+0000 7f35ae7fc640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f35b006bd10 0x7f35b00732d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38328/0 (socket says 172.21.15.86:38328) 2024-09-19T06:47:24.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.400+0000 7f35ae7fc640 1 -- 172.21.15.86:0/1403451005 learned_addr learned my addr 172.21.15.86:0/1403451005 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:47:24.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.400+0000 7f35af7fe640 1 --2- 172.21.15.86:0/1403451005 >> v2:172.21.15.169:3300/0 conn(0x7f35b00c3680 0x7f35b00719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.400+0000 7f35aeffd640 1 --2- 172.21.15.86:0/1403451005 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35b0152060 0x7f35b0072d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.400+0000 7f35ae7fc640 1 -- 172.21.15.86:0/1403451005 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35b0152060 msgr2=0x7f35b0072d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:24.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.400+0000 7f35ae7fc640 1 --2- 172.21.15.86:0/1403451005 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35b0152060 0x7f35b0072d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.400+0000 7f35ae7fc640 1 -- 172.21.15.86:0/1403451005 >> v2:172.21.15.169:3300/0 conn(0x7f35b00c3680 msgr2=0x7f35b00719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:24.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.400+0000 7f35ae7fc640 1 --2- 172.21.15.86:0/1403451005 >> v2:172.21.15.169:3300/0 conn(0x7f35b00c3680 0x7f35b00719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.400+0000 7f35ae7fc640 1 -- 172.21.15.86:0/1403451005 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b01589b0 con 0x7f35b006bd10 2024-09-19T06:47:24.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.401+0000 7f35ae7fc640 1 --2- 172.21.15.86:0/1403451005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35b006bd10 0x7f35b00732d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f35b006bc50 tx=0x7f35a402c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5976e211b20ffed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:24.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.401+0000 7f35adffb640 1 -- 172.21.15.86:0/1403451005 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a4036020 con 0x7f35b006bd10 2024-09-19T06:47:24.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.401+0000 7f35adffb640 1 -- 172.21.15.86:0/1403451005 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f35a4032820 con 0x7f35b006bd10 2024-09-19T06:47:24.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.401+0000 7f35adffb640 1 -- 172.21.15.86:0/1403451005 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a4032c10 con 0x7f35b006bd10 2024-09-19T06:47:24.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.402+0000 7f35b5331640 1 -- 172.21.15.86:0/1403451005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35b006bd10 msgr2=0x7f35b00732d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:24.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.402+0000 7f35b5331640 1 --2- 172.21.15.86:0/1403451005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35b006bd10 0x7f35b00732d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f35b006bc50 tx=0x7f35a402c920 comp rx=0 tx=0).stop 2024-09-19T06:47:24.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.402+0000 7f35b5331640 1 -- 172.21.15.86:0/1403451005 shutdown_connections 2024-09-19T06:47:24.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.402+0000 7f35b5331640 1 --2- 172.21.15.86:0/1403451005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35b006bd10 0x7f35b00732d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.402+0000 7f35b5331640 1 --2- 172.21.15.86:0/1403451005 >> v2:172.21.15.169:3300/0 conn(0x7f35b00c3680 0x7f35b00719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.402+0000 7f35b5331640 1 --2- 172.21.15.86:0/1403451005 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35b0152060 0x7f35b0072d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.402+0000 7f35b5331640 1 -- 172.21.15.86:0/1403451005 >> 172.21.15.86:0/1403451005 conn(0x7f35b00c9280 msgr2=0x7f35b00c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:24.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.402+0000 7f35b5331640 1 -- 172.21.15.86:0/1403451005 shutdown_connections 2024-09-19T06:47:24.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.402+0000 7f35b5331640 1 -- 172.21.15.86:0/1403451005 wait complete. 2024-09-19T06:47:24.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.403+0000 7f35b5331640 1 Processor -- start 2024-09-19T06:47:24.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.403+0000 7f35b5331640 1 -- start start 2024-09-19T06:47:24.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.404+0000 7f35b5331640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35b006bd10 0x7f35b01f0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.404+0000 7f35b5331640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35b00c3680 0x7f35b006cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.404+0000 7f35b5331640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35b0152060 0x7f35b014eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.404+0000 7f35b5331640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f35b00c9e10 con 0x7f35b0152060 2024-09-19T06:47:24.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.404+0000 7f35b5331640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f35b0071350 con 0x7f35b00c3680 2024-09-19T06:47:24.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.404+0000 7f35b5331640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f35b0071f00 con 0x7f35b006bd10 2024-09-19T06:47:24.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.404+0000 7f35af7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35b0152060 0x7f35b014eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.404+0000 7f35af7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35b0152060 0x7f35b014eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38342/0 (socket says 172.21.15.86:38342) 2024-09-19T06:47:24.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.404+0000 7f35af7fe640 1 -- 172.21.15.86:0/1135441035 learned_addr learned my addr 172.21.15.86:0/1135441035 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:47:24.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.404+0000 7f35aeffd640 1 --2- 172.21.15.86:0/1135441035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35b006bd10 0x7f35b01f0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.404+0000 7f35af7fe640 1 -- 172.21.15.86:0/1135441035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35b006bd10 msgr2=0x7f35b01f0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:24.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.404+0000 7f35ae7fc640 1 --2- 172.21.15.86:0/1135441035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35b00c3680 0x7f35b006cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.404+0000 7f35af7fe640 1 --2- 172.21.15.86:0/1135441035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35b006bd10 0x7f35b01f0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.404+0000 7f35af7fe640 1 -- 172.21.15.86:0/1135441035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35b00c3680 msgr2=0x7f35b006cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:24.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.404+0000 7f35af7fe640 1 --2- 172.21.15.86:0/1135441035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35b00c3680 0x7f35b006cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.404+0000 7f35af7fe640 1 -- 172.21.15.86:0/1135441035 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b0152600 con 0x7f35b0152060 2024-09-19T06:47:24.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.404+0000 7f35aeffd640 1 --2- 172.21.15.86:0/1135441035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35b006bd10 0x7f35b01f0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:24.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.404+0000 7f35ae7fc640 1 --2- 172.21.15.86:0/1135441035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35b00c3680 0x7f35b006cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:24.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.404+0000 7f35af7fe640 1 --2- 172.21.15.86:0/1135441035 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35b0152060 0x7f35b014eb70 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f35a8007e90 tx=0x7f35a800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:24.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.404+0000 7f35977fe640 1 -- 172.21.15.86:0/1135441035 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a8014420 con 0x7f35b0152060 2024-09-19T06:47:24.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.404+0000 7f35977fe640 1 -- 172.21.15.86:0/1135441035 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f35a8019070 con 0x7f35b0152060 2024-09-19T06:47:24.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.404+0000 7f35b5331640 1 -- 172.21.15.86:0/1135441035 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35b01eca80 con 0x7f35b0152060 2024-09-19T06:47:24.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.404+0000 7f35977fe640 1 -- 172.21.15.86:0/1135441035 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a8014840 con 0x7f35b0152060 2024-09-19T06:47:24.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.405+0000 7f35b5331640 1 -- 172.21.15.86:0/1135441035 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35b01ed020 con 0x7f35b0152060 2024-09-19T06:47:24.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.406+0000 7f35b5331640 1 -- 172.21.15.86:0/1135441035 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35b0154120 con 0x7f35b0152060 2024-09-19T06:47:24.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.406+0000 7f35977fe640 1 -- 172.21.15.86:0/1135441035 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f35a80149e0 con 0x7f35b0152060 2024-09-19T06:47:24.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.406+0000 7f35977fe640 1 --2- 172.21.15.86:0/1135441035 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f359c06c2b0 0x7f359c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.406+0000 7f35977fe640 1 -- 172.21.15.86:0/1135441035 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6899+0+0 (secure 0 0 0) 0x7f35a808c200 con 0x7f35b0152060 2024-09-19T06:47:24.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.406+0000 7f35aeffd640 1 --2- 172.21.15.86:0/1135441035 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f359c06c2b0 0x7f359c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.407+0000 7f35aeffd640 1 --2- 172.21.15.86:0/1135441035 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f359c06c2b0 0x7f359c06e770 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f35a0006fd0 tx=0x7f35a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:24.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.411+0000 7f35977fe640 1 -- 172.21.15.86:0/1135441035 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f35a805a430 con 0x7f35b0152060 2024-09-19T06:47:24.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:24.578+0000 7f35b5331640 1 -- 172.21.15.86:0/1135441035 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f35b01527d0 con 0x7f35b0152060 2024-09-19T06:47:25.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.287+0000 7f35977fe640 1 -- 172.21.15.86:0/1135441035 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) ==== 169+0+0 (secure 0 0 0) 0x7f35a8059d30 con 0x7f35b0152060 2024-09-19T06:47:25.289 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' removed 2024-09-19T06:47:25.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.290+0000 7f35b5331640 1 -- 172.21.15.86:0/1135441035 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f359c06c2b0 msgr2=0x7f359c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:25.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.290+0000 7f35b5331640 1 --2- 172.21.15.86:0/1135441035 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f359c06c2b0 0x7f359c06e770 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f35a0006fd0 tx=0x7f35a0008040 comp rx=0 tx=0).stop 2024-09-19T06:47:25.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.290+0000 7f35b5331640 1 -- 172.21.15.86:0/1135441035 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35b0152060 msgr2=0x7f35b014eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:25.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.290+0000 7f35b5331640 1 --2- 172.21.15.86:0/1135441035 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35b0152060 0x7f35b014eb70 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f35a8007e90 tx=0x7f35a800e4b0 comp rx=0 tx=0).stop 2024-09-19T06:47:25.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.290+0000 7f35b5331640 1 -- 172.21.15.86:0/1135441035 shutdown_connections 2024-09-19T06:47:25.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.290+0000 7f35b5331640 1 --2- 172.21.15.86:0/1135441035 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f359c06c2b0 0x7f359c06e770 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:25.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.290+0000 7f35b5331640 1 --2- 172.21.15.86:0/1135441035 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35b0152060 0x7f35b014eb70 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:25.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.290+0000 7f35b5331640 1 --2- 172.21.15.86:0/1135441035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35b00c3680 0x7f35b006cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:25.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.290+0000 7f35b5331640 1 --2- 172.21.15.86:0/1135441035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35b006bd10 0x7f35b01f0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:25.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.290+0000 7f35b5331640 1 -- 172.21.15.86:0/1135441035 >> 172.21.15.86:0/1135441035 conn(0x7f35b00c9280 msgr2=0x7f35b00c75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:25.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.290+0000 7f35b5331640 1 -- 172.21.15.86:0/1135441035 shutdown_connections 2024-09-19T06:47:25.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.290+0000 7f35b5331640 1 -- 172.21.15.86:0/1135441035 wait complete. 2024-09-19T06:47:25.303 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-19T06:47:25.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.407+0000 7f20baedd640 1 Processor -- start 2024-09-19T06:47:25.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.407+0000 7f20baedd640 1 -- start start 2024-09-19T06:47:25.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.408+0000 7f20baedd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f20b4153430 0x7f20b40ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:25.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.408+0000 7f20baedd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20b4159bb0 0x7f20b40c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:25.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.408+0000 7f20baedd640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20b415ceb0 con 0x7f20b40730b0 2024-09-19T06:47:25.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.408+0000 7f20baedd640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f20b4159fe0 con 0x7f20b4153430 2024-09-19T06:47:25.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.408+0000 7f20baedd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f20b415d190 con 0x7f20b4159bb0 2024-09-19T06:47:25.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.408+0000 7f20b8c79640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f20b4153430 0x7f20b40ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:25.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.408+0000 7f20b947a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20b4159bb0 0x7f20b40c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:25.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.408+0000 7f20b3fff640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f20b40730b0 0x7f20b415c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.86:59488/0 (socket says 172.21.15.86:59488) 2024-09-19T06:47:25.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.408+0000 7f20b3fff640 1 -- 172.21.15.86:0/3795713318 learned_addr learned my addr 172.21.15.86:0/3795713318 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-19T06:47:25.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.409+0000 7f20b8c79640 1 -- 172.21.15.86:0/3795713318 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20b4159bb0 msgr2=0x7f20b40c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:25.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.409+0000 7f20b8c79640 1 --2- 172.21.15.86:0/3795713318 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20b4159bb0 0x7f20b40c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:25.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.409+0000 7f20b8c79640 1 -- 172.21.15.86:0/3795713318 >> v1:172.21.15.169:6789/0 conn(0x7f20b40730b0 legacy=0x7f20b415c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:25.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.409+0000 7f20b8c79640 1 -- 172.21.15.86:0/3795713318 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b415d470 con 0x7f20b4153430 2024-09-19T06:47:25.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.409+0000 7f20b947a640 1 --2- 172.21.15.86:0/3795713318 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20b4159bb0 0x7f20b40c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:47:25.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.409+0000 7f20b8c79640 1 --2- 172.21.15.86:0/3795713318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20b4153430 0x7f20b40ca0f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f20a80097a0 tx=0x7f20a802a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ea0c0d21d24dc03 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:25.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.410+0000 7f20b37fe640 1 -- 172.21.15.86:0/3795713318 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a8037070 con 0x7f20b4153430 2024-09-19T06:47:25.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.410+0000 7f20b37fe640 1 -- 172.21.15.86:0/3795713318 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f20a802adb0 con 0x7f20b4153430 2024-09-19T06:47:25.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.410+0000 7f20b37fe640 1 -- 172.21.15.86:0/3795713318 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a8032680 con 0x7f20b4153430 2024-09-19T06:47:25.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.410+0000 7f20baedd640 1 -- 172.21.15.86:0/3795713318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20b4153430 msgr2=0x7f20b40ca0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:25.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.410+0000 7f20baedd640 1 --2- 172.21.15.86:0/3795713318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20b4153430 0x7f20b40ca0f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f20a80097a0 tx=0x7f20a802a060 comp rx=0 tx=0).stop 2024-09-19T06:47:25.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.410+0000 7f20baedd640 1 -- 172.21.15.86:0/3795713318 shutdown_connections 2024-09-19T06:47:25.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.410+0000 7f20baedd640 1 --2- 172.21.15.86:0/3795713318 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20b4159bb0 0x7f20b40c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:25.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.410+0000 7f20baedd640 1 --2- 172.21.15.86:0/3795713318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20b4153430 0x7f20b40ca0f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:25.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.410+0000 7f20baedd640 1 -- 172.21.15.86:0/3795713318 >> 172.21.15.86:0/3795713318 conn(0x7f20b40cb3a0 msgr2=0x7f20b40cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:25.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.410+0000 7f20baedd640 1 -- 172.21.15.86:0/3795713318 shutdown_connections 2024-09-19T06:47:25.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.410+0000 7f20baedd640 1 -- 172.21.15.86:0/3795713318 wait complete. 2024-09-19T06:47:25.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.411+0000 7f20baedd640 1 Processor -- start 2024-09-19T06:47:25.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.411+0000 7f20baedd640 1 -- start start 2024-09-19T06:47:25.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.412+0000 7f20baedd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20b40730b0 0x7f20b414b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:25.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.412+0000 7f20baedd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20b4153430 0x7f20b40ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:25.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.412+0000 7f20baedd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20b4159bb0 0x7f20b40cc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:25.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.412+0000 7f20baedd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f20b4159690 con 0x7f20b40730b0 2024-09-19T06:47:25.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.412+0000 7f20baedd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f20b41593b0 con 0x7f20b4159bb0 2024-09-19T06:47:25.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.412+0000 7f20baedd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f20b40cc130 con 0x7f20b4153430 2024-09-19T06:47:25.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.412+0000 7f20b8c79640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20b40730b0 0x7f20b414b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:25.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.412+0000 7f20b8c79640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20b40730b0 0x7f20b414b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38346/0 (socket says 172.21.15.86:38346) 2024-09-19T06:47:25.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.412+0000 7f20b8c79640 1 -- 172.21.15.86:0/2878814895 learned_addr learned my addr 172.21.15.86:0/2878814895 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T06:47:25.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.412+0000 7f20b947a640 1 --2- 172.21.15.86:0/2878814895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20b4159bb0 0x7f20b40cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:25.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.412+0000 7f20b3fff640 1 --2- 172.21.15.86:0/2878814895 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20b4153430 0x7f20b40ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:25.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.413+0000 7f20b8c79640 1 -- 172.21.15.86:0/2878814895 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20b4153430 msgr2=0x7f20b40ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:25.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.413+0000 7f20b8c79640 1 --2- 172.21.15.86:0/2878814895 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20b4153430 0x7f20b40ceb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:25.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.413+0000 7f20b8c79640 1 -- 172.21.15.86:0/2878814895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20b4159bb0 msgr2=0x7f20b40cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:25.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.413+0000 7f20b8c79640 1 --2- 172.21.15.86:0/2878814895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20b4159bb0 0x7f20b40cc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:25.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.413+0000 7f20b8c79640 1 -- 172.21.15.86:0/2878814895 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b4156030 con 0x7f20b40730b0 2024-09-19T06:47:25.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.413+0000 7f20b947a640 1 --2- 172.21.15.86:0/2878814895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20b4159bb0 0x7f20b40cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:25.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.413+0000 7f20b8c79640 1 --2- 172.21.15.86:0/2878814895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20b40730b0 0x7f20b414b420 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f20a8035040 tx=0x7f20a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:25.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.413+0000 7f20b17fa640 1 -- 172.21.15.86:0/2878814895 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a8041020 con 0x7f20b40730b0 2024-09-19T06:47:25.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.413+0000 7f20b17fa640 1 -- 172.21.15.86:0/2878814895 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f20a803c870 con 0x7f20b40730b0 2024-09-19T06:47:25.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.413+0000 7f20baedd640 1 -- 172.21.15.86:0/2878814895 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20b4153a50 con 0x7f20b40730b0 2024-09-19T06:47:25.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.413+0000 7f20b17fa640 1 -- 172.21.15.86:0/2878814895 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a8037040 con 0x7f20b40730b0 2024-09-19T06:47:25.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.413+0000 7f20baedd640 1 -- 172.21.15.86:0/2878814895 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20b4154010 con 0x7f20b40730b0 2024-09-19T06:47:25.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.414+0000 7f20baedd640 1 -- 172.21.15.86:0/2878814895 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20b40c9920 con 0x7f20b40730b0 2024-09-19T06:47:25.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.414+0000 7f20b17fa640 1 -- 172.21.15.86:0/2878814895 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f20a8044020 con 0x7f20b40730b0 2024-09-19T06:47:25.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.415+0000 7f20b17fa640 1 --2- 172.21.15.86:0/2878814895 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f209806c2e0 0x7f209806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:25.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.415+0000 7f20b3fff640 1 --2- 172.21.15.86:0/2878814895 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f209806c2e0 0x7f209806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:25.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.415+0000 7f20b17fa640 1 -- 172.21.15.86:0/2878814895 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6369+0+0 (secure 0 0 0) 0x7f20a80abf80 con 0x7f20b40730b0 2024-09-19T06:47:25.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.416+0000 7f20b3fff640 1 --2- 172.21.15.86:0/2878814895 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f209806c2e0 0x7f209806e7a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f20b4071b80 tx=0x7f20a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:25.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.419+0000 7f20b17fa640 1 -- 172.21.15.86:0/2878814895 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f20a804b030 con 0x7f20b40730b0 2024-09-19T06:47:25.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:25.593+0000 7f20baedd640 1 -- 172.21.15.86:0/2878814895 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f20b41569e0 con 0x7f20b40730b0 2024-09-19T06:47:26.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:26.292+0000 7f20b17fa640 1 -- 172.21.15.86:0/2878814895 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v38) ==== 178+0+0 (secure 0 0 0) 0x7f20a807a3c0 con 0x7f20b40730b0 2024-09-19T06:47:26.293 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data_ec' removed 2024-09-19T06:47:26.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:26.295+0000 7f20baedd640 1 -- 172.21.15.86:0/2878814895 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f209806c2e0 msgr2=0x7f209806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:26.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:26.295+0000 7f20baedd640 1 --2- 172.21.15.86:0/2878814895 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f209806c2e0 0x7f209806e7a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f20b4071b80 tx=0x7f20a0009040 comp rx=0 tx=0).stop 2024-09-19T06:47:26.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:26.295+0000 7f20baedd640 1 -- 172.21.15.86:0/2878814895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20b40730b0 msgr2=0x7f20b414b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:26.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:26.295+0000 7f20baedd640 1 --2- 172.21.15.86:0/2878814895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20b40730b0 0x7f20b414b420 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f20a8035040 tx=0x7f20a80046c0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:26.296+0000 7f20baedd640 1 -- 172.21.15.86:0/2878814895 shutdown_connections 2024-09-19T06:47:26.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:26.296+0000 7f20baedd640 1 --2- 172.21.15.86:0/2878814895 >> [v2:172.21.15.86:6816/4165134248,v1:172.21.15.86:6817/4165134248] conn(0x7f209806c2e0 0x7f209806e7a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:26.296+0000 7f20baedd640 1 --2- 172.21.15.86:0/2878814895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20b4159bb0 0x7f20b40cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:26.296+0000 7f20baedd640 1 --2- 172.21.15.86:0/2878814895 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20b4153430 0x7f20b40ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:26.296+0000 7f20baedd640 1 --2- 172.21.15.86:0/2878814895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20b40730b0 0x7f20b414b420 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:26.296+0000 7f20baedd640 1 -- 172.21.15.86:0/2878814895 >> 172.21.15.86:0/2878814895 conn(0x7f20b40cb3a0 msgr2=0x7f20b40cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:26.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:26.296+0000 7f20baedd640 1 -- 172.21.15.86:0/2878814895 shutdown_connections 2024-09-19T06:47:26.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T06:47:26.296+0000 7f20baedd640 1 -- 172.21.15.86:0/2878814895 wait complete. 2024-09-19T06:47:26.313 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-19T06:47:26.313 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T06:47:26.314 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:47:26.323 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T06:47:26.323 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T06:47:26.323 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:47:26.374 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T06:47:26.374 ERROR:tasks.ceph.mds.e:tried to stop a non-running daemon 2024-09-19T06:47:26.374 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T06:47:26.374 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:47:26.389 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T06:47:26.389 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T06:47:26.389 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:47:26.442 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T06:47:26.443 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-09-19T06:47:26.443 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:47:26.496 INFO:tasks.ceph.mds.f:Stopped 2024-09-19T06:47:26.496 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-19T06:47:26.496 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-19T06:47:26.496 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:47:26.572 INFO:tasks.ceph.osd.0:Stopped 2024-09-19T06:47:26.572 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-19T06:47:26.572 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:47:26.666 INFO:tasks.ceph.osd.1:Stopped 2024-09-19T06:47:26.667 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-19T06:47:26.667 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:47:26.730 INFO:tasks.ceph.osd.2:Stopped 2024-09-19T06:47:26.730 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-19T06:47:26.730 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:47:26.818 INFO:tasks.ceph.osd.3:Stopped 2024-09-19T06:47:26.819 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-19T06:47:26.819 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:47:26.900 INFO:tasks.ceph.osd.4:Stopped 2024-09-19T06:47:26.900 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-19T06:47:26.900 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:47:26.974 INFO:tasks.ceph.osd.5:Stopped 2024-09-19T06:47:26.974 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-19T06:47:26.974 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:47:27.071 INFO:tasks.ceph.osd.6:Stopped 2024-09-19T06:47:27.072 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-19T06:47:27.072 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:47:27.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-19T06:47:27.677 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-19T06:47:27.677 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-19T06:47:33.173 INFO:tasks.ceph.osd.7:Stopped 2024-09-19T06:47:33.173 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-19T06:47:33.174 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-19T06:47:33.174 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:47:33.180 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-19T06:47:33.180 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-19T06:47:33.180 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-19T06:47:33.180 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-19T06:47:33.202 INFO:tasks.ceph.mgr.y:Stopped 2024-09-19T06:47:33.203 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-19T06:47:33.203 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:47:33.233 INFO:tasks.ceph.mgr.x:Stopped 2024-09-19T06:47:33.233 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-19T06:47:33.233 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-19T06:47:33.233 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:47:33.253 INFO:tasks.ceph.mon.a:Stopped 2024-09-19T06:47:33.254 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-19T06:47:33.254 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:47:33.285 INFO:tasks.ceph.mon.b:Stopped 2024-09-19T06:47:33.286 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-19T06:47:33.286 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:47:33.338 INFO:tasks.ceph.mon.c:Stopped 2024-09-19T06:47:33.339 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-19T06:47:33.339 DEBUG:teuthology.orchestra.run.smithi086:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | egrep -v 'Replacing daemon mds' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T06:47:33.418 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-19T06:47:33.418 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-19T06:47:34.150 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-19T06:47:34.150 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-19T06:47:34.360 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-19T06:47:34.360 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-19T06:47:34.495 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-19T06:47:34.495 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-19T06:47:34.641 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-19T06:47:34.641 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-19T06:47:35.059 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-19T06:47:35.059 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-19T06:47:35.153 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-19T06:47:35.153 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-19T06:47:35.236 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-19T06:47:35.236 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-19T06:47:35.325 INFO:tasks.ceph:Archiving mon data... 2024-09-19T06:47:35.327 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911752/data/mon.a.tgz 2024-09-19T06:47:35.327 DEBUG:teuthology.orchestra.run.smithi086:> mktemp 2024-09-19T06:47:35.343 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.jkK6K10bnH 2024-09-19T06:47:35.343 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.jkK6K10bnH 2024-09-19T06:47:35.571 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.jkK6K10bnH 2024-09-19T06:47:35.697 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.jkK6K10bnH is 334KB 2024-09-19T06:47:35.791 DEBUG:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.jkK6K10bnH 2024-09-19T06:47:35.807 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911752/data/mon.b.tgz 2024-09-19T06:47:35.807 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2024-09-19T06:47:35.827 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.6nlwtG1sz8 2024-09-19T06:47:35.828 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.6nlwtG1sz8 2024-09-19T06:47:35.983 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.6nlwtG1sz8 2024-09-19T06:47:36.080 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.6nlwtG1sz8 is 344KB 2024-09-19T06:47:36.175 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.6nlwtG1sz8 2024-09-19T06:47:36.190 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911752/data/mon.c.tgz 2024-09-19T06:47:36.190 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2024-09-19T06:47:36.245 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.8QZX33N8Up 2024-09-19T06:47:36.245 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.8QZX33N8Up 2024-09-19T06:47:36.372 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.8QZX33N8Up 2024-09-19T06:47:36.455 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.8QZX33N8Up is 344KB 2024-09-19T06:47:36.550 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.8QZX33N8Up 2024-09-19T06:47:36.565 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-19T06:47:36.565 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-19T06:47:36.567 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-19T06:47:36.662 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-19T06:47:36.703 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-19T06:47:36.703 INFO:tasks.ceph:Archiving crash dumps... 2024-09-19T06:47:36.705 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911752/remote/smithi086/crash 2024-09-19T06:47:36.706 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-19T06:47:36.730 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911752/remote/smithi169/crash 2024-09-19T06:47:36.731 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-19T06:47:36.767 INFO:tasks.ceph:Shutting down logrotate 2024-09-19T06:47:38.182 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-19T06:50:55.987 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-19T06:50:56.013 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-19T06:50:56.057 INFO:tasks.ceph:Compressing logs... 2024-09-19T06:50:56.057 DEBUG:teuthology.orchestra.run.smithi086:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T06:50:56.060 DEBUG:teuthology.orchestra.run.smithi169:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T06:50:56.098 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-19T06:50:56.100 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52798.log 2024-09-19T06:50:56.100 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53810.log 2024-09-19T06:50:56.100 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.52798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52672.log 2024-09-19T06:50:56.100 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.53810.log: gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.41199.log 2024-09-19T06:50:56.142 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37474.log 2024-09-19T06:50:56.142 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37565.log 2024-09-19T06:50:56.142 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.37474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37394.log 2024-09-19T06:50:56.142 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.37565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37434.log 2024-09-19T06:50:56.142 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.37394.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-19T06:50:56.142 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.37434.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-19T06:50:56.142 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-19T06:50:56.143 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-19T06:50:56.143 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37605.log 2024-09-19T06:50:56.143 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37645.log 2024-09-19T06:50:56.143 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.37605.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-19T06:50:56.143 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.37645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37354.log 2024-09-19T06:50:56.143 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-19T06:50:56.143 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.37354.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-19T06:50:56.143 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-19T06:50:56.143 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-19T06:50:56.143 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-19T06:50:56.143 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-19T06:50:56.143 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37516.log 2024-09-19T06:50:56.143 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-09-19T06:50:56.144 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.37516.log: /var/log/ceph/ceph-mds.f.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37474.log.gz 2024-09-19T06:50:56.144 INFO:teuthology.orchestra.run.smithi169.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37565.log.gz 2024-09-19T06:50:56.144 INFO:teuthology.orchestra.run.smithi169.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37605.log.gz 2024-09-19T06:50:56.144 INFO:teuthology.orchestra.run.smithi169.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37516.log.gz 2024-09-19T06:50:56.164 INFO:teuthology.orchestra.run.smithi169.stderr: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-19T06:50:56.170 INFO:teuthology.orchestra.run.smithi169.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-19T06:50:56.171 INFO:teuthology.orchestra.run.smithi086.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52798.log.gz 2024-09-19T06:50:56.171 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.52672.log: gzip -5 --verbose 89.1% -- -- replaced with /var/log/ceph/ceph-client.admin.53810.log.gz /var/log/ceph/ceph-client.admin.52714.log 2024-09-19T06:50:56.171 INFO:teuthology.orchestra.run.smithi086.stderr: 2024-09-19T06:50:56.171 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.41199.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.52672.log.gz 2024-09-19T06:50:56.171 INFO:teuthology.orchestra.run.smithi086.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49711.log 2024-09-19T06:50:56.171 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.52714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40272.log 2024-09-19T06:50:56.171 INFO:teuthology.orchestra.run.smithi086.stderr: 88.5%/var/log/ceph/ceph-client.admin.49711.log: -- replaced with /var/log/ceph/ceph-client.admin.52714.log.gz 2024-09-19T06:50:56.172 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44478.log 2024-09-19T06:50:56.172 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.40272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49004.log 2024-09-19T06:50:56.172 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.44478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49837.log 2024-09-19T06:50:56.172 INFO:teuthology.orchestra.run.smithi086.stderr:gzip/var/log/ceph/ceph-client.admin.49004.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42109.log 2024-09-19T06:50:56.172 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.49837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48294.log 2024-09-19T06:50:56.172 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.42109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41990.log 2024-09-19T06:50:56.172 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51148.log 2024-09-19T06:50:56.172 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.48294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49402.log 2024-09-19T06:50:56.172 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.41990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40989.log 2024-09-19T06:50:56.172 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.51148.log: /var/log/ceph/ceph-client.admin.49402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36684.log 2024-09-19T06:50:56.172 INFO:teuthology.orchestra.run.smithi086.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51148.log.gz 2024-09-19T06:50:56.172 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43047.log 2024-09-19T06:50:56.173 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.40989.log: /var/log/ceph/ceph-client.admin.36684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50919.log 2024-09-19T06:50:56.173 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.43047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42487.log 2024-09-19T06:50:56.173 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51210.log 2024-09-19T06:50:56.173 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.50919.log: /var/log/ceph/ceph-client.admin.42487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49088.log 2024-09-19T06:50:56.173 INFO:teuthology.orchestra.run.smithi086.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50919.log.gz 2024-09-19T06:50:56.173 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.51210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52252.log 2024-09-19T06:50:56.173 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.49088.log: gzip -5 --verbose 88.1% -- /var/log/ceph/ceph-client.admin.53222.log -- replaced with /var/log/ceph/ceph-client.admin.51210.log.gz 2024-09-19T06:50:56.173 INFO:teuthology.orchestra.run.smithi086.stderr: 2024-09-19T06:50:56.173 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.52252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41157.log 2024-09-19T06:50:56.173 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.53222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51378.log 2024-09-19T06:50:56.173 INFO:teuthology.orchestra.run.smithi086.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52252.log.gz 2024-09-19T06:50:56.173 INFO:teuthology.orchestra.run.smithi086.stderr:gzip/var/log/ceph/ceph-client.admin.41157.log: -5 --verbose -- 88.2% /var/log/ceph/ceph-client.admin.43747.log -- replaced with /var/log/ceph/ceph-client.admin.53222.log.gz 2024-09-19T06:50:56.173 INFO:teuthology.orchestra.run.smithi086.stderr: 2024-09-19T06:50:56.174 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.51378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40819.log 2024-09-19T06:50:56.174 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.43747.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51378.log.gz 2024-09-19T06:50:56.174 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-19T06:50:56.174 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.40819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51641.log 2024-09-19T06:50:56.174 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 89.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.40272.log.gz /var/log/ceph/ceph-client.admin.51252.log 2024-09-19T06:50:56.174 INFO:teuthology.orchestra.run.smithi086.stderr: 2024-09-19T06:50:56.174 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.51641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50244.log 2024-09-19T06:50:56.174 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.51252.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51641.log.gz 2024-09-19T06:50:56.174 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51462.log 2024-09-19T06:50:56.174 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.50244.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51252.log.gz 2024-09-19T06:50:56.174 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48386.log 2024-09-19T06:50:56.174 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.51462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40587.log 2024-09-19T06:50:56.174 INFO:teuthology.orchestra.run.smithi086.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51462.log.gz 2024-09-19T06:50:56.174 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.48386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51985.log 2024-09-19T06:50:56.175 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43045.log 2024-09-19T06:50:56.175 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.40587.log: /var/log/ceph/ceph-client.admin.51985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48920.log 2024-09-19T06:50:56.175 INFO:teuthology.orchestra.run.smithi086.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51985.log.gz 2024-09-19T06:50:56.175 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50413.log 2024-09-19T06:50:56.175 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.43045.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40819.log.gz 2024-09-19T06:50:56.175 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.48920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54282.log 2024-09-19T06:50:56.175 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.50413.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.41199.log.gz 2024-09-19T06:50:56.175 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49525.log 2024-09-19T06:50:56.175 INFO:teuthology.orchestra.run.smithi086.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40989.log.gz 2024-09-19T06:50:56.175 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51336.log 2024-09-19T06:50:56.175 INFO:teuthology.orchestra.run.smithi086.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40587.log.gz 2024-09-19T06:50:56.175 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.54282.log: /var/log/ceph/ceph-client.admin.49525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50835.log 2024-09-19T06:50:56.175 INFO:teuthology.orchestra.run.smithi086.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54282.log.gz 2024-09-19T06:50:56.175 INFO:teuthology.orchestra.run.smithi086.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41157.log.gz 2024-09-19T06:50:56.176 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.51336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48428.log 2024-09-19T06:50:56.176 INFO:teuthology.orchestra.run.smithi086.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51336.log.gz 2024-09-19T06:50:56.176 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.50835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42698.log 2024-09-19T06:50:56.176 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.48428.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50835.log.gz 2024-09-19T06:50:56.176 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44340.log 2024-09-19T06:50:56.176 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.42698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51003.log 2024-09-19T06:50:56.176 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.0.44340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48641.log 2024-09-19T06:50:56.176 INFO:teuthology.orchestra.run.smithi086.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44340.log.gz 2024-09-19T06:50:56.176 INFO:teuthology.orchestra.run.smithi086.stderr:gzip/var/log/ceph/ceph-client.admin.51003.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49753.log 2024-09-19T06:50:56.176 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.48641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54072.log 2024-09-19T06:50:56.176 INFO:teuthology.orchestra.run.smithi086.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51003.log.gz 2024-09-19T06:50:56.176 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.49753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42277.log 2024-09-19T06:50:56.176 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.54072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43042.log 2024-09-19T06:50:56.177 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54072.log.gz 2024-09-19T06:50:56.177 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.42277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49929.log 2024-09-19T06:50:56.177 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.43042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54366.log 2024-09-19T06:50:56.177 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.49929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51853.log 2024-09-19T06:50:56.177 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54240.log 2024-09-19T06:50:56.177 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.54366.log: /var/log/ceph/ceph-client.admin.51853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40733.log 2024-09-19T06:50:56.177 INFO:teuthology.orchestra.run.smithi086.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54366.log.gz 2024-09-19T06:50:56.177 INFO:teuthology.orchestra.run.smithi086.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51853.log.gz 2024-09-19T06:50:56.177 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.54240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51811.log 2024-09-19T06:50:56.177 INFO:teuthology.orchestra.run.smithi086.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36684.log.gz 2024-09-19T06:50:56.177 INFO:teuthology.orchestra.run.smithi086.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54240.log.gz 2024-09-19T06:50:56.177 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.40733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43380.log 2024-09-19T06:50:56.177 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.51811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40370.log 2024-09-19T06:50:56.178 INFO:teuthology.orchestra.run.smithi086.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51811.log.gz 2024-09-19T06:50:56.178 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.43380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43038.log 2024-09-19T06:50:56.178 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54032.log 2024-09-19T06:50:56.178 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.40370.log: 89.1%/var/log/ceph/ceph-client.admin.43038.log: -- replaced with /var/log/ceph/ceph-client.admin.48641.log.gz 2024-09-19T06:50:56.178 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50498.log 2024-09-19T06:50:56.178 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.54032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53516.log 2024-09-19T06:50:56.178 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.50498.log: 87.7%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.48920.log.gz --verbose 2024-09-19T06:50:56.178 INFO:teuthology.orchestra.run.smithi086.stderr: -- /var/log/ceph/ceph-client.admin.52336.log 2024-09-19T06:50:56.178 INFO:teuthology.orchestra.run.smithi086.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54032.log.gz 2024-09-19T06:50:56.178 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43036.log 2024-09-19T06:50:56.178 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.53516.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49004.log.gz 2024-09-19T06:50:56.178 INFO:teuthology.orchestra.run.smithi086.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49088.log.gz 2024-09-19T06:50:56.178 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.52336.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53516.log.gz 2024-09-19T06:50:56.179 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52840.log 2024-09-19T06:50:56.179 INFO:teuthology.orchestra.run.smithi086.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52336.log.gz 2024-09-19T06:50:56.179 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.43036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54114.log 2024-09-19T06:50:56.179 INFO:teuthology.orchestra.run.smithi086.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49711.log.gz 2024-09-19T06:50:56.179 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.52840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50751.log 2024-09-19T06:50:56.179 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.54114.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52840.log.gz 2024-09-19T06:50:56.179 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43381.log 2024-09-19T06:50:56.179 INFO:teuthology.orchestra.run.smithi086.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40733.log.gz 2024-09-19T06:50:56.179 INFO:teuthology.orchestra.run.smithi086.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54114.log.gz 2024-09-19T06:50:56.179 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.50751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50961.log 2024-09-19T06:50:56.179 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.43381.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-19T06:50:56.179 INFO:teuthology.orchestra.run.smithi086.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50751.log.gz 2024-09-19T06:50:56.179 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.50961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52546.log 2024-09-19T06:50:56.180 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52027.log 2024-09-19T06:50:56.180 INFO:teuthology.orchestra.run.smithi086.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50961.log.gz 2024-09-19T06:50:56.180 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52420.log 2024-09-19T06:50:56.180 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.52546.log: /var/log/ceph/ceph-client.admin.52027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52294.log 2024-09-19T06:50:56.180 INFO:teuthology.orchestra.run.smithi086.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52546.log.gz 2024-09-19T06:50:56.180 INFO:teuthology.orchestra.run.smithi086.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52027.log.gz 2024-09-19T06:50:56.180 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.52420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53642.log 2024-09-19T06:50:56.180 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.52294.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40370.log.gz 2024-09-19T06:50:56.180 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48344.log 2024-09-19T06:50:56.180 INFO:teuthology.orchestra.run.smithi086.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52420.log.gz 2024-09-19T06:50:56.180 INFO:teuthology.orchestra.run.smithi086.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42277.log.gz 2024-09-19T06:50:56.180 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.53642.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52294.log.gz 2024-09-19T06:50:56.180 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44907.log 2024-09-19T06:50:56.181 INFO:teuthology.orchestra.run.smithi086.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.42487.log.gz 2024-09-19T06:50:56.181 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.48344.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53642.log.gz 2024-09-19T06:50:56.181 INFO:teuthology.orchestra.run.smithi086.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42698.log.gz 2024-09-19T06:50:56.181 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50118.log 2024-09-19T06:50:56.181 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.44907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50793.log 2024-09-19T06:50:56.181 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.50118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53600.log 2024-09-19T06:50:56.181 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.50793.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43038.log.gz 2024-09-19T06:50:56.181 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42708.log 2024-09-19T06:50:56.181 INFO:teuthology.orchestra.run.smithi086.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43036.log.gz 2024-09-19T06:50:56.181 INFO:teuthology.orchestra.run.smithi086.stderr: 87.6%/var/log/ceph/ceph-client.admin.53600.log: -- replaced with /var/log/ceph/ceph-client.admin.50793.log.gz 2024-09-19T06:50:56.181 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52210.log 2024-09-19T06:50:56.181 INFO:teuthology.orchestra.run.smithi086.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43042.log.gz 2024-09-19T06:50:56.181 INFO:teuthology.orchestra.run.smithi086.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53600.log.gz 2024-09-19T06:50:56.182 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53936.log 2024-09-19T06:50:56.182 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.42708.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43045.log.gz 2024-09-19T06:50:56.182 INFO:teuthology.orchestra.run.smithi086.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43047.log.gz 2024-09-19T06:50:56.182 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.52210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41031.log 2024-09-19T06:50:56.182 INFO:teuthology.orchestra.run.smithi086.stderr: 88.7%/var/log/ceph/ceph-client.admin.53936.log: -- replaced with /var/log/ceph/ceph-client.admin.52210.log.gz 2024-09-19T06:50:56.182 INFO:teuthology.orchestra.run.smithi086.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43381.log.gz 2024-09-19T06:50:56.182 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50625.log 2024-09-19T06:50:56.182 INFO:teuthology.orchestra.run.smithi086.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53936.log.gz 2024-09-19T06:50:56.182 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43705.log 2024-09-19T06:50:56.182 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.41031.log: /var/log/ceph/ceph-client.admin.50625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49046.log 2024-09-19T06:50:56.182 INFO:teuthology.orchestra.run.smithi086.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43380.log.gz 2024-09-19T06:50:56.182 INFO:teuthology.orchestra.run.smithi086.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42708.log.gz 2024-09-19T06:50:56.182 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.43705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48599.log 2024-09-19T06:50:56.182 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.49046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43789.log 2024-09-19T06:50:56.183 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.48599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53348.log 2024-09-19T06:50:56.183 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49669.log 2024-09-19T06:50:56.183 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.43789.log: /var/log/ceph/ceph-client.admin.53348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43579.log 2024-09-19T06:50:56.183 INFO:teuthology.orchestra.run.smithi086.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53348.log.gz 2024-09-19T06:50:56.183 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42193.log 2024-09-19T06:50:56.183 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.49669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50709.log 2024-09-19T06:50:56.183 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.43579.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41031.log.gz 2024-09-19T06:50:56.183 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.42193.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30389.log 2024-09-19T06:50:56.183 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.50709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53264.log 2024-09-19T06:50:56.183 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph.tmp-client.admin.30389.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50709.log.gz -5 2024-09-19T06:50:56.183 INFO:teuthology.orchestra.run.smithi086.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42403.log 2024-09-19T06:50:56.183 INFO:teuthology.orchestra.run.smithi086.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30389.log.gz 2024-09-19T06:50:56.183 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.53264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42445.log 2024-09-19T06:50:56.184 INFO:teuthology.orchestra.run.smithi086.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53264.log.gz 2024-09-19T06:50:56.184 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.42403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44002.log 2024-09-19T06:50:56.184 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.42445.log: /var/log/ceph/ceph-client.admin.42705.log 2024-09-19T06:50:56.184 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.44002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49585.log 2024-09-19T06:50:56.184 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.42705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50541.log 2024-09-19T06:50:56.184 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49172.log 2024-09-19T06:50:56.184 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.49585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44697.log 2024-09-19T06:50:56.184 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.50541.log: /var/log/ceph/ceph-client.admin.49172.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-19T06:50:56.184 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43621.log 2024-09-19T06:50:56.184 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.44697.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49172.log.gz 2024-09-19T06:50:56.184 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44655.log 2024-09-19T06:50:56.184 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.43621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53432.log 2024-09-19T06:50:56.184 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.44655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48557.log 2024-09-19T06:50:56.184 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.53432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51683.log 2024-09-19T06:50:56.185 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51554.log 2024-09-19T06:50:56.185 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.48557.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53432.log.gz 2024-09-19T06:50:56.185 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.51683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48473.log 2024-09-19T06:50:56.185 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.51554.log: gzip -5 88.6% --verbose -- replaced with /var/log/ceph/ceph-client.admin.51683.log.gz -- 2024-09-19T06:50:56.185 INFO:teuthology.orchestra.run.smithi086.stderr: /var/log/ceph/ceph-client.admin.48683.log 2024-09-19T06:50:56.185 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.48473.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51554.log.gz 2024-09-19T06:50:56.185 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50583.log 2024-09-19T06:50:56.185 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.48683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49463.log 2024-09-19T06:50:56.185 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.50583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51087.log 2024-09-19T06:50:56.185 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.49463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43040.log 2024-09-19T06:50:56.185 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.51087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50076.log 2024-09-19T06:50:56.185 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.43040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53894.log 2024-09-19T06:50:56.185 INFO:teuthology.orchestra.run.smithi086.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51087.log.gz 2024-09-19T06:50:56.186 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.50076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48024.log 2024-09-19T06:50:56.186 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.53894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49989.log 2024-09-19T06:50:56.186 INFO:teuthology.orchestra.run.smithi086.stderr:gzip/var/log/ceph/ceph-client.admin.48024.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.52150.log 2024-09-19T06:50:56.186 INFO:teuthology.orchestra.run.smithi086.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53894.log.gz 2024-09-19T06:50:56.186 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.49989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36775.log 2024-09-19T06:50:56.186 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.52150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43873.log 2024-09-19T06:50:56.186 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.36775.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52150.log.gz 2024-09-19T06:50:56.186 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42151.log 2024-09-19T06:50:56.186 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.43873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44739.log 2024-09-19T06:50:56.186 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.42151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51596.log 2024-09-19T06:50:56.186 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.44739.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-19T06:50:56.186 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5/var/log/ceph/ceph-client.admin.51596.log: --verbose -- /var/log/ceph/ceph-client.admin.53978.log 2024-09-19T06:50:56.186 INFO:teuthology.orchestra.run.smithi086.stderr:gzip/var/log/ceph/ceph-mon.a.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.52756.log 2024-09-19T06:50:56.187 INFO:teuthology.orchestra.run.smithi086.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51596.log.gz 2024-09-19T06:50:56.187 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.53978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50667.log 2024-09-19T06:50:56.187 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.52756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49214.log 2024-09-19T06:50:56.187 INFO:teuthology.orchestra.run.smithi086.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53978.log.gz 2024-09-19T06:50:56.187 INFO:teuthology.orchestra.run.smithi086.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52756.log.gz 2024-09-19T06:50:56.187 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.50667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50455.log 2024-09-19T06:50:56.187 INFO:teuthology.orchestra.run.smithi086.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49046.log.gz 2024-09-19T06:50:56.187 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42529.log 2024-09-19T06:50:56.187 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.49214.log: /var/log/ceph/ceph-client.admin.50455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50286.log 2024-09-19T06:50:56.187 INFO:teuthology.orchestra.run.smithi086.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49214.log.gz 2024-09-19T06:50:56.187 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.42529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40905.log 2024-09-19T06:50:56.187 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.50286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42710.log 2024-09-19T06:50:56.187 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.40905.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49669.log.gz 2024-09-19T06:50:56.187 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53474.log 2024-09-19T06:50:56.188 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.42710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43243.log 2024-09-19T06:50:56.188 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.53474.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-19T06:50:56.188 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.43243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51512.log 2024-09-19T06:50:56.188 INFO:teuthology.orchestra.run.smithi086.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53474.log.gz 2024-09-19T06:50:56.188 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51895.log 2024-09-19T06:50:56.188 INFO:teuthology.orchestra.run.smithi086.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.49525.log.gz 2024-09-19T06:50:56.188 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.51512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40947.log 2024-09-19T06:50:56.188 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.51895.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51512.log.gz 2024-09-19T06:50:56.188 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53390.log 2024-09-19T06:50:56.188 INFO:teuthology.orchestra.run.smithi086.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51895.log.gz 2024-09-19T06:50:56.188 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.40947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48748.log 2024-09-19T06:50:56.188 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.53390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51725.log 2024-09-19T06:50:56.188 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.48748.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53390.log.gz 2024-09-19T06:50:56.189 INFO:teuthology.orchestra.run.smithi086.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44478.log.gz 2024-09-19T06:50:56.189 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53684.log 2024-09-19T06:50:56.189 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.51725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54156.log 2024-09-19T06:50:56.189 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.53684.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51725.log.gz 2024-09-19T06:50:56.189 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-19T06:50:56.189 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.54156.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53684.log.gz 2024-09-19T06:50:56.189 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53306.log 2024-09-19T06:50:56.189 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54156.log.gz 2024-09-19T06:50:56.189 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52378.log 2024-09-19T06:50:56.189 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44907.log.gz 2024-09-19T06:50:56.189 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.53306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53088.log 2024-09-19T06:50:56.189 INFO:teuthology.orchestra.run.smithi086.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53306.log.gz 2024-09-19T06:50:56.189 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.52378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48150.log 2024-09-19T06:50:56.189 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.53088.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52378.log.gzgzip 2024-09-19T06:50:56.190 INFO:teuthology.orchestra.run.smithi086.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54198.log 2024-09-19T06:50:56.190 INFO:teuthology.orchestra.run.smithi086.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53088.log.gz 2024-09-19T06:50:56.190 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.48150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41073.log 2024-09-19T06:50:56.190 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49795.log 2024-09-19T06:50:56.190 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.54198.log: /var/log/ceph/ceph-client.admin.41073.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-19T06:50:56.190 INFO:teuthology.orchestra.run.smithi086.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54198.log.gz 2024-09-19T06:50:56.190 INFO:teuthology.orchestra.run.smithi086.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40947.log.gz 2024-09-19T06:50:56.190 INFO:teuthology.orchestra.run.smithi086.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40905.log.gz 2024-09-19T06:50:56.190 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.49795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36420.log 2024-09-19T06:50:56.190 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48210.log 2024-09-19T06:50:56.190 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.36420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49360.log 2024-09-19T06:50:56.190 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.48210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41265.log 2024-09-19T06:50:56.190 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.49360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40629.log 2024-09-19T06:50:56.190 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.41265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49627.log 2024-09-19T06:50:56.191 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.40629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50034.log 2024-09-19T06:50:56.191 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.49627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52882.log 2024-09-19T06:50:56.191 INFO:teuthology.orchestra.run.smithi086.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49402.log.gz 2024-09-19T06:50:56.191 INFO:teuthology.orchestra.run.smithi086.stderr: 86.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-19T06:50:56.191 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.50034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44526.log 2024-09-19T06:50:56.191 INFO:teuthology.orchestra.run.smithi086.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49753.log.gz 2024-09-19T06:50:56.191 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.52882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40861.log 2024-09-19T06:50:56.191 INFO:teuthology.orchestra.run.smithi086.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49837.log.gz 2024-09-19T06:50:56.191 INFO:teuthology.orchestra.run.smithi086.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49929.log.gz 2024-09-19T06:50:56.191 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.44526.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52882.log.gz 2024-09-19T06:50:56.191 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53558.log 2024-09-19T06:50:56.191 INFO:teuthology.orchestra.run.smithi086.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50118.log.gz 2024-09-19T06:50:56.191 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.40861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42707.log 2024-09-19T06:50:56.192 INFO:teuthology.orchestra.run.smithi086.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50413.log.gz 2024-09-19T06:50:56.192 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40671.log 2024-09-19T06:50:56.192 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.53558.log: 87.9%/var/log/ceph/ceph-client.admin.42707.log: -- replaced with /var/log/ceph/ceph-client.admin.50498.log.gz 2024-09-19T06:50:56.192 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43383.log 2024-09-19T06:50:56.192 INFO:teuthology.orchestra.run.smithi086.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.53558.log.gz 2024-09-19T06:50:56.192 INFO:teuthology.orchestra.run.smithi086.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50625.log.gz 2024-09-19T06:50:56.192 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.40671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50877.log 2024-09-19T06:50:56.192 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.43383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51045.log 2024-09-19T06:50:56.192 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.50877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52504.log 2024-09-19T06:50:56.192 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.51045.log: 89.1%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.50877.log.gz --verbose 2024-09-19T06:50:56.192 INFO:teuthology.orchestra.run.smithi086.stderr: -- /var/log/ceph/ceph-client.admin.52956.log 2024-09-19T06:50:56.192 INFO:teuthology.orchestra.run.smithi086.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51045.log.gz 2024-09-19T06:50:56.193 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.52504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43032.log 2024-09-19T06:50:56.193 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52504.log.gz 2024-09-19T06:50:56.193 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.52956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42709.log 2024-09-19T06:50:56.193 INFO:teuthology.orchestra.run.smithi086.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.52956.log.gz 2024-09-19T06:50:56.193 INFO:teuthology.orchestra.run.smithi086.stderr:gzip/var/log/ceph/ceph-client.admin.43032.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.41722.log 2024-09-19T06:50:56.193 INFO:teuthology.orchestra.run.smithi086.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42403.log.gz 2024-09-19T06:50:56.193 INFO:teuthology.orchestra.run.smithi086.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42445.log.gz 2024-09-19T06:50:56.193 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.42709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48515.log 2024-09-19T06:50:56.193 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.41722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42706.log 2024-09-19T06:50:56.193 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.48515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44865.log 2024-09-19T06:50:56.193 INFO:teuthology.orchestra.run.smithi086.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42529.log.gz 2024-09-19T06:50:56.193 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.42706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43379.log 2024-09-19T06:50:56.193 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.44865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43382.log 2024-09-19T06:50:56.193 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.43379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52588.log 2024-09-19T06:50:56.194 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.43382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50332.log 2024-09-19T06:50:56.194 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.52588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50160.log 2024-09-19T06:50:56.194 INFO:teuthology.orchestra.run.smithi086.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42710.log.gz 2024-09-19T06:50:56.194 INFO:teuthology.orchestra.run.smithi086.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42705.log.gz 2024-09-19T06:50:56.194 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.50332.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52588.log.gz 2024-09-19T06:50:56.194 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48066.log 2024-09-19T06:50:56.194 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.50160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42235.log 2024-09-19T06:50:56.194 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.48066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42361.log 2024-09-19T06:50:56.194 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.42235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42067.log 2024-09-19T06:50:56.194 INFO:teuthology.orchestra.run.smithi086.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43040.log.gz 2024-09-19T06:50:56.194 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.42361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42711.log 2024-09-19T06:50:56.194 INFO:teuthology.orchestra.run.smithi086.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43243.log.gz 2024-09-19T06:50:56.194 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.42067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51769.log 2024-09-19T06:50:56.194 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.42711.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44526.log.gz 2024-09-19T06:50:56.195 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54324.log 2024-09-19T06:50:56.195 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.51769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44781.log 2024-09-19T06:50:56.195 INFO:teuthology.orchestra.run.smithi086.stderr:gzip/var/log/ceph/ceph-client.admin.54324.log: 87.8% -5 --verbose -- /var/log/ceph/ceph-client.admin.43046.log 2024-09-19T06:50:56.195 INFO:teuthology.orchestra.run.smithi086.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44655.log.gz 2024-09-19T06:50:56.195 INFO:teuthology.orchestra.run.smithi086.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44739.log.gz 2024-09-19T06:50:56.195 INFO:teuthology.orchestra.run.smithi086.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44697.log.gz 2024-09-19T06:50:56.195 INFO:teuthology.orchestra.run.smithi086.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51769.log.gz 2024-09-19T06:50:56.195 INFO:teuthology.orchestra.run.smithi086.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44865.log.gz 2024-09-19T06:50:56.195 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.44781.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54324.log.gz 2024-09-19T06:50:56.195 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43378.log 2024-09-19T06:50:56.195 INFO:teuthology.orchestra.run.smithi086.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48683.log.gz 2024-09-19T06:50:56.195 INFO:teuthology.orchestra.run.smithi086.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49627.log.gz 2024-09-19T06:50:56.195 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.43046.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49585.log.gz 2024-09-19T06:50:56.196 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53180.log 2024-09-19T06:50:56.196 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.43378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44823.log 2024-09-19T06:50:56.196 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49463.log.gz 2024-09-19T06:50:56.196 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.53180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52630.log 2024-09-19T06:50:56.196 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.44823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51294.log 2024-09-19T06:50:56.196 INFO:teuthology.orchestra.run.smithi086.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53180.log.gz 2024-09-19T06:50:56.196 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.52630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48108.log 2024-09-19T06:50:56.196 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.51294.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52630.log.gz 2024-09-19T06:50:56.196 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41932.log 2024-09-19T06:50:56.196 INFO:teuthology.orchestra.run.smithi086.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51294.log.gz 2024-09-19T06:50:56.196 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51942.log 2024-09-19T06:50:56.196 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.48108.log: /var/log/ceph/ceph-client.admin.41932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53138.log 2024-09-19T06:50:56.196 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.51942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49318.log 2024-09-19T06:50:56.196 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48252.log 2024-09-19T06:50:56.197 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.53138.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51942.log.gz 2024-09-19T06:50:56.197 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log/var/log/ceph/ceph-client.admin.49318.log: 2024-09-19T06:50:56.197 INFO:teuthology.orchestra.run.smithi086.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53138.log.gz 2024-09-19T06:50:56.197 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.48252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40485.log 2024-09-19T06:50:56.197 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44613.log 2024-09-19T06:50:56.197 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.40485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49130.log 2024-09-19T06:50:56.197 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.44613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53726.log 2024-09-19T06:50:56.197 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.49130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43831.log 2024-09-19T06:50:56.197 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.53726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52108.log 2024-09-19T06:50:56.197 INFO:teuthology.orchestra.run.smithi086.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49130.log.gz 2024-09-19T06:50:56.197 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.43831.log: -- /var/log/ceph/ceph-client.admin.43663.log 2024-09-19T06:50:56.197 INFO:teuthology.orchestra.run.smithi086.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53726.log.gz 2024-09-19T06:50:56.197 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.52108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40777.log 2024-09-19T06:50:56.198 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.43663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53852.log 2024-09-19T06:50:56.198 INFO:teuthology.orchestra.run.smithi086.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52108.log.gz 2024-09-19T06:50:56.198 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.40777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49887.log 2024-09-19T06:50:56.198 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.53852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48962.log 2024-09-19T06:50:56.198 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.49887.log: gzip 88.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.53852.log.gz -- 2024-09-19T06:50:56.198 INFO:teuthology.orchestra.run.smithi086.stderr: /var/log/ceph/ceph-osd.3.log 2024-09-19T06:50:56.198 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42319.log 2024-09-19T06:50:56.198 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.48962.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50202.log 2024-09-19T06:50:56.198 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.42319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41115.log 2024-09-19T06:50:56.198 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.50202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54408.log 2024-09-19T06:50:56.198 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.41115.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-19T06:50:56.198 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43375.log 2024-09-19T06:50:56.198 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.54408.log: /var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44570.log 2024-09-19T06:50:56.198 INFO:teuthology.orchestra.run.smithi086.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54408.log.gz 2024-09-19T06:50:56.199 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53768.log 2024-09-19T06:50:56.199 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.43375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49258.log 2024-09-19T06:50:56.199 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.44570.log: /var/log/ceph/ceph-client.admin.53768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52462.log 2024-09-19T06:50:56.199 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.49258.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53768.log.gz 2024-09-19T06:50:56.199 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51420.log 2024-09-19T06:50:56.199 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.52462.log: /var/log/ceph/ceph-client.admin.51420.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52462.log.gz 2024-09-19T06:50:56.199 INFO:teuthology.orchestra.run.smithi086.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51420.log.gz 2024-09-19T06:50:56.199 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49795.log.gz 2024-09-19T06:50:56.199 INFO:teuthology.orchestra.run.smithi086.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36775.log.gz 2024-09-19T06:50:56.200 INFO:teuthology.orchestra.run.smithi169.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-19T06:50:56.200 INFO:teuthology.orchestra.run.smithi169.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-09-19T06:50:56.204 INFO:teuthology.orchestra.run.smithi086.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40671.log.gz 2024-09-19T06:50:56.204 INFO:teuthology.orchestra.run.smithi086.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40629.log.gz 2024-09-19T06:50:56.204 INFO:teuthology.orchestra.run.smithi086.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40861.log.gz 2024-09-19T06:50:56.204 INFO:teuthology.orchestra.run.smithi086.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41073.log.gz 2024-09-19T06:50:56.204 INFO:teuthology.orchestra.run.smithi086.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41115.log.gz 2024-09-19T06:50:56.204 INFO:teuthology.orchestra.run.smithi086.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50541.log.gz 2024-09-19T06:50:56.204 INFO:teuthology.orchestra.run.smithi086.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50583.log.gz 2024-09-19T06:50:56.205 INFO:teuthology.orchestra.run.smithi086.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43747.log.gz 2024-09-19T06:50:56.205 INFO:teuthology.orchestra.run.smithi086.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43789.log.gz 2024-09-19T06:50:56.205 INFO:teuthology.orchestra.run.smithi086.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44002.log.gz 2024-09-19T06:50:56.205 INFO:teuthology.orchestra.run.smithi086.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.43873.log.gz 2024-09-19T06:50:56.205 INFO:teuthology.orchestra.run.smithi086.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50667.log.gz 2024-09-19T06:50:56.205 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42319.log.gz 2024-09-19T06:50:56.205 INFO:teuthology.orchestra.run.smithi086.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42361.log.gz 2024-09-19T06:50:56.205 INFO:teuthology.orchestra.run.smithi086.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41990.log.gz 2024-09-19T06:50:56.205 INFO:teuthology.orchestra.run.smithi086.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42067.log.gz 2024-09-19T06:50:56.205 INFO:teuthology.orchestra.run.smithi086.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42109.log.gz 2024-09-19T06:50:56.205 INFO:teuthology.orchestra.run.smithi086.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42151.log.gz 2024-09-19T06:50:56.205 INFO:teuthology.orchestra.run.smithi086.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42193.log.gz 2024-09-19T06:50:56.205 INFO:teuthology.orchestra.run.smithi086.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42235.log.gz 2024-09-19T06:50:56.206 INFO:teuthology.orchestra.run.smithi086.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48024.log.gz 2024-09-19T06:50:56.206 INFO:teuthology.orchestra.run.smithi086.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48066.log.gz 2024-09-19T06:50:56.206 INFO:teuthology.orchestra.run.smithi086.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-19T06:50:56.206 INFO:teuthology.orchestra.run.smithi086.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48108.log.gz 2024-09-19T06:50:56.206 INFO:teuthology.orchestra.run.smithi086.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50244.log.gz 2024-09-19T06:50:56.206 INFO:teuthology.orchestra.run.smithi086.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50332.log.gz 2024-09-19T06:50:56.206 INFO:teuthology.orchestra.run.smithi086.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50286.log.gz 2024-09-19T06:50:56.206 INFO:teuthology.orchestra.run.smithi086.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42707.log.gz 2024-09-19T06:50:56.206 INFO:teuthology.orchestra.run.smithi086.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42706.log.gz 2024-09-19T06:50:56.206 INFO:teuthology.orchestra.run.smithi086.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42711.log.gz 2024-09-19T06:50:56.206 INFO:teuthology.orchestra.run.smithi086.stderr: 88.6% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43032.log.gz -- replaced with /var/log/ceph/ceph-client.admin.42709.log.gz 2024-09-19T06:50:56.206 INFO:teuthology.orchestra.run.smithi086.stderr: 2024-09-19T06:50:56.206 INFO:teuthology.orchestra.run.smithi086.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43046.log.gz 2024-09-19T06:50:56.207 INFO:teuthology.orchestra.run.smithi086.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43383.log.gz 2024-09-19T06:50:56.207 INFO:teuthology.orchestra.run.smithi086.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43375.log.gz 2024-09-19T06:50:56.207 INFO:teuthology.orchestra.run.smithi086.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43379.log.gz 2024-09-19T06:50:56.207 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43382.log.gz 2024-09-19T06:50:56.207 INFO:teuthology.orchestra.run.smithi086.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43378.log.gz 2024-09-19T06:50:56.207 INFO:teuthology.orchestra.run.smithi086.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44570.log.gz 2024-09-19T06:50:56.207 INFO:teuthology.orchestra.run.smithi086.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44613.log.gz 2024-09-19T06:50:56.207 INFO:teuthology.orchestra.run.smithi086.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44781.log.gz 2024-09-19T06:50:56.207 INFO:teuthology.orchestra.run.smithi086.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44823.log.gz 2024-09-19T06:50:56.207 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36420.log.gz 2024-09-19T06:50:56.207 INFO:teuthology.orchestra.run.smithi086.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48962.log.gz 2024-09-19T06:50:56.208 INFO:teuthology.orchestra.run.smithi169.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37645.log.gz 2024-09-19T06:50:56.208 INFO:teuthology.orchestra.run.smithi086.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49258.log.gz 2024-09-19T06:50:56.208 INFO:teuthology.orchestra.run.smithi086.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48557.log.gz 2024-09-19T06:50:56.209 INFO:teuthology.orchestra.run.smithi086.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48599.log.gz 2024-09-19T06:50:56.209 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41932.log.gz 2024-09-19T06:50:56.209 INFO:teuthology.orchestra.run.smithi086.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.41722.log.gz 2024-09-19T06:50:56.209 INFO:teuthology.orchestra.run.smithi086.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50202.log.gz 2024-09-19T06:50:56.209 INFO:teuthology.orchestra.run.smithi086.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43831.log.gz 2024-09-19T06:50:56.210 INFO:teuthology.orchestra.run.smithi086.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40485.log.gz 2024-09-19T06:50:56.210 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40777.log.gz 2024-09-19T06:50:56.211 INFO:teuthology.orchestra.run.smithi086.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48748.log.gz 2024-09-19T06:50:56.211 INFO:teuthology.orchestra.run.smithi086.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49318.log.gz 2024-09-19T06:50:56.211 INFO:teuthology.orchestra.run.smithi086.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49360.log.gz 2024-09-19T06:50:56.211 INFO:teuthology.orchestra.run.smithi086.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49887.log.gz 2024-09-19T06:50:56.213 INFO:teuthology.orchestra.run.smithi086.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50034.log.gz 2024-09-19T06:50:56.213 INFO:teuthology.orchestra.run.smithi086.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50076.log.gz 2024-09-19T06:50:56.213 INFO:teuthology.orchestra.run.smithi086.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49989.log.gz 2024-09-19T06:50:56.213 INFO:teuthology.orchestra.run.smithi086.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50160.log.gz 2024-09-19T06:50:56.213 INFO:teuthology.orchestra.run.smithi086.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50455.log.gz 2024-09-19T06:50:56.224 INFO:teuthology.orchestra.run.smithi086.stderr: 88.3% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48252.log.gz 2024-09-19T06:50:56.224 INFO:teuthology.orchestra.run.smithi086.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48210.log.gz 2024-09-19T06:50:56.224 INFO:teuthology.orchestra.run.smithi086.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48294.log.gz 2024-09-19T06:50:56.224 INFO:teuthology.orchestra.run.smithi086.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48344.log.gz 2024-09-19T06:50:56.224 INFO:teuthology.orchestra.run.smithi086.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48428.log.gz 2024-09-19T06:50:56.224 INFO:teuthology.orchestra.run.smithi086.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48386.log.gz 2024-09-19T06:50:56.224 INFO:teuthology.orchestra.run.smithi086.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48150.log.gz 2024-09-19T06:50:56.224 INFO:teuthology.orchestra.run.smithi086.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48515.log.gz 2024-09-19T06:50:56.224 INFO:teuthology.orchestra.run.smithi086.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48473.log.gz 2024-09-19T06:50:56.225 INFO:teuthology.orchestra.run.smithi086.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-19T06:50:56.247 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43705.log.gz 2024-09-19T06:50:56.267 INFO:teuthology.orchestra.run.smithi169.stderr: 88.0% 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37394.log.gz 2024-09-19T06:50:56.267 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37434.log.gz 2024-09-19T06:50:56.272 INFO:teuthology.orchestra.run.smithi169.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37354.log.gz 2024-09-19T06:50:56.292 INFO:teuthology.orchestra.run.smithi086.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-19T06:50:56.297 INFO:teuthology.orchestra.run.smithi086.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41265.log.gz 2024-09-19T06:50:56.298 INFO:teuthology.orchestra.run.smithi086.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43579.log.gz 2024-09-19T06:50:56.298 INFO:teuthology.orchestra.run.smithi086.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43621.log.gz 2024-09-19T06:50:56.298 INFO:teuthology.orchestra.run.smithi086.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43663.log.gz 2024-09-19T06:50:56.819 INFO:teuthology.orchestra.run.smithi169.stderr: 92.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-19T06:50:57.001 INFO:teuthology.orchestra.run.smithi086.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-19T06:50:57.793 INFO:teuthology.orchestra.run.smithi169.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-19T06:50:58.098 INFO:teuthology.orchestra.run.smithi169.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-19T06:51:02.804 INFO:teuthology.orchestra.run.smithi086.stderr: 90.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-19T06:53:45.286 INFO:teuthology.orchestra.run.smithi086.stderr: 95.6% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-09-19T06:54:00.055 INFO:teuthology.orchestra.run.smithi169.stderr: 95.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-19T06:54:24.616 INFO:teuthology.orchestra.run.smithi086.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-19T06:54:50.879 INFO:teuthology.orchestra.run.smithi086.stderr: 91.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-19T06:59:00.832 INFO:teuthology.orchestra.run.smithi086.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-19T06:59:33.607 INFO:teuthology.orchestra.run.smithi086.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-19T06:59:33.609 INFO:teuthology.orchestra.run.smithi086.stderr: 2024-09-19T06:59:33.609 INFO:teuthology.orchestra.run.smithi086.stderr:real 8m37.537s 2024-09-19T06:59:33.610 INFO:teuthology.orchestra.run.smithi086.stderr:user 5m58.736s 2024-09-19T06:59:33.610 INFO:teuthology.orchestra.run.smithi086.stderr:sys 0m14.522s 2024-09-19T07:04:33.883 INFO:teuthology.orchestra.run.smithi169.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-19T07:05:42.950 INFO:teuthology.orchestra.run.smithi169.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-19T07:09:18.595 INFO:teuthology.orchestra.run.smithi169.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-19T07:09:41.638 INFO:teuthology.orchestra.run.smithi169.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-19T07:09:41.640 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-19T07:09:41.641 INFO:teuthology.orchestra.run.smithi169.stderr:real 18m45.526s 2024-09-19T07:09:41.641 INFO:teuthology.orchestra.run.smithi169.stderr:user 7m59.697s 2024-09-19T07:09:41.641 INFO:teuthology.orchestra.run.smithi169.stderr:sys 0m22.001s 2024-09-19T07:09:41.645 INFO:tasks.ceph:Archiving logs... 2024-09-19T07:09:41.646 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911752/remote/smithi086/log 2024-09-19T07:09:41.647 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T07:11:19.179 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911752/remote/smithi169/log 2024-09-19T07:11:19.181 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T07:12:41.476 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T07:12:41.487 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T07:12:41.487 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T07:12:41.491 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T07:12:41.655 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T07:12:41.664 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T07:12:41.664 DEBUG:teuthology.orchestra.run.smithi086:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T07:12:41.667 DEBUG:teuthology.orchestra.run.smithi169:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T07:12:41.682 INFO:teuthology.orchestra.run.smithi169.stderr:bash: line 1: ntpq: command not found 2024-09-19T07:12:41.682 INFO:teuthology.orchestra.run.smithi086.stderr:bash: line 1: ntpq: command not found 2024-09-19T07:12:41.710 INFO:teuthology.orchestra.run.smithi086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T07:12:41.710 INFO:teuthology.orchestra.run.smithi086.stdout:=============================================================================== 2024-09-19T07:12:41.710 INFO:teuthology.orchestra.run.smithi086.stdout:^* hv01.front.sepia.ceph.com 3 6 377 36 +777us[ +763us] +/- 53ms 2024-09-19T07:12:41.710 INFO:teuthology.orchestra.run.smithi086.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 37 -1314us[-1328us] +/- 60ms 2024-09-19T07:12:41.710 INFO:teuthology.orchestra.run.smithi086.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 +578us[ +578us] +/- 78ms 2024-09-19T07:12:41.710 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:12:41.721 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T07:12:41.721 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2024-09-19T07:12:41.721 INFO:teuthology.orchestra.run.smithi169.stdout:^* hv01.front.sepia.ceph.com 3 6 377 36 +728us[ +668us] +/- 53ms 2024-09-19T07:12:41.721 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 40 -1338us[-1398us] +/- 60ms 2024-09-19T07:12:41.721 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 +556us[ +496us] +/- 78ms 2024-09-19T07:12:41.721 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:12:41.722 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T07:12:41.731 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T07:12:41.732 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T07:12:41.753 DEBUG:teuthology.orchestra.run.smithi086:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T07:12:41.881 DEBUG:teuthology.orchestra.run.smithi169:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T07:12:41.951 DEBUG:teuthology.orchestra.run.smithi086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T07:12:41.982 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:12:41.983 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T07:12:42.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:12:42.010 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T07:12:42.022 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T07:12:42.045 INFO:teuthology.task.internal:Duration was 2546.028170 seconds 2024-09-19T07:12:42.046 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T07:12:42.082 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T07:12:42.082 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T07:12:42.085 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T07:12:42.141 INFO:teuthology.orchestra.run.smithi086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T07:12:42.155 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T07:12:42.521 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T07:12:42.521 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi086.front.sepia.ceph.com 2024-09-19T07:12:42.521 DEBUG:teuthology.orchestra.run.smithi086:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T07:12:42.545 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi169.front.sepia.ceph.com 2024-09-19T07:12:42.545 DEBUG:teuthology.orchestra.run.smithi169:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T07:12:42.577 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T07:12:42.578 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T07:12:42.587 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T07:12:42.644 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T07:12:42.645 DEBUG:teuthology.orchestra.run.smithi086:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T07:12:42.656 DEBUG:teuthology.orchestra.run.smithi169:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T07:12:42.818 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T07:12:42.829 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T07:12:42.829 DEBUG:teuthology.orchestra.run.smithi086:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T07:12:42.864 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T07:12:42.889 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T07:12:42.900 DEBUG:teuthology.orchestra.run.smithi086:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:12:42.907 DEBUG:teuthology.orchestra.run.smithi169:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:12:42.938 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = core 2024-09-19T07:12:42.978 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = core 2024-09-19T07:12:43.004 DEBUG:teuthology.orchestra.run.smithi086:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:12:43.019 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:12:43.020 DEBUG:teuthology.orchestra.run.smithi169:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:12:43.034 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:12:43.034 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T07:12:43.044 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T07:12:43.046 DEBUG:teuthology.misc:Transferring archived files from smithi086:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911752/remote/smithi086 2024-09-19T07:12:43.046 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T07:12:43.095 DEBUG:teuthology.misc:Transferring archived files from smithi169:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911752/remote/smithi169 2024-09-19T07:12:43.095 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T07:12:43.130 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T07:12:43.130 DEBUG:teuthology.orchestra.run.smithi086:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T07:12:43.133 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T07:12:43.179 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T07:12:43.191 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T07:12:43.191 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T07:12:43.213 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T07:12:43.213 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T07:12:43.215 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T07:12:43.228 INFO:teuthology.orchestra.run.smithi086.stdout: 265852 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 07:12 /home/ubuntu/cephtest 2024-09-19T07:12:43.234 INFO:teuthology.orchestra.run.smithi169.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 07:12 /home/ubuntu/cephtest 2024-09-19T07:12:43.235 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T07:12:43.246 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T07:12:43.326 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} duration: 2546.028170108795 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-19T07:12:43.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T07:12:43.409 INFO:teuthology.run:pass